JP7421579B2 - Information processing system, information processing device, program, and information processing method - Google Patents

Description

The present invention relates to an information processing system, an information processing device, a program, and an information processing method.

Patent Document 1 describes a technique for controlling performances on a stage by inputting comments from a user terminal that views the stage via a network.
[Prior art documents]
[Patent document]
[Patent Document 1] Japanese Patent Application Publication No. 2013-037670

According to one embodiment of the present invention, an information processing system is provided. The information processing system may include an information processing device. The information processing system may include a content distribution device. The information processing device may include a first information receiving unit that receives input operation information indicating an input operation input to the communication terminal from each of a plurality of communication terminals owned by viewers of the live content. The information processing device may include a totaling unit that totals the input operations indicated by the input operation information received by the first information receiving unit from each of the plurality of communication terminals. The information processing device may include an information transmitting unit that transmits a total result of the input operations compiled by the totaling unit to the content distribution device. The content distribution device may include a storage unit that stores first performance correspondence information that associates a type of input operation to the communication terminal with a performance process for the live content. The content distribution device may include a second information receiving unit that receives the total results of the input operations from the information processing device. The content distribution device determines a performance process to be executed based on the total result of the input operations received by the second information receiving unit and the first performance correspondence information stored in the storage unit. It may include an effect processing determining section that performs.

The totaling section may total the input operations indicated by the input operation information received by the first information receiving section from each of the plurality of communication terminals during the performance of the live content. The performance processing determining unit may determine the performance process based on the total result of the input operations that the totaling unit totaled during the performance of the live content. The effect processing determining unit may determine the effect process associated with the input operation with the largest total number of input operations during a predetermined period. The effect processing determining unit may determine the effect process associated with an input operation in which the total number of input operations during a predetermined period is greater than a predetermined total number of times threshold.

The aggregation unit is configured to select the input operations for which an input operation flag indicating whether the input operations are valid or invalid among the input operations indicated by the input operation information received from each of the plurality of communication terminals is valid. Operations may be aggregated. The aggregation unit may aggregate the input operations for each communication terminal. The performance processing determining unit may determine the performance process for the communication terminal to which the input operation that satisfies a predetermined input operation condition is input. The aggregation unit aggregates the input operations indicated by the input operation information received from one of the communication terminals by weighting them more than the input operations indicated by the input operation information received from another communication terminal. good.

The first information receiving unit may receive battery remaining amount information indicating a remaining battery amount of the communication terminal from each of the plurality of communication terminals. The totaling section may total the remaining battery amount indicated by the remaining battery amount information received by the first information receiving section from each of the plurality of communication terminals. The information transmitting unit may transmit a total result of the remaining battery power totaled by the totaling unit to the content distribution device. The second information receiving unit may receive the total result of the battery remaining amount from the information processing device. The performance processing determining unit may execute an event for determining the performance process when the total result of the remaining battery power received by the second information receiving unit satisfies a predetermined remaining battery power condition. .

The first information receiving unit may receive communication terminal related information including communication terminal related data from each of the plurality of communication terminals. The aggregation unit may aggregate the communication terminal related data included in the communication terminal related information received by the first information receiving unit from each of the plurality of communication terminals. The information transmitting unit may transmit a total result of the communication terminal related data compiled by the totaling unit to the content distribution device. The storage unit may store second effect correspondence information that associates the type of communication terminal related data related to the communication terminal with the effect processing. The second information receiving unit may receive the total result of the communication terminal related data from the information processing device. The effect processing determining section executes the effect processing based on the aggregation result of the communication terminal related data received by the second information receiving section and the second effect corresponding information stored in the storage section. You may decide.

The effect processing determining unit may determine the effect processing to change the content of the live content that is XR (Cross Reality) content. The performance processing determining unit may determine the performance processing that changes the output of equipment used to perform the live content. The first information receiving unit receives, from each of the plurality of communication terminals, the input operation information indicating the input operation detected by at least one of a gyro sensor and an acceleration sensor mounted on the communication terminal. good.

According to one embodiment of the present invention, an information processing device is provided. The information processing device may include an information receiving unit that receives input operation information indicating an input operation input to the communication terminal from each of a plurality of communication terminals owned by each audience member of the live content. The information processing device may include a totaling unit that totals the input operations indicated by the input operation information received by the information receiving unit from each of the plurality of communication terminals. The information processing device may include an information transmitting section that transmits information based on a total result of the input operations compiled by the totaling section.

The information processing device may further include a storage unit that stores first performance correspondence information that associates a type of input operation to the communication terminal with a performance process for the live content. The information processing device determines a performance process to be executed based on the total results of the input operations compiled by the total unit and the first performance correspondence information stored in the storage unit. It may further include a section. The information transmitting section may transmit performance processing information indicating the performance processing determined by the performance processing determining section.

According to one embodiment of the present invention, a program for causing a computer to function as the information processing device is provided.

According to one embodiment of the present invention, an information processing method is provided. The information processing method includes a first information receiving step in which the information processing device receives input operation information indicating an input operation input to the communication terminal from each of a plurality of communication terminals owned by each audience member of the live content. good. The information processing method may include a totaling step in which the information processing device totalizes the input operations indicated by the input operation information received from each of the plurality of communication terminals in the first information receiving step. The information processing method may include an information transmitting step in which the information processing device transmits a total result of the input operations totaled in the totaling step to a content distribution device. The information processing method may include a second information receiving step in which the content distribution device receives the aggregated results of the input operations from the information processing device. In the information processing method, the content distribution device collects the total result of the input operations received in the second information receiving step, the type of input operation for the communication terminal stored in the content distribution device, and the live data processing method. The content processing apparatus may include a performance processing determining step of determining a performance process to be executed based on first performance correspondence information that associates the performance process with respect to the content.

According to one embodiment of the present invention, an information processing method executed by a computer is provided. The information processing method may include an information receiving step of receiving input operation information indicating an input operation input to the communication terminal from each of a plurality of communication terminals owned by each audience member of the live content. The information processing method may include a totaling step of totaling the input operations indicated by the input operation information received from each of the plurality of communication terminals in the information receiving step. The information processing method may include an information transmitting step of transmitting information based on the aggregation results of the input operations compiled in the aggregating step.

Note that the above summary of the invention does not list all the necessary features of the invention. Furthermore, subcombinations of these features may also constitute inventions.

1 schematically depicts an example of a system 10; Another example of the system 10 is schematically shown. An example of live content displayed on the display device 40 is schematically shown. Another example of live content displayed on the display device 40 is schematically shown. Another example of live content displayed on the display device 40 is schematically shown. Another example of live content displayed on the display device 40 is schematically shown. Another example of live content displayed on the display device 40 is schematically shown. An example of the functional configuration of the information processing device 100 is schematically shown. An example of the functional configuration of the content distribution device 200 is schematically shown. An example of event correspondence information stored in the information processing device 100 is schematically shown. An example of the total results compiled by the information processing device 100 is schematically shown. Another example of the total results compiled by the information processing device 100 is schematically shown. An example of presentation correspondence information stored in the content distribution device 200 is schematically shown. An example of communication terminal related data correspondence information stored in the information processing device 100 is schematically shown. Another example of the total results compiled by the information processing device 100 is schematically shown. Another example of production correspondence information stored in the content distribution device 200 is schematically shown. FIG. 2 is an explanatory diagram for explaining an example of a processing flow of the information processing device 100. FIG. An example of the hardware configuration of a computer 1200 functioning as the information processing device 100 is schematically shown.

Currently, when it comes to live content such as online music concerts, the only ways for viewers of live content to communicate their intentions through the live content are to post in chat, respond to surveys, or donate money. Therefore, the intentions of the viewers can only be reflected in the production of live content during a performance to the extent that chat posts and survey responses by the viewers are reflected. Therefore, it is not possible to obtain with a high degree of freedom the expression of intention by a viewer associated with the production or scene of the live content during the performance of the live content, and to reflect it in the production of the live content in real time. In addition, even if you want to create a special performance for a specific viewer, you cannot do so. Additionally, currently, in live content such as live music performances, the only way for viewers to communicate their intentions through the live content is by waving a penlight or fan if they do not use a dedicated device. . Therefore, unless a dedicated device is used, it is not possible to obtain the viewer's intentions associated with the production and scene of live content with a high degree of freedom during the performance of live content and reflect them in the production of live content in real time. . On the other hand, the method of using a dedicated device is not universal. In addition, even if you want to create a special performance for a specific viewer, you cannot do so. Furthermore, in current live content, the method of acquiring weather data such as temperature data and humidity data, and data on the flow of people is to install sensors in advance, or to search for and utilize externally published APIs (Application Programming Interfaces). There is only a certain degree. Therefore, it is not possible to acquire weather data, crowd flow data, etc. at an arbitrary point during a live content performance and reflect it in the live content performance in real time. The system 10 according to the present embodiment includes, for example, software for smartphones that allows viewers of live content held online or offline to input their own intentions, and acquires viewer input operations from the software. API to store and accumulate data, API to acquire statistical data of input operations by viewers, and API to send operation signals for live content (if digital content is rendered by an MEC (Multi-access Edge Computing) server). provide. This allows viewers to express their intentions to a high degree. In addition, by passing this information to the live content side, it is possible to utilize it in producing the live content. Furthermore, since smartphones are used, by making it possible to create effects for specific smartphones, it becomes possible to create special effects for specific viewers.

Hereinafter, the present invention will be explained through embodiments of the invention, but the following embodiments do not limit the invention according to the claims. Furthermore, not all combinations of features described in the embodiments are essential to the solution of the invention.

FIG. 1 schematically depicts an example of a system 10. The system 10 includes, for example, an information processing device 100 and a content distribution device 200. System 10 may include multiple communication terminals 300. System 10 may include a communication terminal 400. System 10 may include a display device 40 .

Information processing device 100 communicates with multiple communication terminals 300. The information processing device 100 communicates with a plurality of communication terminals 300 via the network 20, for example. For example, the information processing device 100 communicates with each of a plurality of communication terminals 300 owned by viewers of live content distributed by the content distribution device 200.

Network 20 may include a core network provided by a carrier. The core network may be based on, for example, a 5G (5th Generation) communication system. The core network may be based on a mobile communication system after the 6G (6th Generation) communication system. The core network may conform to a 3G (3rd Generation) communication system. The core network may be compliant with the Long Term Evolution (LTE) communication system. Network 20 may include the Internet.

The information processing device 100 receives, for example, via the network 20, input operation information indicating an input operation input to the communication terminal 300 from each of a plurality of communication terminals 300 owned by each audience member of the live content. An input operation input to the communication terminal 300 is detected by, for example, at least one of a gyro sensor and an acceleration sensor mounted on the communication terminal 300. In this case, the input operation input to the communication terminal 300 may be an operation of shaking the communication terminal 300. An input operation input to the communication terminal 300 may be detected by a touch panel display mounted on the communication terminal 300. In this case, the input operation input into the communication terminal 300 may be a tapping operation, a swiping operation, or the like. The input operation input into the communication terminal 300 may be any other operation detected by any other sensor.

For example, the information processing device 100 aggregates input operations indicated by input operation information received from each of a plurality of communication terminals 300 owned by viewers of live content. The information processing device 100 transmits information based on the aggregated results of input operations, for example, via the network 20. For example, the information processing device 100 transmits information based on the total result of input operations to the content distribution device 200. The information processing device 100 may transmit information based on the total result of input operations to the communication terminal 400 owned by the creator of the live content. The creator of live content is, for example, a director of live content. The live content creator may be a live content producer.

Content distribution device 200 distributes live content. The content distribution device 200 distributes live content via the network 20, for example.

For example, the content distribution device 200 generates live content and distributes the generated live content. The content distribution device 200 may distribute live content stored in advance.

The content distribution device 200 distributes live content, for example, so that the live content is displayed on a display device 40 at a live venue or the like. The content distribution device 200 distributes live content, for example, so that the live content is displayed on each display device 40 of a plurality of different live venues. The content distribution device 200 may distribute the live content so that the live content is displayed on the display of the communication terminal 300 owned by the audience of the live content.

The information processing device 100 may have the functions of the content distribution device 200. That is, the information processing device 100 and the content distribution device 200 may be integrated.

The live content is, for example, online live live content. The live content may be offline live live content.

The live content is, for example, live music live content. The live content is, for example, live content of a comedy show. Live content may be any other live content.

The live content is, for example, live content by a virtual character. In this case, the live content is, for example, XR content. XR content is, for example, VR (Virtual Reality) content. XR content is, for example, AR (Augmented Reality) content. The XR content may be MR (Mixed Reality) content. The live content may be live content by a real person.

Communication terminal 300 and communication terminal 400 communicate with information processing device 100 using, for example, an application. Communication terminal 300 and communication terminal 400 communicate with information processing device 100 using, for example, a web application. Communication terminal 300 and communication terminal 400 communicate with information processing device 100 using, for example, a native application. The communication terminal 300 and the communication terminal 400 may communicate with the information processing device 100 using a hybrid application that is a combination of a web application and a native application.

The communication terminal 300 and the communication terminal 400 may be any terminals that can communicate with the information processing device 100. For example, the communication terminal 300 and the communication terminal 400 may be a mobile phone such as a smartphone, a tablet terminal, a wearable terminal, or the like. Communication terminal 300 and communication terminal 400 may be a PC (Personal Computer).

In FIG. 1, an example will be mainly described in which the content distribution device 200 determines production processing for live content that is XR content of live music. Here, the explanation will be continued assuming that XR content is distributed so as to be displayed on the display device 40 at the live venue.

In the content distribution device 200, performance correspondence information that associates the type of input operation to the communication terminal 300 with the performance processing for live content is registered in advance. Here, the "operation of shaking the communication terminal 300 to the left" and the production process "the virtual character wears costume A and plays song 1" are associated, and the "operation of shaking the communication terminal 300 to the right" and the "virtual character The virtual character wears costume B and plays song 1.'' The process of ``shaking the communication terminal 300 upwards'' and the virtual character wears costume C and plays song 1 are made to correspond. The production correspondence information that associates the "operation of shaking the communication terminal 300 downward" with the production processing of "the virtual character wears costume D and plays song 1" is registered in advance in the content distribution device 200. Continue to explain as such.

The information processing device 100 receives input operation information via the network 20 from each of the plurality of communication terminals 300 owned by spectators of live content at a live venue. Spectators of the live content perform an input operation on the communication terminal 300, for example, in response to an event notification notifying a "voting event." The event notification is displayed on the display device 40, for example.

The information processing device 100 aggregates input operations indicated by input operation information received from each of the plurality of communication terminals 300. For example, the information processing device 100 performs operations such as "shaking the communication terminal 300 to the left", "shaking the communication terminal 300 to the right", "shaking the communication terminal 300 up", and "shaking the communication terminal 300 down". "Operations to move to" are counted. Here, the explanation will be continued assuming that the total number of operations of "shaking the communication terminal 300 to the left" is the largest.

The information processing device 100 transmits the total result of input operations to the content distribution device 200 via the network 20 as information based on the total result of the input operations. The content distribution device 200 determines a performance process for the live content to be executed based on the total result of input operations and the performance correspondence information received from the information processing device 100. Here, the content distribution device 200 executes the production process of ``the virtual character wears costume A and plays song 1'' corresponding to ``the operation of shaking the communication terminal 300 to the left'' that has the highest total number of input operations. The explanation will continue assuming that this has been determined as the target performance processing.

The content distribution device 200 generates live content in which a virtual character wears costume A and performs song 1 based on the determined production process. The content distribution device 200 distributes the generated live content via the network 20.

Currently, when live content is online live content, it is only possible to know the intentions of the live content audience by checking chat posts, survey responses, or monetary support such as donations from the live content audience. . When understanding the intentions of live content viewers from chat posts and survey responses, it is difficult for live content viewers to post chats or respond to surveys while watching live content. The audience's sense of presence in the live content decreases. When the intentions of the live content audience are learned from financial support such as donations, the intentions of the live content audience can only be learned to a very limited extent. In addition, if the live content is offline live content, unless the live content audience uses a special device to communicate their intentions, check the penlights and fans brought by the live content audience. Only to the extent that it is possible to understand the intentions of the audience for live content. When learning the intentions of the audience for live content using a penlight or fan, the intention of the audience for live content can only be learned to a very limited extent. When using a dedicated device to understand the intentions of a live content audience, you need as many dedicated devices as there are live content viewers, and you must explain how to use the dedicated device to the live content audience. Therefore, dedicated devices require high installation costs and are not versatile. Therefore, the intention of the audience of live content regarding the production and scene of live content can be learned with a high degree of freedom without reducing the sense of presence of the audience of live content, and the intention of the audience of live content that has been learned can be used for live content. There is a need for a general-purpose system that can be reflected in the production.

According to the system 10 according to the present embodiment, the information processing device 100 receives input operation information from each of the plurality of communication terminals 300, aggregates the input operations indicated by the received input operation information, and aggregates the input operations. Information based on the results is transmitted to the content distribution device 200. The content distribution device 200 determines the performance processing for the live content to be executed based on the information based on the total result of input operations received from the information processing device 100 and the performance correspondence information. Since the content distribution device 200 can register production correspondence information for each event that determines production processing, it can highly freely learn the intention of the live content audience regarding the production and scene of the live content and produce the live content. can be reflected in In particular, when the information processing device 100 aggregates input operations during a live content performance, the content distribution device 200 performs a production process to be executed based on information based on the aggregate result of input operations aggregated during the live content performance. can be determined. Therefore, the content distribution device 200 can reflect the intentions of the live content audience in the live content in real time. This can further enhance the sense of unity between the live content audience and the live content creator. Further, the content distribution device 200 determines the execution target based on the information based on the aggregation result of the information processing device 100 aggregating the input operations indicated by the input operation information received from the communication terminal 300, which is a general-purpose device such as a smartphone. You can decide the production process. Furthermore, since the input operations that the information processing device 100 totals are simple input operations such as shaking the communication terminal 300, the audience of live content can perform input operations on the communication terminal 300 while watching the live content. It is. Therefore, the system 10 according to the present embodiment can learn the intentions of the live content audience and reflect them in the performance of the live content without reducing the sense of presence of the live content audience. As a result, the system 10 according to the present embodiment can freely learn and understand the live content audience's intention regarding the performance and scene of the live content without reducing the live content audience's sense of presence with the live content. It is possible to realize a general-purpose system that can reflect the intentions of the audience of live content in the production of live content.

FIG. 2 schematically shows another example of the system 10. In FIG. 2, an example in which the content distribution device 200 determines production processing for live content that is XR content of live music will be mainly described.

The processor 220 of the content distribution device 200 aggregates the input operations indicated by the input operation information that the information processing device 100 receives from each of the plurality of communication terminals 300 via the API from the information processing device 100 via the API. Receive the aggregated results of input operations. The processor 220 stores the total results of input operations received from the information processing device 100 in the total result storage unit 230 .

Processor 220 receives presentation correspondence information from communication terminal 400 via API. The processor 220 stores the received presentation correspondence information in the presentation correspondence information storage section 240.

Processor 220 receives IoT sensor data from IoT (Internet of Things) sensor 600 via API. Processor 220 receives temperature data from IoT sensor 600, for example. Processor 220 may receive any other IoT sensor data from IoT sensor 600. Processor 220 stores the received IoT sensor data in IoT sensor data storage 260.

The IoT sensor 600 is installed, for example, at a live venue where XR content is distributed. IoT sensor 600 may be installed at any other location.

Processor 220 receives environmental data from environmental data management device 700 via API. Processor 220 receives weather data from environmental data management device 700, for example. Processor 220 may also receive any other environmental data from environmental data management device 700. Processor 220 stores the received environmental data in environmental data storage section 270.

The environmental data management device 700 manages, for example, environmental data such as a live venue where XR content is distributed. The environmental data management device 700 may manage environmental data at any other location.

Processor 220 may receive any data from any other external device via the API. The external device is, for example, a city OS (Operating System) server. The external device is, for example, a fixed point camera. The external device is, for example, an SNS (Social Networking Service) server. The external device is, for example, a search engine server. The external device may be a payment data management server that manages payment data.

The processor 220 receives motion data from the motion capture device 500, which provides a detection result of a motion of a living person as motion data. The processor 220 receives motion data from the motion capture device 500 using, for example, a VPN (Virtual Private Network) communication protocol. Processor 220 may receive motion data from motion capture device 500 using any other communication protocol.

The processor 220 determines the performance processing for the XR content to be executed based on the total result of input operations stored in the total result storage unit 230 and the performance correspondence information stored in the performance correspondence information storage unit 240. do. The processor 220 may determine the performance process to be executed further based on the IoT sensor data stored in the IoT sensor data storage unit 260. The processor 220 may further determine the effect processing to be executed based on the environmental data stored in the environmental data storage section 270.

Processor 220 generates XR content. The processor 220 generates XR content by, for example, rendering the XR content based on the motion data received from the motion capture device 500 and the effect processing to be executed that the processor 220 has determined.

The processor 220 distributes the generated XR content so that it is displayed on a display device 40 at a live venue or the like. The processor 220 distributes the XR content using, for example, the OSC (Open Sound Control) communication protocol. Processor 220 distributes the XR content using, for example, the Art-Net communication protocol. Processor 220 may use any other communication protocol to distribute XR content.

FIG. 3 schematically shows an example of live content displayed on the display device 40. In FIG. 3, an example in which the display device 40 displays live content that is XR content of live music will be mainly described.

The display device 40 displays XR content on which an event notification notifying a "voting event" is superimposed. The event notification in Figure 3 includes the message "Which hat do you want me to wear in the next song?", image data of hat A as one of the choices, image data of a leftward arrow, and the message "Swing left to select". , image data of hat B, which is another one of the options, image data of a right-pointing arrow, and the message "Swing right to select." If the audience member of the live content who has confirmed the event notification displayed on the display device 40 wants the virtual character to wear hat A in the next song, he or she swings the communication terminal 300 to the left and instructs the virtual character to wear hat B in the next song. If you want it covered, shake the communication terminal 300 to the right. The information processing device 100 determines "an operation to shake the communication terminal 300 to the left" and "an operation to shake the communication terminal 300 to the right" from the input operations indicated by the input operation information received from each of the plurality of communication terminals 300. Total each. The information processing device 100 transmits the total results of input operations to the content distribution device 200.

FIG. 4 schematically shows another example of live content displayed on the display device 40. In FIG. 4, in the "voting event" in the explanation of FIG. 3, the total number of input operations for "shaking the communication terminal 300 to the left" is greater than the total number of "shaking the communication terminal 300 to the right" An example of a case where this is shown will be mainly explained.

The content distribution device 200 determines that the total number of input operations indicates that the total number of "actions to move the communication terminal 300 to the left" is greater than the total number of "actions to move the communication terminal 300 to the right." In the production response information for "Event", the production process of "virtual character plays song 1 while wearing hat A" corresponding to the "operation of shaking the communication terminal 300 to the left" is determined as the production process for the XR content to be executed. . The content distribution device 200 renders and distributes the XR content in which the virtual character wears the hat A and plays the song 1 based on the determined production process. The display device 40 displays the XR content distributed by the content distribution device 200.

FIG. 5 schematically shows another example of live content displayed on the display device 40. In FIG. 5, an example in which the display device 40 displays live content that is XR content of live music will be mainly described.

The display device 40 displays XR content on which an event notification notifying a "tap event" is superimposed. The event notification in FIG. 5 includes the message "Let's all tap to open the treasure chest before the next song!" and image data of the treasure chest in a closed state. A live content audience member who has confirmed the event notification displayed on the display device 40 taps an "open" button displayed on the communication terminal 300 if he or she wishes to open the treasure chest. The information processing device 100 aggregates the "operations of tapping the communication terminal 300" from the input operations indicated by the input operation information received from each of the plurality of communication terminals 300. The information processing device 100 transmits the total results of input operations to the content distribution device 200.

FIG. 6 schematically shows another example of live content displayed on the display device 40. FIG. 6 shows an example of a case where the total number of input operations indicates that the total number of "tap operations on the communication terminal 300" is greater than a predetermined total number of times threshold in the "tap event" in the explanation of FIG. Mainly explained.

Since the total number of input operations indicates that the total number of "tap operations on the communication terminal 300" is greater than the total number of times threshold, the content distribution device 200 determines that "the communication terminal 300 The ``treasure box opens'' effect processing corresponding to the ``operation of tapping'' is determined as the effect process for the XR content to be executed. Based on the determined rendering process, the content distribution device 200 changes the closed treasure box into an open treasure box, and renders and distributes the XR content including the message "Treasure box opened!". The display device 40 displays the XR content distributed by the content distribution device 200.

FIG. 7 schematically shows another example of live content displayed on the display device 40. In FIG. 7, an example in which the display device 40 displays live content that is XR content of live music will be mainly described. In FIG. 7, parts different from those in FIG. 3 will be mainly explained.

When a plurality of display devices are installed at a live venue or the like, a display device 45 different from the display device 40 displays an event notification notifying a "voting event." The display device 40 displays XR content on which an event notification notifying a "voting event" is not superimposed.

FIG. 8 schematically shows an example of the functional configuration of the information processing device 100. The information processing device 100 includes a storage section 102, a performance-related information registration section 104, an information reception section 106, a totaling section 108, a performance processing determining section 110, an information transmission section 112, and a content generation section 114. Note that it is not essential for the information processing device 100 to have all of these configurations.

The storage unit 102 stores various information. The storage unit 102 stores, for example, user information of audience members of live content. The user information includes, for example, user identification information that identifies audience members of the live content. The user information includes, for example, terminal identification information that identifies the communication terminal 300 owned by a viewer of the live content. The user information includes, for example, email address information of viewers of the live content. The user information includes password information for communication terminal 300 to log into the application. The user information may include ticket type information indicating the type of ticket purchased by a live content audience member. The ticket is, for example, a regular ticket. The ticket may be a premium ticket that is more expensive than a regular ticket.

The storage unit 102 stores, for example, event correspondence information that associates the type of input operation to the communication terminal 300 with an event that determines a performance process for the live content to be executed. For example, an event tag is attached to the event correspondence information for each event that determines the production process.

The event that determines the production process is, for example, a voting event. The event that determines the production process is, for example, a tap event. The event that determines the production process may be any other event.

The storage unit 102 stores, for example, communication terminal-related data correspondence information that associates the type of communication terminal-related data related to the communication terminal 300 with a reception condition under which the information processing device 100 receives communication terminal-related data from the communication terminal 300. do. In the communication terminal-related data correspondence information, for example, a communication terminal-related data tag is attached to each piece of communication terminal-related data.

The communication terminal related data includes, for example, position data indicating the position of the communication terminal 300. The communication terminal related data includes, for example, temperature data indicating the temperature of the communication terminal 300. The communication terminal related data includes, for example, moving speed data indicating the moving speed of the communication terminal 300. The communication terminal related data includes, for example, atmospheric pressure data indicating the atmospheric pressure detected by the communication terminal 300. The communication terminal related data may include any other data related to the communication terminal 300.

The performance-related information registration unit 104 registers the performance-related information in the storage unit 102. The performance corresponding information registration unit 104 registers, for example, the performance corresponding information received by the information receiving unit 106 from the communication terminal 400 in the storage unit 102. The performance-compatible information registration unit 104 may register, in the storage unit 102, performance-compatible information input by the creator of the live content using an input device included in the information processing apparatus 100.

The performance correspondence information includes, for example, first performance correspondence information that associates the type of input operation to the communication terminal 300 with the performance processing for the live content. For example, an event tag is attached to the first performance corresponding information for each event that determines the performance process. The production correspondence information may include second production correspondence information that associates the type of communication terminal related data related to the communication terminal 300 with production processing for live content. In the second performance corresponding information, for example, a communication terminal related data tag is attached to each communication terminal related data.

For example, the performance corresponding information registration unit 104 further associates the event corresponding information with an input operation flag indicating whether the input operation on the communication terminal 300 corresponding to the event corresponding information is valid or invalid, and stores the information in the storage unit 102. Register. For example, the performance-related information registration unit 104 further associates an input operation flag corresponding to the event tag with an event tag attached to the event-related information, and registers this in the storage unit 102.

The information receiving unit 106 receives various information from external devices. The information receiving unit 106 receives various information from, for example, an external device via the network 20. The information receiving unit 106 stores various types of received information in the storage unit 102.

The information receiving unit 106 receives various information from each of the plurality of communication terminals 300, for example. The information receiving unit 106 receives various information from, for example, each of a plurality of communication terminals 300 owned by viewers of live content. The information receiving unit 106 receives various information from each of the plurality of communication terminals 300, for example, during a live content performance.

The information receiving unit 106 receives input operation information from each of the plurality of communication terminals 300, for example. The information receiving unit 106 receives, for example, battery remaining amount information indicating the remaining battery amount of the communication terminal 300 from each of the plurality of communication terminals 300. The information receiving unit 106 may receive communication terminal related information including communication terminal related data from each of the plurality of communication terminals 300. The information receiving unit 106 periodically receives, for example, battery remaining amount information and communication terminal related information.

The information receiving unit 106 receives various information from the content distribution device 200, for example. The information receiving unit 106 receives various information from the content distribution device 200, for example, during a live content performance.

The information receiving unit 106 receives, for example, production corresponding information from the content distribution device 200. The information receiving unit 106 receives input operation flag change instruction information that instructs to change the input operation flag from the content distribution device 200, for example. The input operation flag change instruction information is, for example, information that instructs to change the input operation flag from a valid state to an invalid state. The input operation flag change instruction information is, for example, information that instructs to change the input operation flag from an invalid state to a valid state. Note that the input operation flag may be changed by the creator of the live content inputting input operation flag change instruction information using an input device included in the information processing apparatus 100. The information receiving unit 106 may receive reception conditions for receiving communication terminal related data from the content distribution device 200.

The information receiving unit 106 receives various information from the communication terminal 400, for example. The information receiving unit 106 receives various information from the communication terminal 400, for example, during a live content performance.

The information receiving unit 106 receives, for example, the same information as the information received from the content distribution device 200 from the communication terminal 400. The information transmitter 112 may receive arbitrary information different from the information received from the content distribution device 200 from the communication terminal 400.

The information receiving unit 106 may receive IoT sensor data from the IoT sensor 600. The information receiving unit 106 may receive environmental data from the environmental data management device 700. The information receiving unit 106 may receive any data from any other external device.

The aggregation unit 108 aggregates various information. The aggregation unit 108 aggregates various information during a live content performance, for example.

The totaling unit 108, for example, totals the input operations indicated by the input operation information received by the information receiving unit 106 from each of the plurality of communication terminals 300. For example, the totaling unit 108 totals the input operations whose input operation flags are valid among the input operations indicated by the input operation information received by the information receiving unit 106 from each of the plurality of communication terminals 300. The aggregation unit 108 may aggregate input operations for each communication terminal 300.

The totaling unit 108 totals the input operations in a totaling mode according to the type of event that determines the performance processing for the live content to be executed, for example. For example, when the event that determines the performance process is a "voting event," the tallying unit 108 tallies the input operations in an "overwrite" mode that tallies only the latest input operations input to the communication terminal 300. For example, when the event that determines the production process is a "tap event", the totaling unit 108 totals the input operations in an "accumulation" mode that totals all input operations input to the communication terminal 300.

The totaling unit 108 may total the remaining battery power indicated by the remaining battery power information received by the information receiving unit 106 from each of the plurality of communication terminals 300. The aggregation unit 108 may aggregate communication terminal-related data included in the communication terminal-related information received by the information receiving unit 106 from each of the plurality of communication terminals 300. The totaling unit 108 totals the battery remaining amount and communication terminal related data, for example, in response to the information receiving unit 106 receiving the battery remaining amount information and the communication terminal related information.

The effect processing determining unit 110 determines an effect process for the live content to be executed. For example, the performance processing determining unit 110 determines a performance process to be executed during a live content performance.

For example, the performance processing determining unit 110 executes an event that determines the performance process for the live content to be executed, when the total result of the various information collected by the totaling unit 108 satisfies a predetermined event execution condition. For example, the performance processing determining unit 110 determines to execute an event that determines the performance process to be executed, when the result of the battery remaining amount totaled by the totaling unit 108 satisfies a predetermined battery remaining amount condition. The performance processing determining unit 110 determines to execute an event that determines the performance process to be executed when the total result of the communication terminal related data compiled by the totaling unit 108 satisfies a predetermined communication terminal related data condition. Good too.

The performance processing determining unit 110 determines the performance process to be executed, for example, based on the total results compiled by the totaling unit 108 and the performance correspondence information stored in the storage unit 102. The performance processing determining unit 110 determines the performance process to be executed, for example, based on the total result of input operations compiled by the totaling unit 108 and the first performance correspondence information stored in the storage unit 102. The performance processing determining unit 110 determines the performance to be executed based on, for example, the total input operation results collected by the totalization unit 108 during the live content performance and the first performance correspondence information stored in the storage unit 102. Decide on processing. The effect processing determining unit 110 determines the effect process to be executed based on the aggregation result of the communication terminal related data aggregated by the aggregation unit 108 and the second effect corresponding information stored in the storage unit 102. good.

The performance processing determining unit 110 may determine the performance process to be executed based further on the IoT sensor data stored in the storage unit 102. The effect processing determining unit 110 may determine the effect process to be executed based further on the environmental data stored in the storage unit 102.

For example, the performance processing determining unit 110 determines, as the performance process to be executed, a performance process whose input operation satisfies a predetermined performance process determination condition. For example, the performance processing determining unit 110 determines, as the performance process to be executed, the performance process associated with the input operation with the largest total number of input operations during a predetermined period. The performance processing determining unit 110 determines, as the performance process to be executed, a performance process that is associated with an input operation in which the total number of input operations during a predetermined period is greater than a predetermined total number of times threshold. You can. The performance processing determining unit 110 may determine a performance process whose communication terminal related data satisfies the performance process determination condition as the performance process to be executed.

For example, when the live content is XR content, the performance processing determining unit 110 determines a performance process that changes the content of the XR content as the performance process to be executed. The performance processing determining unit 110 may determine, as the performance process to be executed, a performance process that changes the output of equipment used to perform live content. The equipment used to perform live content is, for example, a sound output device such as a speaker. The equipment used to perform live content is, for example, a lighting device. The equipment used to perform live content may be any other device.

The information transmitter 112 transmits various information to external devices. The information transmitter 112 transmits various information to an external device via the network 20, for example.

The information transmitter 112 transmits various information to the communication terminal 300, for example. The information transmitting unit 112 transmits, for example, a transmission request to the communication terminal 300 requesting transmission of input operation information. For example, the information transmitting unit 112 transmits to the communication terminal 300 the transmission request that includes valid input operation information indicating the valid input operations that are being totaled by the totaling unit 108. The information transmitting unit 112 transmits the transmission request to the communication terminal 300, for example, in response to a change in the valid input operations counted by the counting unit 108. The communication terminal 300 that has received the transmission request from the information processing device 100 transmits the input operation information to the information processing device 100 when a valid input operation indicated by the valid input operation information included in the transmission request is input. It's fine.

The information transmitter 112 may transmit a transmission request to the communication terminal 300 requesting transmission of communication terminal related data. The communication terminal 300 that has received the transmission request from the information processing device 100 may transmit communication terminal related information including the communication terminal related data to the information processing device 100.

For example, the information transmitting unit 112 transmits a transmission stop instruction that instructs to stop transmitting the remaining battery power information when the total battery remaining power totaled by the totaling unit 108 does not satisfy a predetermined battery remaining power condition. Send to terminal 300. For example, the information transmitting unit 112 issues a transmission stop instruction to stop transmitting the communication terminal-related information when the total result of the communication terminal-related data compiled by the totaling unit 108 does not satisfy a predetermined communication terminal-related data condition. is transmitted to the communication terminal 300.

The information transmitting unit 112 transmits various information to the content distribution device 200, for example. The information transmitting unit 112 transmits, for example, information based on the total result of input operations compiled by the totaling unit 108 to the content distribution device 200. The information transmitting unit 112 transmits, for example, the total result of the input operations compiled by the totaling unit 108 to the content distribution device 200 as information based on the total result of the input operations. The information transmitting unit 112 transmits to the content distribution device 200 the performance processing information indicating the performance process determined by the performance process determining unit 110 based on the total result of the input operations compiled by the totaling unit 108, as information based on the total result of the input operations. You may also send it to

For example, the information transmitting unit 112 transmits information based on the aggregation result of the communication terminal related data compiled by the aggregating unit 108 to the content distribution device 200. The information transmitting unit 112 transmits, for example, the total result of the communication terminal-related data compiled by the totaling unit 108 to the content distribution device 200 as information based on the total result of the communication terminal-related data. The information transmitting unit 112 transmits to the content distribution device 200 the effect processing information determined by the effect processing determining unit 110 based on the aggregation result of the communication terminal related data aggregated by the aggregation unit 108 as information based on the aggregation result of the communication terminal related data. You may also send it to The information transmitting unit 112 may transmit the total battery remaining amount totaled by the totaling unit 108 to the content distribution device 200.

The information transmitter 112 transmits various information to the communication terminal 400, for example. The information transmitter 112 transmits, for example, the same information as the information transmitted to the content distribution device 200 to the communication terminal 400. The information transmitter 112 may transmit arbitrary information different from the information transmitted to the content distribution device 200 to the communication terminal 400.

The content generation unit 114 generates XR content when the live content is XR content. The content generation unit 114 generates XR content during a live content performance, for example.

The content generation unit 114 may, for example, render the XR content including the performance processing for the XR content to be executed determined by the performance processing determination unit 110 based on the motion data received by the information reception unit 106 from the motion capture device 500. to generate XR content. The information transmitter 112 may transmit the XR content generated by the content generator 114.

The information processing device 100 does not need to include the performance corresponding information registration section 104 and the performance processing determining section 110. In this case, an external device such as the content distribution device 200 may determine the effect processing for the live content to be executed.

The information processing device 100 does not need to include the content generation unit 114. In this case, an external device such as the content distribution device 200 may generate the live content.

FIG. 9 schematically shows an example of the functional configuration of the content distribution device 200. The content distribution device 200 includes a storage section 202, a performance-related information registration section 204, an information reception section 206, a performance processing determination section 208, an information transmission section 210, and a content generation section 212. Note that it is not necessarily necessary for the content distribution device 200 to have all of these configurations.

The storage unit 202 stores various information. The storage unit 202 stores, for example, performance correspondence information. The storage unit 202 stores, for example, first performance correspondence information. The storage unit 202 stores, for example, second performance correspondence information.

The performance-related information registration unit 204 registers the performance-related information in the storage unit 202. The performance-compatible information registration unit 204 registers the performance-compatible information in the storage unit 202, for example, in the same manner as the performance-compatible information registration unit 104.

Information receiving section 206 receives various information from external devices. The information receiving unit 206 receives various information from, for example, an external device via the network 20. The information receiving unit 206 receives various information from an external device, for example, during a live content performance. The information receiving unit 206 stores various types of received information in the storage unit 202.

The information receiving unit 206 receives various information from the information processing device 100, for example. The information receiving unit 206 receives, for example, from the information processing device 100 information based on the total results compiled by the information processing device 100. The information receiving unit 206 receives, for example, from the information processing device 100 information based on the total results of input operations compiled by the information processing device 100. The information receiving unit 206 receives, for example, from the information processing device 100 information based on the aggregation result of communication terminal related data compiled by the information processing device 100. The information receiving unit 206 may receive, from the information processing device 100, the total battery remaining amount totaled by the information processing device 100.

The information receiving unit 206 receives various information from the communication terminal 400, for example. The information receiving unit 106 receives the production corresponding information from the communication terminal 400, for example. The performance-compatible information registration unit 204 may register the performance-compatible information received by the information receiving unit 206 from the communication terminal 400 in the storage unit 202.

The information receiving unit 206 may receive IoT sensor data from the IoT sensor 600. The information receiving unit 206 may receive environmental data from the environmental data management device 700. The information receiving unit 206 may receive any data from any other external device.

The effect processing determining unit 208 determines an effect process for the live content to be executed. For example, the production processing determining unit 208 determines production processing to be executed during a live content performance.

For example, the performance processing determining unit 208 determines the performance based on the information received from the information processing device 100 by the information receiving unit 206 and based on the total results compiled by the information processing device 100 and the performance corresponding information stored in the storage unit 202. Then, the performance processing to be executed is determined. The performance processing determining unit 208 determines the performance process to be executed, based on, for example, the input operations totaled by the information processing device 100 and the first performance correspondence information stored in the storage unit 202. The effect processing determining unit 208 determines the effect process to be executed based on the aggregation result of the communication terminal related data aggregated by the information processing device 100 and the second effect corresponding information stored in the storage unit 202. Good too. The effect processing determining section 208 determines the effect processing to be executed, for example, in the same manner as the effect processing determining section 110.

The information transmitter 210 transmits various information to external devices. The information transmitter 210 transmits various information to an external device via the network 20, for example.

The information transmitter 210 distributes live content, for example. The information transmitting unit 210 distributes live content so that it is displayed on the display device 40, for example.

The information transmitting unit 210 transmits various information to the information processing device 100, for example. The information receiving unit 206 transmits, for example, production corresponding information to the information processing device 100. The information transmitter 210 may transmit input operation flag change instruction information to the information processing apparatus 100.

Information transmitting section 210 may transmit various information to communication terminal 400. The information transmitter 210 transmits, for example, information received from the information processor 100 by the information receiver 206 and based on the total results compiled by the information processor 100 to the communication terminal 400.

The content generation unit 212 generates XR content when the live content is XR content. The content generation unit 212 generates XR content during a live content performance, for example. The content generation unit 212 generates XR content in the same manner as the content generation unit 114, for example.

FIG. 10 schematically shows an example of event correspondence information stored in the information processing device 100. In FIG. 10, an example of event correspondence information when the live content is XR content of live music will be mainly described.

The event correspondence information in FIG. 10 includes the event tag of the event that determines the production process for the XR content to be executed, the aggregation start time at which the aggregation unit 108 starts aggregating the input operations, and the aggregation start time at which the aggregation unit 108 starts aggregating the input operations. The aggregation period, aggregation mode, valid input operations, and input operation flags are associated with each other. Note that in FIG. 10, the aggregation start time is expressed as the elapsed time from the XR content distribution start time.

The aggregation start time of the event tag "voting event 1" is "00:30:00". The aggregation period for the event tag "Vote Event 1" is "5 minutes". The aggregation mode of the event tag "voting event 1" is "overwrite" mode. Valid input operations for the event tag "voting event 1" are "swing left", which is an operation of shaking the communication terminal 300 to the left, and "swing right", which is an operation of shaking the communication terminal 300 to the right. The input operation flag of the event tag "voting event 1" is "valid".

The aggregation start time of the event tag "Vote Event 2" is "01:30:00". The aggregation period for the event tag "Vote Event 2" is "8 minutes". The aggregation mode of the event tag "voting event 2" is "overwrite" mode. Valid input operations for the event tag "voting event 2" are "up swing", which is an operation of shaking the communication terminal 300 upward, and "down swing", which is an operation of shaking the communication terminal 300 downward. The input operation flag of the event tag "voting event 2" is "valid".

The aggregation start time of the event tag "tap event 1" is "01:00:00". The aggregation period for the event tag "tap event 1" is "10 minutes". The aggregation mode of the event tag "tap event 1" is the "accumulation" mode. A valid input operation for the event tag “tap event 1” is “tap the “open” button, which is an operation of tapping the “open” button displayed on the communication terminal 300. The input operation flag of the event tag "tap event 1" is "valid".

The aggregation start time of the event tag "tap event 2" is "00:45:00". The aggregation period for the event tag "tap event 2" is "20 minutes". The aggregation mode of the event tag "tap event 2" is the "accumulation" mode. A valid input operation for the event tag “tap event 2” is “tap the “like” button, which is an operation of tapping the “like” button displayed on the communication terminal 300. The input operation flag of the event tag "tap event 2" is "invalid".

FIG. 11 schematically shows an example of the total results compiled by the information processing apparatus 100. FIG. 11 shows an example of the results of aggregating the input operations of a plurality of communication terminals 300 in "voting event 1", "voting event 2", and "tap event 1" in which the input operation flag in FIG. 10 is valid. Mainly explained.

The number of communication terminals 300 that participated in the event tag "voting event 1" is "200". The total number of valid input operations for the event tag "voting event 1" is "150 times" for "swing left" and "50 times" for "swing right".

The number of communication terminals 300 that participated in the event tag "voting event 2" is "150". The total number of valid input operations for the event tag "voting event 2" is "120 times" for "up" and "30" for "down".

The number of communication terminals 300 that participated in the event tag "tap event 1" is "300". The total number of valid input operations for "tap event 1" is "2000" for the event tag "tap".

FIG. 12 schematically shows another example of the total results compiled by the information processing apparatus 100. In FIG. 12, an example of the total results when input operations are totaled for each communication terminal 300 in the total results of FIG. 11 will be mainly explained.

The user identification information of "communication terminal A" is "user A." A ticket purchased by a live content audience member who owns "communication terminal A" is a "regular ticket." The events in which "communication terminal A" participated are "voting event 1," "voting event 2," and "tap event 1." The event participation rate of "communication terminal A" is "100%". The input operation indicated by the input operation information that "communication terminal A" transmitted to the information processing apparatus 100 in "voting event 1" is "swing to the left." The input operation indicated by the input operation information transmitted by "communication terminal A" to the information processing apparatus 100 in "voting event 2" is "downward swing". The input operation indicated by the input operation information that "communication terminal A" transmitted to the information processing apparatus 100 in "tap event 1" is "tap twice." In this case, "communication terminal A" transmits input operation information indicating an operation of tapping the "open" button to the information processing apparatus 100 twice during the aggregation period of "tap event 1", for example. "Communication terminal A" counts that the operation of tapping the "open" button is input twice during the aggregation period of "tap event 1", and the input operation indicates the operation of tapping the "open" button twice. The information may be transmitted to the information processing device 100.

The user identification information of "communication terminal B" is "user B." A ticket purchased by a live content audience member who owns "communication terminal B" is a "premium ticket." The event in which "communication terminal B" participated is "voting event 2." The event participation rate of "communication terminal B" is "33%". Since “communication terminal B” does not participate in “voting event 1”, “communication terminal B” does not transmit input operation information to information processing device 100 in “voting event 1”. Therefore, the input operation indicated by the input operation information transmitted by "communication terminal B" to the information processing apparatus 100 in "voting event 1" is "none". The input operation indicated by the input operation information sent by "communication terminal B" to the information processing apparatus 100 in "voting event 2" is "downward swing". Since “communication terminal B” does not participate in “tap event 1”, “communication terminal B” does not transmit input operation information to information processing device 100 in “tap event 1”. Therefore, the input operation indicated by the input operation information transmitted by "communication terminal B" to the information processing apparatus 100 in "tap event 1" is "none".

The user identification information of "communication terminal C" is "user C." A ticket purchased by a live content audience member who owns "communication terminal C" is a "regular ticket." The events in which "communication terminal C" participated are "voting event 1" and "tap event 1." The event participation rate of "communication terminal C" is "67%". The input operation indicated by the input operation information sent by "communication terminal C" to the information processing apparatus 100 in "voting event 1" is "swing to the right." Since “communication terminal C” does not participate in “voting event 2”, “communication terminal C” does not transmit input operation information to information processing device 100 in “voting event 2”. Therefore, the input operation indicated by the input operation information transmitted by "communication terminal C" to information processing apparatus 100 in "voting event 2" is "none". The input operation indicated by the input operation information that "communication terminal C" transmitted to the information processing apparatus 100 in "tap event 1" is "tap 30 times." In this case, "communication terminal C" transmits input operation information indicating an operation of tapping the "open" button to the information processing apparatus 100 30 times during the aggregation period of "tap event 1", for example. "Communication terminal C" counts that the operation of tapping the "open" button is input 30 times during the aggregation period of "tap event 1", and the input operation indicates the operation of tapping the "open" button 30 times. The information may be transmitted to the information processing device 100.

For example, the totaling unit 108 totalizes the input operations indicated by the input operation information received from one communication terminal 300 by weighting them more than the input operations indicated by the input operation information received from another communication terminal 300. For example, the aggregation unit 108 may convert the input operation indicated by the input operation information received from one communication terminal 300 to the input operation indicated by the input operation information received from another communication terminal 300 based on the aggregation results compiled in the past. Aggregation is weighted rather than operation. For example, the aggregation unit 108 may input the input operation indicated by the input operation information received from the communication terminal 300 whose event participation rate is higher than a predetermined event participation rate threshold from the communication terminal 300 whose event participation rate is lower than the event participation rate threshold. The input operations indicated by the input operation information received from the input operations are weighted and totaled. In the example shown in FIG. 12, when the event participation rate threshold is 75%, the aggregation unit 108 converts the input operation indicated by the input operation information received from communication terminal A into the input operation received from communication terminal B and communication terminal C. The input operations indicated by the operation information are weighted and aggregated.

Based on the user information stored in the storage unit 102, the aggregation unit 108 calculates the input operation indicated by the input operation information received from one communication terminal 300 based on the input operation information received from another communication terminal 300. The input operations may be weighted and aggregated based on the input operations. For example, the aggregation unit 108 may perform an input operation indicated by the input operation information received from a communication terminal 300 owned by a live content audience member who has purchased a premium ticket to a communication terminal 300 owned by a live content audience member who has purchased a normal ticket. The input operations indicated by the input operation information received from the input operations are weighted and totaled. In the example shown in FIG. 12, the aggregation unit 108 weights the input operation indicated by the input operation information received from communication terminal B than the input operation indicated by the input operation information received from communication terminal A and communication terminal C. Tally.

FIG. 13 schematically shows an example of presentation correspondence information stored in the content distribution device 200. In FIG. 13, an example of the first effect corresponding information corresponding to the event corresponding information shown in FIG. 10 will be mainly explained.

The first performance correspondence information in FIG. 13 corresponds to the event tag of the event that determines the performance process for the XR content to be executed, the event execution condition, the valid input operation, the performance process to be performed, and the performance determination condition. I'm wearing it.

The event execution condition for the event tag "voting event 1" is "none". Valid input operations for the event tag "voting event 1" are "swing left" and "swing right." The performance processing for the performance target of the event tag "Voting Event 1" is the performance processing that "the virtual character wears hat A and plays song 1" when "left swing" satisfies the performance determination condition, and the "virtual character plays song 1 wearing hat A", and "right swing ” satisfies the performance determination conditions, the performance process is “the virtual character wears hat B and plays song 1”. The performance determination condition for the event tag "Voting Event 1" is that "the total number of input operations is the largest" during the counting period.

The event execution condition for the event tag "voting event 2" is "average remaining battery level>30%". The average remaining battery power is the average of the remaining battery power indicated by the remaining battery power information that the information receiving unit 106 receives from each of the plurality of communication terminals 300 . Valid input operations for the event tag "voting event 2" are "up" and "down". The performance processing for the event tag "Voting Event 2" is a performance process in which "virtual character plays song 2" when "upward swing" satisfies the performance determination condition, and "downward swing" is the performance determination condition. If the condition is satisfied, it is a production process in which "the virtual character plays song 3". The performance determination condition for the event tag "Voting Event 2" is that "the total number of input operations is the largest" during the counting period.

The event execution condition for the event tag "tap event 1" is "none". The valid input operation for the event tag "tap event 1" is "tap the "open" button". The performance processing for the performance target of the event tag "tap event 1" is the "treasure box opens" performance process. The performance determination condition for the event tag "Tap Event 1" is "Total number of taps on the "open" button>1000 times" in the aggregation period. The total number of taps on the "open" button is the total number of times the information receiving unit 106 taps the "open" button indicated by the input operation information from each of the plurality of communication terminals 300.

The event execution condition for the event tag "tap event 2" is "average temperature of temperature data<35°C". The average temperature of the temperature data is the average of the temperature data indicated by the communication terminal related information that the information receiving unit 106 receives from each of the plurality of communication terminals 300. The valid input operation for the event tag "Tap Event 2" is "Tap the "Like" button". The performance processing for the performance target of the event tag "tap event 2" is a performance process of "increasing the volume" output by the speaker. The effect determination condition for the event tag "Tap Event 1" is "Total number of taps on the "Like" button>5000 times" during the aggregation period. The total number of taps on the "Like" button is the total number of times the information receiving unit 106 taps the "Like" button indicated by input operation information from each of the plurality of communication terminals 300.

The following description of FIG. 13 will focus on an example in which the effect processing determination unit 208 determines the effect process to be executed based on the total result shown in FIG. 11 and the first effect correspondence information shown in FIG. Explain.

In the event tag "voting event 1," the performance processing determining unit 208 determines that the total number of "swings to the left" satisfies the performance determining condition "total number of input operations is the largest", so the performance processing determining unit 208 selects "swings to the left" corresponding to "swings to the left". The effect process "virtual character wears hat A and plays song 1" is determined as the effect process for the XR content to be executed in the event tag "voting event 1". The content generation unit 212 generates XR content including a production process in which "the virtual character wears hat A and plays song 1."

In the event tag "voting event 2," the performance processing determining unit 208 determines that the total number of "overturns" satisfies the performance determination condition "the total number of input operations is the largest", so The performance process "virtual character plays song 2" is determined as the performance process for the XR content to be executed in the event tag "voting event 2". The content generation unit 212 generates XR content including a production process in which “the virtual character plays song 2”.

The performance processing determining unit 208 determines that in the event tag "tap event 1", the total number of times the "open" button is tapped satisfies the performance determination condition "total number of taps on the "open" button>1000 times". The “treasure box opens” effect process is determined as the effect process for the XR content to be executed in the event tag “tap event 1”. The content generation unit 212 generates XR content including a "treasure box opening" effect process.

The performance processing determining unit 208 may determine the performance process to be performed for a specific communication terminal 300 based on the total result of input operations for each communication terminal 300. For example, the performance processing determining unit 208 determines a performance process to be performed for the communication terminal 300 to which an input operation that satisfies a predetermined input operation condition is input. The input operation condition is, for example, that an input operation that satisfies the effect determination condition is input in a voting event. The input operation condition is, for example, that in a tap event, the most tapping operations are input among the plurality of communication terminals 300. The input operation condition may be that a tap operation is input more than a predetermined number of taps in a tap event.

In an example of the total results shown in FIG. 12, the performance processing determining unit 208 sends a message "You are The hat selected by has been selected! The effect process of "notifying" is determined as the effect process of the effect target. The content generation unit 212 generates XR content including the production process. The information transmitter 210 transmits the XR content generated by the content generator 212 to the communication terminal A.

In the example of the total results shown in FIG. 12, the effect processing determining unit 208 selects, for example, the communication terminal C to which the most tapping operations have been input among the plurality of communication terminals 300 in the event tag "tap event 1". On the other hand, "Message" You Win! The effect process of "notifying" is determined as the effect process of the effect target. The content generation unit 212 generates XR content including the production process. The information transmitter 210 transmits the XR content generated by the content generator 212 to the communication terminal C.

FIG. 14 schematically shows an example of communication terminal-related data correspondence information stored in the information processing device 100. In FIG. 14, an example of communication terminal-related data correspondence information when the live content is XR content of live music will be mainly described.

The communication terminal-related data correspondence information in FIG. 14 associates communication terminal-related data tags, communication terminal-related data, reception conditions, and aggregation modes.

The communication terminal related data of the communication terminal related data tag “Communication terminal related data 1” is “location data” of the communication terminal 300. The reception condition for receiving the position data of the communication terminal related data tag "Communication terminal related data 1" is "none". The aggregation mode of the communication terminal related data tag "Communication terminal related data 1" is the "overwrite" mode.

The communication terminal related data of the communication terminal related data tag “Communication terminal related data 2” is “temperature data” of the communication terminal 300. The reception condition for receiving the temperature data of the communication terminal related data tag "Communication terminal related data 2" is "average remaining battery level>30%". The aggregation mode of the communication terminal related data tag "Communication terminal related data 2" is the "overwrite" mode.

FIG. 15 schematically shows another example of the total results compiled by the information processing apparatus 100. In FIG. 15, location data of the communication terminal 300 corresponding to the communication terminal related data tag "Communication terminal related data 1" in FIG. 14 and temperature data of the communication terminal 300 corresponding to the communication terminal related data tag "Communication terminal related data 2" are shown. An example of the total results will be mainly explained.

The number of communication terminals 300 that have transmitted location data to the information processing device 100 is "300." Among them, the number of communication terminals 300 that transmitted the location data of "position A" is "5", the number of terminals of the communication terminals 300 that transmitted the location data of "position B" is "10", The number of communication terminals 300 that transmitted the location data of "C" is "150", the number of communication terminals 300 that transmitted the location data of "position D" is "55", and the number of terminals of the communication terminals 300 that transmitted the location data of "position D" is "55", The number of communication terminals 300 that transmitted data is "80".

The number of communication terminals 300 that transmitted temperature data to the information processing device 100 is "300". Among them, the number of communication terminals 300 that transmitted temperature data indicating a temperature of "25 degrees Celsius or less" was "5", and the number of communication terminals 300 that transmitted temperature data indicating a temperature of "25 to 30 degrees Celsius". is "120", the number of communication terminals 300 that sent temperature data indicating a temperature of "30 to 35 degrees Celsius" is "165", and the number of communication terminals 300 that transmitted temperature data indicating a temperature of "35 degrees Celsius or higher" is "165". The number of terminals in the terminal 300 is "10". The average temperature of the temperature data transmitted to the information processing apparatus 100 by each of the "300" communication terminals 300 is "32.5" degrees Celsius.

FIG. 16 schematically shows another example of production-related information stored in the content distribution device 200. In FIG. 16, an example of the second effect corresponding information corresponding to the communication terminal related data corresponding information shown in FIG. 14 will be mainly explained.

The second performance correspondence information in FIG. 16 associates a communication terminal-related data tag, communication terminal-related data, a performance process for the XR content to be executed, and a performance process determination condition.

The communication terminal related data of the communication terminal related data tag “Communication terminal related data 1” is “location data” of the communication terminal 300. The performance processing for the performance target of the communication terminal related data tag "Communication terminal related data 1" is a performance process that "makes the weather at the location indicated by the most location data". The effect processing determination condition for the communication terminal related data tag "Communication terminal related data 1" is "the position indicated by the most position data".

The communication terminal related data of the communication terminal related data tag “Communication terminal related data 2” is “temperature data” of the communication terminal 300. The performance processing of the performance target of the communication terminal related data tag "Communication terminal related data 2" is a performance process in which "the character performs while sweating". The effect processing determination condition for the communication terminal related data tag "Communication terminal related data 2" is "average temperature of temperature data>30°C".

The following description of FIG. 16 will focus on an example in which the effect processing determination unit 208 determines the effect process to be executed based on the total result shown in FIG. 15 and the second effect correspondence information shown in FIG. Explain.

In the communication terminal-related data tag "Communication terminal-related data 1," the effect processing determining unit 208 determines that the position data of "Position C" satisfies the effect determination condition "This is the position indicated by the most position data." The rendering process "Set the weather of C" is determined as the rendering process for the XR content to be executed in the communication terminal related data tag "Communication terminal related data 1". The content generation unit 212 generates XR content including a production process of “making the weather at position C” based on the weather data at position C received by the information reception unit 206 from the environmental data management device 700.

Since the average temperature of the temperature data satisfies the performance determination condition "average temperature of temperature data>30°C" in the communication terminal related data tag "Communication terminal related data 2", the production processing determining unit 208 determines that "the character is sweating". The effect processing "Play while playing" is determined as the effect processing for the XR content to be executed in the communication terminal related data tag "Communication terminal related data 2". The content generation unit 212 generates XR content including a production process in which a character performs while sweating.

FIG. 17 is an explanatory diagram for explaining an example of the processing flow of the information processing apparatus 100. FIG. 17 mainly describes an example in which the information processing device 100 transmits to the content distribution device 200 the aggregated results of input operations input to each of a plurality of communication terminals 300 owned by viewers of live content. In FIG. 17, a state in which the aggregation start time has passed will be described as a start state.

In step (step may be abbreviated as S) 102, the information receiving unit 106 receives input operation information from each of the plurality of communication terminals 300 via the network 20. For example, the content distribution device 200 distributes the XR content such that the XR content with the event notification superimposed thereon is displayed on the display device 40 during the aggregation period.

In S104, if the aggregation period has elapsed, the process advances to S106. In S104, if the aggregation period has not elapsed, the process returns to S102.

In S106, the totaling unit 108 totals the input operations indicated by the input operation information received by the information receiving unit 106 from each of the plurality of communication terminals 300 in S102. In S<b>108 , the information transmitting unit 112 transmits the total result of the input operations totaled by the totaling unit 108 to the content distribution device 200 via the network 20 . The content distribution device 200 determines the performance processing of the live content to be executed based on the total result of input operations received from the information processing device 100 and the first performance corresponding information capital stored in the content distribution device 200. do. The content distribution device 200 generates XR content including the determined performance processing to be executed, and distributes the XR content so that the generated XR content is displayed on the display device 40. This completes the process in which the information processing device 100 transmits to the content distribution device 200 the aggregated results of the input operations input to each of the plurality of communication terminals 300 owned by the live content audience members.

FIG. 18 schematically shows an example of the hardware configuration of a computer 1200 functioning as the information processing device 100. The program installed on the computer 1200 causes the computer 1200 to function as one or more "parts" of the apparatus according to the above embodiment, or causes the computer 1200 to perform operations associated with the apparatus according to the above embodiment or the one or more "parts" of the apparatus according to the above embodiment. Multiple units may be executed and/or the computer 1200 may execute a process or a step of a process according to the embodiments described above. Such programs may be executed by CPU 1212 to cause computer 1200 to perform certain operations associated with some or all of the blocks in the flowcharts and block diagrams described herein.

The computer 1200 according to this embodiment includes a CPU 1212, a RAM 1214, and a graphics controller 1216, which are interconnected by a host controller 1210. The computer 1200 also includes input/output units such as a communication interface 1222, a storage device 1224, a DVD drive 1226, and an IC card drive, which are connected to the host controller 1210 via an input/output controller 1220. DVD drive 1226 may be a DVD-ROM drive, a DVD-RAM drive, or the like. Storage device 1224 may be a hard disk drive, solid state drive, or the like. Computer 1200 also includes legacy input/output units, such as ROM 1230 and keyboard 1242, which are connected to input/output controller 1220 via input/output chip 1240.

The CPU 1212 operates according to programs stored in the ROM 1230 and RAM 1214, thereby controlling each unit. Graphics controller 1216 obtains image data generated by CPU 1212, such as in a frame buffer provided in RAM 1214 or itself, and causes the image data to be displayed on display device 1218.

Communication interface 1222 communicates with other electronic devices via a network. Storage device 1224 stores programs and data used by CPU 1212 within computer 1200. The DVD drive 1226 reads a program or data from a DVD-ROM 1227 or the like and provides it to the storage device 1224. The IC card drive reads programs and data from and/or writes programs and data to the IC card.

ROM 1230 stores therein programs that are dependent on the computer 1200 hardware, such as a boot program that is executed by the computer 1200 upon activation. I/O chip 1240 may also connect various I/O units to I/O controller 1220 via USB ports, parallel ports, serial ports, keyboard ports, mouse ports, etc.

The program is provided by a computer readable storage medium such as a DVD-ROM 1227 or an IC card. The program is read from a computer-readable storage medium, installed in storage device 1224, RAM 1214, or ROM 1230, which are also examples of computer-readable storage media, and executed by CPU 1212. The information processing described in these programs is read by the computer 1200 and provides coordination between the programs and the various types of hardware resources described above. An apparatus or method may be configured to implement the operation or processing of information according to the use of computer 1200.

For example, when communication is performed between the computer 1200 and an external device, the CPU 1212 executes a communication program loaded into the RAM 1214 and sends communication processing to the communication interface 1222 based on the processing written in the communication program. You can give orders. The communication interface 1222 reads transmission data stored in a transmission buffer area provided in a recording medium such as a RAM 1214, a storage device 1224, a DVD-ROM 1227, or an IC card under the control of the CPU 1212, and transmits the read transmission data. Data is transmitted to the network, or received data received from the network is written to a reception buffer area provided on the recording medium.

Further, the CPU 1212 causes the RAM 1214 to read all or a necessary part of a file or database stored in an external recording medium such as a storage device 1224, a DVD drive 1226 (DVD-ROM 1227), or an IC card. Various types of processing may be performed on the data. CPU 1212 may then write the processed data back to an external storage medium.

Various types of information, such as various types of programs, data, tables, and databases, may be stored on a recording medium and subjected to information processing. CPU 1212 performs various types of operations, information processing, conditional determination, conditional branching, unconditional branching, and information retrieval on data read from RAM 1214 as described elsewhere in this disclosure and specified by the program's instruction sequence. Various types of processing may be performed, including /substitutions, etc., and the results are written back to RAM 1214. Further, the CPU 1212 may search for information in a file in a recording medium, a database, or the like. For example, when a plurality of entries are stored in a recording medium, each having an attribute value of a first attribute associated with an attribute value of a second attribute, the CPU 1212 selects the first entry from among the plurality of entries. Search for an entry whose attribute value matches the specified condition, read the attribute value of the second attribute stored in the entry, and then set the attribute value to the first attribute that satisfies the predetermined condition. An attribute value of the associated second attribute may be obtained.

The programs or software modules described above may be stored in a computer-readable storage medium on or near computer 1200. Also, a storage medium such as a hard disk or RAM provided in a server system connected to a dedicated communication network or the Internet can be used as a computer-readable storage medium, thereby allowing the program to be transferred to the computer 1200 via the network. provide.

Blocks in the flowcharts and block diagrams of the present embodiments may represent stages in a process in which an operation is performed or a "part" of a device responsible for performing the operation. Certain steps and units may be provided with dedicated circuitry, programmable circuitry provided with computer readable instructions stored on a computer readable storage medium, and/or provided with computer readable instructions stored on a computer readable storage medium. May be implemented by a processor. Dedicated circuitry may include digital and/or analog hardware circuits, and may include integrated circuits (ICs) and/or discrete circuits. Programmable circuits can perform AND, OR, EXCLUSIVE OR, NAND, NOR, and other logical operations, such as field programmable gate arrays (FPGAs), programmable logic arrays (PLAs), etc. , flip-flops, registers, and memory elements.

A computer-readable storage medium may include any tangible device capable of storing instructions for execution by a suitable device such that a computer-readable storage medium with instructions stored therein may be illustrated in a flowchart or block diagram. A product will be provided that includes instructions that can be executed to create a means for performing specified operations. Examples of computer-readable storage media may include electronic storage media, magnetic storage media, optical storage media, electromagnetic storage media, semiconductor storage media, and the like. More specific examples of computer readable storage media include floppy disks, diskettes, hard disks, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM or flash memory). , Electrically Erasable Programmable Read Only Memory (EEPROM), Static Random Access Memory (SRAM), Compact Disk Read Only Memory (CD-ROM), Digital Versatile Disk (DVD), Blu-ray Disc, Memory Stick , integrated circuit cards, and the like.

Computer-readable instructions may include assembler instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state configuration data, or instructions such as Smalltalk®, JAVA®, C++, etc. any source code or object code written in any combination of one or more programming languages, including object-oriented programming languages such as may include.

The computer-readable instructions are for producing means for a processor of a general purpose computer, special purpose computer, or other programmable data processing device, or programmable circuit to perform the operations specified in the flowchart or block diagrams. A general purpose computer, special purpose computer, or other programmable data processor, locally or over a local area network (LAN), wide area network (WAN), such as the Internet, to execute the computer readable instructions. It may be provided in a processor or programmable circuit of the device. Examples of processors include computer processors, processing units, microprocessors, digital signal processors, controllers, microcontrollers, and the like.

Although the present invention has been described above using the embodiments, the technical scope of the present invention is not limited to the range described in the above embodiments. It will be apparent to those skilled in the art that various changes or improvements can be made to the embodiments described above. It is clear from the claims that forms with such changes or improvements may also be included within the technical scope of the present invention.

The execution order of each process, such as an operation, a procedure, a step, and a stage in the apparatus, system, program, and method shown in the claims, specification, and drawings, specifically refers to "before" or "before". It should be noted that they can be implemented in any order unless the output of the previous process is used in the subsequent process. Even if the claims, specifications, and operational flows in the drawings are explained using "first," "next," etc. for convenience, this does not mean that it is essential to carry out the operations in this order. It's not a thing.

Reference Signs List 10 system, 20 network, 40 display device, 45 display device, 100 information processing device, 102 storage unit, 104 production corresponding information registration unit, 106 information reception unit, 108 aggregation unit, 110 production processing determination unit, 112 information transmission unit, Reference Signs List 114 content generation unit, 200 content distribution device, 202 storage unit, 204 performance corresponding information registration unit, 206 information reception unit, 208 performance processing determination unit, 210 information transmission unit, 212 content generation unit, 220 processor, 230 tally result storage unit , 240 performance-compatible information storage unit, 260 IoT sensor data storage unit, 270 environment data storage unit, 300 communication terminal, 400 communication terminal, 500 motion capture device, 600 IoT sensor, 700 environment data management device, 1200 computer, 1210 host controller , 1212 CPU, 1214 RAM, 1216 graphic controller, 1218 display device, 1220 input/output controller, 1222 communication interface, 1224 storage device, 1226 DVD drive, 1227 DVD-ROM, 1230 ROM, 1240 input/output chip, 1242 keyboard

Claims (28)

an information processing device;
Equipped with a content distribution device and
The information processing device includes:
a first information receiving unit that receives input operation information indicating an input operation input to the communication terminal from each of a plurality of communication terminals owned by each audience member of the live content;
a totalizing unit that totals the input operations indicated by the input operation information received by the first information receiving unit from each of the plurality of communication terminals;
an information transmitting unit that transmits the total results of the input operations compiled by the totaling unit to the content distribution device;
The content distribution device includes:
a storage unit that stores first performance correspondence information that associates a type of input operation to the communication terminal with a performance process for the live content;
a second information receiving unit that receives the total results of the input operations from the information processing device;
a performance processing determining unit that determines a performance process to be executed based on the total result of the input operations received by the second information receiving unit and the first performance correspondence information stored in the storage unit; has
The first information receiving unit receives battery remaining amount information indicating a remaining battery amount of the communication terminal from each of the plurality of communication terminals,
The totaling unit totals the remaining battery amount indicated by the remaining battery amount information received by the first information receiving unit from each of the plurality of communication terminals,
The information transmitting unit transmits a total result of the remaining battery power totaled by the totaling unit to the content distribution device,
The second information receiving unit receives the total result of the battery remaining amount from the information processing device,
The performance processing determining unit executes an event for determining the performance process when the total result of the battery remaining amount received by the second information receiving unit satisfies a predetermined battery remaining amount condition.
Information processing system. The information transmitting unit is configured to send a transmission stop instruction to the plurality of units to stop transmitting the remaining battery level information when the total result of the remaining battery level compiled by the totaling unit does not satisfy the remaining battery level condition. The information processing system according to claim 1, wherein the information processing system transmits to a communication terminal. The aggregating unit aggregates the input operations indicated by the input operation information received by the first information receiving unit from each of the plurality of communication terminals during the performance of the live content,
The performance processing determining unit determines the performance process based on the total result of the input operations compiled by the totaling unit during the performance of the live content.
The information processing system according to claim 1 or 2. 4. The effect processing determining unit determines the effect process associated with an input operation with the largest total number of input operations during a predetermined period. information processing system. Claims 1 to 4, wherein the effect processing determining unit determines the effect process associated with an input operation in which the total number of input operations during a predetermined period is greater than a predetermined total number threshold. The information processing system according to any one of . The aggregation unit is configured to select the input operations for which an input operation flag indicating whether the input operations are valid or invalid among the input operations indicated by the input operation information received from each of the plurality of communication terminals is valid. aggregate operations,
The information processing system according to any one of claims 1 to 5. The aggregation unit aggregates the input operations for each communication terminal,
7. The effect processing determining unit determines the effect process for the communication terminal to which the input operation that satisfies a predetermined input operation condition is input. Information processing system. an information processing device;
Equipped with a content distribution device and
The information processing device includes:
a first information receiving unit that receives input operation information indicating an input operation input to the communication terminal from each of a plurality of communication terminals owned by each audience member of the live content;
a totalizing unit that totals the input operations indicated by the input operation information received by the first information receiving unit from each of the plurality of communication terminals;
a first information transmitting unit that transmits the total results of the input operations compiled by the totaling unit to the content distribution device;
The content distribution device includes:
a storage unit that stores first performance correspondence information that associates a type of input operation to the communication terminal with a performance process for the live content;
a second information receiving unit that receives the total results of the input operations from the information processing device;
a performance processing determining unit that determines a performance process to be executed based on the total result of the input operations received by the second information receiving unit and the first performance correspondence information stored in the storage unit; has
The aggregation unit aggregates the input operations for each communication terminal,
The performance processing determining unit determines a performance process for the communication terminal to which the input operation that satisfies predetermined input operation conditions is input,
The content distribution device further includes a second information transmitting unit that transmits the live content including the production process to the communication terminal to which the input operation that satisfies the input operation condition is input.
Information processing system. The aggregation unit aggregates the input operations indicated by the input operation information received from one of the communication terminals by weighting them more than the input operations indicated by the input operation information received from another communication terminal. The information processing system according to any one of claims 1 to 8. The first information receiving unit receives communication terminal related information including communication terminal related data related to the communication terminal from each of the plurality of communication terminals,
The aggregation unit aggregates the communication terminal related data included in the communication terminal related information received by the first information receiving unit from each of the plurality of communication terminals,
The information transmitting unit transmits a total result of the communication terminal related data compiled by the totaling unit to the content distribution device,
The storage unit stores second performance correspondence information that associates the type of communication terminal related data with a performance process for the live content,
The second information receiving unit receives the aggregation result of the communication terminal related data from the information processing device,
The performance processing determining unit determines a performance to be executed based on the aggregation result of the communication terminal related data received by the second information receiving unit and the second performance corresponding information stored in the storage unit. determine the processing;
The information processing system according to any one of claims 1 to 7 . The first information receiving unit receives communication terminal related information including communication terminal related data related to the communication terminal from each of the plurality of communication terminals,
The aggregation unit aggregates the communication terminal related data included in the communication terminal related information received by the first information receiving unit from each of the plurality of communication terminals,
The first information transmitting unit transmits a total result of the communication terminal related data compiled by the totaling unit to the content distribution device,
The storage unit stores second performance correspondence information that associates the type of communication terminal related data with a performance process for the live content,
The second information receiving unit receives the aggregation result of the communication terminal related data from the information processing device,
The performance processing determining unit determines a performance to be executed based on the aggregation result of the communication terminal related data received by the second information receiving unit and the second performance corresponding information stored in the storage unit. determine the processing;
The information processing system according to claim 8. an information processing device;
Equipped with a content distribution device and
The information processing device includes:
a first information receiving unit that receives input operation information indicating an input operation input to the communication terminal from each of a plurality of communication terminals owned by each audience member of the live content;
a totalizing unit that totals the input operations indicated by the input operation information received by the first information receiving unit from each of the plurality of communication terminals;
an information transmitting unit that transmits the total results of the input operations compiled by the totaling unit to the content distribution device;
The content distribution device includes:
first performance correspondence information that associates a type of input operation to the communication terminal with a performance process for the live content, and associates a type of communication terminal related data related to the communication terminal with a performance process for the live content. a storage unit that stores information corresponding to the second performance;
a second information receiving unit that receives the total results of the input operations from the information processing device;
a performance processing determining unit that determines a performance process to be executed based on the total result of the input operations received by the second information receiving unit and the first performance correspondence information stored in the storage unit; has
The first information receiving unit receives communication terminal related information including the communication terminal related data from each of the plurality of communication terminals,
The aggregation unit aggregates the communication terminal related data included in the communication terminal related information received by the first information receiving unit from each of the plurality of communication terminals,
The information transmitting unit transmits a total result of the communication terminal related data compiled by the totaling unit to the content distribution device,
The second information receiving unit receives the aggregation result of the communication terminal related data from the information processing device,
The performance processing determining unit determines a performance to be executed based on the aggregation result of the communication terminal related data received by the second information receiving unit and the second performance corresponding information stored in the storage unit. determine the processing;
Information processing system. The communication terminal related data includes position data indicating the position of the communication terminal, temperature data indicating the temperature of the communication terminal, moving speed data indicating the moving speed of the communication terminal, and atmospheric pressure detected by the communication terminal. The information processing system according to any one of claims 10 to 12 , comprising at least one of atmospheric pressure data. The information processing system according to any one of claims 1 to 13 , wherein the presentation processing determining unit determines the presentation processing that changes the content of the live content that is XR (Cross Reality) content. The information processing system according to any one of claims 1 to 14 , wherein the performance processing determining unit determines the performance processing that changes the output of equipment used to perform the live content. The first information receiving unit receives, from each of the plurality of communication terminals, the input operation information indicating the input operation detected by at least one of a gyro sensor and an acceleration sensor mounted on the communication terminal. The information processing system according to any one of claims 1 to 15 . a storage unit that stores first performance correspondence information that associates a type of input operation on a communication terminal owned by a live content audience with a performance process for the live content;
an information receiving unit that receives input operation information indicating an input operation input to the communication terminal from each of the plurality of communication terminals;
a totalizing unit that totals the input operations indicated by the input operation information received by the information receiving unit from each of the plurality of communication terminals;
a performance processing determining unit that determines a performance process to be executed based on the total result of the input operations compiled by the totaling unit and the first performance correspondence information stored in the storage unit;
an information transmitting section that transmits performance processing information indicating the performance processing determined by the performance processing determining section;
The information receiving unit receives battery remaining amount information indicating a remaining battery amount of the communication terminal from each of the plurality of communication terminals,
The totaling unit totals the remaining battery power indicated by the remaining battery power information received by the information receiving unit from each of the plurality of communication terminals,
The performance processing determining unit executes an event for determining the performance process when a total result of the remaining battery power totaled by the totaling unit satisfies a predetermined battery remaining power condition.
Information processing device. The information transmitting unit is configured to send a transmission stop instruction to the plurality of units to stop transmitting the remaining battery level information when the total result of the remaining battery level compiled by the totaling unit does not satisfy the remaining battery level condition. The information processing device according to claim 17 , which transmits the information to a communication terminal. a storage unit that stores first performance correspondence information that associates a type of input operation on a communication terminal owned by a live content audience with a performance process for the live content;
an information receiving unit that receives input operation information indicating an input operation input to the communication terminal from each of the plurality of communication terminals;
a totalizing unit that totals the input operations indicated by the input operation information received by the information receiving unit from each of the plurality of communication terminals;
a performance processing determining unit that determines a performance process to be executed based on the total result of the input operations compiled by the totaling unit and the first performance correspondence information stored in the storage unit;
an information transmitting section that transmits performance processing information indicating the performance processing determined by the performance processing determining section;
The aggregation unit aggregates the input operations for each communication terminal,
The performance processing determining unit determines a performance process for the communication terminal to which the input operation that satisfies predetermined input operation conditions is input,
The information transmitting unit transmits the live content including the production process to the communication terminal to which the input operation that satisfies the input operation condition is input, to the communication terminal.
Information processing device. first performance correspondence information that associates the type of input operation on a communication terminal owned by a live content audience with a performance process for the live content; the type of communication terminal related data related to the communication terminal; and the live content. a storage unit that stores second performance correspondence information that associates the performance processing with the performance processing;
an information receiving unit that receives input operation information indicating an input operation input to the communication terminal from each of the plurality of communication terminals;
a totalizing unit that totals the input operations indicated by the input operation information received by the information receiving unit from each of the plurality of communication terminals;
a performance processing determining unit that determines a performance process to be executed based on the total result of the input operations compiled by the totaling unit and the first performance correspondence information stored in the storage unit;
and an information transmitting unit that transmits performance processing information indicating the performance processing determined by the performance processing determining unit based on the first performance corresponding information,
The information receiving unit receives communication terminal related information including the communication terminal related data from each of the plurality of communication terminals,
The aggregation unit aggregates the communication terminal related data included in the communication terminal related information received by the information receiving unit from each of the plurality of communication terminals,
The performance processing determining unit determines a performance process to be executed based on the aggregation result of the communication terminal related data received by the information receiving unit and the second performance corresponding information stored in the storage unit. decided,
The information transmitting unit transmits performance processing information indicating the performance process determined by the performance process determining unit based on the second performance corresponding information,
Information processing device. The communication terminal related data includes position data indicating the position of the communication terminal, temperature data indicating the temperature of the communication terminal, moving speed data indicating the moving speed of the communication terminal, and atmospheric pressure detected by the communication terminal. The information processing device according to claim 20 , comprising at least one of the atmospheric pressure data. A program for causing a computer to function as the information processing device according to any one of claims 17 to 21 . a first information receiving step in which the information processing device receives input operation information indicating an input operation input to the communication terminal from each of a plurality of communication terminals owned by each audience member of the live content;
a totalizing step in which the information processing device totalizes the input operations indicated by the input operation information received from each of the plurality of communication terminals in the first information receiving step;
an information transmitting step in which the information processing device transmits the total results of the input operations compiled in the totaling step to a content distribution device;
a second information receiving step in which the content distribution device receives the aggregated results of the input operations from the information processing device;
The content distribution device includes the aggregation results of the input operations received in the second information receiving step, the types of input operations for the communication terminal, and performance processing for the live content, which are stored in the content distribution device. and a performance processing determining step of determining a performance process to be executed based on the first performance correspondence information that associates the
The first information receiving step includes a step in which the information processing device receives battery remaining amount information indicating the remaining battery amount of the communication terminal from each of the plurality of communication terminals,
The aggregation step includes a step in which the information processing device aggregates the remaining battery amount indicated by the remaining battery amount information received from each of the plurality of communication terminals in the first information receiving step;
The information transmitting step includes a step in which the information processing device transmits a total result of the remaining battery power totaled in the totaling step to the content distribution device,
The second information receiving step includes a step in which the content distribution device receives the aggregation result of the remaining battery amount from the information processing device,
In the effect processing determining step, the content distribution device determines the effect processing when the total result of the battery remaining amount received in the second information receiving step satisfies a predetermined battery remaining amount condition. having a step of executing an event;
Information processing method. An information processing method,
a first information receiving step in which the information processing device receives input operation information indicating an input operation input to the communication terminal from each of a plurality of communication terminals owned by each audience member of the live content;
a totalizing step in which the information processing device totalizes the input operations indicated by the input operation information received from each of the plurality of communication terminals in the first information receiving step;
a first information transmitting step in which the information processing device transmits the total results of the input operations compiled in the totaling step to a content distribution device;
a second information receiving step in which the content distribution device receives the aggregated results of the input operations from the information processing device;
The content distribution device includes the aggregation results of the input operations received in the second information receiving step, the types of input operations for the communication terminal, and performance processing for the live content, which are stored in the content distribution device. and a performance processing determining step of determining a performance process to be executed based on the first performance correspondence information that associates the
The aggregation step includes a step in which the information processing device aggregates the input operations for each communication terminal,
The effect processing determining step includes a step in which the content distribution device determines an effect process for the communication terminal to which the input operation that satisfies a predetermined input operation condition is input,
The information processing method includes a second information transmitting step in which the content distribution device transmits the live content including the production process to the communication terminal to which the input operation that satisfies the input operation condition is input. Further prepare,
Information processing method. a first information receiving step in which the information processing device receives input operation information indicating an input operation input to the communication terminal from each of a plurality of communication terminals owned by each audience member of the live content;
a totalizing step in which the information processing device totalizes the input operations indicated by the input operation information received from each of the plurality of communication terminals in the first information receiving step;
an information transmitting step in which the information processing device transmits the total results of the input operations compiled in the totaling step to a content distribution device;
a second information receiving step in which the content distribution device receives the aggregated results of the input operations from the information processing device;
The content distribution device includes the aggregation results of the input operations received in the second information receiving step, the types of input operations for the communication terminal, and performance processing for the live content, which are stored in the content distribution device. and a performance processing determining step of determining a performance process to be executed based on the first performance correspondence information that associates the
The first information receiving step includes a step in which the information processing device receives communication terminal related information including communication terminal related data related to the communication terminal from each of the plurality of communication terminals,
The aggregation step includes a step in which the information processing device aggregates the communication terminal-related data included in the communication terminal-related information received from each of the plurality of communication terminals in the first information reception step;
The information transmitting step includes a step in which the information processing device transmits the aggregation result of the communication terminal related data compiled in the aggregating step to the content distribution device,
The second information receiving step includes a step in which the content distribution device receives the aggregation result of the communication terminal related data from the information processing device,
In the effect processing determining step, the content distribution device calculates the total result of the communication terminal related data received in the second information receiving step and the type of the communication terminal related data stored in the content distribution device. and second performance correspondence information that associates the performance process with respect to the live content, the step of determining a performance process to be executed.
Information processing method. An information processing method performed by a computer, the method comprising:
an information receiving step of receiving input operation information indicating an input operation input to the communication terminal from each of a plurality of communication terminals owned by each audience member of the live content;
a totalizing step of totalizing the input operations indicated by the input operation information received from each of the plurality of communication terminals in the information receiving step;
Based on the total results of the input operations totaled in the totalization step and first performance correspondence information stored in the computer that associates the type of input operation to the communication terminal with the performance processing for the live content, a performance processing determination stage for determining a performance process to be executed;
an information transmitting step of transmitting presentation processing information indicating the presentation processing determined in the presentation processing determining step;
The information receiving step includes receiving battery remaining amount information indicating the remaining battery amount of the communication terminal from each of the plurality of communication terminals,
The aggregating step includes a step of aggregating the remaining battery power indicated by the remaining battery power information received from each of the plurality of communication terminals in the information receiving step,
The effect processing determining step includes a step of executing an event for determining the effect processing when the total battery remaining amount totaled in the aggregation step satisfies a predetermined battery remaining amount condition.
Information processing method. An information processing method performed by a computer, the method comprising:
an information receiving step of receiving input operation information indicating an input operation input to the communication terminal from each of a plurality of communication terminals owned by each audience member of the live content;
a totalizing step of totalizing the input operations indicated by the input operation information received from each of the plurality of communication terminals in the information receiving step;
Based on the total results of the input operations totaled in the totalization step and first performance correspondence information stored in the computer that associates the type of input operation to the communication terminal with the performance processing for the live content, a performance processing determination stage for determining a performance process to be executed;
an information transmitting step of transmitting presentation processing information indicating the presentation processing determined in the presentation processing determining step;
The aggregation step includes a step of aggregating the input operations for each communication terminal,
The effect processing determining step includes a step of determining an effect process for the communication terminal to which the input operation that satisfies predetermined input operation conditions is input,
The information transmitting step includes transmitting the live content including the production processing to the communication terminal to which the input operation satisfying the input operation condition is input, to the communication terminal.
Information processing method. An information processing method performed by a computer, the method comprising:
an information receiving step of receiving input operation information indicating an input operation input to the communication terminal from each of a plurality of communication terminals owned by each audience member of the live content;
a totalizing step of totalizing the input operations indicated by the input operation information received from each of the plurality of communication terminals in the information receiving step;
Based on the total results of the input operations totaled in the totalization step and first performance correspondence information stored in the computer that associates the type of input operation to the communication terminal with the performance processing for the live content, a performance processing determination stage for determining a performance process to be executed;
an information transmitting step of transmitting performance processing information indicating the performance processing determined based on the first performance corresponding information in the performance processing determining step;
The information receiving step includes receiving communication terminal related information including communication terminal related data related to the communication terminal from each of the plurality of communication terminals,
The aggregating step includes a step of aggregating the communication terminal-related data included in the communication terminal-related information received from each of the plurality of communication terminals in the information receiving step,
The effect processing determining step associates the aggregation result of the communication terminal related data received in the information receiving step with the type of communication terminal related data stored in the computer and the effect processing for the live content. a step of determining a performance process to be executed based on the second performance corresponding information;
The information transmitting step includes a step of transmitting performance processing information indicating the performance processing determined based on the second performance corresponding information in the performance processing determining step.
Information processing method.

Images