WO2023233849A1 - 情報処理装置、情報処理方法及び記録媒体 - Google Patents

情報処理装置、情報処理方法及び記録媒体 Download PDF

Info

Publication number
WO2023233849A1
WO2023233849A1 PCT/JP2023/015342 JP2023015342W WO2023233849A1 WO 2023233849 A1 WO2023233849 A1 WO 2023233849A1 JP 2023015342 W JP2023015342 W JP 2023015342W WO 2023233849 A1 WO2023233849 A1 WO 2023233849A1
Authority
WO
WIPO (PCT)
Prior art keywords
group
distributor
user
unit
information processing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2023/015342
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
孝悌 清水
奈南 沖村
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Group Corp
Original Assignee
Sony Group Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Group Corp filed Critical Sony Group Corp
Priority to DE112023002537.1T priority Critical patent/DE112023002537T5/de
Priority to US18/862,579 priority patent/US20250294223A1/en
Priority to JP2024524228A priority patent/JPWO2023233849A1/ja
Publication of WO2023233849A1 publication Critical patent/WO2023233849A1/ja
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/15—Conference systems
    • H04N7/152—Multipoint control units therefor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/2187—Live feed
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25866—Management of end-user data
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor

Definitions

  • the present disclosure relates to an information processing device, an information processing method, and a recording medium.
  • Patent Document 1 discloses a technology that provides feedback to a performer (distributor) of the movement and emotional reaction data of a viewer (user) avatar in response to the movements of a performer (distributor) avatar using display formats, tactile sensations, etc. ing.
  • a communication unit that transmits distribution content provided by a distributor to a plurality of user terminals; or a group selection unit that selects a first group that is two or more groups, and a connection control unit that controls connection so that users belonging to the first group and the distributor can communicate bidirectionally;
  • An information processing device is provided.
  • distribution content provided by a distributor is distributed to a plurality of user terminals, and a third group that is one or more groups is selected from a plurality of groups to which two or more users each belong.
  • an information processing method executed by a computer the method comprising: selecting one group; and controlling a connection so that a user belonging to the first group and the distributor can communicate in both directions; provided.
  • a distribution unit that distributes distribution content provided by a distributor to a plurality of user terminals, and one or more groups to which two or more users each belong.
  • a computer-readable non-transitory recording medium is provided having recorded thereon.
  • FIG. 1 is an explanatory diagram of an overview of an information processing system according to the present disclosure.
  • FIG. 3 is an image diagram of two-way communication by the distribution server 30 according to the present disclosure.
  • FIG. 1 is a block diagram showing an example of the configuration of a distributor terminal 10 according to the present embodiment.
  • FIG. 2 is a block diagram showing an example of the configuration of a user terminal 20 according to the present embodiment.
  • FIG. 2 is a block diagram showing an example of the configuration of a distribution server 30 according to the present embodiment.
  • 3 is an explanatory diagram showing a specific example of connection control by a connection control unit 324.
  • FIG. 7 is an explanatory diagram for explaining screen images of each terminal in the specific example of FIG. 6.
  • FIG. 7 is an explanatory diagram showing another specific example of connection control by the connection control unit 324.
  • FIG. It is a flowchart showing an example of the operation of the distribution server 30 according to the present embodiment.
  • 12 is a flowchart illustrating an operational example of implementing bidirectional communication controlled by the distribution server 30 according to the present embodiment.
  • FIG. 7 is an explanatory diagram for explaining an example of a screen image of each terminal in a first modified example of the present disclosure.
  • 12 is a flowchart illustrating an operational example of implementing bidirectional communication controlled by the distribution server 30 according to a first modification of the present disclosure.
  • FIG. 2 is a block diagram illustrating a hardware configuration example of an information processing device 900 that implements a distributor terminal 10, a user terminal 20, and a distribution server 30 according to an embodiment of the present disclosure.
  • One embodiment of the present disclosure relates to an information processing system including an information processing device that can improve the user's experience value in live distribution.
  • an information processing system that transmits distributed content provided by a distributor to a user will be described.
  • the distribution content provided by the distributor is, for example, entertainment content such as live music, comedy shows, and online games, remote education content, remote support content, remote training lessons, etc., and the contents of the content are not limited.
  • entertainment content such as live music, comedy shows
  • remote education content such as live music, comedy shows
  • remote support content remote training lessons, etc.
  • FIG. 1 is an explanatory diagram of an overview of an information processing system according to the present disclosure.
  • the information processing system according to the present disclosure includes a distributor terminal 10 used by a distributor D, a plurality of user terminals 20 used by each of a plurality of users U, and a distribution server 30.
  • the distributor terminal 10, the user terminal 20, and the distribution server 30 are configured to be able to communicate via the network 40.
  • each of the users U belongs to one of the groups G among the plurality of groups G.
  • the distributor terminal 10 is an information processing terminal used by the distributor D. Video, audio, text, or movement is input to the distributor terminal 10. The distributor terminal 10 transmits information indicating input video, audio, text, movement, etc. to the distribution server 30.
  • the distributor terminal 10 may be composed of a plurality of information processing terminals, or may be a single information processing terminal.
  • the distributor terminal 10 is a PC (Personal Computer), and a camera 11 is connected to the distributor terminal 10.
  • the distributor terminal 10 shown in FIG. 1 transmits image data of the distributor D obtained by the camera 11 to the distribution server 30.
  • the distributor terminal 10 is configured of various devices such as a tablet terminal, a smartphone, an HMD (Head Mounted Display), a game terminal, a television device, a wearable device, a motion capture device, and a microphone, or a combination of the above-mentioned various devices. It's okay.
  • the distributor terminal 10 may have the function of the camera 11 built-in.
  • the user terminal 20 is an information processing terminal used by the user U. Video, audio, text, or movement is input to the user terminal 20 .
  • the user terminal 20 transmits information indicating input video, audio, text, movement, etc. to the distribution server 30.
  • the user terminal 20 receives distributed content provided by the distributor D from the distribution server 30. Further, the user terminal 20 performs output processing to enable the user U to view the distributed content received from the distribution server 30.
  • user U1 uses user terminal 20-1.
  • user U2 uses user terminal 20-2
  • user U3 uses user terminal 20-3.
  • Users U1 to U3 may be viewing the distributed content at different locations, or may be viewing the distributed content at the same location.
  • the user terminal 20 may be composed of a plurality of information processing terminals, or may be a single information processing terminal.
  • FIG. 1 shows an example in which the user terminal 20-1 is an HMD, the user terminal 20-2 is a PC, and the user terminal 20-3 is a smartphone. In addition to the example shown in FIG.
  • the user terminal 20 may include various devices such as a tablet terminal, a game terminal, a television device, a wearable device, a camera, a motion capture device, and a microphone, or a combination of the above-mentioned devices. Good too.
  • each of the users U who use the user terminal 20 belongs to one of the groups G among the plurality of groups G.
  • user U1, user U2, and user U3 belong to group G1.
  • user U4, user U5, and user U6 belong to group G2.
  • the number of users belonging to group G is three, but the number of users U belonging to group G may be any number of two or more.
  • the number of users U belonging to group G may be, for example, 3 to 6, which is a suitable number for communication. Further, the number of users U belonging to group G may be different for each group G.
  • the number of groups G is not particularly limited, and may be determined according to the number of users U.
  • the distribution server 30 is an information processing device that transmits distribution content provided by the distributor D to the user terminal 20.
  • the distribution content transmitted to the user terminal 20 may be data such as video, audio, text, etc. transmitted from the distributor terminal 10. Further, the distribution server 30 may transmit information on the virtual space and information on a distributor object corresponding to the distributor D placed in the virtual space to the user terminal 20 as distribution content.
  • the distribution server 30 can realize live distribution by transmitting the distribution content provided by the distributor D to the user terminal 20 in real time. Note that the distribution server 30 may realize live distribution by transmitting virtual space information to the user terminal 20 in advance and transmitting distributor object information to the user terminal 20 in real time.
  • FIG. 2 is an image diagram of two-way communication by the distribution server 30 according to the present disclosure.
  • users U belonging to groups G1-G4 are provided with conventional unidirectional distribution.
  • the user U belonging to the group G5 is provided with a distribution accompanied by a special experience in which the user can communicate interactively with the distributor D.
  • the experience of users U belonging to groups G1 to G4 is like watching the alter ego of broadcaster D
  • the experience of user U belonging to group G5 is two-way communication with broadcaster D. It is an experience that is like watching the reality of broadcaster D.
  • the distribution server 30 of the embodiment according to the present disclosure can meet the needs of users who cannot participate in events held offline.
  • the distribution server 30 selects one or more groups G from a plurality of groups G.
  • the distribution server 30 realizes two-way communication between the user U and the distributor D by transmitting data such as video, audio, text, etc. transmitted from the user U belonging to the selected group G to the distributor terminal 10. You may.
  • the distribution server 30 transmits the information of the user object corresponding to the user U, which is transmitted from the user U belonging to the selected group G, to the distributor terminal 10, so that the user U and the distributor D can interact with each other. Communication may be realized.
  • FIG. 3 is a block diagram showing an example of the configuration of the distributor terminal 10 according to the present embodiment.
  • the distributor terminal 10 includes a communication section 110, a control section 120, an input section 130, an output section 140, and an operation section 150.
  • the communication unit 110 communicates with the distribution server 30 and sends and receives data. For example, the communication unit 110 distributes information indicating video, audio, or movement acquired by the input unit 130, information such as characters input to the operation unit 150, or information on a distributor object corresponding to distributor D. Send to server 30. The communication unit 110 also receives information indicating video, audio, or text, information on a user object corresponding to the user U, information on a virtual space, etc. from the distribution server 30.
  • the control unit 120 controls the overall operation of the distributor terminal 10. For example, the control unit 120 causes the communication unit 110 to transmit information indicating video, audio, movement, etc. acquired by the input unit 130, or information such as characters input to the operation unit 150. Further, the control unit 120 causes the output unit 140 to output the video, audio, text, virtual space information, etc. received from the distribution server 30 by the communication unit 110.
  • the control unit 120 generates information on the distributor object based on information indicating the video or movement, etc., input to the input unit 130.
  • the distributor object may be, for example, a 3D or 2D live-action avatar, or a 3D or 2D CG character.
  • control unit 120 updates the information on the distributor object based on the motion information input to the input unit 130, which is information indicating motion. For example, when the hand movement information of distributor D is input to the input unit 130, the control unit 120 updates the information on the distributor object so that the distributor object moves its hand. When the facial movement information of distributor D is input to the input unit 130, the control unit 120 may update the information on the distributor object so as to change the facial expression of the distributor object.
  • the control unit 120 may hold the virtual space information received from the distribution server 30. Further, the control unit 120 may perform a process of newly generating virtual space information by arranging the distributor object indicated by the generated distributor object information in the virtual space. Further, the control unit 120 may perform a process of generating new virtual space information by arranging the user object indicated by the user object information received by the communication unit 210 in the virtual space.
  • the control unit 120 may generate information about the virtual space in which the user object is placed from the viewpoint of the distributor object.
  • the virtual space of the viewpoint of the distributor object may or may not include the distributor object.
  • the input unit 130 acquires information indicating video, audio, text, movement, etc. detected by the sensor.
  • the input unit 130 may acquire information detected by a sensor such as a camera, microphone, keyboard, mouse, touch pad, IMU (Inertial Measurement Unit), IR sensor, or biosensor.
  • a sensor such as a camera, microphone, keyboard, mouse, touch pad, IMU (Inertial Measurement Unit), IR sensor, or biosensor.
  • the input unit 130 obtains, for example, an image of the distributor D captured by the camera 11. Furthermore, the input unit 130 may acquire the voice of the distributor D detected by the microphone or the sound emitted by the distributor D. The input unit 130 also inputs information related to the broadcaster object in the virtual space, detected by the keyboard and input by the broadcaster D, such as position information or motion information of the broadcaster object, or information on the property of the broadcaster object. Information etc. may also be acquired. In addition, the input unit 130 may acquire information on the movement (position, posture, limb movement, head movement, etc.) of the distributor D detected by the IMU, or information on the distributor D's movement detected by the camera. Information such as facial movements (eye, eyebrow, mouth movements, etc.) and line of sight movements may be acquired. Note that the input unit 130 may acquire information input by multiple types of sensors.
  • the output unit 140 has a function of outputting information etc. received from the distribution server 30 by the communication unit 110.
  • the output unit 140 may be realized by a 2D display, a 3D display, a projector, a stereoscopic hologram presentation device, or the like.
  • the output unit 140 may display information about the virtual space as an image on a 2D display.
  • the output unit 140 may be a sound output device such as a speaker or headphones. Further, the output unit 140 may be configured by a combination of the various devices described above.
  • the operation unit 150 receives an operation by the distributor D to input instructions or information to the distributor terminal 10.
  • the distributor D may use characters input by operating the operation unit 150 as part of the distributed content.
  • the distributor D may select a group G with which to perform two-way communication by operating the operation unit 150.
  • the operation unit 150 may receive instructions for operations performed by the distribution server 30.
  • the operation unit 150 may receive an instruction to start live distribution.
  • the operation unit 150 may receive an instruction to transition to a scene where the broadcaster D and the user U can communicate bidirectionally during live distribution.
  • live distribution is performed by distinguishing between scenes where two-way communication is difficult, such as live music performances, and scenes where two-way communication is possible. Is possible.
  • FIG. 4 is a block diagram showing an example of the configuration of the user terminal 20 according to this embodiment.
  • the user terminal 20 includes a communication section 210, a control section 220, an input section 230, an output section 240, and an operation section 250.
  • the communication unit 210 communicates with the distribution server 30 and sends and receives data. For example, the communication unit 210 transmits video, audio, or movement information acquired by the input unit 230, information such as characters input to the operation unit 250, or information on a user object corresponding to the user U to the distribution server 30. Send.
  • the communication unit 210 also receives information indicating video, audio, and text, information on a distributor object corresponding to distributor D, information on virtual space, etc. from the distribution server 30.
  • the information received from the distribution server 30 includes distribution content provided by the distributor D.
  • the information indicating video, audio, and text that the communication unit 210 receives from the distribution server 30 may include information transmitted from another user U who belongs to the same group G as the user U. Further, the communication unit 210 may receive information on user objects corresponding to other users U who belong to the same group G as the user U from the distribution server 30.
  • the control unit 220 controls the overall operation of the user terminal 20. For example, the control unit 220 causes the communication unit 210 to transmit information indicating video, audio, movement, etc. acquired by the input unit 230, and information such as characters input to the operation unit 150. Further, the control unit 220 causes the output unit 240 to output the video, audio, text, virtual space information, etc. received from the distribution server 30 by the communication unit 210.
  • the control unit 220 generates user object information based on the information indicating the video or movement, etc., input to the input unit 230.
  • the user object may be, for example, a 3D or 2D live-action avatar, or a 3D or 2D CG character.
  • control unit 220 updates the information of the user object based on motion information, which is information indicating movement, input to the input unit 230. For example, when user U's hand movement information is input to the input unit 230, the control unit 220 updates the user object information so that the user object moves its hand. When the facial movement information of the user U is input to the input unit 230, the control unit 220 may update the information of the user object so as to change the facial expression of the user object.
  • the control unit 220 may hold the virtual space information received from the distribution server 30. Further, the control unit 220 may perform a process of newly generating virtual space information by arranging the user object indicated by the generated user object information in the virtual space. Furthermore, the control unit 220 creates a new virtual space by placing the distributor object and user object indicated by the distributor object information and user object information received by the communication unit 210 in the virtual space. Processing to generate information may also be performed.
  • the control unit 220 may generate information about the virtual space in which the distributor object and other user objects are placed from the user object's perspective.
  • the user object may or may not be included in the virtual space of the user object's viewpoint.
  • the input unit 230 acquires information indicating video, audio, text, movement, etc. detected by the sensor.
  • the input unit 230 may acquire information detected by a sensor such as a camera, microphone, keyboard, mouse, touch pad, IMU, IR sensor, or biosensor.
  • the input unit 230 obtains, for example, an image of the user U captured by a camera. Furthermore, the input unit 230 may acquire the voice of the distributor D detected by the microphone or the sound emitted by the distributor D. The input unit 230 also provides information about the user object in the virtual space detected by the keyboard and input by the user U into the keyboard, such as position information or motion information of the user object, or information about possessions of the user object, etc. may be obtained. In addition, the input unit 230 may acquire information on the user U's movements (position, posture, limb movements, head movements, etc.) detected by the IMU, or the user U's face acquired by the camera. Information such as movement of the user (eye, eyebrow, mouth movement, etc.) and line of sight movement may also be acquired. Note that the input unit 230 may acquire information input by multiple types of sensors.
  • the output unit 240 has a function of outputting information etc. received from the distribution server 30 by the communication unit 210.
  • the output unit 240 may be realized by a 2D display, a 3D display, a projector, a stereoscopic hologram presentation device, or the like.
  • the output unit 240 may display information about the virtual space as an image on a 2D display.
  • the output unit 240 may be a sound output device such as a speaker or headphones. Further, the output unit 240 may be configured by a combination of the various devices described above.
  • the operation unit 250 receives an operation by the user U to input instructions or information to the user terminal 20. Instructions and information input into the operation unit 250 are transmitted to the distribution server 30 by the communication unit 210. For example, by operating the operation unit 250, the user U may use a chat function to transmit a reaction to the distributed content in real time in the form of text or stamps. Alternatively, the user U may use a so-called tipping system in which the user U sends an item that can be exchanged for cash to the distributor D in the distributed content by operating the operation unit 250.
  • the user U may specify the group G to which he or she belongs by operating the operation unit 250.
  • the user U may specify the group G to which he or she belongs, for example, by inputting the group ID into the operation unit 250.
  • the user U may input his or her own profile information by operating the operation unit 250.
  • the profile information includes information such as user U's gender, age, and music preferences, for example.
  • the user U may select a genre for viewing the live distribution from among the genres displayed on the output unit 240.
  • FIG. 5 is a block diagram showing an example of the configuration of the distribution server 30 according to this embodiment. As shown in FIG. 5, the distribution server 30 includes a communication section 310 and a control section 320.
  • the communication unit 310 communicates with the distributor terminal 10 and the user terminal 20 via the network 40.
  • the communication unit 310 communicates with the distributor terminal 10 and the user terminal 20 under the control of the connection control unit 324.
  • the communication unit 310 transmits distributed content provided by distributor D to a plurality of user terminals 20.
  • the control unit 320 controls the overall operation of the distribution server 30.
  • the control unit 320 controls operations in the distribution server 30, for example, in response to instructions received from the distributor terminal 10 by the communication unit 310.
  • the control unit 320 functions as a group selection unit 321, a calculation unit 322, a virtual space generation unit 323, and a connection control unit 324.
  • the group selection unit 321 selects one or more groups G from a plurality of groups G to which two or more users U belong. For example, the group selection unit 321 selects the first group, which is the group G that has the right to have two-way communication with the distributor D, from the plurality of groups G.
  • a connection control unit 324 which will be described later, controls the connection so that the user U and the distributor D who belong to the first group can communicate in both directions.
  • the group selection unit 321 may select the group G based on, for example, conditions related to the degree of excitement or contribution calculated by the calculation unit 322, which will be described later.
  • the group selection unit 321 may select group G based on an instruction from the distributor terminal 10 received by the communication unit 310.
  • the group selection unit 321 may newly select group G based on predetermined conditions. For example, the group selection unit 321 may newly select group G based on conditions related to the degree of excitement or contribution calculated by the calculation unit 322, which will be described later. Specifically, the group selection unit 321 may newly select the group G with the highest degree of excitement or contribution. Alternatively, the group selection unit 321 may newly select the group G based on whether the group has been selected by the distributor D or not. In that case, the group selection unit 321 reselects the group G based on the instruction from the distributor terminal 10 received by the communication unit 310.
  • the group selection unit 321 may reselect a new group G based on the time that has passed since a certain group G was selected. For example, the group selection unit 321 may sequentially reselect the groups G so that the time from when the group G is selected until when a new group G is selected is equal for each group G. Furthermore, the group selection unit 321 may sequentially reselect the groups G such that the group G with a higher degree of excitement or contribution takes longer to be selected.
  • the number of groups G selected by the group selection section 321 may be a predetermined number, or may be dynamically changed based on the load status of communication performed by the communication section 310. Further, the number of groups G selected by the group selection section 321 may be determined based on calculation results by the calculation section 322, which will be described later. For example, the group selection unit 321 may determine the number of selections of group G based on the average value of the excitement level or contribution level of group G.
  • the group selection unit 321 has a function of determining users U who belong to each group G.
  • the group selection unit 321 may randomly determine the users U belonging to each group G.
  • the group selection unit 321 may decide to make the users U whose profile information matches belong to the same group G based on the profile information of each user U transmitted by the user terminal 20. Further, the group selection unit 321 may determine the users U belonging to the group G based on the designation of the group G to which the user U belongs, which is transmitted from the user terminal 20.
  • the calculation unit 322 calculates the degree of excitement or contribution of each user U belonging to the same group G based on the communication between the users U belonging to the same group G.
  • the calculation unit 322 calculates the excitement level of the user U based on the video, audio, text, or movement input to the user U, for example. Specifically, the calculation unit 322 may calculate the excitement level of the user U such that the longer the time for which the user U inputs the voice, the higher the excitement level of the user U becomes. Further, the calculation unit 322 may calculate the excitement level of the user U such that the more characters input by the user U, the higher the excitement level of the user U becomes.
  • the calculation unit 322 may calculate the degree of contribution of the user U based on how much the video, audio, text, or movement input by the user U matches the conditions specified by the distributor D. Specifically, the calculation unit 322 may calculate the degree of contribution of the user U based on whether the keyword specified by the distributor D has been input by the user U. Further, the calculation unit 322 may calculate the degree of contribution of the user U such that the more the billed amount in the tipping system used by the user U becomes, the higher the degree of contribution of the user U becomes.
  • the calculation unit 322 may calculate the degree of excitement or contribution of each of the plurality of groups G based on communication between users U belonging to the same group G. For example, the calculation unit 322 may calculate the excitement level or contribution level of group G by adding up the excitement level or contribution level of each user U belonging to group G.
  • the degree of excitement and contribution of the user U or group G calculated by the calculation unit 322 may be transmitted to the user terminal 20 by the communication unit 310 and displayed on the user terminal 20.
  • a ranking table of the excitement level of group G may be displayed on the user terminal 20.
  • the group selection unit 321 selects a new group G that is capable of two-way communication with the distributor D based on the conditions regarding the level of excitement, the user U can determine how he or she will behave by checking the ranking table. You can decide. That is, by displaying the degree of excitement or contribution calculated by the calculation unit 322 on the user terminal 20, it is possible to further enhance the sense of realism of live distribution.
  • the virtual space generation unit 323 generates a virtual space in which the distributor object and the user object are placed.
  • the virtual space generation unit 323 may determine the placement location of the object corresponding to the distributor D or the user U in the virtual space.
  • the virtual space generation unit 323 may place an object corresponding to the distributor D or the user U in the virtual space.
  • the virtual space generation unit 323 may generate a distributor object and a user object based on information indicating video, movement, etc. received from the distributor terminal 10 or the user terminal 20.
  • connection control unit 324 controls communication of the communication unit 310.
  • the connection control unit 324 controls the connection so that the user U and the distributor D who belong to the group G selected by the group selection unit 321 can communicate bidirectionally.
  • the connection control unit 324 causes the communication unit 310 to transmit information on a user object transmitted from a user U belonging to a group G selected by the group selection unit 321 to a distributor terminal 10 used by a distributor D. May be controlled.
  • the connection control unit 324 may transmit information such as video, audio, or text transmitted from the user U belonging to the group G selected by the group selection unit 321 to the distributor terminal 10.
  • FIG. 6 is an explanatory diagram showing a specific example of connection control by the connection control unit 324.
  • the group selection unit 321 selects the group G1 as the group G that can communicate with the distributor D in both directions.
  • the distributor terminal 10 transmits distributor data Y to the distribution server 30. Further, the user terminal 20 transmits user data X to the distribution server 30. Distributor data Y and user data X each include distributor object information and user object information.
  • Distributor data Y and user data X each include distributor object information and user object information.
  • distribution content C1 transmitted to user terminal 20-1 includes user data X2 and X3 and distributor data Y.
  • the connection control unit 324 controls the connection so that the user U and the distributor D who belong to the group G1 selected by the group selection unit 321 can communicate in both directions.
  • the connection control unit 324 controls communication so that the information CD that includes user data X1 to X3 and is sent to the distributor terminal 10 is transmitted to the distributor terminal 10.
  • the user U belonging to the group G1 can communicate with the distributor D in both directions.
  • the distributor data Y and the user data Two-way communication with high experiential value is provided.
  • FIG. 7 is an explanatory diagram for explaining screen images of each terminal in the specific example of FIG. 6.
  • Video of the virtual space V in which the distributor object OD and the user object O are arranged is output to the screens of the distributor terminal 10 and the user terminal 20.
  • the video of the virtual space V1 generated by the control unit 220 of -1 is output.
  • the screen of the distributor terminal 10 also displays the virtual space V1 generated by the control unit 120 of the distributor terminal 10 based on the user data X1 to X3 and the distributor data Y.
  • the video is output.
  • connection control unit 324 controls the distribution contents C4 to C6 including user data X and distributor data Y transmitted from other users belonging to the group G2 to be transmitted to the users U4 to U6, respectively. Therefore, users U4 to U6 can communicate with each other. On the other hand, since the information CD sent to the distributor terminal 10 does not include the user data X4 to X6, the user U belonging to the group G2 cannot communicate with the distributor D in both directions.
  • the screen of the user terminal 20-4 shown in FIG. Based on this, the video of the virtual space V2 generated by the control unit 220 of the user terminal 20-4 is output.
  • FIG. 8 is an explanatory diagram showing another specific example of connection control by the connection control unit 324.
  • the communication performed by the distributor terminal 10 and the user terminals 20-1 to 20-3, which is controlled by the connection control unit 324 is the same as in the specific example described using FIG. be.
  • the connection control unit 324 controls not to receive user data X from user terminals 20 belonging to group G2 that are not selected by the group selection unit 321.
  • the connection control unit 324 controls the distribution contents C4 to C6 including only the distributor data Y to be transmitted to each of the users U4 to U6.
  • connection control unit 324 selects which live distribution among the plurality of live distributions the distribution content is transmitted to the user based on the genre selected by the user U, which is received from the user terminal 20 by the communication unit 310. It may also be determined whether to transmit it to the terminal 20. In that case, the connection control unit 324 controls the connection of the communication unit 310 based on the determination. Furthermore, if live distribution regarding the genre selected by user U is not being performed, the connection control unit 324 allows users U belonging to the same group G to communicate with each other until the live distribution starts. The connection may be controlled so that
  • FIG. 9 is a flowchart showing an example of the operation of the distribution server 30 according to this embodiment.
  • each user U specifies the group G to which he/she belongs and logs into the distribution system for viewing the distribution content provided by the distributor D (S104).
  • the group selection unit 321 of the distribution server 30 determines the users U who belong to each group G based on the designation of the group G to which the user U belongs, which is received by the communication unit 310.
  • each user U selects a genre in which to view the live distribution by operating the user terminal 20 (S108).
  • the connection control unit 324 controls communication by the communication unit 310 so that users U belonging to the same group G can communicate with each other. For example, the connection control unit 324 transmits user object information, video, and audio received from user terminals 20 used by other users U belonging to the same group G to the user terminals 20 used by users U belonging to the same group G. , controls communication by the communication unit 310 to transmit information such as characters.
  • the output unit 240 of the user terminal 20 outputs a video of a virtual space including user objects corresponding to other users U belonging to the group G. User U communicates with other users U belonging to the same group G (S112).
  • the user U When the instruction from the distributor terminal 10 is received by the communication unit 310 and the live distribution by the distributor D regarding the genre selected by the user U is started (S116/Yes), the user U is given a message from the distributor D. Unidirectional delivery is provided. Specifically, the output unit 240 of the user terminal used by the users belonging to each group G outputs the video of the virtual space including the distributor object received from the distribution server 30 by the communication unit 210. Furthermore, the communication unit 310 of the distribution server 30 transmits information such as video, audio, text, etc. received from the distributor terminal 10 to each user terminal 20.
  • control unit 320 causes the user U and the distributor D to perform two-way communication. control (S124).
  • FIG. 10 is a flowchart illustrating an operational example of implementing bidirectional communication controlled by the distribution server 30 according to the present embodiment.
  • the group selection unit 321 selects a group G that performs two-way communication with the distributor D. (S128).
  • the connection control unit 324 controls the communication in the communication unit 310 so that the user U who belongs to the group G who has the right to have two-way communication with the distributor D can communicate with the distributor D (S132).
  • the connection control unit 324 controls the user object information transmitted from the user U belonging to the group G selected by the group selection unit 321 to be transmitted to the distributor terminal 10 used by the distributor D.
  • the connection control unit 324 transmits information such as video, audio, text, etc. transmitted from the user U belonging to the group G selected by the group selection unit 321 to the distributor terminal 10.
  • the control unit 320 When the group selection unit 321 newly selects the group G that has the right to bidirectional communication (S136/Yes), the control unit 320 returns the process to S132 again, and the connection control unit 324 selects the newly selected group G.
  • the user U belonging to G and the distributor D are controlled to be able to communicate.
  • the process proceeds to S140.
  • the process proceeds to S144 in FIG. If the scene in which two-way communication with the distributor D is possible does not end (S140/No), the control unit 320 returns the process to S136 again.
  • the distribution server 30 receives the instruction from the distributor terminal 10 through the communication unit 310, and repeats the operations of S136 to S140 until the scene in which two-way communication with the distributor D is possible ends.
  • the control unit 320 controls to end the live distribution. . After the live distribution ends, the control unit 320 returns the process to S112 again.
  • the control unit 320 causes the communication unit 310 to transmit the information from the user terminals 20 to each It is determined whether a new selection of user U's favorite genre has been received. When user U newly selects a favorite genre (S152/Yes), control unit 320 returns the process to S112 again. Even when a favorite genre is not newly selected by user U (S152/No) and the communication unit 310 does not receive a selection to log out from the distribution system from the user terminal 20 (S156/No), the control unit 320 , the process returns to S112 again. When the communication unit 310 receives a selection of logout from the distribution system from the user terminal 20 (S156/Yes), the control unit 320 logs out the user U who uses the user terminal 20 from the distribution system (S160).
  • the distribution server 30 according to the present disclosure allows users U belonging to the same group G to communicate with each other.
  • a configuration may be considered in which information such as text or audio received from the user U who views the live broadcast is transmitted to all the users U.
  • the users U receive all the calls from other users U, there is a possibility that the information sends from the other users U will feel like a nuisance.
  • the distribution server 30 according to the present disclosure since the user terminal 20 only receives information transmission from a limited number of users U, it is possible to provide comfortable live distribution to the users U.
  • the user U when receiving information from the user terminal 20 about the group G to which the user U using the user terminal 20 belongs, it is possible to determine that a plurality of users U belong to the same group G. In this case, the user U can only receive information sent from other users U that the user U knows, and it is possible to further increase the value of the user U's experience.
  • the communication unit 310 transmits the information on the user object transmitted from the user U belonging to the group G to the distributor terminal 10 and the user terminal 20.
  • a configuration may also be considered in which information on user objects corresponding to all users U who view live distribution is transmitted to the distributor terminal 10 and the user terminal 20.
  • the rendering load of the virtual space by the distributor terminal 10 and the user terminal 20 can be reduced compared to the comparative example.
  • the communication load between the distributor terminal 10, the user terminal 20, and the distribution server 30 can be reduced.
  • the group selection unit 321 reselects a new group G that has the right to communicate with the distributor D based on predetermined conditions. According to this configuration, more users U can perform two-way communication with the distributor D, although the number of channels on which two-way communication is possible is limited. For example, even if the distributed content is live distributed to tens of thousands of people, the value of the experience for many users U can be increased by having Group G, who has the right to communicate interactively, making the rounds.
  • Modification example according to this embodiment >> The operation example of the distribution server 30 according to this embodiment has been described above.
  • the technology according to the present disclosure is not limited to the embodiments described above.
  • a modified example of the distribution server 30 according to the present disclosure will be described with reference to FIGS. 11 and 12.
  • the group selection unit 321 further has a function of selecting a second group, which is one or more groups, from the plurality of groups G that have not been selected as the group G with the right to bidirectional communication.
  • a connection control unit 324 which will be described later, controls the connection so that the communication between the users U belonging to the monitored group G, which is the second group, is transmitted to the distributor D.
  • the group selection unit 321 may reselect a new group G to be monitored based on predetermined conditions. For example, the group selection unit 321 may reselect a new group G to be monitored based on an instruction from the distributor terminal 10 received by the communication unit 310.
  • the group selection unit 321 may reselect a new group G to be monitored based on the time that has passed since a certain group G to be monitored was selected. For example, the group selection unit 321 selects groups G to be monitored one after another so that the time it takes to select a new group G to be monitored after group G is selected is equal for each group G to be monitored. You can fix it.
  • the connection control unit 324 further has a function of controlling the connection so that the communication between the users U belonging to the group G to be monitored is transmitted to the distributor D.
  • the connection control unit 324 transmits information on the user object corresponding to the user U belonging to the monitoring target group G selected by the group selection unit 321 to the distributor terminal 10 used by the distributor D for monitoring.
  • the communication unit 310 may be controlled in such a manner.
  • the screen of the distributor terminal 10 displays an image of a virtual space including user objects belonging to group G that can communicate bidirectionally with distributor D, and a video of a virtual space including user objects belonging to group G to be monitored. Both images of the virtual space are displayed.
  • the connection control unit 324 may transmit information such as video, audio, or text transmitted from the user U belonging to the monitoring target group G selected by the group selection unit 321 to the distributor terminal 10. .
  • FIG. 11 is an explanatory diagram for explaining an example of a screen image of each terminal in the first modification of the present disclosure.
  • user U who uses user terminal 20-1 belongs to group G1
  • user U who uses user terminal 20-3 belongs to group G2
  • user U who uses user terminal 20-4 belongs to group G1.
  • group G3 belongs to group G3.
  • group selection unit 321 selects the group G1 as the group G that can communicate with the distributor D in both directions.
  • group selection unit 321 selects group G2 as group G to be monitored.
  • a video of the virtual space VD in which the distributor object OD and the user object O corresponding to the user U belonging to the group G1 are arranged is output. Further, on the screen of the distributor terminal 10, an image of the monitoring virtual space VO in which the distributor object OD and the user object O corresponding to the user U belonging to the group G2 are arranged is output.
  • users U belonging to groups G2 and G3 are provided with conventional unidirectional distribution.
  • Distributor D communicates with user U belonging to group G1 while viewing the video in virtual space VD.
  • the distributor D checks the video of the monitoring virtual space VO and monitors the communication between the users U belonging to the group G2, which is the group G to be monitored.
  • the distributor D can use the video of the virtual space including the user object belonging to the group G to be monitored as a material for determining the selection of the group G with which the distributor D can communicate bidirectionally.
  • the group selection unit 321 reselects a new group G to be monitored, the video of the virtual space VO for monitoring is switched to the video of a virtual space that includes user objects belonging to other groups G.
  • FIG. 12 is a flowchart illustrating an operational example of implementing bidirectional communication controlled by the distribution server 30 according to the first modification of the present disclosure.
  • connection control unit 324 transmits communication between users U belonging to group G to be monitored to distributor D.
  • the connection is controlled as follows (S134).
  • the control unit 320 returns the process to S134 again.
  • the connection control unit 324 controls the connection so that the communication between the users U belonging to the newly selected group G to be monitored is transmitted to the distributor D.
  • the control unit 320 determines whether a group G with two-way communication rights has been newly selected ( S136).
  • the distributor D can determine which group G has a new right to bidirectional communication based on the content of the communication between the users U belonging to the group G to be monitored.
  • the control unit 320 returns the process to S132 again.
  • the process proceeds to S140.
  • the control unit 320 In response to an instruction from the distributor terminal 10 received by the communication unit 310, if the scene in which two-way communication is possible ends (S140/Yes), the process proceeds to S144 in FIG. If the scene in which two-way communication with the distributor D is possible does not end (S140/No), the control unit 320 returns the process to S135.
  • the distribution server 30 receives the instruction from the distributor terminal 10 through the communication unit 310, and repeats the operations from S132 to S140 until the scene in which two-way communication with the distributor D is possible ends.
  • Second modification> The operation example of the distribution server 30 according to the first modified example of the present disclosure has been described above with reference to FIG. 12. Next, a second modification according to the present disclosure will be described.
  • the virtual space generation unit 323 arranges only the broadcaster object and the user object corresponding to the user U belonging to the group G.
  • a specific virtual space is created.
  • the specific virtual space may be a space that matches the scenario of the distributed content. Scenarios of the distributed content include, for example, a talk session, sightseeing tour, drive, boat ride, fireworks display, exhibition tour, and museum tour. For example, if the scenario of the distributed content is a drive, the specific virtual space is inside a car.
  • the virtual space generation unit 323 selects a plurality of locations in the virtual space for each of the user objects representing the user U belonging to the group G selected by the group selection unit 321, which have different experience values regarding communication with the distributor D. It may be determined from the type of location. For example, when the virtual space generated by the virtual space generation unit 323 is inside the car described above, the virtual space generation unit 323 determines to place the distribution object in the driver's seat, and It may be determined that the corresponding user objects are placed in the front passenger seat or the back seat, respectively.
  • the user terminal 20 may perform a process of generating virtual space information according to the placement location of the user object determined by the virtual space generation unit 323.
  • the virtual space generation unit 323 may determine the placement location of each user object in the virtual space based on the degree of excitement or contribution of each user U calculated by the calculation unit 322.
  • the virtual space generation unit 323 may change the placement location of each user object in the virtual space as time passes.
  • the virtual space generation unit 323 may determine the placement location of each user object in the virtual space based on an instruction from the distributor terminal 10 received by the communication unit 310.
  • connection control unit 324 determines a communication method with the distributor D for each user U belonging to the group G selected by the group selection unit 321.
  • the connection control unit 324 may determine the communication method with the distributor D from among a plurality of methods having different experience values for communicating with the distributor D.
  • connection control unit 324 may control the connection of audio information so that only a certain user U can have a conversation with the distributor D. Furthermore, when transmitting the audio information transmitted from the distributor D to the user U, the connection control unit 324 may determine the loudness and clarity of the audio for each user U. Further, the connection control unit 324 may determine the communication method for each user U with the distributor D based on the degree of excitement or contribution of each user U calculated by the calculation unit 322.
  • the third modification of the present disclosure has been described above.
  • a two-way distribution system configuration in which two or more distributors D can participate may also be used. good.
  • the group selection unit 321 may select, for each distributor D, a group G with different two-way communication rights. Further, the group selection unit 321 may select a group G that has one bidirectional communication right.
  • the connection control unit 324 may control the connection so that all the distributors D can communicate with the users U belonging to the group G who have the right to communicate bidirectionally.
  • a video of a virtual space including user objects belonging to group G to which user U, who uses user terminal 20 to which distribution content is transmitted, belongs is output on the screen of user terminal 20.
  • the video output to the screen of the user terminal 20 is not limited to this example.
  • a video of a virtual space including user objects belonging to group G with which two-way communication is being performed is displayed. May be displayed. Further, information such as video, audio, text, etc. transmitted from the group G with which the two-way communication is being performed may be transmitted to the user terminal 20 used by the user U who is provided with unidirectional distribution.
  • the distribution content is transmitted from the distribution server 30 to the user terminal 20, but the distribution content may also be transmitted from the distribution server 30 to the user terminal 20 via the cloud.
  • the distribution server 30 may transmit distribution content to multiple clouds. In that case, the distribution content may be transmitted to the user terminal 20 from one of the plurality of clouds based on the area where the user terminal 20 is present.
  • the calculation unit 322 may calculate the degree of excitement and the degree of contribution, but the calculation unit 322 may calculate other indices.
  • the calculation unit 322 may calculate the concentration level of the user U when the distributed content is distance learning content.
  • the communication unit 310 receives information indicating how the user U moves the fingertip as the user U's movement information from the user terminal 20.
  • the calculation unit 322 may calculate the concentration level of the user U based on the movement information. In this case, by implementing two-way communication, the distributor D, who is a teacher, can encourage the user U to concentrate.
  • the calculation unit 322 may calculate the degree of progress of the user U when the distributed content is remote learning content or remote support content. Specifically, when the distributed content is distance learning content, the communication unit 310 receives the answer to the question input by the user U, who is a student, from the user terminal 20. The calculation unit 322 may calculate the degree of progress based on the user U's problem accuracy rate or problem progress status. In this case, the distributor D, who is a teacher, can give a lecture suitable for the user U by implementing two-way communication.
  • the communication unit 310 receives the number of parts assembled by the user U, who is the worker, from the user terminal 20.
  • the calculation unit 322 may calculate the degree of progress based on the user U's achievement of the parts assembly quota. In this case, by implementing two-way communication, distributor D, who is a factory leader or manager, can encourage user U to improve his or her work.
  • the calculation unit 322 may calculate the movement score of the user U when the distributed content is a remote training lesson such as golf, body building, yoga, playing a musical instrument, or singing.
  • the communication unit 310 receives movement information of the user U, who is a student, from the user terminal 20, and transmits the movement indicated by the movement information and the broadcaster terminal 10 used by the distributor D, who is a teacher.
  • the motion score of the user U is calculated based on the consistency with the correct motion. In this case, by implementing two-way communication, the distributor D, who is a teacher, can urge the user U to improve his or her behavior.
  • FIG. 13 is a block diagram illustrating a hardware configuration example of an information processing apparatus 900 that implements the distributor terminal 10, the user terminal 20, and the distribution server 30 according to the embodiment of the present disclosure. Note that the information processing device 900 does not necessarily need to have all of the hardware configuration shown in FIG. 13. Further, part of the hardware configuration shown in FIG. 13 may not exist in the distributor terminal 10, the user terminal 20, or the distribution server 30.
  • the information processing device 900 includes a CPU 901, a ROM (Read Only Memory) 903, and a RAM 905. Further, the information processing device 900 may include a host bus 907, a bridge 909, an external bus 911, an interface 913, an input device 915, an output device 917, a storage device 919, a drive 921, a connection port 923, and a communication device 925.
  • the information processing device 900 includes a GPU (Graphics Processing Unit), a DSP (Digital Signal Processor), or an ASIC (Application Specific) instead of or together with the CPU 901. It may also have a processing circuit called an integrated circuit.
  • the CPU 901 functions as an arithmetic processing device and a control device, and controls the entire operation within the information processing device 900 or a part thereof according to various programs recorded in the ROM 903, RAM 905, storage device 919, or removable recording medium 927.
  • the ROM 903 stores programs used by the CPU 901, calculation parameters, and the like.
  • the RAM 905 temporarily stores programs used in the execution of the CPU 901 and parameters that change as appropriate during the execution.
  • the CPU 901, the ROM 903, and the RAM 905 are interconnected by a host bus 907, which is an internal bus such as a CPU bus. Further, the host bus 907 is connected via a bridge 909 to an external bus 911 such as a PCI (Peripheral Component Interconnect/Interface) bus.
  • PCI Peripheral Component Interconnect/Interface
  • the input device 915 is a device operated by the user, such as a button, for example.
  • Input device 915 may include a mouse, keyboard, touch panel, switch, lever, and the like.
  • Input device 915 may also include a microphone that detects the user's voice.
  • the input device 915 may be, for example, a remote control device that uses infrared rays or other radio waves, or may be an external connection device 929 such as a mobile phone that is compatible with the operation of the information processing device 900.
  • Input device 915 includes an input control circuit that generates an input signal based on information input by the user and outputs it to CPU 901. By operating this input device 915, the user inputs various data to the information processing device 900 and instructs processing operations.
  • the input device 915 may include an imaging device and a sensor.
  • the imaging device includes, for example, an imaging element such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor), and various members such as a lens for controlling the formation of a subject image on the imaging element. actual using This is a device that captures images of space and generates captured images.
  • the imaging device may be one that captures still images or may be one that captures moving images.
  • the sensor is, for example, a variety of sensors such as a distance sensor, an acceleration sensor, a gyro sensor, a geomagnetic sensor, a vibration sensor, a light sensor, and a sound sensor.
  • the sensor acquires information about the state of the information processing device 900 itself, such as the attitude of the casing of the information processing device 900, and information about the surrounding environment of the information processing device 900, such as brightness and noise around the information processing device 900.
  • the sensor may also include a GPS (Global Positioning System) sensor that receives a GPS (Global Positioning System) signal and measures the latitude, longitude, and altitude of the device.
  • GPS Global Positioning System
  • the output device 917 is configured with a device that can visually or audibly notify the user of the acquired information.
  • the output device 917 may be, for example, a display device such as an LCD (Liquid Crystal Display) or an organic EL (Electro-Luminescence) display, or a sound output device such as a speaker or headphones.
  • the output device 917 may include a PDP (Plasma Display Panel), a projector, a hologram, a printer device, or the like.
  • the output device 917 outputs the results obtained by the processing of the information processing device 900 as a video such as text or an image, or as a sound such as audio or sound.
  • the output device 917 may include a lighting device that brightens the surroundings.
  • the storage device 919 is a data storage device configured as an example of a storage unit of the information processing device 900.
  • the storage device 919 is configured by, for example, a magnetic storage device such as a HDD (Hard Disk Drive), a semiconductor storage device, an optical storage device, a magneto-optical storage device, or the like.
  • This storage device 919 stores programs and various data executed by the CPU 901, various data acquired from the outside, and the like.
  • the drive 921 is a reader/writer for a removable recording medium 927 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, and is built into the information processing device 900 or attached externally.
  • the drive 921 reads information recorded on the attached removable recording medium 927 and outputs it to the RAM 905.
  • the drive 921 also writes records to the attached removable recording medium 927.
  • the connection port 923 is a port for directly connecting a device to the information processing device 900.
  • the connection port 923 may be, for example, a USB (Universal Serial Bus) port, an IEEE1394 port, a SCSI (Small Computer System Interface) port, or the like. Further, the connection port 923 may be an RS-232C port, an optical audio terminal, an HDMI (registered trademark) (High-Definition Multimedia Interface) port, or the like.
  • the communication device 925 is, for example, a communication interface configured with a communication device for connecting to the network 40.
  • the communication device 925 may be, for example, a communication card for a wired or wireless LAN (Local Area Network), Bluetooth (registered trademark), Wi-Fi (registered trademark), or WUSB (Wireless USB). Further, the communication device 925 may be a router for optical communication, a router for ADSL (Asymmetric Digital Subscriber Line), a modem for various communications, or the like.
  • the communication device 925 for example, transmits and receives signals and the like to and from the Internet and other communication devices using a predetermined protocol such as TCP/IP.
  • the network 40 connected to the communication device 925 is a wired or wireless network, such as the Internet, a home LAN, infrared communication, radio wave communication, or satellite communication.
  • a communications department that transmits distributed content provided by a distributor to multiple user terminals; a group selection unit that selects a first group that is one or more groups from a plurality of groups to which two or more users each belong; a connection control unit that controls a connection so that users belonging to the first group and the distributor can communicate in both directions;
  • An information processing device comprising: (2) further comprising a virtual space generation unit that generates a virtual space in which user objects corresponding to users belonging to the same group are arranged;
  • the communication unit transmits information on a user object corresponding to a user belonging to the first group to a distributor terminal used by the distributor, based on control by the connection control unit.
  • the communication unit transmits the distribution content including information on a distributor object corresponding to the distributor placed in the virtual space to a user terminal used by the user. Processing equipment.
  • the information of the user object is updated based on motion information input to the user terminal, the communication unit receives updated information of the user object;
  • the information processing device according to (1) or (3) above.
  • the communication unit transmits video information, audio information, or text information transmitted from users belonging to the first group to a distributor terminal used by the distributor, based on control by the connection control unit.
  • the information processing device according to any one of (1) to (4) above.
  • the group selection unit selects a second group that is one or more groups from a plurality of groups that are not selected as the first group by the group selection unit,
  • the connection control unit controls the connection so that communication between users belonging to the second group is transmitted to the distributor.
  • the information processing device according to any one of (2) to (5) above.
  • the group selection unit reselects the first group based on predetermined conditions.
  • the information processing device according to any one of (1) to (6) above.
  • the predetermined condition is whether a group is selected by the distributor, the group selection unit selects the group selected by the distributor as the new first group;
  • the information processing device further includes a calculation unit that calculates the degree of excitement or contribution of each of the plurality of groups based on the communication between users belonging to the same group,
  • the predetermined condition is a condition related to the degree of excitement or contribution calculated by the calculation unit,
  • the information processing device according to (7) above.
  • the number of the first groups selected by the group selection section is a predetermined number;
  • the information processing device according to any one of (1) to (9) above.
  • (11) The number of the first groups selected by the group selection section is determined based on a calculation result by the calculation section.
  • the virtual space generation unit When the first group is selected by the group selection unit, the virtual space generation unit generates a specific virtual space in which the broadcaster object and the user object corresponding to the user belonging to the first group are arranged. generate space, The information processing device according to (3) above. (13) The virtual space generation unit determines the placement location in the virtual space of each of the user objects corresponding to the users belonging to the first group selected by the group selection unit, based on the experience value of communication with the distributor. Deciding from multiple different types of locations, The information processing device according to (3) or (12) above.
  • the information processing device further includes a calculation unit that calculates the degree of excitement or contribution of each user belonging to the same group based on the content of the communication performed between the users belonging to the same group, The information processing device according to 13, wherein the virtual space generation unit determines the placement location based on the degree of excitement or contribution of each of the users calculated by the calculation unit.
  • the connection control unit sets a communication method with the distributor for each of the users belonging to the first group selected by the group selection unit to a plurality of types having different experience values regarding communication with the distributor. Determine from the method of The information processing device according to any one of (1) to (14) above.
  • the communication unit receives from the user terminal information about the group to which a user using the user terminal belongs.
  • the information processing device according to any one of (1) to (15) above.
  • An information processing method performed by a computer including: (18) computer, a distribution unit that distributes distribution content provided by a distributor to multiple user terminals; a group selection unit that selects a first group that is one or more groups from a plurality of groups to which two or more users each belong; a connection control unit that controls a connection so that users belonging to the first group and the distributor can communicate in both directions;

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • Computer Graphics (AREA)
  • General Engineering & Computer Science (AREA)
  • Information Transfer Between Computers (AREA)
PCT/JP2023/015342 2022-06-03 2023-04-17 情報処理装置、情報処理方法及び記録媒体 Ceased WO2023233849A1 (ja)

Priority Applications (3)

Application Number Priority Date Filing Date Title
DE112023002537.1T DE112023002537T5 (de) 2022-06-03 2023-04-17 Informationsverarbeitungsvorrichtung, informationsverarbeitungsverfahren und aufzeichnungsmedium
US18/862,579 US20250294223A1 (en) 2022-06-03 2023-04-17 Information processing device, information processing method, and recording medium
JP2024524228A JPWO2023233849A1 (https=) 2022-06-03 2023-04-17

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2022-090823 2022-06-03
JP2022090823 2022-06-03

Publications (1)

Publication Number Publication Date
WO2023233849A1 true WO2023233849A1 (ja) 2023-12-07

Family

ID=89026216

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2023/015342 Ceased WO2023233849A1 (ja) 2022-06-03 2023-04-17 情報処理装置、情報処理方法及び記録媒体

Country Status (4)

Country Link
US (1) US20250294223A1 (https=)
JP (1) JPWO2023233849A1 (https=)
DE (1) DE112023002537T5 (https=)
WO (1) WO2023233849A1 (https=)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015166573A1 (ja) * 2014-05-01 2015-11-05 貴弘 市橋 ライブ放送システム
JP2020166575A (ja) * 2019-03-29 2020-10-08 株式会社ドワンゴ 配信サーバ、視聴者端末、配信者端末、配信方法、情報処理方法及びプログラム
JP2021071963A (ja) * 2019-10-31 2021-05-06 Ｌｉｎｅ株式会社 情報処理方法、プログラムおよび情報処理装置
WO2021246183A1 (ja) * 2020-06-03 2021-12-09 ソニーグループ株式会社 情報処理装置、情報処理方法、及び、プログラム
JP7071718B1 (ja) * 2021-12-27 2022-05-19 １７Ｌｉｖｅ株式会社 サーバ及び方法

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9021369B2 (en) * 2013-01-08 2015-04-28 Disney Enterprises, Inc. User matching in a virtual environment
US12041323B2 (en) * 2021-08-09 2024-07-16 Rovi Guides, Inc. Methods and systems for modifying a media content item based on user reaction

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015166573A1 (ja) * 2014-05-01 2015-11-05 貴弘 市橋 ライブ放送システム
JP2020166575A (ja) * 2019-03-29 2020-10-08 株式会社ドワンゴ 配信サーバ、視聴者端末、配信者端末、配信方法、情報処理方法及びプログラム
JP2021071963A (ja) * 2019-10-31 2021-05-06 Ｌｉｎｅ株式会社 情報処理方法、プログラムおよび情報処理装置
WO2021246183A1 (ja) * 2020-06-03 2021-12-09 ソニーグループ株式会社 情報処理装置、情報処理方法、及び、プログラム
JP7071718B1 (ja) * 2021-12-27 2022-05-19 １７Ｌｉｖｅ株式会社 サーバ及び方法

Also Published As

Publication number Publication date
DE112023002537T5 (de) 2025-06-18
JPWO2023233849A1 (https=) 2023-12-07
US20250294223A1 (en) 2025-09-18

Similar Documents

Publication Publication Date Title
US11662813B2 (en) Spectating virtual (VR) environments associated with VR user interactivity
CN112104594B (zh) 沉浸式交互式远程参与现场娱乐
JP6700463B2 (ja) ヘッドマウントディスプレイ上の視覚的作用を制限するためのフィルタリング及びペアレンタルコントロール法
CN109069934B (zh) 对虚拟现实环境(vr)中的vr用户的观众视图跟踪
JP6739611B1 (ja) 授業システム、視聴端末、情報処理方法及びプログラム
JP6663505B2 (ja) Ｖｒ環境における観客ビュー視点
US10092838B2 (en) Electronic apparatus for controlling a multi-field-of-view display apparatus, electronic system and control method
CN107683449A (zh) 控制经由头戴式显示器呈现的个人空间内容
US12567203B2 (en) Information processing system, information processing method, and information processing program
CN114288654A (zh) 直播互动方法、装置、设备、存储介质及计算机程序产品
US20240303947A1 (en) Information processing device, information processing terminal, information processing method, and program
Steptoe et al. Acting rehearsal in collaborative multimodal mixed reality environments
JP7408506B2 (ja) コンテンツ配信システム、コンテンツ配信方法、およびコンテンツ配信プログラム
US11206452B2 (en) Video display system, information processing apparatus, and video display method
JP7465737B2 (ja) 授業システム、視聴端末、情報処理方法及びプログラム
JP2022173870A (ja) 鑑賞システム、鑑賞装置及びプログラム
KR20220124961A (ko) 스테레오스코픽 영상과 파노라마 영상의 스위칭을 이용한 클라우드 게임 제공 방법 및 장치
JP2022103753A (ja) コンテンツ配信システム、サーバシステム及びプログラム
WO2023233849A1 (ja) 情報処理装置、情報処理方法及び記録媒体
JP7011746B1 (ja) コンテンツ配信システム、コンテンツ配信方法、及びコンテンツ配信プログラム
CN115068929A (zh) 游戏信息获取方法、装置、电子设备和存储介质
US20250319405A1 (en) System for enabling viewer interactivity with linear media
US20240390806A1 (en) Using gamer heart rate streams to identify game video highlights
KR20200127658A (ko) 방송 효과 제공 장치 및 방법
CN116069974A (zh) 一种虚拟现实设备及视频播放方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23815610

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2024524228

Country of ref document: JP

WWE Wipo information: entry into national phase

Ref document number: 202417082255

Country of ref document: IN

WWE Wipo information: entry into national phase

Ref document number: 18862579

Country of ref document: US

WWE Wipo information: entry into national phase

Ref document number: 112023002537

Country of ref document: DE

122 Ep: pct application non-entry in european phase

Ref document number: 23815610

Country of ref document: EP

Kind code of ref document: A1

WWP Wipo information: published in national office

Ref document number: 112023002537

Country of ref document: DE

WWP Wipo information: published in national office

Ref document number: 18862579

Country of ref document: US