CN117178558A

CN117178558A - Information processing device, information processing method, and program

Info

Publication number: CN117178558A
Application number: CN202280029021.9A
Authority: CN
Inventors: 岩濑广; 杉原贤次; 近藤茜; 饭田文彦; 朽木悠
Original assignee: Sony Group Corp
Current assignee: Sony Group Corp
Priority date: 2021-05-19
Filing date: 2022-02-22
Publication date: 2023-12-05
Also published as: DE112022002670T5; WO2022244364A1

Abstract

The information processing apparatus includes a control unit that acquires information on a first communication delay from a content distribution server to a target terminal and a second communication delay from the content distribution server to the target terminal through an edge terminal, and controls reproduction on the target terminal of content transmitted from the content distribution server and reaction information transmitted from the edge terminal based on the information on the first communication delay and the second communication delay.

Description

Information processing device, information processing method, and program

Technical Field

The present technology relates to an information processing apparatus, an information processing method, and a program, and particularly relates to a technology for reproducing content.

Background

As an information processing apparatus, an apparatus has been proposed which receives content from a content distribution server, receives user information obtained by imaging the body shape of a user who is viewing the content from a user terminal, and displays the content and an image based on the user information (the body shape of the user) on a display unit (for example, patent document 1).

Therefore, the information processing apparatus can give the user a sense of unity as if the user is viewing the content together with another user who is viewing the same content at a different place.

CITATION LIST

Patent literature

Patent document 1: WO 2014/192552.

Disclosure of Invention

Problems to be solved by the invention

However, the technique disclosed in patent document 1 may experience a delay in communication through the network when receiving content and user information.

Accordingly, the information processing apparatus experiences different communication delays between the case of receiving the content and the case of receiving the user information. In such a case, there is a possibility that the information processing apparatus causes loss of synchronicity between the content and the body shape of the user and thus reduces the sense of unity with another user.

Therefore, an object of the present technology is to suppress a decrease in sense of unity with another user.

Solution to the problem

An information processing apparatus according to the present technology includes a control unit configured to: information on a first communication delay from a content distribution server to a target terminal and information on a second communication delay from the content distribution server to the target terminal via an edge terminal are acquired, and reproduction in the target terminal of content transmitted from the content distribution server and reaction information transmitted from the edge terminal is controlled based on the information on the first communication delay and the information on the second communication delay.

Thus, the information processing apparatus enables the target terminal to reproduce the content and the reaction information in a case where the content and the reaction information are synchronized with each other.

Drawings

Fig. 1 is an explanatory diagram depicting a configuration of a content distribution system according to an embodiment of the present technology.

Fig. 2 is a diagram depicting a functional configuration of the content distribution server.

Fig. 3 is a diagram depicting a functional configuration of the management server.

Fig. 4 is a diagram depicting a functional configuration of a user terminal.

Fig. 5 is a diagram for describing example 1.

Fig. 6 is a flowchart depicting an automatic matching process performed by the management server according to example 1.

Fig. 7 is a flowchart depicting a user terminal selection process according to example 1.

Fig. 8 is a diagram for describing example 2.

Fig. 9 is a flowchart depicting an automatic matching process performed by a target terminal according to example 2.

Fig. 10 is a flowchart depicting a user terminal selection process according to example 2.

Fig. 11 is a diagram for describing example 3.

Fig. 12 is a flowchart depicting a friend matching process performed by the management server according to example 3.

Fig. 13 is a diagram for describing example 4.

Fig. 14 is a flowchart depicting a friend matching process performed by a management server according to example 4.

Fig. 15 is a flowchart depicting the first delay addition process.

Fig. 16 is a flowchart depicting the second delay addition process.

Fig. 17 is a diagram for describing a playback mode.

Fig. 18 is a diagram depicting an example of arrangement of a display device and a sound output device in a user terminal system.

Fig. 19 is a diagram depicting an example of how the reaction information is reproduced.

Fig. 20 is a diagram depicting a hardware configuration.

Detailed Description

Hereinafter, embodiments will be described in the following order.

<1 > configuration of content distribution System

<2 > synchronization processing >

<3 > examples of how content and reaction information are reproduced

<4. Hardware configuration example >

<5. Modified example >

<6. Summary >

<7 > this technology

<1 > configuration of content distribution System

1.1 overall configuration of content distribution System

Fig. 1 is an explanatory diagram depicting a configuration of a content distribution system 1 according to an embodiment of the present technology. As depicted in fig. 1, a content distribution system 1 according to an embodiment of the present technology includes a content distribution server system 2, a management server 3, and a plurality of user terminal systems 4. The content distribution server system 2, the management server 3, and the user terminal system 4 are connected to a network 5 such as the internet, and can communicate with each other via the network 5.

The content distribution server system 2 is provided in a sports venue, a concert venue, or the like, and distributes images and sounds of sports, concerts, or the like as content to a plurality of user terminal systems 4 in real time.

Note that a case where the content includes an image (moving image) and sound will be described below as an example. However, the content may include only images or only sounds, or may include other data such as still images, for example. Further, the content distribution server system 2 distributes content in real time, but may distribute pre-recorded content.

The content distribution server system 2 includes a content distribution server 10, an imaging device 11, a sound collection device 12, a display device 13, and a sound output device 14. The content distribution server 10 is a computer including a Central Processing Unit (CPU), a Random Access Memory (RAM), and a Read Only Memory (ROM), and controls the content distribution server system 2 in a centralized manner.

The imaging device 11 is a video camera device that captures an image, and includes an imaging device 11a and an imaging device 11b. The imaging device 11a captures images of sports, concerts (including performers Cpf who perform sports or concerts), and the like. The imaging device 11b captures an image of a viewer Cau who is watching content such as sports or concerts on the spot.

The sound collection device 12 is a microphone and includes a sound collection device 12a and a sound collection device 12b. The sound collection device 12a collects sounds of sports, concerts (including performers Cpf who perform sports or concerts), and the like. The sound collecting device 12b collects sound emitted by the viewer Cau.

Then, the content distribution server 10 distributes the image captured by the imaging device 11a and the sound collected by the sound collection device 12a as content to the user terminal system 4 via the network 5.

Further, the content distribution server 10 distributes the image captured by the imaging device 11b and the sound collected by the sound collection device 12b to the user terminal system 4 as viewer information via the network 5. Here, the viewer information is information about a viewer Cau who is watching content such as sports or concerts on site, and includes, for example, an image showing the viewer Cau and sound emitted by the viewer Cau.

The display device 13 is a liquid crystal display, an Organic Light Emitting Diode (OLED) display, a projector device, or the like, and displays images for the performer Cpf and the viewer Cau. The sound output device 14 is a speaker, and outputs sound to both the performer Cpf and the viewer Cau.

The management server 3 is a computer including a CPU, a RAM, and a ROM, and controls reproduction of content in the user terminal system 4 and reaction information to be described later based on a delay (communication delay) occurring in the content distribution system 1.

The user terminal system 4 receives and reproduces the content distributed from the content distribution server system 2. The user terminal system 4 includes a user terminal 20, a display device 21, a sound output device 22, an imaging device 23, and a sound collection device 24.

The user terminal 20 is a computer including a CPU, a RAM, and a ROM, and controls the user terminal system 4 in a centralized manner. For example, the user terminal 20 receives content via the network 5.

The display device 21 is a liquid crystal display, an OLED display, a projector device, or the like, and displays an image included in received content. The sound output device 22 is a speaker, and outputs sound included in the received content. Note that, hereinafter, the display of an image by the display device 21 and the output of sound by the sound output device 22 may be collectively referred to as "reproduction".

The imaging device 23 is a video camera device, and captures an image of the body shape (whole body, upper body, or face) of the user. The sound collection device 24 is a microphone and collects sound emitted by the user.

Then, the user terminal 20 can transmit the image captured by the imaging device 23 and the sound collected by the sound collecting device 24 as reaction information to the content distribution server system 2 (content distribution server 10), the management server 3, and the other user terminal systems 4 (user terminals 20) via the network 5. Here, the reaction information is information on the reaction of the user who is viewing the content at a remote location (user terminal system 4), and is, for example, the user's body shape and the sound from the user.

The user terminal system 4 is provided for each user or each household present at a different location. Note that, hereinafter, for convenience of description, the user terminal system 4 of any target user T is referred to as a target user terminal system 4a, and the user terminal systems 4 of other users R are referred to as other user terminal systems 4b. Thus, the target user terminal system 4a may be the other user terminal system 4b, and the other user terminal system 4b may be the target user terminal system 4a.

Further, the user terminal 20 of the target user terminal system 4a is referred to as a target terminal 20a, and the user terminals 20 of the other user terminal systems 4b are referred to as edge terminals 20b.

In the content distribution system 1 configured as described above, content is simultaneously distributed from the content distribution server 10 to a plurality of user terminals 20. Further, in the content distribution system 1, reaction information about a user who is viewing the content distributed from the content distribution server 10 is transmitted to the other user terminals 20.

Then, the user terminal 20 reproduces the content distributed from the content distribution server 10, and reproduces the reaction information transmitted from the other user terminals 20.

Accordingly, the user terminal system 4 can reproduce the reaction of the other user together with the content and give the user the fun of viewing the content integrally with the other user.

However, when transmitting and receiving the content and the reaction information, the content distribution system 1 experiences a delay in communication through the network 5 or the like. Thus, the user terminal system 4 may suffer from loss of synchronism and time lag between the content being reproduced and the reaction information.

Here, the synchronicity between the content and the reaction information means that the reaction information reproduced by the user terminal system 4 is reaction information captured and collected when viewing the content at the same time as the content reproduced by the user terminal system 4. Note that the same time includes an error equal to or smaller than a preset prescribed value.

Accordingly, in the user terminal system 4, in the case where the content and the reaction information are synchronized with each other, the reaction of another user who is viewing the content at the same time as the content being reproduced is reproduced simultaneously with the content.

Then, for example, when the delay amount of the reaction information is small with respect to the content, that is, when the reaction information is received earlier than the content, there is a possibility that reproduction of the reaction information in the user terminal system 4 makes the user grasp details of the content (so-called corruption). In particular, in the case of sports content, it is possible to reproduce scenes satisfied by other users before reproducing the scoring scene. In such a case, the user is caused to grasp the score before the content is reproduced.

Further, for example, when the delay amount of the reaction information is large with respect to the content, that is, when the reaction information is received later than the content, there is a possibility that the sense of unity with other users is impaired in the user terminal system 4. For example, in the case of sports content, it is possible to reproduce scenes satisfied by other users after reproducing the scoring scene. In such a case, scenes that are satisfied by other users are reproduced with a time difference from the scoring scene, and the user cannot be satisfied with the scenes together with other users, and thus cannot feel a sense of unity.

Accordingly, in the content distribution system 1, the content and the reaction information are reproduced in synchronization with each other. Hereinafter, specific processing for the above will be described.

[1.2 functional configuration of content distribution Server 10 ]

Fig. 2 is a diagram depicting a functional configuration of the content distribution server 10. As depicted in fig. 2, the content distribution server 10 functions as a network communication unit 31, a content viewer information input unit 32, a time stamp adding unit 33, a content viewer information distribution unit 34, a content viewer information storage unit 35, a reaction information receiving unit 36, and an image and sound output unit 37.

The network communication unit 31 establishes communication with the management server 3 and the user terminal 20 via the network 5, and realizes transmission and reception of data with the management server 3 and the user terminal 20.

The content viewer information input unit 32 acquires, as content, an image captured by the imaging device 11a and sound collected by the sound collection device 12 a. Further, the content viewer information input unit 32 acquires an image captured by the imaging device 11b and sound collected by the sound collection device 12b as viewer information.

The time stamp adding unit 33 divides the content acquired by the content viewer information input unit 32 into packets as distribution units, and adds a time stamp indicating the current time to the packets.

Further, the time stamp adding unit 33 divides the viewer information acquired by the content viewer information input unit 32 into packets as distribution units, and adds a time stamp indicating the current time to the packets.

The content viewer information distribution unit 34 transmits (distributes) the content divided into packets with time stamps added by the time stamp adding unit 33 to the user terminal system 4 via the network communication unit 31 and the network 5.

Further, the content viewer information distribution unit 34 transmits (distributes) the viewer information divided into packets to which the time stamp is added by the time stamp adding unit 33 to the user terminal system 4 via the network communication unit 31 and the network 5.

The content viewer information storage unit 35 stores content divided into packets to which time stamps are added by the time stamp adding unit 33 at any time.

Further, the content viewer information storage unit 35 stores viewer information divided into packets to which time stamps are added by the time stamp adding unit 33 at any time.

The reaction information receiving unit 36 receives the reaction information transmitted from the management server 3 or the user terminal system 4 via the network 5 and the network communication unit 31.

The image and sound output unit 37 reads the content stored in the content viewer information storage unit 35 in a playback mode, which will be described in detail later. Then, the image and sound output unit 37 causes the display device 13 to display the image included in the read content, and causes the sound output device 14 to output the sound included in the content.

Further, in the playback mode, the image and sound output unit 37 causes the display device 13 to display the image included in the reaction information together with the image included in the content. Further, in the playback mode, the image and sound output unit 37 causes the sound output device 14 to output the sound included in the reaction information together with the sound included in the content.

[1.3 functional configuration of management Server 3 ]

Fig. 3 is a diagram depicting a functional configuration of the management server 3. As depicted in fig. 3, the management server 3 functions as a network communication unit 41, a delay information receiving unit 42, a delay synchronization control unit 43, a reaction information communication command unit 44, a reaction information receiving unit 45, a reaction information storage unit 46, a time stamp receiving unit 47, and a reaction information distribution unit 48.

The network communication unit 41 establishes communication with the content distribution server 10 and the user terminal 20 via the network 5, and realizes transmission and reception of data with the content distribution server 10 and the user terminal 20.

The delay information receiving unit 42 receives information on communication delay from each of the plurality of user terminals 20 via the network communication unit 41 and the network 5. The information on the communication delay is, for example, a delay time or a time stamp, which will be described in detail later.

The delay synchronization control unit 43 controls reproduction of the content and the response information in the target terminal 20a based on the delay information from the plurality of user terminals 20 received by the delay information receiving unit 42.

The response information communication command unit 44 transmits a command to transmit the response information to the edge terminal 20b via the network communication unit 41 and the network 5 under the control of the delay synchronization control unit 43.

The reaction information receiving unit 45 receives reaction information from the user terminal 20 via the network communication unit 41 and the network 5.

The reaction information storage unit 46 stores the reaction information received by the reaction information receiving unit 45.

The time stamp receiving unit 47 receives time stamps of content to be reproduced in the replay mode from the content distribution server 10 via the network communication unit 41 and the network 5.

The response information distribution unit 48 reads the response information having the time stamp indicating the same time as the time stamp received by the time stamp receiving unit 47 from the response information storage unit 46, and transmits the response information to the content distribution server 10 and the user terminal 20 via the network communication unit 41 and the network 5.

1.4 functional configuration of user terminal 20

Fig. 4 is a diagram depicting a functional configuration of the user terminal 20. As depicted in fig. 4, the user terminal 20 functions as a network communication unit 51, a content receiving unit 52, a content delay adding unit 53, an image and sound generating unit 54, an image and sound output unit 55, a reaction information receiving unit 56, a reaction information delay adding unit 57, a reaction information input unit 58, a time stamp adding unit 59, a reaction information transmitting unit 60, a reaction information storing unit 61, a reaction information communication command receiving unit 62, a delay synchronization control unit 63, a content delay measuring unit 64, and an inter-user terminal communication delay measuring unit 65.

The network communication unit 51 establishes communication with the management server 3 and the content distribution server 10 via the network 5, and realizes transmission and reception of data with the management server 3 and the content distribution server 10.

The content receiving unit 52 receives the content transmitted from the content distribution server 10 via the network 5 and the network communication unit 51.

The content delay adding unit 53 adds a delay to the content received by the content receiving unit 52 under the control of the delay synchronization control unit 63. That is, the content delay adding unit 53 delays reproduction of the content received by the content receiving unit 52 by a predetermined delay time (delay amount).

The image and sound generation unit 54 generates images and sounds based on the content received by the content reception unit 52 or the content delayed by the content delay addition unit 53.

The image and sound output unit 55 causes the display device 21 to display the image generated by the image and sound generation unit 54, and causes the sound output device 22 to output the sound generated by the image and sound generation unit 54. That is, the image and sound generation unit 54 and the image and sound output unit 55 reproduce the content distributed from the content distribution server 10.

The reaction information receiving unit 56 receives the reaction information transmitted from the edge terminal 20b (other user terminal system 4 b) and the viewer information transmitted from the content distribution server 10 (content distribution server system 2) via the network communication unit 41 and the network 5.

The reaction information delay adding unit 57 adds a delay to the reaction information received by the reaction information receiving unit 56. That is, the reaction information delay adding unit 57 delays reproduction of the reaction information received by the reaction information receiving unit 56 by a predetermined delay time (delay amount).

The image and sound generation unit 54 generates an image and sound based on the reaction information or viewer information received by the reaction information reception unit 56 or the reaction information delayed by the reaction information delay addition unit 57. The image and sound output unit 55 causes the display device 21 to display the image generated by the image and sound generation unit 54, and causes the sound output device 22 to output the sound generated by the image and sound generation unit 54. That is, the image and sound generation unit 54 and the image and sound output unit 55 reproduce the reaction information or the viewer information.

The reaction information input unit 58 acquires the image captured by the imaging device 23 and the sound collected by the sound collecting device 24 as reaction information.

The time stamp adding unit 59 divides the reaction information acquired by the reaction information input unit 58 into packets as distribution units, and adds a time stamp indicating the current time to the packets.

The reaction information transmission unit 60 transmits the reaction information divided into packets added with the time stamp by the time stamp addition unit 59 to the management server 3 and the user terminal system 4 via the network communication unit 51 and the network 5.

The reaction information storage unit 61 stores reaction information divided into packets to which time stamps are added by the time stamp adding unit 59 at any time.

The response information communication command receiving unit 62 receives a command transmitted from the management server 3. The delay synchronization control unit 63 controls each unit with respect to delay in reproduction of the content and the reaction information based on a command from the management server 3.

The content delay measurement unit 64 measures a delay occurring between the user terminal 20 and the content distribution server 10, that is, an amount of delay with respect to reception of the content.

The inter-user terminal communication delay measurement unit 65 measures a delay occurring between the user terminal 20 and the edge terminal 20b (other user terminal system 4 b), that is, a delay amount with respect to the reception of the reaction information.

<2 > synchronization processing >

The target user terminal system 4a reproduces the content distributed from the content distribution server system 2 and the reaction information transmitted from the edge terminal 20b in a case where the content and the reaction information are synchronized with each other.

As described above, as a mode in which the content and the reaction information are reproduced in synchronization with each other, the content distribution system 1 is provided with the following modes: an automatic matching mode in which synchronization is established with an undetermined non-specific user terminal 20, and a friend mode in which synchronization is established with a predetermined specific user terminal 20.

The user terminal 20 may select an automatic matching mode or a friend mode. Then, in the content distribution system 1, processing corresponding to the mode selected by the user terminal 20 is performed.

Further, the content distribution system 1 is provided with a playback mode in which, for example, a part of the content such as a score scene of sports is distributed for playback (transmitted for playback, reproduced for playback). The playback mode may be implemented in an auto-match mode or a friend mode.

[2.1 auto match mode ]

The automatic matching mode is a mode in which content and reaction information are reproduced with synchronization established with the non-specific user terminal 20. Here, the automatic matching pattern will be described with reference to example 1 in which synchronization is established based on a delay time and example 2 in which synchronization is established based on a time stamp.

Note that in example 1, the content and the reaction information are reproduced in synchronization with each other under the control of the management server 3. On the other hand, in example 2, the content and the reaction information are reproduced in synchronization with each other under the control of the target terminal 20 a.

[2.1.1 example 1]

Fig. 5 is a diagram for describing example 1. Fig. 6 is a flowchart depicting an automatic matching process performed by the management server 3 according to example 1. Fig. 7 is a flowchart depicting a user terminal selection process according to example 1.

As depicted in fig. 5, it is assumed that the content distributed from the content distribution server 10 to the target terminal 20a is delayed by the distribution delay time Dct. Further, it is assumed that the content distributed from the content distribution server 10 to the edge terminal 20b is delayed by the distribution delay time Dcr. Further, it is assumed that the communication from the edge terminal 20b to the target terminal 20a is delayed by the inter-user-terminal delay time Drt.

In this case, the target terminal 20a reproduces the content only with a delay of the distribution delay time Dct with respect to the time when the content is distributed from the content distribution server 10.

Further, the edge terminal 20b reproduces the content only with a delay of the distribution delay time Dcr with respect to the time when the content is distributed from the content distribution server 10. Accordingly, the response information about the other users R who are viewing the content reproduced only with the delay of the distribution delay time Dcr is reproduced by the target terminal 20a with the delay of the response delay time Dcrt (the distribution delay time dcr+the inter-user-terminal delay time dry) with respect to the time when the content is distributed from the content distribution server 10.

Therefore, when there is a time difference (time lag) between the distribution delay time Dct and the reaction delay time Dcrt, the content and the reaction information are not synchronized with each other.

Therefore, when the automatic matching process according to example 1 is performed, the management server 3 performs the edge terminal selection process in step S1, as depicted in fig. 6. As depicted in fig. 7, when the edge terminal selection process starts, in step S11, the delay synchronization control unit 43 requests the distribution delay time Dct to the target terminal 20a to acquire the distribution delay time Dct.

Here, the target terminal 20a, upon receiving the request for the distribution delay time Dct, causes the content delay measurement unit 64 to measure (calculate) the distribution delay time Dct by comparing the time stamp included in the content received by the content reception unit 52 with the current time. Then, the delay synchronization control unit 63 transmits the measured distribution delay time Dct to the management server 3. Accordingly, the delay synchronization control unit 43 acquires the distribution delay time Dcr (information about the first communication delay) from the target terminal 20 a.

Subsequently, in step S12, the delay synchronization control unit 43 randomly selects the edge terminal 20b, and requests the distribution delay time Dcr and the inter-user-terminal delay time Drt from the edge terminal 20b to acquire the distribution delay time Dcr and the inter-user-terminal delay time Drt.

Here, the edge terminal 20b causes the content delay measurement unit 64 to measure the distribution delay time Dcr by comparing the time stamp included in the content received by the content reception unit 52 with the current time, as with the target terminal 20 a.

Further, the inter-user terminal communication delay measurement unit 65 transmits a test packet to the target terminal 20 a. The inter-user terminal communication delay measurement unit 65 of the target terminal 20a returns the test packet to the edge terminal 20b that has transmitted the test packet upon receiving the test packet. Then, the inter-user-terminal communication delay measurement unit 65 of the edge terminal 20b measures the inter-user-terminal delay time Drt based on the transmission time of the test packet and the reception time of the test packet.

Then, the delay synchronization control unit 63 transmits the measured distribution delay time Dcr and the inter-user-terminal delay time Drt to the management server 3. Accordingly, the delay synchronization control unit 43 receives the distribution delay time Dcr and the inter-user-terminal delay time Drt from the edge terminal 20b.

Subsequently, in step S13, the delay synchronization control unit 43 calculates a reaction delay time Dcrt (information about the second communication delay) by adding together the acquired distribution delay time Dcr and the inter-user-terminal delay time Drt.

In step S14, the delay synchronization control unit 43 determines whether the time difference between the distribution delay time Dct and the reaction delay time Dcrt is equal to or smaller than a preset prescribed value. Note that the prescribed value is set to a value (time) indicating a limit until the user perceives synchronization, and is, for example, 70ms. Therefore, it is determined here whether the content and the reaction information transmitted to the target terminal 20a are synchronized with each other.

Then, in the case where the time difference between the distribution delay time Dct and the reaction delay time Dcrt is equal to or smaller than the prescribed value (yes in step S14), the delay synchronization control unit 43 issues a reaction information transmission command to the selected edge terminal 20b, which causes the edge terminal 20b to transmit reaction information to the target terminal 20 a. Further, the delay synchronization control unit 43 increments the communication count indicating the number of edge terminals 20b transmitting the reaction information to the target terminal 20a by 1, and ends the edge terminal selection process.

The edge terminal 20b, upon receiving the response information transmission command, causes the response information transmission unit 60 to transmit the response information to the target terminal 20 a.

As described above, the delay synchronization control unit 43 causes the edge terminal 20b, which has the difference between the delay amount of the content (distribution delay time Dct) and the delay amount of the response information (response delay time Dcrt) equal to or smaller than the prescribed value, to transmit the response information.

Returning to fig. 6, in step S2, the delay synchronization control unit 43 determines whether the communication count has reached a preset upper limit. When the result shows that the communication count has reached the upper limit (yes in step S2), the automatic matching process is ended. Note that the upper limit may be any number as long as it is equal to or greater than 1. Note that the upper limit of the change in the transmission speeds of the content distribution server 10 and the user terminal 20 may be considered. Here, the delay synchronization control unit 43 causes the upper limit number of edge terminals 20b to transmit the reaction information to the target terminal 20 a.

On the other hand, in the case where the communication count does not reach the upper limit (no in step S2), the delay synchronization control unit 43 determines in step S3 whether the execution count of the edge terminal selection process has reached the preset upper limit. Accordingly, the processing from step S1 to step S3 is repeated until the execution count reaches the upper limit (no in step S3). Note that the upper limit may be any number as long as it is equal to or greater than 1.

Then, in the case where the execution count has reached the upper limit (yes in step S3), the delay synchronization control unit 43 determines in step S4 whether the communication count is equal to or greater than 1. Here, it is determined whether there is an edge terminal 20b capable of transmitting the reaction information to the target terminal 20a in synchronization with the content.

Therefore, in the case where the communication count is equal to or greater than 1 (yes in step S4), the automatic matching process is ended.

On the other hand, in the case where the communication count is smaller than 1, that is, in the case where the communication count is 0 (no in step S4), the delay synchronization control unit 43 determines in step S5 whether or not there is a reaction delay time Dcrt smaller than the distribution delay time Dct among the reaction delay times Dcrt of the edge terminals 20b selected in the edge terminal selection processing. Here, it is determined whether there is an edge terminal 20b capable of transmitting the response information of the content earlier than the content reproduced by the target terminal 20 a.

Then, in the case where there is a reaction delay time Dcrt smaller than the distribution delay time Dct (yes in step S5), the delay synchronization control unit 43 selects an edge terminal 20b whose reaction delay time Dcrt is closest to the distribution delay time Dct among the smaller reaction delay times Dcrt in step S6, and issues a reaction information transmission command to the selected edge terminal 20b.

That is, the delay synchronization control unit 43 selects the edge terminal 20b that transmits the response information whose delay amount is closest to the delay amount of the content from the plurality of edge terminals 20b, and causes the selected edge terminal 20b to transmit the response information.

Further, the delay synchronization control unit 43 issues a delay addition command to the target terminal 20a in step S7, which causes the target terminal 20a to add a delay time (delay amount) obtained by subtracting the reaction delay time Dcrt from the distribution delay time Dct to the reaction information.

The target terminal 20a, after receiving the delay addition command, causes the reaction information delay addition unit 57 to add a delay time to the reaction information under the control of the delay synchronization control unit 63. That is, the target terminal 20a delays reproduction of the reaction information received from the edge terminal 20b by a delay time. Thus, the target terminal 20a can synchronize the content with the reaction information.

On the other hand, in the case where there is No reaction delay time Dcrt smaller than the distribution delay time Dct (No in step S5), the delay synchronization control unit 43 issues a viewer information transmission command to the content distribution server 10 in step S8 to cause the content distribution server 10 to start transmitting the viewer information to the target terminal 20 a.

That is, in the case where there is no reaction information in which the difference between the delay amount of the content and the delay amount of the reaction information is equal to or smaller than the prescribed value, the delay synchronization control unit 43 causes the content distribution server 10 to transmit the viewer information to the target terminal 20 a.

The content distribution server 10, upon receiving the viewer information transmission command, causes the content viewer information distribution unit 34 to transmit the viewer information to the target terminal 20 a.

Here, since the content and the viewer information are distributed from the content distribution server 10, their respective delay times to the target terminal 20a are the same.

Therefore, in the case where there is no reaction information that can be synchronized, the user terminal system 4 can give the target user T a sense of unity by reproducing the viewer information synchronized with the content as if the target user T is viewing the content together with the viewer Cau.

[2.1.2 example 2]

Fig. 8 is a diagram for describing example 2. Fig. 9 is a flowchart depicting an automatic matching process performed by the target terminal 20a according to example 2. Fig. 10 is a flowchart depicting a user terminal selection process according to example 2.

As described above, in example 2, the target terminal 20a performs the automatic matching process, which eliminates the need for the management server 3.

When receiving the content from the content distribution server 10, the target terminal 20a and the edge terminal 20b receive packets including time stamps of the content at any time. Here, as depicted in fig. 8, the time stamp received by the target terminal 20a is denoted as a distribution time stamp Tct, and the time stamp received by the edge terminal 20b is denoted as a distribution time stamp Tcr.

When the automatic matching process according to example 2 is performed, the target terminal 20a performs an edge terminal selection process in step S21, as depicted in fig. 9. As depicted in fig. 10, in the edge terminal selection process, the delay synchronization control unit 63 randomly selects the edge terminal 20b, and requests transmission of a test packet including the distribution timestamp Tcr to the selected edge terminal 20b to acquire the test packet in step S31.

Here, the edge terminal 20b, after receiving the request to transmit the test packet, causes the delay synchronization control unit 63 to transmit the test packet including the distribution timestamp Tcr included in the content received by the content receiving unit 52 to the target terminal 20 a. Then, the delay synchronization control unit 63 of the target terminal 20a, after receiving the test packet, acquires the distribution timestamp Tcr included in the test packet as the reaction timestamp Tcrt (information about the second communication delay).

Subsequently, in step S32, the delay synchronization control unit 63 determines whether the time difference between the distribution timestamp Tct (information on the first communication delay) included in the packet of the content acquired at the same time as the test packet including the reaction timestamp Tcrt and the reaction timestamp Tcrt included in the test packet is equal to or smaller than a preset prescribed value. Note that it is determined here whether or not the content and the reaction information transmitted to the target terminal 20a are synchronized with each other.

Then, when the difference between the distribution time stamp Tct and the response time stamp Tcrt is equal to or smaller than the predetermined value (yes in step S32), the delay synchronization control unit 63 issues a response information transmission command to the edge terminal 20b to start the edge terminal 20b to transmit the response information. Further, the delay synchronization control unit 63 increments the communication count indicating the number of edge terminals 20b transmitting the reaction information by 1, and ends the edge terminal selection process.

Returning to fig. 9, in step S22, the delay synchronization control unit 63 determines whether the communication count has reached a preset upper limit. When the result shows that the communication count has reached the upper limit (yes in step S22), the automatic matching process is ended.

On the other hand, in the case where the communication count does not reach the upper limit (no in step S22), the delay synchronization control unit 63 determines in step S23 whether the execution count of the edge terminal selection process has reached the preset upper limit. Accordingly, the processing from step S21 to step S23 is repeated until the execution count reaches the upper limit (no in step S23).

Then, in the case where the execution count has reached the upper limit (yes in step S23), the delay synchronization control unit 63 determines in step S24 whether the communication count is equal to or greater than 1. Therefore, in the case where the communication count is equal to or greater than 1 (yes in step S24), the automatic matching process is ended.

On the other hand, in the case where the communication count is smaller than 1, that is, in the case where the communication count is 0 (no in step S24), the delay synchronization control unit 63 determines in step S25 whether or not there is a reaction time stamp Tcrt earlier than the distribution time stamp Tct acquired at the same timing among the reaction time stamps Tcrt of the edge terminals 20b selected in the edge terminal selection processing. Here, it is determined whether there is an edge terminal 20b capable of transmitting the response information of the content earlier than the content reproduced by the target terminal 20 a.

Accordingly, in the case where there is a reaction time stamp Tcrt earlier than the distribution time stamp Tct (yes in step S25), the delay synchronization control unit 63 issues a reaction information transmission command to the edge terminal 20b whose reaction time stamp Tcrt is closest to the distribution time stamp Tct among the reaction time stamps Tcrt earlier than the distribution time stamp Tct in step S26.

Further, in step S27, the delay synchronization control unit 63 adds a delay time (delay amount) obtained by subtracting the reaction time stamp Tcrt from the distribution time stamp Tct to the reaction information. That is, the target terminal 20a delays reproduction of the reaction information received from the edge terminal 20b by a delay time. Thus, the target terminal 20a can synchronize the content with the reaction information.

On the other hand, in the case where there is no reaction time stamp Tcrt earlier than the distribution time stamp Tct (no in step S25), the delay synchronization control unit 63 issues a viewer information transmission command to the content distribution server 10 to cause the content distribution server 10 to start transmitting viewer information in step S28.

Therefore, in the case where there is no reaction information that can be synchronized, the target terminal 20a can give the target user T a sense of unity by reproducing the viewer information synchronized with the content as if the target user T is viewing the content together with the viewer Cau.

[2.2 friend pattern ]

The friend mode will be described with reference to example 3 in which synchronization is established with one specific edge terminal 20b set in advance and example 4 in which synchronization is established with a plurality of specific edge terminals 20b set in advance.

[2.2.1 example 3]

Fig. 11 is a diagram for describing example 3. Fig. 12 is a flowchart depicting a friend matching process performed by the management server 3 according to example 3.

As depicted in fig. 11, it is assumed that the content distributed from the content distribution server 10 to the target terminal 20a is delayed by the distribution delay time Dct. Further, it is assumed that the content distributed from the content distribution server 10 to one specific edge terminal 20b is delayed by the distribution delay time Dcr. Further, it is assumed that the communication from the target terminal 20a to the edge terminal 20b is delayed by the inter-user-terminal delay time Dtr. Further, it is assumed that the communication from the edge terminal 20b to the target terminal 20a is delayed by the inter-user-terminal delay time Drt.

Further, the edge terminal 20b reproduces the content only with a delay of the distribution delay time Dcr with respect to the time when the content is distributed from the content distribution server 10. Accordingly, the response information about the other users R who are viewing the content reproduced only with the delay of the distribution delay time Dcr is reproduced by the target terminal 20a with the delay of the response delay time Dcrt (the distribution delay time dcr+the inter-user-terminal delay time dry).

Therefore, when there is a time difference (difference) between the distribution delay time Dct and the reaction delay time Dcrt, the content and the reaction information are not synchronized with each other.

Therefore, when the friend matching process is performed, as depicted in fig. 12, the delay synchronization control unit 43 requests the distribution delay time Dct (information on the first communication delay) to the target terminal 20a to acquire the distribution delay time Dct in step S41.

Subsequently, in step S42, the delay synchronization control unit 43 requests the distribution delay time Dcr and the inter-user-terminal delay time Drt to one specific edge terminal 20b to acquire the distribution delay time Dcr and the inter-user-terminal delay time Drt.

Further, in step S43, the delay synchronization control unit 43 calculates a reaction delay time Dcrt (information about the second communication delay) by adding together the acquired distribution delay time Dcr and the inter-user-terminal delay time Drt.

In step S44, the delay synchronization control unit 43 determines whether the distribution delay time Dct is smaller than the reaction delay time Dcrt. Then, in the case where the distribution delay time Dct is smaller than the reaction delay time Dcrt (yes in step S44), the delay synchronization control unit 43 issues a delay addition command to the target terminal 20a in step S45 to cause the target terminal 20a to add to the content a delay time Ac obtained by subtracting the distribution delay time Dct from the reaction delay time Dcrt.

The target terminal 20a, after receiving the delay adding command, causes the content delay adding unit 53 to add the delay time Ac to the content under the control of the delay synchronization control unit 63. Accordingly, the target terminal 20a delays the reproduction of the content received from the content distribution server 10 by the delay time Ac.

By so doing, the distribution delay time Dct' of the content in the target terminal 20a becomes equal to the time obtained by adding the delay time Ac to the distribution delay time Dct.

Note that the processing from step S41 to step S45 described above is also performed in one specific edge terminal 20 b. Then, in the case where the delay time Ac is added by the edge terminal 20b, the reaction delay time Dcrt' after the addition becomes equal to the time obtained by adding the delay time Ac to the reaction delay time Dcrt.

As described above, in the case where the distribution delay time is smaller than the reaction delay time, the target terminal 20a and the edge terminal 20b synchronize the content and the reaction information by adding a delay to the content.

Thereafter, in step S46, the delay synchronization control unit 43 requests the inter-user-terminal delay time Dtr to the target terminal 20a to acquire the inter-user-terminal delay time Dtr, and determines whether or not the difference between the inter-user-terminal delay time Dtr and the inter-user-terminal delay time Drt is equal to or smaller than a prescribed value. Here, it is determined whether the content and the reaction information in both the target terminal 20a and the edge terminal 20b are synchronized.

Then, when the difference between the inter-user-terminal delay time Dtr and the inter-user-terminal delay time dry is equal to or smaller than the predetermined value (yes in step S46), the friend matching process is ended. On the other hand, when the difference between the inter-user-terminal delay time Dtr and the inter-user-terminal delay time dry is not equal to or smaller than the predetermined value (no in step S46), the delay synchronization control unit 43 determines in step S47 whether or not the distribution delay time Dct 'is greater than the sum of the reaction delay time Dcrt' and the predetermined value.

In the case where the result shows that the distribution delay time Dct 'is greater than the sum of the reaction delay time Dcrt' and the prescribed value (yes in step S47), the delay synchronization control unit 43 issues a delay addition command to add the delay time Ar obtained by subtracting the reaction delay time Dcrt 'and the prescribed value from the distribution delay time Dct' to the reaction information in step S48.

After receiving the delay addition command, the target terminal 20a causes the reaction information delay addition unit 57 to add the delay time Ar to the reaction information under the control of the delay synchronization control unit 63. Accordingly, the target terminal 20a delays reproduction of the reaction information received from the edge terminal 20b by the delay time Ar.

In step S49, the delay synchronization control unit 43 issues a response information transmission command to one specific edge terminal 20b to cause the edge terminal 20b to start transmitting response information to the target terminal 20 a.

Thus, the target terminal 20a can prevent the reaction information of the content earlier than the content being reproduced from being reproduced first.

[2.2.2 example 4]

Fig. 13 is a diagram for describing example 4. Fig. 14 is a flowchart depicting a friend matching process performed by the management server 3 according to example 4. Fig. 15 is a flowchart depicting the first delay addition process. Fig. 16 is a flowchart depicting the second delay addition process.

As depicted in fig. 13, it is assumed that the content distributed from the content distribution server 10 to the target terminal 20a is delayed by the distribution delay time Dct. Further, it is assumed that the content distributed from the content distribution server 10 to the plurality of specific edge terminals 20b is delayed by the distribution delay time Dcr. Further, it is assumed that the communication from the target terminal 20a to the edge terminal 20b is delayed by the inter-user-terminal delay time Dtr. Further, it is assumed that the communication from the edge terminal 20b to the target terminal 20a is delayed by the inter-user-terminal delay time Drt.

Further, the edge terminal 20b reproduces the content only with a delay of the distribution delay time Dct with respect to the time when the content is distributed from the content distribution server 10.

Accordingly, the response information about the other users R who are viewing the content reproduced only with the delay of the distribution delay time Dct is reproduced by the target terminal 20a with the delay of the response delay time Dcrt (the distribution delay time dcr+the inter-user-terminal delay time dry).

Therefore, when the management server 3 performs the friend matching process, as depicted in fig. 14, the delay synchronization control unit 43 performs the first delay adding process in step S51, performs the second delay adding process in step S52, and issues a reaction information transmission command to the specific edge terminal 20b to cause the edge terminal 20b to start transmitting reaction information to the target terminal 20a in step S53.

Hereinafter, the first delay adding process and the second delay adding process will be described in detail.

As depicted in fig. 15, when the first delay adding process starts, the delay synchronization control unit 43 requests the distribution delay time Dct (information on the first communication delay) to the target terminal 20a in step S61 to acquire the distribution delay time Dct.

Subsequently, in step S62, the delay synchronization control unit 43 selects one of the plurality of specific edge terminals 20b, and requests the distribution delay time Dcr and the inter-user-terminal delay time Drt from the selected edge terminal 20b to acquire the distribution delay time Dcr and the inter-user-terminal delay time Drt.

Further, in step S63, the delay synchronization control unit 43 calculates a reaction delay time Dcrt (information about the second communication delay) by adding together the acquired distribution delay time Dcr and the inter-user-terminal delay time Drt.

Then, in step S64, the delay synchronization control unit 43 determines whether the reaction delay time Dcrt has been calculated for all the specific edge terminals 20 b. Then, in the case where the reaction delay time Dcrt is not calculated for all the specific edge terminals 20b (no in step S64), the process returns to step S62.

On the other hand, in the case where the reaction delay time Dcrt has been calculated for all the specific edge terminals 20b (yes in step S64), the delay synchronization control unit 43 extracts the maximum reaction delay time Dcrt from the calculated reaction delay times Dcrt as the maximum reaction delay time Dcrtmax in step S65.

Then, in step S66, the delay synchronization control unit 43 determines whether the maximum reaction delay time Dcrtmax is greater than the distribution delay time Dct. In the case where the result shows that the maximum reaction delay time Dcrtmax is not greater than the distribution delay time Dct (no in step S66), the first delay determination processing is ended.

On the other hand, in the case where the maximum reaction delay time Dcrtmax is greater than the distribution delay time Dct (yes in step S66), the delay synchronization control unit 43 issues a delay addition command to add the delay time Ac obtained by subtracting the distribution delay time Dct from the maximum reaction delay time Dcrtmax to the content in step S67.

That is, the delay synchronization control unit 43 adds a delay to the content based on the largest delay amount among the delay amounts of the pieces of reaction information.

Note that the above-described first delay adding process is also performed in all the specific edge terminals 20 b. By so doing, in the case where the delay time Ac is added by the target terminal 20a, the distribution delay time Dct' after the addition is equal to the time obtained by adding the delay time Ac to the distribution delay time Dct. Further, in the case where the delay time Ac is added by the edge terminal 20b, the distribution delay time Dcr 'after the addition is equal to the time obtained by adding the delay time Ac to the distribution delay time Dcr, and the reaction delay time Dcrt' becomes equal to the time obtained by adding the delay time Ac to the reaction delay time Dcrt.

As depicted in fig. 16, when the second delay adding process starts, the delay synchronization control unit 43 requests the target terminal 20a for the distribution delay time Dct 'obtained by the first delay adding process to acquire the distribution delay time Dct' in step S71.

In step S72, the delay synchronization control unit 43 selects one of the plurality of specific edge terminals 20b, and requests the distribution delay time Dcr 'and the inter-user-terminal delay time Drt obtained by the first delay adding process from the selected edge terminal 20b to acquire the distribution delay time Dcr' and the inter-user-terminal delay time Drt. Then, the delay synchronization control unit 43 calculates the reaction delay time Dcrt 'by adding the distribution delay time Dcr' and the inter-user-terminal delay time Drt.

In step S73, the delay synchronization control unit 43 determines whether the distribution delay time Dct 'is greater than the sum of the reaction delay time Dcrt' and a prescribed value. If the result shows that the distribution delay time Dct 'is not greater than the sum of the reaction delay time Dcrt' and the predetermined value (no in step S73), the process proceeds to step S75.

On the other hand, when the distribution delay time Dct 'is greater than the sum of the reaction delay time Dcrt' and the prescribed value (yes in step S73), the delay synchronization control unit 43 issues a delay addition command to add the delay time Ar obtained by subtracting the reaction delay time Dcrt 'and the prescribed value from the distribution delay time Dct' to the reaction information received from the specific edge terminal 20b in step S74.

The target terminal 20a, after receiving the delay addition command, causes the reaction information delay addition unit 57 to add the delay time Ar to the reaction information under the control of the delay synchronization control unit 63. Accordingly, the target terminal 20a delays reproduction of the reaction information received from the edge terminal 20b by the delay time Ar.

In step S75, the delay synchronization control unit 43 determines whether all the specific edge terminals 20b have been designated. Then, in the case where all the specific edge terminals 20b are not specified (no in step S75), the process returns to step S72.

On the other hand, in the case where all the specific edge terminals 20b have been designated (yes in step S75), the second delay adding process is ended.

[2.3 playback mode ]

Fig. 17 is a diagram for describing a playback mode. As described above, the content distribution server 10 transmits the content to the user terminal 20 in real time in units of packets. Further, the content viewer information storage unit 35 of the content distribution server 10 stores the content to which the time stamp is added.

In addition, in the user terminal 20, the reaction information to which the time stamp is added is stored in the reaction information storage unit 61. Further, in the content distribution server 10, the reaction information receiving unit 45 receives the time-stamped reaction information from the user terminal 20, and stores the reaction information in the reaction information storage unit 46.

Then, when the playback mode starts, as depicted in fig. 17, the content viewer information distribution unit 34 of the content distribution server 10 reads the content having the predetermined time stamp Tcp from the content viewer information storage unit 35, and transmits the content to the user terminal 20. Further, the content viewer information distribution unit 34 transmits the time stamp Tcp to the management server 3.

In the user terminal 20, when the content receiving unit 52 receives the content, the image and sound generating unit 54 and the image and sound outputting unit 55 reproduce the content for playback. Thus, the user terminal 20 enables the user to view the redistributed content.

In the management server 3, when the time stamp reception unit 47 receives the time stamp Tcp, the response information distribution unit 48 transmits the response information corresponding to the time stamp Tcp to the user terminal 20 and the content distribution server 10.

In the content distribution server 10, when the response information receiving unit 36 receives the response information, the image and sound output unit 37 causes the display device 13 to display the image included in the response information, and causes the sound output device 14 to output the sound included in the response information. For example, in the case of reproducing a plurality of pieces of reaction information, the image and sound output unit 37 causes the display device 13 to display images included in the plurality of pieces of reaction information in a multi-view manner. Further, the image and sound output unit 37 mixes the sounds included in the pieces of reaction information, applies reverberation to the sounds, or converts the sounds into cheering sounds, and causes the sound output device 14 to output the sounds. Thus, the performer Cpf and the viewer Cau can view the reaction information.

Further, in the user terminal 20, when the response information receiving unit 56 receives the response information, the image and sound generating unit 54 and the image and sound output unit 55 reproduce the response information. Thus, it is possible to view the reaction information in synchronization with the content reproduced for playback.

Note that the user terminal 20 may reproduce the reaction information corresponding to the time stamp Tcp captured and collected by itself. Further, the content distribution server 10 may receive reaction information corresponding to the time stamp Tcp from the user terminal 20.

<3 > examples of how content and reaction information are reproduced

Next, an example of how the content and the reaction information are reproduced in the user terminal system 4 will be described. Fig. 18 is a diagram depicting an example of arrangement of the display device 21 and the sound output device 22 in the user terminal system 4. Fig. 19 is a diagram depicting an example of how the reaction information is reproduced.

For example, in the user terminal system 4, as depicted in fig. 18, display devices 21a to 21c are provided as the display device 21, and sound output devices 22a to 22k are provided as the sound output devices 22.

The display device 21a is provided in front of the user, the display device 21b is provided on the left side of the display device 21a, and the display device 21c is provided on the right side of the display device 21 a. Then, an image of the content is displayed on the display device 21a, and images of the reaction information (the body shape of the user) are displayed on the display devices 21b and 21 c.

The sound output device 22a is disposed at the front upper right as viewed from the user, the sound output device 22b is disposed at the front upper left as viewed from the user, the sound output device 22k is disposed at the rear of the user, and the sound of the content is output by such a device.

The sound output device 22c is disposed at the upper right side viewed from the user, the sound output device 22d is disposed at the upper left side viewed from the user, the sound output device 22g is disposed at the lower right side viewed from the user, the sound output device 22h is disposed at the lower left side viewed from the user, and the sound of the reaction information is output by such a device.

The sound output device 22e is disposed at the upper rear right side viewed from the user, the sound output device 22f is disposed at the upper rear left side viewed from the user, the sound output device 22i is disposed at the lower rear right side viewed from the user, the sound output device 22j is disposed at the lower rear left side viewed from the user, and the sound of the viewer information is output by such a device.

Then, in the case where an image based on a plurality of pieces of reaction information is displayed on the display device 21b or 21c, as depicted in fig. 19, the image and sound generation unit 54 and the image and sound output unit 55 display images of other users R such that the images change according to the delay time added to the reaction information. That is, the image and sound generation unit 54 and the image and sound output unit 55 reproduce the reaction information in a manner depending on the amount of delay added to the reaction information.

Specifically, as the amount of delay (delay time) added to the reaction information increases, the image and sound generation unit 54 and the image and sound output unit 55 display images of other users R, so that the images shrink in size, increase in spatial distance, increase in transparency, or change in color.

Therefore, the target user T can easily grasp the other users R having a long delay time, and can also make the other users R having a long delay time and having difficulty in establishing synchronization inconspicuous.

<4. Hardware configuration example >

The above-described management server 3, content distribution server 10, and user terminal 20 may have a hardware configuration depicted in fig. 20, for example.

As depicted in fig. 20, the hardware 900 basically includes a CPU 902, a ROM 904, a RAM 906, a host bus 908 and a bridge 910. The hardware also includes an external bus 912, an interface 914, an input unit 916, an output unit 918, a storage unit 920, a drive 922, a connection port 924, and a communication unit 926.

The CPU 902 executes the above-described processing based on various programs recorded in the ROM 904, the RAM 906, the storage unit 920, or the removable recording medium 928. The ROM 904 stores programs to be read by the CPU 902, data to be used for calculation, and the like. For example, the RAM 906 stores a program to be read by the CPU 902, various parameters appropriately changed when the program is executed, and the like.

Such components are connected to each other via, for example, a host bus 908 capable of high-speed data transmission. On the other hand, the host bus 908 is connected to an external bus 912 having a relatively low data transmission speed via a bridge 910, for example. Further, as the input unit 916, for example, components such as a mouse, a keyboard, a touch panel, buttons, switches, and a joystick may be used. Further, a remote controller (hereinafter, referred to as a remote controller) capable of transmitting a control signal using infrared rays or other radio waves may be used as the input unit 916.

The output unit 918 is, for example, a device capable of outputting the acquired information, such as a printer, a mobile phone, or a facsimile. The storage unit 920 is a device for storing various data. For example, a magnetic storage device such as a Hard Disk Drive (HDD), a semiconductor storage device, an optical storage device, a magneto-optical storage device, or the like is used as the storage unit 920.

The drive 922 is, for example, a device that reads information recorded in a removable recording medium 928 (e.g., a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory) or writes information to the removable recording medium 928. The removable recording medium 928 is, for example, a DVD medium, a Blu-ray (Blu-ray) medium, an HDDVD medium, various semiconductor storage media, or the like. Needless to say, the removable recording medium 928 may be, for example, an IC card on which a noncontact IC chip is mounted, an electronic device, or the like. Note that IC is an abbreviation for integrated circuit.

The connection port 924 is, for example, a port to which the external connection device 930 is connected, such as a USB port, an IEEE 1394 port, a SCSI, an RS-232C port, or an optical audio terminal. The external connection device 930 is, for example, a printer, a portable music player, a digital image pickup device, a digital video image pickup device, an IC recorder, or the like. Note that USB is an abbreviation for universal serial bus. In addition, SCSI is an abbreviation for Small computer System interface.

The communication unit 926 is means for establishing a connection with the network 5.

<5. Modified example >

Note that the embodiment modes are not limited to the specific examples described above, and can be configured as various modified examples.

For example, in example 1, in the case where there is a reaction delay time Dcrt shorter than the distribution delay time Dct, the delay time (delay amount) is added to the reaction information. However, in the case where there is a reaction delay time Dcrt longer than the distribution delay time Dct, the delay time may be added to the content.

Further, in the case where the communication count is not equal to or greater than 1 in example 1 (no in step S4), the delay synchronization control unit 43 may issue a command to the content distribution server 10 to transmit the viewer information to the target terminal 20 a.

Further, in examples 1, 3, and 4, the management server 3 controls reproduction of the content and the reaction information, but reproduction may be controlled by the user terminal 20. Further, in example 2, the user terminal 20 controls reproduction of the content and the reaction information, but reproduction may be controlled by the management server 3.

Further, the functional units (control units) of the management server 3, the content distribution server 10, and the user terminal 20 in the above-described embodiments may be appropriately grouped or separated for each process. Further, functional units (control units) provided in the management server 3, the content distribution server 10, and the user terminal 20 may be provided in other devices.

<6. Summary >

In the above embodiment, the following effects can be obtained.

The information processing apparatus (management server 3 or user terminal 20) of the embodiment includes a control unit (delay synchronization control unit 43, delay synchronization control unit 63, etc.) that acquires information on a first communication delay (distribution delay time, distribution timestamp) from the content distribution server 10 to the target terminal 20a and information on a second communication delay (reaction delay time, reaction timestamp) from the content distribution server 10 to the target terminal 20a via the edge terminal 20b, and controls reproduction in the target terminal of the content transmitted from the content distribution server 10 and the reaction information transmitted from the edge terminal 20b based on the information on the first communication delay and the information on the second communication delay.

Thus, the information processing apparatus enables the target terminal 20a to reproduce the content and the reaction information in a case where the content and the reaction information are synchronized with each other.

Therefore, the information processing apparatus can suppress a decrease in sense of unity with the other users R given to the target user T due to a loss of synchronism between the content and the reaction information.

Further, in the information processing apparatus, it is conceivable that the control unit adds a delay to the reaction information transmitted from the edge terminal 20 b.

Thus, the information processing apparatus enables the target terminal 20a to add a delay to the reaction information and reproduce the reaction information synchronized with the content.

Further, in the information processing apparatus, it is conceivable that the control unit adds a delay to the content transmitted from the content distribution server 10.

Thus, the information processing apparatus enables the target terminal 20a to add a delay to the content and reproduce the content synchronized with the reaction information.

Further, in the information processing apparatus, it is conceivable that the control unit acquires the delay amount of the content transmitted from the content distribution server 10 to the target terminal 20a as the information on the first communication delay.

Further, in the information processing apparatus, it is conceivable that the control unit acquires, as information on the second communication delay, the delay amount of the content transmitted from the content distribution server to the edge terminal and the delay amount between the edge terminal and the target terminal.

Accordingly, the information processing apparatus can synchronize the content and the reaction information based on the delay amount.

Further, in the information processing apparatus, it is conceivable that the control unit selects, from the plurality of edge terminals 20b, the edge terminal 20b that transmits the reaction information whose delay amount is closest to the delay amount of the content, and causes the selected edge terminal 20b to transmit the reaction information.

Therefore, the information processing apparatus can reproduce the content and the reaction information so that the time lag is as small as possible.

Further, in the information processing apparatus, it is conceivable that the control unit adds a delay to the content based on a maximum delay amount among delay amounts of the pieces of reaction information.

Thus, the information processing apparatus can prevent the reaction information of the content earlier than the content to be reproduced from being reproduced.

Further, in the information processing apparatus, the control unit may cause the upper limit number of edge terminals 20b to transmit the reaction information to the target terminal 20 a.

Accordingly, the target terminal 20a can reproduce the upper limit number of pieces of reaction information together with the content.

Thus, the information processing apparatus can give the target user T a sense of unity with many other users R.

Further, in the information processing apparatus, it is conceivable that the control unit causes the edge terminal 20b, which has a difference between the delay amount of the content and the delay amount of the reaction information equal to or smaller than a prescribed value, to transmit the reaction information.

Accordingly, the target terminal 20a reproduces the content and the reaction information in a case where loss of synchronism between the content and the reaction information is equal to or smaller than a prescribed value.

Further, in the information processing apparatus, in the case where there is no reaction information in which the difference between the delay amount of the content and the delay amount of the reaction information is equal to or smaller than a prescribed value, the control unit causes the content distribution server to transmit the viewer information to the target terminal.

Accordingly, the target terminal 20a reproduces the content and the viewer information in a state where the content and the viewer information are synchronized with each other.

Accordingly, the information processing apparatus can give the target user T an sense of unity with the viewer Cau who is watching the content on site.

Further, in the information processing apparatus, it is conceivable that the control unit reproduces the reaction information in a manner depending on the amount of delay added to the reaction information.

Further, in the information processing apparatus, it is conceivable that when the content for playback is transmitted from the content distribution server 10, the control unit causes the target terminal 20a to reproduce the reaction information corresponding to the content transmitted for playback.

Thus, it is possible to view the reaction information in synchronization with the content reproduced for playback.

Further, in the information processing apparatus, it is conceivable that the control unit causes the target terminal 20a to reproduce the reaction information acquired by the target terminal 20a, the reaction information corresponding to the content transmitted for playback.

Thus, the target user T can view his/her reaction when the content for playback is reproduced.

Further, in the information processing apparatus, it is conceivable that the control unit causes the content distribution server 10 to reproduce reaction information corresponding to the content transmitted for playback.

Thus, the performer Cpf and the viewer Cau in the content venue can view the reactions of the users existing at the remote locations.

Further, the information processing method of the embodiment includes: information on a first communication delay from a content distribution server to a target terminal and information on a second communication delay from the content distribution server to the target terminal via an edge terminal are acquired, and reproduction in the target terminal of content transmitted from the content distribution server and reaction information transmitted from the edge terminal is controlled based on the information on the first communication delay and the information on the second communication delay.

Further, the program of the embodiment includes: information on a first communication delay from a content distribution server to a target terminal and information on a second communication delay from the content distribution server to the target terminal via an edge terminal are acquired, and reproduction in the target terminal of content transmitted from the content distribution server and reaction information transmitted from the edge terminal is controlled based on the information on the first communication delay and the information on the second communication delay.

Such a program may be recorded in advance in an HDD that is a storage medium built in an apparatus such as a computer apparatus, or in a ROM or the like in a microcomputer having a CPU.

Alternatively, the program may be temporarily or permanently stored (recorded) in a removable recording medium such as a flexible disk, a compact disc read only memory (CD-ROM), a magneto-optical (MO) disc, a Digital Versatile Disc (DVD), a blu-ray disc (registered trademark), a magnetic disk, a semiconductor memory, or a memory card. Such a removable recording medium may be provided as so-called packaged software.

Further, such a program may be installed from a removable recording medium into a personal computer or the like, or may be downloaded from a download site via a network such as a Local Area Network (LAN) or the internet.

Further, such a program is suitable for providing the information processing apparatus of the embodiment in a wide range. For example, downloading a program to a mobile terminal device such as a smart phone or tablet computer, a mobile phone, a personal computer, a video game console, a video device, a Personal Digital Assistant (PDA), or the like enables such a device to be used as an information processing device of the present disclosure.

Note that the effects described herein are merely examples and are not limiting, and other effects may be provided.

<7 > this technology

Note that the present technology may also have the following configuration.

(1)

An information processing apparatus includes

A control unit configured to:

acquiring information on a first communication delay from a content distribution server to a target terminal and information on a second communication delay from the content distribution server to the target terminal via an edge terminal, and

based on the information on the first communication delay and the information on the second communication delay, reproduction in the target terminal of the content transmitted from the content distribution server and the reaction information transmitted from the edge terminal is controlled.

(2)

The information processing apparatus according to (1), wherein,

the control unit adds a delay to the reaction information transmitted from the edge terminal.

(3)

The information processing apparatus according to (1) or (2), wherein,

the control unit adds a delay to the content transmitted from the content distribution server.

(4)

The information processing apparatus according to any one of (1) to (3), wherein,

the control unit acquires, as information on the first communication delay, a delay amount of the content transmitted from the content distribution server to the target terminal.

(5)

The information processing apparatus according to any one of (1) to (4), wherein,

the control unit acquires, as information on the second communication delay, an amount of delay of the content transmitted from the content distribution server to the edge terminal and an amount of delay between the edge terminal and the target terminal.

(6)

The information processing apparatus according to any one of (1) to (5), wherein,

the control unit selects an edge terminal that transmits reaction information whose delay amount is closest to that of the content from among the plurality of edge terminals, and causes the selected edge terminal to transmit the reaction information.

(7)

The information processing apparatus according to any one of (1) to (6), wherein,

the control unit adds a delay to the content based on a maximum delay amount among delay amounts of a plurality of pieces of the reaction information.

(8)

The information processing apparatus according to any one of (1) to (7), wherein,

the control unit causes an upper limit number of the edge terminals to transmit the reaction information to the target terminal.

(9)

The information processing apparatus according to any one of (1) to (8), wherein,

the control unit adds a delay to the content or the reaction information so that a difference between a delay amount of the content and a delay amount of the reaction information is equal to or smaller than a prescribed value.

(10)

The information processing apparatus according to any one of (1) to (9), wherein,

in the case where there is no reaction information in which the difference between the delay amount of the content and the delay amount of the reaction information is equal to or smaller than a prescribed value, the control unit causes the content distribution server to transmit viewer information to the target terminal.

(11)

The information processing apparatus according to any one of (1) to (10), wherein,

the control unit causes the reaction information to be reproduced in a manner depending on the amount of delay added to the reaction information.

(12)

The information processing apparatus according to any one of (1) to (11), wherein,

when the content is transmitted from the content distribution server for playback, the control unit causes the target terminal to reproduce the reaction information corresponding to the content transmitted for playback.

(13)

The information processing apparatus according to (12), wherein,

the control unit causes the target terminal to reproduce the reaction information acquired by the target terminal, the reaction information corresponding to the content transmitted for playback.

(14)

The information processing apparatus according to (12) or (13), wherein,

the control unit causes the content distribution server to reproduce the reaction information corresponding to the content transmitted for playback.

(15)

An information processing method, comprising:

(16)

A program that causes an information processing apparatus to execute processing, the processing comprising:

controlling reproduction in the target terminal of the content transmitted from the content distribution server and the reaction information transmitted from the edge terminal based on the information on the first communication delay and the information on the second communication delay.

List of reference numerals

1 content distribution System

2 content distribution server system

3 management server

4 user terminal system

10 content distribution server

20 user terminal

43 delay synchronous control unit

63 delay the synchronization control unit.

Claims

1. An information processing apparatus includes

A control unit configured to:

2. The information processing apparatus according to claim 1, wherein,

3. The information processing apparatus according to claim 1, wherein,

4. The information processing apparatus according to claim 1, wherein,

5. The information processing apparatus according to claim 1, wherein,

6. The information processing apparatus according to claim 1, wherein,

7. The information processing apparatus according to claim 1, wherein,

8. The information processing apparatus according to claim 1, wherein,

9. The information processing apparatus according to claim 1, wherein,

the control unit causes an edge terminal, in which a difference between a delay amount of the content and a delay amount of the response information is equal to or smaller than a prescribed value, to transmit the response information.

10. The information processing apparatus according to claim 1, wherein,

11. The information processing apparatus according to claim 1, wherein,

12. The information processing apparatus according to claim 1, wherein,

13. The information processing apparatus according to claim 12, wherein,

14. The information processing apparatus according to claim 12, wherein,

15. An information processing method, comprising:

16. A program that causes an information processing apparatus to execute processing, the processing comprising: