JP3974450B2 - Stream media distribution method and apparatus, software and recording medium - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a stream media distribution method and apparatus, software, and a recording medium, and relates to the production of main media performed when distributing stream media such as video and audio.
[0002]
[Prior art]
Conventionally, stream media using a combination of moving images and sound is used in television broadcasting, and information is transmitted to each viewer using stream media containing only audio in radio broadcasting.
In addition, sound effects are often used to convey viewers' emotions when conveying the contents of the broadcast. Generally, music is used as the sound effect.
[0003]
For example, when producing stream media such as a movie or a television program, music is superimposed on the sound as BGM (background music) for each scene. Since this BGM is provided to viewers and viewers together with moving images, it has the effect of enhancing the emotions of the viewers and viewers. Such effects using BGM are generally widely used.
[0004]
[Problems to be solved by the invention]
Production using BGM is now indispensable for production of television programs and the like. However, such effects are rarely used in live broadcasting such as sports broadcasting. The reason is as follows.
In live broadcasting such as sports broadcasting, it is impossible to predict the contents of various events and their timing. Therefore, when a specific event assumed in advance occurs, it is difficult to immediately select a specific BGM for effectively attracting the scene and reflect it in the contents of the program.
[0005]
Also, in order to effectively attract the scene, it is necessary to insert BGM from a time slightly before the time when the event occurs. However, before an unpredictable event occurs, it is impossible to select a specific BGM that is effective for producing the event.
[0006]
Further, for example, in the case of a baseball game, fans of two teams that play against each other watch the game relay at the same time. In this case, the emotion of each fan causes opposite feelings of “happy” and “sorry” for the event that one team player hit the home run.
Therefore, assuming that a BGM for exciting the home run scene is added, the fan psychology of both teams must be taken into consideration, so that a desirable BGM represents not only “joy” but also “sorrow”. Things are also needed and not one.
[0007]
Further, in the case of programs and relays in which a plurality of preferences can exist as in the case of baseball broadcasts, the number of types of effects is required for the number of preferences.
However, in the case of television relay, since only one type of audio signal transmitted together with a moving image can be used as a BGM transmission means, BGM used for production is limited to one type.
[0008]
Therefore, the same BGM is provided to all viewers in the television relay, and an effective BGM for exciting each emotion that is different for each viewer cannot be given.
It is an object of the present invention to provide a stream media distribution method and apparatus, a program, and a recording medium that enable effective production of the main media in response to differences in viewer preference and emotion.
[0009]
[Means for Solving the Problems]
Claim 1 By live or live broadcast A communication system in which a server that distributes continuously appearing information such as video and audio as stream media and at least one client terminal that receives and reproduces the stream media distributed by the server are connected via a predetermined communication network The stream media delivery method for controlling the stream media, wherein the server side provides live information representing the situation in each scene of the stream media to be delivered. Input, add the same identification information to the stream media and the live information at the time corresponding to each other, send the live information, and delay the stream media to which the same identification information is given with respect to the live information in time And then send On the client terminal side, an additional medium for producing each scene of the stream media and a table indicating the playback trigger of the additional media are prepared, and the analysis result of the received live information matches the playback trigger of the table. Received live information If the identification information added to is the same as the identification information included in the received stream media, The corresponding additional medium is output at a timing according to the identification information.
[0010]
In the first aspect, live information is distributed to the client terminal together with the stream media from the server side. Live information represents the status of events that occur in various situations. For example, when a live broadcast is performed using baseball video and audio as stream media, an event such as a home run or a hit may be distributed as live information.
[0011]
Since the same identification information (ID) is added to the stream media and the live information at the corresponding times, even if the stream media and the live information are distributed separately from independent servers, this The timing of the stream media and the live information can be matched using the identification information.
The additional media used on the client terminal side is information for producing each scene of the stream media. For example, sound effects and BGM may be used. On the client terminal side, when the analysis result of the received live information matches the playback timing of the table, the corresponding additional media is output at a timing according to the received live information and the identification information included in the stream media. To do.
[0012]
If the contents of the table are determined in advance in accordance with the viewer's preference and emotional difference, even if the same live information is distributed from the server side, the difference in the preference and emotion of each viewer is reflected. It is possible to play additional media with various playback opportunities and to attract each viewer effectively to each viewer.
[0013]
Claim 2 By live or live broadcast A communication system in which a server that distributes continuously appearing information such as video and audio as stream media and at least one client terminal that receives and reproduces the stream media distributed by the server are connected via a predetermined communication network The stream media delivery method for controlling the stream media, wherein the server side provides live information representing the situation in each scene of the stream media to be delivered. Input, add the same identification information to the stream media and the live information at the time corresponding to each other, send the live information, and delay the stream media to which the same identification information is given with respect to the live information in time Then send It is characterized by doing.
[0014]
In the second aspect, similarly to the first aspect, the stream media and the live information are distributed to the client terminal.
[0015]
Also, Since the live information reaches the client terminal before the stream media, it is possible to start the reproduction of the additional media slightly before the time when the specific event occurs.
Claim 3 The stream media distribution method according to claim 2, wherein the server side uses a numerical value that monotonously increases with time as identification information added to the stream media and live information.
[0016]
Claim 3 Since the time can be grasped from the contents of the identification information added to the stream media and the live information, it is possible to adjust the timing for starting the reproduction of the additional media.
Claim 4 Claims 3 In this stream media distribution method, the server side periodically adds the identification information to the stream media and live information.
[0017]
Claim 4 In this case, the client terminal can periodically acquire identification information from the stream media and the live information to grasp the time.
Claim 5 Is By live or live broadcast A communication system in which a server that distributes continuously appearing information such as video and audio as stream media and at least one client terminal that receives and reproduces the stream media distributed by the server are connected via a predetermined communication network Stream media delivery method for controlling video, when live information representing the situation in each scene is delivered along with the stream media Thus, the same identification information is periodically added to the stream media and the live information corresponding to each other at regular intervals, and the stream media to which the same identification information is assigned is temporally related to the live information. If delivered later, On the client terminal side, an additional medium for producing each scene of the stream media and a table indicating the playback trigger of the additional media are prepared, and the analysis result of the received live information matches the playback trigger of the table. If Control the playback timing of the additional media according to the contents of the delay table describing the correspondence between the playback trigger of the additional media and the delay time. A corresponding additional medium is output.
[0018]
Claim 5 As in claim 1, since the client terminal plays the additional media together with the stream media, if the contents of the table are determined in advance corresponding to the viewer's preference and emotional difference, the server side Even when the same live information is distributed, additional media can be played at a playback opportunity that reflects the difference in taste and emotion of each viewer, and each scene can be effectively attracted to each viewer. .
[0020]
Also, It is possible to automatically adjust the playback timing of the additional media for each type of playback timing of the additional media, and perform an effective presentation.
[0023]
Claim 6 Is By live or live broadcast A communication system in which a server that distributes continuously appearing information such as video and audio as stream media and at least one client terminal that receives and reproduces the stream media distributed by the server are connected via a predetermined communication network The stream media distribution device for controlling the stream media, the server side is provided with live information indicating the situation in each scene of the stream media to be distributed Input information, an identification information adding means for adding the same identification information to the stream media and the live information at the corresponding times, and a stream for delaying the stream media provided with the same identification information with respect to the live information in terms of time Media delay means and live information to stream media delivery A live information sending means for sending, and on the client terminal side, an additional medium for producing each scene of the stream media, a table showing a playback trigger of the additional media, and an analysis result of the received live information are Live information received when the table playback timing matches If the identification information added to is the same as the identification information included in the received stream media, Additional media playback means for outputting the corresponding additional media at a timing according to the identification information is provided.
[0024]
Claim 6 By using this apparatus, the same operation as the method of claim 1 is realized.
Claim 7 Is By live broadcast or live broadcast A communication system in which a server that distributes continuously appearing information such as video and audio as stream media and at least one client terminal that receives and reproduces the stream media distributed by the server are connected via a predetermined communication network A stream media distribution device for controlling the stream media, wherein the server side receives live information indicating the situation in each scene of the stream media to be distributed. An input of identification information adding means for adding the same identification information to the stream media and the live information at the time corresponding to each other, and a stream for delaying the stream media provided with the same identification information with respect to the live information in terms of time Media delay means and live information to stream media delivery Live information sending means for sending is provided.
[0025]
Claim 7 By using this apparatus, the same operation as the method of claim 2 is realized.
[0026]
Claim 8 Claims 7 In the stream media distribution apparatus, the server side Identification information adding means Is characterized in that a numerical value that monotonously increases with the passage of time is used as identification information added to stream media and live information.
[0027]
Claim 8 By using the device of claim 3 The same operation as that of the method is realized.
Claim 9 Claims 8 In the stream media distribution apparatus, the server side Identification information adding means Is characterized in that the identification information is periodically added to stream media and live information.
[0028]
Claim 9 By using the device of claim 4 The same operation as that of the method is realized.
Claim 10 Is By live broadcast or live broadcast A communication system in which a server that distributes continuously appearing information such as video and audio as stream media and at least one client terminal that receives and reproduces the stream media distributed by the server are connected via a predetermined communication network Stream media distribution device for controlling video, when live information representing the situation in each scene is distributed along with the stream media Thus, the same identification information is periodically added to the stream media and the live information corresponding to each other at regular intervals, and the stream media to which the same identification information is assigned is temporally related to the live information. If delivered later, On the client terminal side, when the additional media for producing each scene of the stream media and the table representing the playback trigger of the additional media, and the analysis result of the received live information match the playback trigger of the table, Control the playback timing of the additional media according to the contents of the delay table describing the correspondence between the playback trigger of the additional media and the delay time. And additional media playback means for outputting the corresponding additional media.
[0029]
Claim 10 By using the device of claim 5 The same operation as that of the method is realized.
[0033]
Claim 11 Is By live broadcast or live broadcast A communication system in which a server that distributes continuously appearing information such as video and audio as stream media and at least one client terminal that receives and reproduces the stream media distributed by the server are connected via a predetermined communication network Software for controlling the server side of the live stream information representing the situation in each scene of the stream media to be distributed Input, An identification information addition procedure for adding the same identification information to stream media and live information at corresponding times; A stream media delay procedure for delaying the stream media with the same identification information in time with respect to the live information, and matching the live information with the delivery of the stream media A live information transmission procedure is provided. The identification information adding procedure uses a numerical value that monotonously increases with time as identification information to be added to the stream media and live information, and periodically adds the identification information to the stream media and live information. It is characterized by that.
[0034]
Claim 11 By installing the software in the server side device, , 3 and 4 The same operation as the method can be realized.
[0037]
Claim 12 Is By live broadcast or live broadcast A communication system in which a server that distributes continuously appearing information such as video and audio as stream media and at least one client terminal that receives and reproduces the stream media distributed by the server are connected via a predetermined communication network Software for controlling the client terminal side, and live information representing the situation in each scene is delivered together with the stream media Thus, the same identification information is periodically added to the stream media and the live information corresponding to each other at regular intervals, and the stream media to which the same identification information is assigned is temporally related to the live information. If delivered later, When the additional media for producing each scene of the stream media and the table data indicating the playback trigger of the additional media and the analysis result of the received live information match the playback trigger of the table, Control the playback timing of the additional media according to the contents of the delay table describing the correspondence between the playback trigger of the additional media and the delay time. And an additional medium output procedure for outputting the corresponding additional medium.
[0038]
Claim 12 By installing the software in the client terminal. 5 The same operation as the method can be realized.
[0040]
Claim 13 Claims 11 A recording medium on which the software described in 1 is recorded.
Claim 13 By installing the software recorded on the recording medium in the server-side device, claims 2 to 4 The same operation as the method can be realized.
[0041]
Claim 14 Claims 12 A recording medium on which the software described in 1 is recorded.
Claim 14 The software recorded on the recording medium is incorporated into the client terminal to 5 The same operation as the method can be realized.
[0042]
DETAILED DESCRIPTION OF THE INVENTION
One embodiment of a stream media distribution method and apparatus, software, and recording medium according to the present invention will be described with reference to FIGS. This form corresponds to all the claims.
[0043]
FIG. 1 is a block diagram illustrating a configuration example of a system. FIG. 2 is a block diagram illustrating a configuration example of the main media distribution server. FIG. 3 is a block diagram illustrating a configuration example of the live information distribution server. FIG. 4 is a schematic diagram showing a configuration example (1) of the rule DB. FIG. 5 is a schematic diagram showing a configuration example (2) of the rule DB. FIG. 6 is a schematic diagram showing a configuration example (1) of live information. FIG. 7 is a schematic diagram showing a configuration example (2) of live information. FIG. 8 is a schematic diagram illustrating a configuration example of the timing determination rule.
[0044]
In this form, each The live information sending means, identification information adding means, table, and additional media reproducing means in the claims correspond to the live information distributor 24, ID assigner 23, rule DB 50, and additional media player 49, respectively.
[0045]
In the system shown in FIG. 1, a main media distribution server 10, a live information distribution server 20, and a client terminal 40 are connected via a network 30 in a state where they can communicate with each other.
The main media distribution server 10 distributes continuous video and audio obtained by shooting, that is, information on stream media, to the client terminal 40 via the network 30 as the main media, as in a general live broadcast such as sports. To do.
[0046]
The live information distribution server 20 distributes the status of various events that have occurred for the relay target to the client terminal 40 via the network 30 as live information. Specific examples of live information are shown in FIGS.
The client terminal 40 reproduces the stream media distributed from the main media distribution server 10 and reproduces the production corresponding to the live information distributed from the live information distribution server 20.
[0047]
As the network 30, for example, an IP network such as the Internet may be used, or a network that communicates using other protocols may be used. Further, as the network 30, a wired or wireless general broadcasting network may be used, or a digital broadcasting network may be used.
Further, the main media distribution server 10 and the live information distribution server 20 may be configured integrally. Further, a communication network connecting the main media distribution server 10 and the client terminal 40 and a communication network connecting the live information distribution server 20 and the client terminal 40 may be configured independently.
[0048]
As shown in FIG. 1, the client terminal 40 includes a main media receiver 41, an ID decoder 42, a main media player 43, a live information receiver 44, a situation determination unit 45, an additional media selector 46, an ID decoder 47, A synchronizer 48, an additional media player 49, a rule DB 50, an additional media DB 51, and a user setting device 52 are provided.
The main media receiver 41 receives the main media distributed from the main media distribution server 10 from the network 30. The ID decoder 42 decodes and extracts the ID, that is, the identification information from the received main medium. The main media player 43 reproduces the received main media, that is, video and audio, such as a television receiver.
[0049]
The live information receiver 44 receives live information distributed from the live information distribution server 20 from the network 30.
The situation determination unit 45 analyzes the content of the received live information and determines the current situation of the relay target according to the rules held in the rule DB 50.
The additional media selector 46 selects additional media used for production according to the result of the situation determination by the situation determiner 45. In the example of FIG. 1, the additional media DB 51 that holds a large number of additional media is provided on the client terminal 40, so that the additional media selector 46 can selectively extract one additional media from the additional media DB 51.
[0050]
The ID decoder 47 decodes and extracts ID, that is, identification information, from the received live information.
The synchronizer 48 synchronizes the output timing of the additional media to be reproduced with the timing of the main media using the ID.
[0051]
The additional media player 49 plays back the specific additional media (for example, sound effect) selected by the additional media selector 46 at a timing controlled by the synchronizer 48.
The user setting device 52 updates the contents of the rule DB 50 and the additional media DB 51 according to the input from the user. Thereby, the contents of the rule DB 50 and the additional media DB 51 can be matched to individual user preferences.
[0052]
On the other hand, the main media distribution server 10 includes a main media input device 11, an ID insertion device 12, a main media delay device 13, a main media distribution device 14, and an ID transmitter 15, as shown in FIG.
The main media input device 11 is input with information of the main media that is the main subject of relay, such as live relay video and live relay audio. For example, baseball broadcast video, concert broadcast audio, and the like are input as main media information.
[0053]
The ID inserter 12 sequentially inserts IDs indicating time positions into the main media input from the main media input device 11.
The timing at which the ID inserter 12 inserts the ID may be matched with the timing at which an event such as a hit or home run occurs, for example, in a baseball broadcast, or may be periodically inserted at a constant period.
[0054]
Regarding the contents of the ID to be inserted, arbitrary character strings that do not overlap each other may be automatically generated and assigned to the ID every time ID is inserted, or a time code representing time or time may be assigned as the ID.
As for the method for inserting the ID, for example, assuming that the main medium is encoded by the MPEG-2 system (ISO / IEC JTC1 / 13818-1), the ID may be embedded in the user area. Further, an ID may be embedded in the video as a digital watermark.
[0055]
The information on the main media input from the main media input device 11 is buffered for a predetermined time inside the main media delay device 13 and is input to the main media distributor 14 after being delayed.
The main media distributor 14 distributes the main media information input from the main media delay unit 13 to the client terminal 40 via the network 30.
[0056]
Since the main media is delayed for a certain time by the main media delay unit 13 before being distributed, the main media distributed to the client terminal 40 is delayed by the client terminal 40 from the live information distributed from the live information distribution server 20. Received.
The ID transmitter 15 notifies the live information distribution server 20 of the same ID as the ID inserted into the main medium by the ID inserter 12 via the network 30.
[0057]
On the other hand, the live information distribution server 20 includes a live information input device 21, an ID receiver 22, an ID assigning device 23, and a live information distribution device 24 as shown in FIG.
Live information indicating the current situation or event to be relayed is sequentially input to the live information input unit 21. For example, in the case of a baseball broadcast, information on events such as hits and home runs and the progress of the game are input as live information. In the case of a music concert, information on the currently played music and the progress of the performance are input as live information.
[0058]
The format of the live information to be input may be, for example, a format formatted in XML (eXtensible Markup Language), or may be free text information.
The ID receiver 22 receives the ID information transmitted from the main media distribution server 10 via the network 30.
[0059]
The ID assigner 23 assigns the same ID as the ID received by the ID receiver 22 to the live information input to the live information input device 21. Therefore, the ID assigned to the main media distributed by the main media distribution server 10 and the ID assigned to the live information distributed by the live information distribution server 20 are the same.
In this example, in order to give the same ID to the main media and live information, the ID information generated inside the main media distribution server 10 is notified to the live information distribution server 20, but a common ID is used. A generator may be specially provided so that both the main media distribution server 10 and the live information distribution server 20 acquire an ID by referring to a common ID generator.
[0060]
The live information to which the ID is assigned by the ID assigner 23 is input to the live information distributor 24 and distributed to the client terminal 40 via the network 30.
The main media distributed from the main media distribution server 10 is received by the main media receiver 41 of the client terminal 40, the ID is extracted by the ID decoder 42, and then reproduced by the main media player 43.
[0061]
The live information distributed from the live information distribution server 20 is received by the live information receiver 44 of the client terminal 40 and input to the situation determination unit 45.
By the way, in order to enable an effective presentation, it is necessary to register information in accordance with the user's preference and the like in the rule DB 50 and the additional media DB 51. In this example, the contents of the rule DB 50 and the additional media DB 51 can be updated using the user setting device 52. Therefore, the user operates the user setting device 52 prior to the live broadcast or during the live broadcast to update the contents of the rule DB 50 and the additional media DB 51 according to his / her preference.
[0062]
In other words, the additional media DB 51 registers effect videos such as music, sound effects, and animation videos that are preferred for effective viewing of the main media. In addition, conditions for reproducing sound effects and effect images registered in the additional media DB 51 are registered in the rule DB 50.
The rules registered in the rule DB 50 are configured as shown in FIG. 4, for example. In the example of FIG. 4, the rules are described in a table format in which the correspondence between the specific situation and the sound effect presented at that time is paired.
[0063]
In the rule of FIG. 4, for example, when the situation “Team A player home run” occurs, a condition that the sound effect “happy.wav” is presented is described. Here, sound effect (additional media) data such as “happy.wav” is registered in the additional media DB 51 in advance.
However, it is not always necessary to place the additional media in the additional media DB 51. For example, the additional media may be placed on a server on the network that can be referred to by the client terminal 40, such as a WWW server.
[0064]
In that case, the rules may be described as shown in FIG. In the example of FIG. 5, the rule is described using a URI (Uniform Resource Identifier) indicating the location and file name of the sound effect file.
The status determination unit 45 of the client terminal 40 analyzes the content of the received live information and determines whether or not the conditions of each rule are satisfied based on the rules registered in the rule DB 50. When the condition is satisfied, the situation determination unit 45 gives the set of the corresponding live information and sound effect file name to the additional media selection unit 46.
[0065]
The live information shown in FIG. 6 is described in XML. The live information in FIG. 6 represents a situation in which “a player belonging to team A has hit a home run (action)”.
Such live information is interpreted by the determination rules described in the rule DB 50.
[0066]
For example, in the rule DB 50 as a determination rule
(team = A) & (action = home run) → "Team A player home run"
6 can be interpreted as “the home run of the players of Team A”.
[0067]
In this case, since the condition “home run of players of team A” is established in the rule of FIG. 4, the sound effect file name “happpy.wav” is sent to the additional media selector 46 together with the live information.
In addition, by using live information, the current situation can be inferred to determine whether the condition is satisfied.
[0068]
For example, when the live information is the content of FIG. 7, the situation determination unit 45 determines that “Team A is offensive” based on the determination rule of the rule DB 50.
Here, the following determination rule may be used.
(base2 = true) & (base3 = true) & (playerID = 4) & (team = A) → "Team A is offensive"
In addition, if the live information is described in natural language such as “4th batter of Team A in the runner 2, 3 塁 batter box”, natural language processing is performed using an inference engine and the result. Can be determined as “Team A is offensive” and the current situation.
[0069]
If it is determined that “Team A is offensive”, the conditions of the rule shown in FIG. 4 are met, so the situation determination unit 45 adds the sound effect file name “cheer.wav” together with live information to the additional media selector 46. Send to.
The additional media selector 46 extracts the sound effect files “happy.wav” and “cheer.wav” from the additional media DB 51 based on the sound effect file name input from the situation determination unit 45.
[0070]
The sound effect file data and live information extracted by the additional media selector 46 are sent to the ID decoder 47. The ID decoder 47 extracts the ID assigned to the input live information and sends the data of the set of the ID, the live information, and the sound effect file to the synchronizer 48.
The synchronizer 48 controls the output timing of the additional medium to be synchronized with the main medium.
[0071]
As described above, since the main media is distributed from the main media distribution server 10 later than the live information, the live information received by the client terminal 40 appears before the main media. Due to this time difference, when the ID of the live information is input from the ID decoder 47 to the synchronizer 48, the ID does not match the ID of the main medium input from the ID decoder 42 to the synchronizer 48.
[0072]
Therefore, the synchronizer 48 waits until an ID that matches the ID of the live information input from the ID decoder 47 is input from the ID decoder 42, and sends the sound effect file to the additional media player 49 at the matching timing. Play sound.
Further, when the ID is represented by a value that monotonously increases with the passage of time, such as a time code, and the ID is periodically inserted into the main medium at a certain period, the following is performed in the synchronizer 48: By controlling in this way, the generation of sound effects can be started before the time when the event occurs.
[0073]
In other words, the synchronizer 48 has a variable m (m is an arbitrary period) in which the ID value (time) inserted into the main medium is greater than the ID value (time) assigned to the input live information. The sound effect file is sent to the additional media player 49 when it is smaller by a value of a multiple of. This makes it possible to sound a sound effect before an event actually occurs.
[0074]
For example, when a time code is inserted into the main medium as an ID every second and m = 10 seconds is given to the synchronizer 48, the ID given to the live information sent from the ID decoder 47 is If it is 30 seconds, since the sound effect file is sent to the additional media player 49 when the ID inserted in the main medium sent from the ID decoder 42 is 20 seconds, 10 seconds when the event occurs. The sound effect will begin to sound from before.
[0075]
For the value of the variable m, an effective reproduction start time position can be determined for each live information, that is, for each event type.
For example, a timing determination rule for determining the value of the variable m from live information or a situation determined from the live information is determined as shown in FIG. 8, and the timing is determined by using the timing determination rule in the synchronizer 48. do it.
[0076]
This timing determination rule is also preferably registered in the rule DB 50 so that the contents can be changed for each user by the operation of the user setting device 52.
In the example of FIG. 8, when the situation determined from the live information is “offensive”, m is assigned 10 seconds, and when it is “home run”, m = 0 seconds is assigned. Further, the operation of sounding the sound effect at the determined timing can be performed by time-based control using a timer or the like. Further, in the case of “Team B player hit”, m = −1 seconds is described. In this case, sound effects are produced by timer processing −1 second before the event occurs, that is, 1 second after the event occurs. Start ringing.
[0077]
When relaying a music concert, it is also effective to display a photograph or video in accordance with the music instead of the sound effect as an additional medium.
In that case, a photo or video file may be registered in the additional media DB 51 instead of the sound effect file, and in the rule registered in the rule DB 50, the photo or video file name may be designated.
[0078]
Further, as an additional medium, it is possible to perform an effect such as support using an external device such as a doll or a robot. In that case, an operation control file for controlling a doll, a robot, or the like may be registered in the additional media DB 51 instead of the sound effect file, and the control file name may be specified in the rule of the rule DB 50. When controlling an external device such as a robot, the control may be performed using infrared rays or audio signals.
[0079]
Even when various types of additional media are used as described above, the basic operation of the system is the same as when the sound effects are used as BGM, and the specified operation is performed at the timing specified by the user. Can be effectively produced.
[0080]
【The invention's effect】
As described above, according to the present invention, the live information distributed to the client terminal can be used to effectively produce effects according to the situation of each scene of the main media using the additional media such as sound effects. In addition, even if it is a live broadcast, if additional media playback opportunities that effectively attract each scene for each event are registered in the table in the form of rules, etc., additional media can be instantly used when a specific event occurs. The effect of producing a program effectively by selecting is obtained.
[0081]
In addition, video and audio, which are the main media, are distributed later than the live information, and the main media and live information are synchronized using IDs, so that sound effects can be played back at an effective timing before the event occurs. Can start.
Furthermore, since the rules and additional media to be played can be individually determined for each user, a sound effect or the like can be added to the sound to excite different emotions for each user. As an additional medium, not only audio and video but also signals for controlling external devices can be handled, so that various effects can be expressed.
[Brief description of the drawings]
FIG. 1 is a block diagram illustrating a configuration example of a system.
FIG. 2 is a block diagram illustrating a configuration example of a main media distribution server.
FIG. 3 is a block diagram illustrating a configuration example of a live information distribution server.
FIG. 4 is a schematic diagram showing a configuration example (1) of a rule DB.
FIG. 5 is a schematic diagram showing a configuration example (2) of the rule DB.
FIG. 6 is a schematic diagram showing a configuration example (1) of live information.
FIG. 7 is a schematic diagram showing a configuration example (2) of live information.
FIG. 8 is a schematic diagram illustrating a configuration example of a timing determination rule.
[Explanation of symbols]
10 Main media distribution server
11 Main media input device
12 ID inserter
13 Main media delay
14 Main media distributor
15 ID transmitter
20 Live information distribution server
21 Live information input device
22 ID receiver
23 ID applicator
24 Live information distributor
30 network
40 client terminals
41 Main media receiver
42 ID decoder
43 Main media player
44 Live information receiver
45 Situation judging device
46 Additional media selector
47 ID decoder
48 Synchronizer
49 Additional media player
50 Rule DB
51 Additional Media DB
52 User setting device

Claims (14)

A server that distributes continuously appearing information such as video and audio by live relay or live relay as stream media, and at least one client terminal that receives and plays back the stream media distributed by the server via a predetermined communication network A stream media delivery method for controlling a connected communication system,
On the server side,
Live information representing the situation in each scene of the stream media to be distributed is input, the same identification information is added to the stream media and the live information at the corresponding times, the live information is transmitted, and the same identification information is Send the stream media after delaying the live information in time,
On the client terminal side,
Prepare an additional medium for producing each scene of the stream media and a table representing the playback opportunity of the additional medium,
If the analysis result of the received live information matches the playback trigger of the table, if the identification information added to the received live information is the same as the identification information included in the received stream media, the identification information A stream media distribution method characterized in that the corresponding additional media is output at a timing according to. A server that distributes continuously appearing information such as video and audio by live relay or live relay as stream media, and at least one client terminal that receives and plays back the stream media distributed by the server via a predetermined communication network A stream media delivery method for controlling a connected communication system,
On the server side,
Live information representing the situation in each scene of the stream media to be distributed is input, the same identification information is added to the stream media and the live information at the corresponding times, the live information is transmitted, and the same identification information is A stream media delivery method, wherein the attached stream media is sent after being delayed with respect to the live information .   3. The stream media distribution method according to claim 2, wherein on the server side, a numerical value that monotonously increases with the passage of time is used as identification information added to the stream media and live information. 4. The stream media distribution method according to claim 3 , wherein the identification information is periodically added to the stream media and live information on the server side. A server that distributes continuously appearing information such as video and audio by live relay or live relay as stream media, and at least one client terminal that receives and plays back the stream media distributed by the server via a predetermined communication network A stream media delivery method for controlling a connected communication system,
When live information representing the situation in each scene is delivered together with the stream media, the same identification information is periodically added to the stream media and the live information at the corresponding times at regular intervals. When the stream media with the identification information is delivered after being delayed with respect to the live information,
On the client terminal side,
Prepare an additional medium for producing each scene of the stream media and a table representing the playback opportunity of the additional medium,
When the analysis result of the received live information matches the playback trigger of the table, according to the contents of the delay table describing the correspondence between the reproduction triggered and the delay time of the additional media, and controls the reproduction timing of the additional media And outputting the corresponding additional media. A server that distributes continuously appearing information such as video and audio by live relay or live relay as stream media, and at least one client terminal that receives and plays back the stream media distributed by the server via a predetermined communication network A stream media distribution device for controlling a connected communication system,
On the server side,
Identification information adding means for inputting live information representing a situation in each scene of the stream media to be distributed, and adding the same identification information to the stream media and the live information at corresponding times;
A stream media delay means for delaying the stream media provided with the same identification information with respect to the live information in time,
Live information sending means for sending live information according to streaming media delivery, and
On the client terminal side,
An additional medium for directing each scene of the stream media, and a table representing a playback opportunity of the additional medium;
If the analysis result of the received live information matches the playback trigger of the table, if the identification information added to the received live information is the same as the identification information included in the received stream media, the identification information A stream media distribution device, comprising: additional media playback means for outputting the corresponding additional media at a timing according to. A server that distributes continuously appearing information such as video and audio by live relay or live relay as stream media, and at least one client terminal that receives and plays back the stream media distributed by the server via a predetermined communication network A stream media distribution device for controlling a connected communication system,
On the server side,
Identification information adding means for inputting live information representing a situation in each scene of the stream media to be distributed, and adding the same identification information to the stream media and the live information at corresponding times;
A stream media delay means for delaying the stream media provided with the same identification information with respect to the live information in time,
A stream media distribution device comprising: live information transmission means for transmitting live information in accordance with distribution of stream media. 7. The stream media distribution device according to claim 6 , wherein the server-side identification information adding means uses a numerical value that monotonously increases as time passes as the identification information added to the stream media and the live information. Media distribution device. 8. The stream media distribution device according to claim 7 , wherein the server-side identification information adding means periodically adds the identification information to the stream media and live information. A server that distributes continuously appearing information such as video and audio by live relay or live relay as stream media, and at least one client terminal that receives and plays back the stream media distributed by the server via a predetermined communication network A stream media distribution device for controlling a connected communication system,
When live information representing the situation in each scene is delivered together with the stream media, the same identification information is periodically added to the stream media and the live information at the corresponding times at regular intervals. When the stream media with the identification information is delivered after being delayed with respect to the live information,
On the client terminal side,
An additional medium for directing each scene of the stream media, and a table representing a playback opportunity of the additional medium;
When the analysis result of the received live information matches the playback timing of the table, the playback timing of the additional media is controlled according to the contents of the delay table describing the correspondence between the playback timing of the additional media and the delay time. Te, and outputs the appropriate additional media value-added media reproduction means, the stream media distribution apparatus characterized in that a. A server that distributes continuously appearing information such as video and audio by live relay or live relay as stream media, and at least one client terminal that receives and plays back the stream media distributed by the server via a predetermined communication network Software for controlling the server side of the connected communication system,
An identification information addition procedure for inputting live information representing the situation in each scene of the stream media to be distributed, and adding the same identification information to the stream media and the live information at times corresponding to each other ;
A stream media delay procedure for delaying the stream media with the same identification information in time with respect to the live information;
A live information sending procedure for sending live information according to the distribution of stream media is provided ,
The identification information addition procedure uses numerical values that monotonously increase with time as identification information to be added to stream media and live information, and periodically adds the identification information to stream media and live information. Software characterized by. A server that distributes continuously appearing information such as video and audio by live relay or live relay as stream media, and at least one client terminal that receives and plays back the stream media distributed by the server via a predetermined communication network Software for controlling the client terminal side of the connected communication system,
When live information representing the situation in each scene is delivered together with the stream media, the same identification information is periodically added to the stream media and the live information at the corresponding times at regular intervals. When the stream media with the identification information is delivered after being delayed with respect to the live information,
Additional media for producing each scene of the stream media, and data of a table representing a playback opportunity of the additional media;
When the analysis result of the received live information matches the playback timing of the table, the playback timing of the additional media is controlled according to the contents of the delay table describing the correspondence between the playback timing of the additional media and the delay time. And an additional media output procedure for outputting the corresponding additional media. The recording medium which recorded the software of Claim 11 . A recording medium on which the software according to claim 12 is recorded.

Images