JP5381434B2 - Content processing device - Google Patents

Description

  The present invention relates to a content processing apparatus, a content processing method, a content processing program, and a content distribution system that realize an audio-added content distribution service that distributes content and distributes a user comment on the content.

  With the widespread use of broadband networks such as xDSL (Digital Subscriber Line) and FTTH (Fiber To The Home), content distribution services using IP (Internet Protocol) networks have been actively performed. Until now, content producers provided audio information other than normal programs such as multilingual audio and sub-audio.

  Recently, as disclosed in Patent Document 1, a content sharing service has been proposed in which a viewer creates content in which information such as characters is added to a video screen, and the viewer can view the content simultaneously with other viewers. Yes.

  Further, as disclosed in Patent Document 2, a service has been proposed in which the same content is simultaneously viewed, voice communication using a VoIP (Voice over Internet Protocol) function is performed, and a comment comment is shared.

JP 2006-41886 A JP 2007-274227 A

  The techniques of Patent Documents 1 and 2 require viewers to view the same content at the same time. For this reason, when a viewer individually requests and reproduces content such as VOD (Video On Demand), it is necessary for the participant to determine a schedule in advance and to watch the TV at that time. Therefore, there was a problem that members who happened to be unable to participate listened to the content of the conversation and could not participate in comments later.

  In particular, the technique of Patent Document 2 cannot leave a comment in synchronization with content even if the content being simultaneously viewed and the content of the conversation can be shared during simultaneous viewing. In addition, when writing a comment such as a character on the video screen, it is difficult to insert the comment at a timing when the comment is desired to be added.

  By the way, a method of inserting a comment based on time information that has elapsed since the start of content in VOD is also conceivable. However, for example, when comment data is inserted when viewing an IP multicast broadcast, there remains a problem that a comment cannot be inserted at an appropriate time because the start time of the content is not known. Further, when performing VOD called “viewing and viewing service” in which broadcast content is overlooked in the future in units of programs, there is a method of matching comment insertion time information when viewing broadcast content with comments inserted and editing in units of programs. Not proposed.

  An object of the present invention is to provide a content processing apparatus, a content processing method, a content processing program, and a content distribution system that solve the above-described problems.

The content processing apparatus of the present invention is a content processing apparatus that realizes an audio-added content distribution service that distributes content and distributes comments on the content, and a video playback unit that outputs a video of the content; If the time information of the audio separated from the time information of the comment given in advance based on the time information of the content and received based on the user's request matches, the sound of the content is switched to the comment. Audio switching means for outputting.
The content distribution system of this invention is provided with the said content processing apparatus.

  The content processing method of the present invention is a content processing method that realizes an audio-added content distribution service that distributes content and distributes comments on the content, and includes a video reproduction step of outputting the video of the content, and the content If the time information of the audio separated from the time information of the comment given in advance based on the time information of the content and received based on the user's request matches, the sound of the content is switched to the comment. An audio switching step of outputting.

  The content processing program of the present invention is a content processing program that realizes an audio-added content distribution service that distributes content and distributes comments on the content, and outputs video of the content to a content processing device. If the processing matches the time information of the sound separated from the content and the time information of the comment given in advance based on the time information of the content and received based on the user's request, the sound of the content is And an audio switching process of switching to the comment and outputting.

  According to the present invention, the viewing time of the content distribution service can be freely selected by the viewer, and when a comment is input to the content being viewed, it is input at the timing of the video intended by the speaker. Comments can be heard by viewers.

1 is a block diagram schematically showing a content distribution system according to a first embodiment of this invention. 1 is a block diagram schematically showing a content processing apparatus according to a first embodiment of the present invention. It is a block diagram which shows the content processing apparatus of the 1st Embodiment of this invention in detail. It is a timing chart which shows the flow of the content processing method of the 1st Embodiment of this invention. It is a flowchart which shows operation | movement of the content processing program of the 1st Embodiment of this invention. It is a block diagram which shows the content processing apparatus of the 2nd Embodiment of this invention in detail. It is a timing chart which shows the flow of the content processing method of the 2nd Embodiment of this invention. It is a flowchart which shows operation | movement of the content processing program of the 2nd Embodiment of this invention. It is a block diagram which shows roughly the content delivery system of the 4th Embodiment of this invention. It is a block diagram which shows the content processing apparatus of the 4th Embodiment of this invention in detail.

  A content processing apparatus, a content processing method, a content processing program, and a content distribution system according to an embodiment of the present invention will be described. However, the present invention is not limited to the following embodiment. In addition, for clarity of explanation, the following description and drawings are simplified as appropriate.

<First Embodiment>
The content processing apparatus according to the present embodiment can be suitably used in the audio-added content distribution system shown in FIG.

  For convenience, the configuration of the audio-added content distribution system will be described first. The audio-added content distribution system according to the present embodiment distributes content using an IP network and distributes comments on the content. However, in the audio-added content distribution system shown in FIG. 1, viewers A and B are connected to the IP network, but the number of viewers is not limited to this.

  The content server 1 is a server that distributes a content service such as a VOD service, and distributes content S101 according to a viewing request of the viewer A. The content S101 is distributed to the content processing device (STB: Set Top Box) 4 of the viewer A's home via the IP network 2, the content processing device 4 decodes the content, and the viewing device 5 performs video / audio. Is output. The viewing device 5 may be a normal television screen or a monitor such as a personal computer. The viewer A inputs comments such as comments and opinions from the microphone (input unit) 6 while watching the monitor screen. The comment may be, for example, sub-audio for visually impaired persons or dubbed voice in a foreign language that is not broadcast.

  As will be described in detail later, the content processing device 4 digitizes the comment information (audio information) input from the microphone 6, adds the time information of the content currently being decoded and encodes it together with the content information, and then the IP network 2. To the comment server 3. That is, when the content to be distributed is MPEG-2 TS, the comment and the video of the content are added by adding the PTS (Presentation Time Stamp) of the MPEG-2 TS Audio stream or Video stream as time information. Can be synchronized. Since the content information may be information that can identify the distributed content, the content information being reproduced from the viewing device 5 (for example, the title of the content, the time information when the content recording is started, the channel information, etc.) ). Note that the clock for digitizing the audio information can be synchronized with the time information by using the clock for decoding the content. The digitized comment information may be transmitted to the comment server 3 without being compressed, or may be compressed and encoded and transmitted to the comment server 3. In addition, when compressing and encoding the comment information, the processing of the comment server 3 is simplified by using the same compression encoding method as the audio information of the content being reproduced and controlling the code amount to the same compression rate. Can do.

  The comment server 3 receives the comment information S102 to which time information is added and the content information from the content processing device 4 at the viewer A's home, and receives detailed content information (for example, content recording start) from the content information to the content server 1 Comment information received from the content processing apparatus 4 of the viewer A's home), and the time information and the channel information, the information such as the video encoding method and encoding rate of the content, and the information such as the audio encoding method and the encoding rate) The information S102 is compressed and stored in the same audio format as the content S101 based on the detailed information S103 of the content. The content server 1 stores that there is comment information in the content S <b> 101 by the content detailed information inquiry of the comment server 3.

  When the content processing device 4 at the viewer B's home requests the content server 1 to play the content S101, the content server 1 notifies the content processing device 4 at the viewer B's home that the viewer A has a comment. . As a method of notifying that the comment of the viewer A is present in the content processing device 4, notification is made using an application such as Widget, or a popup comment presence display is shown on the screen of the viewing device 5. If there is a comment on the GUI (Graphical User Interface) on the VOD selection screen displayed on the viewing device 5, it is determined that the program display has a comment.

  If there is a request from the viewer B, the comment server 3 distributes the comment information S104 when the content server 1 distributes the content S101. The content processing device 4 at the viewer B home receives and decodes the content S101 and the comment information S104, reproduces the content S101, and outputs it to the viewing device 5. At the same time, the content processing device 4 at the viewer B's home outputs the comment information S104 to the viewing device 5 at the timing when the decryption time information of the content S101 matches the time information of the comment information S104. Thereby, the viewer B can hear a comment on the content at the timing when the viewer A speaks. Incidentally, the viewer B can request a comment by, for example, selecting a button (selection unit) linked to a comment on the GUI of the VOD selection screen provided in the content processing device 4 (not shown). ).

In such an audio-added content distribution system, the content processing device 4 of the present embodiment is used at the viewer B's home.
As shown in FIG. 2, the content processing device 4 includes at least a video playback unit 42 and an audio switching unit 44. Based on the request of the viewer B, the video playback unit 42 outputs the video of the content S101 transmitted from the content server 1 via the IP network 2 to the viewing device 5. The audio switching unit 44 matches the audio time information separated from the content S101 with the time information of the comment information S104 transmitted from the comment server 3 via the IP network 2 based on the request of the viewer B. Then, the audio of the content S101 is switched to the comment information S104, and the comment information S104 is output to the viewing device 5. That is, to the content processing apparatus 4, the process of outputting the video of the content S 101, the audio time information separated from the content S 101, and the comment transmitted to the content processing apparatus 4 based on the request from the viewer B When the time information of the information S104 matches, a content processing program that realizes a process of switching the voice of the content S101 to the comment information S104 and outputting the comment information S104 is stored. And the content processing apparatus 4 implement | achieves the process mentioned above based on the said program.

  Here, the comment information S104 (S102) is stored in the comment server 3 in a state in which the time information is given in advance based on the time information of the content S101 viewed at the viewer A's home as described above. Then, the comment information S104 is transmitted from the comment server 3 to the content processing device 4 at the viewer B home based on the request from the viewer B. At this time, as the time information of the comment information S104, the time information of the content S101, for example, when the content to be distributed is MPEG-2 TS, the audio stream of the MPEG-2 TS or the PTS of the Video stream is used as the time information. Giving.

  Such a content processing apparatus 4, content processing method, content processing program, and content distribution system receive desired content from the content server 1 based on the viewer's request, so that the viewer can freely view the content. Can be selected. Further, when a comment is input to the content being viewed, the viewer (viewer B) can listen to the comment input at the timing of the video intended by the speaker (viewer A).

  Such a content processing apparatus 4 is preferably configured as shown in FIG. That is, in the content processing apparatus 4, data S400 of various services is input to the communication I / F unit 40 through the IP network. The communication I / F unit 40 selects the content stream S401 and inputs the content stream S401 to the stream separation unit 41. Further, the communication I / F unit 40 indicates to the viewer that there is a comment on the screen of the viewing device 5 using a message of the TCP protocol, or uses the application such as Widget to use the viewing device 5. The presence or absence of comments is indicated on the screen.

  The stream separation unit 41 analyzes the header information of the content stream S401 and separates the content stream S401 into a video stream S402, clock information S403, and an audio stream S404. The clock information S403 is input to the clock control unit 43. The clock control unit 43 generates an operation clock for the content processing apparatus 4 based on the clock information S403. The video stream S402 is decoded (decoded) by the video decoding unit (video reproduction unit) 42 based on the video clock signal S406 generated by the clock control unit 43 and output as a video signal S405. The audio stream S404 is decoded by the audio decoding unit (audio switching unit) 44 based on the audio clock signal S407 generated by the clock control unit 43 and output as an audio signal S409. At this time, the audio signal S409 does not necessarily have to be decoded by the audio decoding unit 44, and may be output as a compressed digital stream, for example, an audio signal S409 in a format compliant with the AES / EBU standard or SPDIF standard.

  For example, the viewer B requests a comment by operating a button (selection unit) linked to a comment on the GUI of the VOD selection screen provided in advance in the content processing apparatus 4. When the comment information S412 is output as the audio signal S409 during content playback based on the comment request from the viewer B, the comment information S412 received by the communication I / F unit 40 is input to the audio decoding unit 44. The audio decoder 44 receives the audio stream S404 and the comment information S412. The audio decoding unit 44 decodes the comment information S412, and outputs the comment information S412 as the audio signal S409 when the time stamp (time information) of the comment information S412 matches the audio stream S404.

  Incidentally, the CPU (Central Processing Unit) 46 is an entire content processing device 4 in which the communication I / F unit 40 selects user-desired content from various information and communicates comment input / output with a server. To control.

Using such a content processing apparatus 4, a content processing method is realized as shown in FIG.
First, a content viewing request is output from the content processing device 4 at the viewer B's home to the content server 1 (C11). As a result, the content is delivered from the content server 1 to the content processing device 4 (C12). Further, information indicating that the comments of the viewer A are accumulated from the content server 1 is distributed to the content processing device 4 (C13). The content processing device 4 at the viewer B's home starts decoding the received content, and informs the viewer B of the presence or absence of a comment using an application such as Widget as described above. The content processing device 4 transmits a comment request from the viewer B to the comment server 3 via the IP network 2 (C14). Thereby, the comment of the viewer A is distributed from the comment server 3 to the content processing device 4 (C15). When the time information of the audio separated from the content matches the time information of the comment of the viewer A, the content processing device 4 switches the sound of the content to the comment of the viewer A and outputs it. As a result, at the viewer B's home, it is possible to view the content and view a comment synchronized with the content (C16).

More specifically, the content processing device 4 realizes the processing flow shown in FIG. 5 based on the content processing program.
The communication I / F unit 40 of the content processing apparatus 4 analyzes an RTP (Real-time Transport Protocol) / UDP (User Datagram Protocol) packet header from the input IP packet (F101). Then, only the stream requested by the viewer B is sent to the processing of the next F103, and if it is not so, it is discarded and the processing proceeds to the processing of the next packet data (F102).

  Next, the communication I / F unit 40 of the content processing device 4 determines whether the packet data is a content stream packet or a comment packet based on the sequence number in the RTP packet header. Then, in the case of a content packet, the process proceeds to F104, and in the case of a comment packet, the process proceeds to F110 (F103).

  Next, the stream separation unit 41 of the content processing apparatus 4 performs TS header analysis, and uses TS packet separation information as time information such as video packets (video packets), audio packets (voice packets), and PCR (Program Clock Reference). PID information for separation into (1) is acquired (F104).

  Next, the stream separation unit 41 of the content processing apparatus 4 separates the PCR, video packet, and audio packet from the PID information, and proceeds to the processes of F106, F107, and F110, respectively (F105).

  The PCR is input to the clock control unit 43 of the content processing apparatus 4. The clock control unit 43 generates a reference clock based on the PCR (F106). The video decoding unit 42 decodes the separated video data and outputs a video signal (F107). The audio decoding unit 44 selects whether to decode the comment information or the content audio information (F110), and decodes and outputs either one of the information (F108).

<Second Embodiment>
The content processing apparatus according to the first embodiment is configured to be able to satisfactorily receive audio-added content, but preferably further includes means for inputting a comment to the content.

  That is, the content processing apparatus preferably includes an input unit 6 such as a microphone for inputting a comment and an audio encoding unit 45 as shown in FIG. The comment information S410 input from the input unit 6 is transmitted from the communication I / F unit 40 to the comment server 3 via the IP network 2 as comment information S411 encoded by the audio encoding unit 45. Thus, the content processing apparatus can not only receive the audio-added content but also add a comment to the content. In addition, it is possible to add a comment to the content being played at the intended timing.

  The audio encoding unit 45 receives the currently received audio stream information S408. The audio encoding unit 45 encodes (encodes) the comment information S410 based on the audio stream information S408. Here, the audio stream information S408 includes encoding method information, encoding rate, time information (PTS), and the like of the audio stream decoded by the audio decoding unit 44.

  The audio encoding unit 45 continues encoding in a state where it is uttered. For this reason, it is preferable to mount an echo canceller for preventing the audio output from the content processing apparatus from being captured. Thereby, it becomes possible to input the input comment with higher accuracy.

  When such a content processing apparatus is used, a sound-added content processing method as shown in FIG. 7 can be realized. The description will be given on the assumption that the audio-added content processing system shown in FIG.

  First, the content processing device 4 at the viewer A's home outputs a content viewing request to the content server 1 based on the request from the viewer A (C100). Based on the viewing request, the content server 1 starts distributing desired content to the content processing device 4 at the viewer A's home (C101).

  Next, the content processing device 4 at the viewer A's home decodes the content so that the viewer A can view it (C102). At this time, when the viewer A makes a comment during viewing, the input unit 6 of the content processing device 4 in the viewer A's home acquires the comment. Then, the audio encoding unit 45 of the content processing apparatus 4 encodes the comment by adding the time information of the content being reproduced to the comment server 3 (C103).

  Next, when the comment server 3 receives the comment, the comment server 3 transmits a comment accumulation notification to the content server 1 (C104). The content server 1 manages that the comment of the viewer A is left in the content from the comment accumulation notification.

  On the other hand, the content processing apparatus 4 at the viewer B's home outputs a content viewing request to the content server 1 based on the request from the viewer B (C105). Based on the content viewing request, the content server 1 distributes the desired content to the content processing device 4 at the viewer B home (C106). Furthermore, the content server 1 distributes information indicating that the comments of the viewer A are accumulated to the content processing device 4 of the viewer B home (C107).

  The content processing device 4 at the viewer B's home receives the content, starts decoding, and informs the viewer B that there is a comment. The content processing device 4 at the viewer B's home transmits a comment request from the viewer B to the comment server 3 via the IP network 2 (C108). Thereby, the comment server 3 distributes the comment of the viewer A via the IP network 2 from the comment server 3 to the content processing device 4 of the viewer B home (C109). When the time information of the audio separated from the content matches the time information of the comment of the viewer A, the content processing device 4 at the viewer B home switches the sound of the content to the comment of the viewer A and outputs it. As a result, at the viewer B's home, it is possible to view the content and view a comment synchronized with the content (C110).

  Incidentally, the content processing device 4 according to the present embodiment also operates based on the content processing program, and operates in substantially the same manner as the content processing device 4 according to the first embodiment. However, in the content processing apparatus 4 of the present embodiment, as shown in FIG. 8, when comment information is input, the audio encoding unit 45 of the content processing apparatus 4 performs comment information, clock information, and audio output time information. Are transmitted to the comment server 3 via the communication I / F unit 40 (F109).

<Third Embodiment>
In the first and second embodiments, the audio of content is switched to a comment and output, but this is not restrictive.

  That is, it is preferable that the audio decoding unit 44 is configured to switch the output of the channel of the rear speaker from the audio stream to the comment information when the speaker of the viewer B's home is in the surround setting. As a result, it is possible to hear a comment from the rear speaker while listening to the audio of the content from the front speaker.

  That is, as shown in FIG. 1, when the speaker at the viewer B's home is set to surround, the comment S105 obtained by decoding the comment information S104 is output from the rear speaker 7, and the audio of the content is output from the front speaker. It becomes possible. Thereby, the viewer B can enjoy the comment of the viewer A while viewing the content S101. At this time, the comment server 3 controls the comment information to a code amount according to the compression format of the back channel when the audio data of the content to be distributed is multi-channel audio such as 5.1ch surround sound or 7.1ch surround sound. . In the content processing apparatus 4, the back channel information is switched to comment information and output. Thus, the viewer B can hear the comment S105 from the rear speaker 7. By dividing and outputting the comment and the audio of the content into the front and back channels, it becomes possible to distinguish the audio of the content itself and the comment added later using the human auditory characteristics.

<Fourth embodiment>
In the third embodiment, the content is received from the content server 1 in order to add a comment to the content distributed from the content server 1, but this is not restrictive.

  That is, the content processing apparatus 4 of the present embodiment is preferably used in the audio-added content distribution system shown in FIG. In addition to the functions of the audio additional content distribution system shown in FIG. 1, the audio additional content distribution system is configured such that broadcast content is broadcast from the broadcast station 8, or the missed broadcast content is distributed.

  In the audio-added content distribution system shown in FIG. 9, the broadcast content S106 from the broadcast station 8 is broadcast to each home and is stored in the content server 1 for each broadcast content. The content processing device 4 at the viewer A's home receives the broadcast content S106 with an antenna, and then decodes the broadcast content in substantially the same manner as the video content from the content server 1 described in the above embodiment, and the viewing device 5 outputs video / audio. The viewing device 5 may be a normal TV screen or a monitor such as a PC.

The viewer A inputs comments such as comments and opinions from the input unit (microphone) 6 while watching the monitor screen. The comment may be, for example, a sub-audio for the visually impaired or a dubbed voice in a foreign language that is not broadcast. In the content processing apparatus 4 at the viewer A's home, the audio encoding unit 45 digitizes the comment information (audio information) input from the input unit 6 and further adds time information that is currently decoded and encodes it together with the broadcast content information. Then, it is transmitted to the comment server 3 via the IP network 2. When the content to be distributed is MPEG-2 TS, the comment and the video can be synchronized by adding the PTS of the MPEG-2 TS Audio stream or Video stream as time information. That is, since the broadcast content from the broadcast station 8 is MPEG-2 TS, the PTS of the audio stream or the video stream is added as time information as in the first embodiment.
The broadcast content information only needs to be information that can identify the broadcast content that has been broadcast. Note that the clock for digitizing the comment information is synchronized with the time information by using the clock for decoding the broadcast content. The digitized comment information may be transmitted to the comment server 3 without being compressed, or may be compressed and encoded and transmitted to the comment server 3. Also, when compressing and encoding comment information, the processing of the comment server 3 can be simplified by using the same compression encoding method as the audio information of the broadcast content and controlling the code amount to the same compression rate. .

  The comment server 3 receives and decodes the comment information to which the time information is added and the broadcast content information from the content processing device 4 at the viewer A's home, and inquires the content server 1 for detailed information on the broadcast content from the content information. The comment information received from the content processing device 4 at the viewer A's home is compressed and stored in the same audio format as the broadcast content S106.

  The content server 1 stores that there is a comment in the broadcast content S106 in response to the detailed content information (S103) inquiry from the comment server 3. The content server 1 is a server that distributes a content service such as a VOD service, and distributes broadcast content S106 as video content S101 in response to a viewer B's viewing request. When the content processing device 4 at the viewer B's home requests the content server 1 to reproduce the video content S101 (broadcast content S106), the content server 1 sends the comment of the viewer A to the content processing device 4 at the viewer B's home. Announce that there is. If there is a request from the viewer B, the comment server distributes the comment information S104 when the content server 1 distributes the video content S101.

The content processing device 4 at the viewer B's home receives the video content S101 and the comment information S104, reproduces and outputs the video content S101 to the viewing device 5, and also decodes the video content S101, as in the above embodiment. The comment information S104 is output to the viewing device 5 at the timing when the time information and the time information of the comment information S104 match. Thus, the viewer B can view the broadcast content S106 received by the viewer A from the broadcast station 8 and leaving a comment at a desired timing, and listen to the comment at the timing intended by the viewer A. It becomes possible.
Of course, the viewer B can also add a comment to the broadcast content using the content processing device 4.

  The operation of the content processing apparatus according to the present embodiment will be described with reference to FIG. The broadcast receiving unit 47 that receives the broadcast S106 from the broadcast station 8 outputs the stream S414 of the broadcast channel selected by the viewer. The stream separation unit 41 separates the video stream S402, the clock information S403, and the audio S404. The video decoding unit 42 decodes the video stream S402 and outputs a video signal S405. The audio decoding unit 44 decodes the audio stream S404, outputs an audio signal S409, and outputs audio encoding information S408 such as an audio encoding method and an encoding rate. The clock control unit 43 generates a reference clock based on the clock information S403, matches the output timing of the video signal and the audio signal, and causes the audio encoding unit 45 to output time information of the encoded comment data.

  The present invention is not limited to the above-described embodiment, and can be changed as appropriate without departing from the spirit of the present invention.

DESCRIPTION OF SYMBOLS 1 Content server 2 IP network 3 Comment server 4 Content processing apparatus 5 Viewing apparatus 6 Input part (microphone)
7 Rear speaker 8 Broadcast station 40 Communication I / F unit 41 Stream separation unit 42 Video decoding unit (video playback unit)
43 Clock control unit 44 Audio decoding unit 45 Audio encoding unit 46 CPU
47 Broadcast receiver

Claims (16)

A content processing apparatus that realizes an audio-added content distribution service that distributes content and distributes comments on the content,
Video playback means for outputting video of the content;
When the time information of the audio separated from the content matches the time information of the comment given in advance based on the time information of the content and received based on a user request, the audio of the content is converted into the comment. An audio switching means for switching and outputting;
A content processing apparatus comprising: An input means for a user to input a comment during playback of the content;
Audio encoding means for encoding the comment based on audio time information separated from the content being reproduced and audio encoding scheme information of the content being reproduced;
Transmitting means for transmitting the user's comment to a comment server;
The content processing apparatus according to claim 1, further comprising: Broadcast content receiving means for receiving broadcast content from a broadcast station, and video content receiving means for receiving video content from a content server via a network,
The video reproduction means reproduces the video of the received broadcast content or the video of the received video content,
The audio encoding means encodes the comment based on audio time information separated from broadcast content or video content being played back and audio encoding method information of the broadcast content or video content being played back. The content processing apparatus according to claim 2 .   4. The content processing apparatus according to claim 3, wherein the video content receiving unit receives broadcast content stored in the content server as the video content based on a user request. Said audio encoding means, according to claim 3, characterized in that with respect to comments entered from said input means, performs encoding in accordance with the code amount corresponding to the rear channels of the audio information of the video content Content processing apparatus.   A content distribution system comprising the content processing device according to claim 1. A content processing method that realizes an audio-added content distribution service that distributes content and distributes comments on the content,
A video playback process for outputting video of the content;
When the time information of the audio separated from the content matches the time information of the comment given in advance based on the time information of the content and received based on a user request, the audio of the content is converted into the comment. An audio switching process for switching and outputting;
A content processing method comprising: An input step in which a user inputs a comment during playback of the content;
An audio encoding step of encoding the comment based on audio time information separated from the content being reproduced and audio encoding scheme information of the content being reproduced;
A transmitting step of transmitting the user's comment to a comment server;
The content processing method according to claim 7, further comprising: In the video playback step, the video of the broadcast content received from the broadcasting station or the video content received from the content server via the network is played back,
In the audio encoding step, the comment is encoded based on audio time information separated from the broadcast content or video content being played back and audio encoding method information of the broadcast content or video content being played back. The content processing method according to claim 8 .   10. The content processing method according to claim 9, wherein, in the video playback step, the video of the broadcast content stored in the content server as the video content received based on a user request is played back. The content according to claim 9 , wherein, in the audio encoding step, the comment input by the user is encoded according to a code amount corresponding to a rear channel of audio information of the video content. Processing method. A content processing program that realizes an audio-added content distribution service that distributes content and distributes comments on the content,
In the content processing device,
Video playback processing for outputting video of the content;
When the time information of the audio separated from the content matches the time information of the comment given in advance based on the time information of the content and received based on a user request, the audio of the content is converted into the comment. Audio switching processing to switch and output,
Content processing program that realizes An input process in which a user inputs a comment during playback of the content;
An audio encoding process that encodes the comment based on audio time information separated from the content being reproduced and audio encoding scheme information of the content being reproduced;
A transmission process for transmitting the user's comment to a comment server;
The content processing program according to claim 12, further comprising: In the video playback process, the video of the broadcast content received from the broadcasting station or the video content of the video content received from the content server via the network is played back,
In the audio encoding process, the comment is encoded based on audio time information separated from broadcast content or video content being played back and audio encoding method information of the broadcast content or video content being played back. The content processing program according to claim 13 .   15. The content processing program according to claim 14, wherein in the video reproduction process, the video of the broadcast content stored in the content server as the video content received based on a user request is reproduced. 15. The audio encoding process according to claim 14 , wherein the comment input by the user is encoded according to a code amount corresponding to a rear channel of audio information of the video content. Content processing program.

Images