JP7125692B2 - Broadcast service communication network distribution apparatus and method - Google Patents

Description

The present invention relates to broadcasting service communication network distribution technology for distributing television broadcasting services using a communication network.

Broadcasters are desired to simultaneously distribute video and audio content provided by broadcasting services using a communication network. By the way, when a broadcaster prepares distribution data for a communication network at each business base, the cost burden increases. In addition, when distributing by broadcasting and when distributing by communication networks, there are restrictions due to commercial content and copyright issues. For example, the contents distributed by communication networks must be different from those for broadcasting. There are also restrictions.

Note that Japanese Patent Application Laid-Open No. 2017-050631 is a patent document related to this invention. This discloses adaptively switching commercial content between the broadcast service and the communication network when distributing the content provided by the broadcast service using the communication network.

The above-described prior art and its problems are provided only to provide some background to the present invention. It should be noted that the present invention is not limited to the prior art and problems discussed above.

JP 2017-050631 A

The present invention has been made in consideration of the above circumstances, and aims to realize a scheme suitable for simultaneously distributing video and audio contents provided by broadcasting services via a communication network.

According to the present invention, in order to achieve the above object, the configuration described in the claims is adopted. Here, before describing the invention in detail, a supplementary description of the description of the scope of claims will be given.

That is, according to one aspect of the present invention, a broadcasting service communication network distribution device: receives a transmission stream obtained by converting a broadcasting service TS stream for communication network transmission via the communication network, reconstructing means for reconstructing the TS stream of the broadcasting service from the reconstructing means; converting a video stream and an audio stream included in the TS stream of the broadcasting service reconstructed by the reconstructing means into a video stream in a format for IP distribution. a video stream in the IP distribution format generated by the IP distribution conversion means is transmitted to the client terminal via the communication network in response to a request from the client terminal on the communication network. the conversion means for IP distribution receives information specifying the start and end of a time interval and alternative content to define the video stream in the format for IP distribution with the start and end. It is configured to be replaced with alternative content in the interval. A video stream in IP delivery format may have separate video and audio streams. The same applies hereinafter.

According to this configuration, it is possible to easily deal with commercials and copyright problems of broadcasting services.

In this configuration, the alternative content may be video stream segments and audio stream segments or still pictures and predetermined audio.

In this configuration, the IP distribution conversion means has demultiplexing means for demultiplexing the TS stream of the broadcasting service reconstructed by the reconstruction means to generate a video stream and an audio stream, and In the section defined by and the end period, alternative content may be used instead of the video signal and audio signal decoded from the video stream and audio stream.

In this configuration, the start and end of the time interval are displayed in year, month, day, hour, minute, and second, and are based on the time information displayed in year, month, day, hour, minute, and second in the time offset table and the clock conforming to the TS stream of the broadcast service. , may be contrasted with time displayed in year-month-day-hours-minutes-seconds.

According to another aspect of the present invention, a broadcast service communication network distribution device receives a transmission stream obtained by converting a broadcast service TS stream for communication network transmission via the communication network, and transmits the transmission stream. a reconstructing means for reconstructing the TS stream of the broadcasting service from the stream; and a video stream and an audio stream included in the TS stream of the broadcasting service reconstructed by the reconstructing means into a moving picture stream in a format for IP distribution. converting means for IP distribution; transmitting the video stream in the format for IP distribution generated by the conversion means for IP distribution to the client terminal via the communication network in response to a request from the client terminal on the communication network. and control information to the client device to receive information specifying the start and end of a time interval and alternative content and to replace the interval defined by the start and end of the video stream with the video stream segment. and control information supply means for supplying the

According to this configuration, it is possible to easily deal with commercials and copyright problems of broadcasting services.

Further, according to another aspect of the present invention, a client terminal connected to the broadcast service communication network distribution device via a communication network: transmits the format for IP distribution from the transmission means of the broadcast service communication network distribution device to the IP distribution format. said moving picture stream reproducing means for receiving and reproducing said moving picture stream; said moving picture stream reproducing means corresponding to the start and end of said time interval received from said control information supply means of said broadcasting service communication network delivery device. It is configured to reproduce the alternative content instead of the video stream during the reproduction time.

According to this configuration, it is possible to easily deal with commercials and copyright problems of broadcasting services.

In this configuration, the format for IP distribution is HLS (HTTP Live Streaming, both trademarks of Apple Inc.), and the moving picture stream reproducing means complies with EXT-PROGRAM-DATE-TIME of the moving picture stream file. , the alternative content may be played instead of the video stream.

According to another aspect of the present invention, a broadcast service communication network distribution device receives a transmission stream obtained by converting a broadcast service TS stream for communication network transmission via the communication network, and transmits the transmission stream. a reconstructing means for reconstructing the TS stream of the broadcasting service from the stream; and a video stream and an audio stream included in the TS stream of the broadcasting service reconstructed by the reconstructing means into a moving picture stream in a format for IP distribution. converting means for IP distribution; transmitting means for transmitting the video stream in the format for IP distribution generated by the converting means for IP distribution to the client terminal on a communication network in response to a request from the client terminal; broadcasting Video/audio stream transmission means for transmitting a video/audio stream extracted from the stream to the client terminal via a network via a streaming method; and alternative content to be replaced with the video stream or audio stream during a specified period via the network. alternative content distribution control means for controlling transmission to the client terminal; the alternative content distribution control means: index file storage for storing an index file that enables access to the insertion control information in replacement operation units means for transmitting the index file to the client terminal via the network in response to polling from the client terminal; the client terminal uses the insertion control information to perform a predetermined The alternative content is acquired from the alternative content storage means and the alternative content replaces the video stream and the audio stream for a predetermined period.

According to this configuration, it is possible to easily deal with commercials and copyright problems of broadcasting services.

According to another aspect of the present invention, a client terminal connectable to a network receives, from a transmission device, a video/audio stream extracted from a broadcast stream and transmitted via the network in a streaming manner. - Audio stream receiving means; Alternative content receiving means for receiving alternative content stored in the alternative content storage means via the network; Said alternative content receiving means: stored in said alternative content storage means index file receiving means for receiving from the transmitting device by polling an index file that enables access to the alternative content that has been stored in replacement operation units; and the alternative content stored in the alternative content storage means, and means for receiving the index file received by the index file receiving means in units of the replacement operation.

Also, in this configuration, the terminal is typically a mobile terminal or mobile communication terminal that performs communication based on mobile communication, but may be a fixed type terminal. Handheld or mobile communication terminals are typically mobile phones, but include portable computers, tablet computers, media players, personal digital assistants, and combinations of two or more of these products. , can be any device.

According to this configuration, it is possible to easily deal with commercials and copyright problems of broadcasting services.

Further, according to a technical feature related to the present invention, a broadcasting service communication network distribution device: receives a transmission stream obtained by converting a broadcasting service TS stream for communication network transmission via the communication network. reconstruction means for reconstructing the TS stream of the broadcast service from the transmission stream; characteristic determination means for determining characteristics of the TS stream of the broadcast service reconstructed by the reconstruction means; reconstruction by the reconstruction means IP distribution converting means for converting a video stream and an audio stream included in the constructed TS stream of the broadcasting service into a video stream in an IP distribution format; and an IP distribution format generated by the IP distribution converting means. to the client terminal in response to a request from the client terminal on the communication network; and the conversion means for IP distribution is in a standard format based on the characteristics determined by the characteristic determination means to generate a video stream in the IP distribution format.

According to this configuration, a video stream in a format for IP distribution is generated in a standard manner, so various broadcast programs can be dealt with.

In this configuration, the audio mode may be a stereo audio mode in the video stream in the IP distribution format generated in the standard format.

In this configuration, the video mode may be the high-definition mode in the video stream in the IP distribution format generated in the standard format.

In this configuration, the conversion means for IP distribution may generate, from the TS stream of the broadcasting service, a number of motion picture streams in the IP distribution format corresponding to N (N is an integer equal to or greater than 2) organized channels.

In this configuration, the N organization channels are two organization channels, and even if the TS stream of the broadcasting service includes only one organization channel, the number of the IP distribution formats corresponding to the two organization channels may generate a video stream of

In this configuration, the IP distribution converting means may generate a number of video streams in the IP distribution format corresponding to the two modes of main audio and secondary audio.

In this configuration, the conversion means for IP distribution may generate moving image streams in the IP distribution format in numbers corresponding to the two modes even when the TS stream of the broadcast service does not include sub-audio.

In this configuration, the IP distribution converting means may generate a number of video streams in the IP distribution format corresponding to the number of viewing selections of subtitle display and subtitle non-display.

In this configuration, even if the TS stream of the broadcasting service does not contain caption data, the IP distribution converting means generates the video streams of the IP distribution format in a number corresponding to the two viewing selection numbers. good.

In this configuration, the motion picture stream may comprise a series of motion picture files that are reproduced sequentially by means of an index file.

In this configuration, the video stream in the IP distribution format may be a streaming video stream.

In this configuration, the streaming method is a streaming method based on the HTTP protocol. For example, HLS (HTTP Live Streaming, Apple Inc.), MPEG-DASH method, Smooth Streaming (Microsoft Inc.), HTTP Dynamic Streaming (Adobe Systems Inc.) may be used. Methods other than HTTP streaming, such as RTS (Real Time Streaming Protocol) and RTMP (Real Time Messaging Protocol), may be employed.

In this configuration, the transport stream may be an IP packetized TS stream of the broadcast service.

In this configuration, the conversion means for IP distribution includes: demultiplexing means for demultiplexing the TS stream of the broadcasting service reconstructed by the reconstructing means to generate a video stream and an audio stream; decoding means for decoding the video stream and the audio stream output from the means to generate a video signal and an audio signal; standard mode conversion means for converting the video signal and the audio signal into a standard mode; and encoding means for encoding the video signal and the audio signal to generate the video stream in the IP delivery format.

In this configuration, the moving image stream in the IP distribution format generated in the standard format may have a plurality of selectable sets of moving image streams.

In this configuration, one set of the selectable video streams may include subtitle display, and the other set of video streams may not include subtitle display.

According to another technical feature related to the present invention, a broadcasting service communication network distribution device configuration: transmits a transmission stream obtained by converting a broadcasting service TS stream for communication network transmission via the communication network. reconstructing means for receiving and reconstructing a TS stream of the broadcasting service from the transmission stream; and transmitting a video stream and an audio stream included in the TS stream of the broadcasting service reconstructed by the reconstructing means for IP distribution. IP distribution conversion means for converting into a format video stream; and transmitting the IP distribution format video stream generated by the IP distribution conversion means to the client terminal in response to a request from the client terminal on the communication network. and a transmitting means; the converting means for IP distribution performs the IP distribution of the video stream and the audio stream generated by the video/audio stream generating means when caption data is included in the TS stream of the broadcasting service. In addition to generating a video stream in a format for IP distribution, another video stream in a format for IP distribution is generated from a video stream of a synthesized video obtained by adding subtitles based on subtitle data to the video of the video stream and the audio stream. It's like

With this configuration, it is possible to easily handle caption data.

The present invention can be implemented not only as an apparatus or system, but also as a method. Moreover, of course, a part of such an invention can be configured as software. Naturally, a software product used to cause a computer to execute such software is also included in the technical scope of the present invention.

The above-mentioned and other aspects of the present invention are defined in the claims and are described in detail below with the help of examples.

The invention makes it easy to deal with commercial and copyright issues.

It is a figure explaining the environment in which the IP delivery system of the Example of this invention is performed. FIG. 2 is a functional block diagram illustrating the outline of the IP delivery system of FIG. 1; 3 is a functional block diagram illustrating a video/audio transcoding unit 220 of FIG. 2; FIG. FIG. 4 is a diagram for explaining an example of standard output; FIG. 11 is a functional block diagram illustrating the configuration of an alternative video/audio transcoding unit 220A; It is a figure explaining the example of an alternative standard output. 2 is a block diagram showing a configuration example of the mobile terminal in FIG. 1; FIG. 2 is a functional block diagram of the mobile terminal of FIG. 1; FIG. FIG. 2 is a diagram for explaining a display example of the mobile terminal in FIG. 1; FIG. 4 is a diagram for explaining an example of a channel selection screen of a video/audio stream reproduction unit 360; FIG. 4 is a functional block diagram outlining an IP delivery system according to another embodiment of the present invention; 12 is a block diagram showing a configuration example of a caption data reproducing unit 370 of FIG. 11; FIG. 12A and 12B are schematic diagrams for explaining the operation of a caption data reproducing unit 370 of FIG. 11; FIG. 12A and 12B are schematic diagrams for explaining the correction PCR acquisition operation of the caption data reproducing unit 370 of FIG. 11; FIG. 4 is a diagram for explaining a message management file; FIG. It is a figure explaining caption data. 2 is a functional block diagram illustrating an alternative configuration of the IP delivery system of FIG. 1; FIG. 18 is a functional block diagram illustrating the configuration of a video/audio transcoding unit 220B in FIG. 17; FIG. FIG. 19 is a diagram for explaining the operation of a video/audio transcoding unit 220B in FIG. 18; FIG. 11 is a diagram for explaining the operation of an inserted moving image reproducing unit 380 of the mobile terminal 300; It is a schematic diagram explaining the processing flow of caption data. FIG. 4 is a diagram for explaining messages in a message management file; FIG. FIG. 4 is a diagram for explaining entity types of messages in a message management file; 19 is a functional block diagram illustrating a configuration example of an insertion control unit 270 of FIG. 18; FIG. FIG. 2 is a diagram illustrating a playlist and media segment files for network delivery conforming to HTTP; FIG. 2 is a diagram illustrating an example of moving image delivery of network delivery conforming to HTTP;

Examples of the present invention will be described below.

FIG. 1 shows an overall embodiment of the present invention applied to a digital television distribution system for IP simultaneous distribution of digital television broadcasting (terrestrial digital television broadcasting, BS, CS digital television broadcasting). The broadcaster subsystem 100 is a subsystem operated by a basic broadcaster, acquires the TS stream of the broadcasting service before being uplinked, and sends it to the communication network distribution subsystem 200 via the communication network 500 (Internet) or a predetermined Transmission using line 700 . The communication network distribution subsystem 200 may be operated by the main broadcaster or by a third party. MPEG-2 TS) is acquired, and this video/audio stream is transcoded into a predetermined format for IP redistribution (HLS, MPEG-DASH, etc.) and distributed to the mobile terminal 300 . The communications network distribution subsystem 200 is connected to a communications network 500, typically the Internet. At least part of the communication network 500 may comprise a CDN (Content Delivery Network) service. A mobile terminal 300 is connected to a communication network 500 via a gateway 400 of a mobile communication carrier. Further, the authentication server 600 may be connected to the communication network 500 to authenticate requests from the mobile terminal 300 regarding the IP delivery service. The communication network distribution subsystem 200 is provided at a site separate from the broadcaster subsystem 100 of the primary broadcaster. Communication network distribution subsystem 200 may also serve broadcaster subsystems at other business locations, or broadcaster subsystems of a different primary broadcaster, via communication network 500, with fewer System resources may be operated efficiently as a so-called cloud system by using communication lines from multiple bases. The line 700 may use an optical fiber transmission line or an SDI transmission line. The broadcaster subsystem 100 and the communication network distribution subsystem 200 may each comprise a server computer.

FIG. 2 illustrates a configuration example of each main part of the broadcaster subsystem 100, the communication network distribution subsystem 200, and the portable terminal 300, and other configuration examples may also be adopted. Subsystems 100 and 200 may be configured by appropriately combining server devices (processors) and the like. In FIG. 2, the broadcaster subsystem 100 has a broadcast service TS stream output section 110, an uplink section 120, an IP transmission device 130, and the like. A broadcast service TS stream output unit 110 outputs a broadcast service TS stream obtained by multiplexing a video stream, an audio stream, and data. The uplink unit 120 modulates the broadcast service TS stream and broadcasts it through a transmission antenna. The IP transmission device 130 receives the broadcast service TS stream, converts it into IP packets, and transmits the broadcast service TS stream to the communication network distribution subsystem 200 via the communication network using the IP protocol.

The communication network distribution subsystem 200 includes an IP receiver 210, a video/audio transcoding unit 220, a video/audio distribution unit 230, and the like. The IP receiver 210 receives IP packets transmitted from the IP transmitter 130 of the broadcaster subsystem 100 and reconstructs the TS stream of the broadcast service. IP transmission of TS streams is described, for example, in Pro-MPEG Code of Practice #3 release 2, July 2004, "Transmission of Professional MPEG-2 Transport Streams over IP Networks". The video/audio transcoding unit 220 converts video/audio MPEG-2 TS packets into HTTP streaming format (typically HLS format) streaming files. The video/audio distribution unit 230 distributes video/audio streams to the mobile terminal 300 by HTTP streaming. The video/audio transcoding unit 220 is configured to output the video/audio stream in a predetermined standard format regardless of the structure of the TS stream of the broadcast service. A standard configuration is, for example, stereo mode for audio, HD mode for video, and two channels. This will be explained later with an example.

The communication network distribution subsystem 200 may acquire caption data from the TS stream of the broadcast service and distribute it to the mobile terminal 300 by HTTP long polling, for example. This will be explained later in an alternative embodiment.

Portable terminal 300 displays video 300 distributed by HTTP streaming on display unit 300A (FIG. 2). Also, as will be described later, when the caption data (300B) is distributed using the message management file transmitted by HTTP long polling, the caption data (300B) is superimposed on the video on the display unit 300A. , or in a separate display area (see FIG. 9).

FIG. 3 shows a configuration example of the video/audio transcoding unit 220 in FIG. It has a section 223, an encoding section 224, a TS stream characteristic determination section 225, and the like. In FIG. 3, the TS demultiplexer 221 demultiplexes the TS stream of the broadcast service to generate a video stream and an audio stream. A decoding unit 222 decodes the MPEG code to generate a video signal and an audio signal. The TS stream characteristic determination unit 225 determines the characteristics of the TS stream of the broadcast service, the number of channels, caption data, video mode, audio mode, and the like. The standard mode conversion unit 223 performs output conversion in a predetermined form, for example, converts an input video signal and an input audio signal, and further outputs in two channels. In this example, the number of outputs is basically 2 channels, and the 2-channel video and audio signals are supplied to the encoding section 224 . The standard mode conversion unit 223 may output the video signal and the audio signal in the standard mode as they are when they are input. The encoding unit 224 converts the input two-channel video signal and audio signal into a streaming format moving image file, for example, an HTTP streaming format (typically HLS format) streaming file. In the example of FIG. 3, the first moving image streaming file 226 and the second moving image streaming file 227 are output. The first video streaming file 226 has video in HD mode and audio in stereo, and the second video streaming file 227 also has video in HD mode and audio in stereo. The standard mode may be changed to another mode, for example, SD mode for video and monaural mode for audio.

If the TS stream of the broadcast service contains only one channel, the first video stream and the second video stream will be the same. When the TS streams of the broadcast service include two different channels, the first moving image stream and the second moving image stream are different moving image streams corresponding to channels different from each other.

The video/audio transcoder 220 generates a program table 228 that shows what the multiple video streams look like. Program table 228 may indicate which channel the video stream is on. If multiple video streams are viewable, selectable groups may be specified using, for example, the “EXT-MEDIA” tag in HLS.

The TS stream characteristics discriminator 225 may include a video mode discriminator 225A, an audio mode discriminator 225B, a multi-channel discriminator 225C, and the like. The audio mode determination unit 225B determines the number of audio PESs (packetized elementary streams) and the audio mode in each audio PES. Audio mode determination unit 225B determines that there is a secondary audio in addition to the main audio when there are a plurality of audio PESs described in the PMT (program map table). Further, the audio mode determination unit 225B determines the mode based on the contents of "channel_configuration" (3 bits) of "adts_fixed_header" of "adts_frame" of the header of the audio PES as follows.
1: Monaural 2: Stereo 6: 5.1 channel (SS)
0: Dual mono (main audio and sub audio are included in one audio PES)

If the audio is in mono mode, make the left and right stereo elements the same. Audio in 5.1-channel mode uses stereo compote only.

Considering secondary audio, the number of channels of a standard video stream may be set to four as shown in FIG. 6(A). In FIG. 6A, the video stream of the first channel (HD/stereo/main audio), the video stream of the second channel (HD/stereo/main audio), the video stream of the first channel (HD/stereo /Secondary Audio) video stream and the second channel (HD/Stereo/Secondary Audio) video stream can be output in standard form. If there is no secondary audio, all video streams may contain duplicate primary audio.

On the mobile terminal 300, valid programs are displayed based on the information in the program table 228, for example, as shown in FIG. Although it may be like this, it is not limited to this. In the example of FIG. 10A, "channel 01" can be selected, and "channel 02" has the same content and cannot be selected. If the contents are not the same, both can be selected. By making a selection, the video file can be streamed from the destination. In the case of the moving image stream shown in FIG. 6A (the case of four), it becomes as shown in FIG. In this example as well, gray display cannot be selected due to the same content.

A configuration example of the mobile terminal 300 will be further described later with reference to FIGS. 7, 8, 9, and the like.

The video mode determination unit 225A determines the video mode such as resolution based on the value of "video\encode\format" in the "descriptor" included in the PMT, or decodes the MPEG2 video transmitted by the video PES. , and the "sequence header" therein. The standard video mode is HD (High Definition).

The multi-channel determination unit 225C determines whether or not there are multiple channels (services) in the TS stream. For example, if there are two channels, they are treated as two standard video/audio streams. If there is only one channel, two identical video streams are generated. The number of channels can be determined by whether multiple services (PMT) are described in the PAT. Whether or not two channels have the same content can be determined based on EPG (Electronic Program Guide) information and whether or not the video/audio of each channel is the same.

FIG. 5 shows an alternative example (220A) of the video/audio transcoder 220 described with reference to FIG. 221, a decoding unit 222, a standard mode conversion unit 223, an encoding unit 224, a TS stream characteristic determination unit 225, a caption data extraction unit 231, a video synthesis unit 229, and the like. In this example, when there is subtitle data, a video stream (stereo, HD) of video not including subtitles and a video stream (stereo, HD) of video including subtitles are formed. A video signal including subtitles is generated using the video synthesizing unit 229 .

When both video with subtitles and video without subtitles are included in the standard video stream, the standard video stream is as shown in FIG. 6(B). Considering the presence or absence of subtitles and both main and sub-audio, eight standard video streams may be formed as shown in FIG. 6(C).

A display example of the program selection section in the portable terminal 300 is as shown in FIG. 10(A). If the main audio and sub audio are in the standard format, it becomes as shown in FIG. 10(B). Grayed out buttons may be disabled as described above, but are not limited to this.

Note that a conventional streaming method conforming to the HTTP protocol, for example, a video distribution service based on HLS (HTTP Live Streaming, Apple Inc., USA) uses a playlist file (for example, an m3u8 file) and one or more video segment file (MPEG2-TS segment file). In the example of FIG. 25, it is possible to select multiple (two) alternative playlists with different resolutions using the master index file. There may be only one playlist. The alternative playlist (playlist) is rewritten and repeatedly transmitted. The viewing client refers to the play list, sequentially extracts the moving image segment files as shown in FIG. 25, and reproduces the moving image (FIG. 26). If a plurality of playlists can be selected using the master playlist (master index) shown in FIG. Corresponding media segment files may be retrieved sequentially based on a desired standard format playlist. While one playlist is selected for viewing, another playlist may be selected using the program selection unit to switch the specification of the standard format and switch to viewing based on the other playlist.

FIG. 7 shows a configuration example of a mobile terminal 300 , in which the mobile terminal 300 includes a processing system 310 , a memory 320 , an input/output subsystem 330 , a high frequency circuit section 340 and an audio circuit section 350 . Each of the components may be implemented in hardware, including signal processing integrated circuits, application specific integrated circuits, as appropriate, software, or a combination thereof. Radio frequency circuitry 340 is used to transmit and receive information over a wireless link or network to other devices and includes antenna systems, RF transceivers, amplifiers, tuners, oscillators, Including, but not limited to, digital signal processors, CODEC chipsets, memory, and other known circuitry. The high-frequency circuit unit 340 is used for mobile communications such as time division multiple access (TDMA) and code division multiple access (CDMA), wireless LAN (IEEE 802.11b, IEEE802.11a, IEEE802.11g and/or IEEE802.11N), Bluetooth (Registered Trademark: IEEE802.15.1), Wi-MAX (IEEE802.16) and other communication protocols can be used, but are not limited thereto. Audio circuitry 350 is coupled to audio speaker 351 and microphone 352 . Processing system 310 includes processor 311 , memory controller 312 , and peripheral device interface 313 . Memory 320 stores code and data that processor 311 executes. Memory 320 may include any storage device such as RAM, ROM, FLASH, disk drives, magnetic tape, and the like. Processor 311 executes various software components stored in memory 320 . For example, software components include operating system 321 , communication module 322 , contact/action module 323 , graphics module 324 , application 325 , timer module 326 and web browser module 327 . Applications 325 include a browser, address book, e-mail, encryption, location determination functions such as Global Positioning System (GPS), and a two-dimensional barcode decoder. Internet-delivered television viewing application 325 A ( FIG. 6 ) of this embodiment is typically implemented as one of applications 325 . The input/output subsystem 330 controls the touch panel 331 and the like. In this portable terminal 300, the function of viewing the television broadcast service distributed by Internet retransmission is implemented as an application. By installing the corresponding application in the memory 320, the portable terminal 300 is realized as an Internet-delivered television broadcast viewing terminal.

FIG. 8 schematically shows the functions realized by the Internet-delivered television broadcast viewing application 325A. etc. may be included as functions. The closed caption data playback unit 370 allows the closed caption data to be manipulated independently of the video/video stream, similar to normal digital broadcasting services, which will be described later as an alternative embodiment. In this case, a video stream with subtitles (a stream on which fixed subtitles are superimposed) may or may not be provided.

The video/audio stream reproducing unit 360 in FIG. 8 selects a program from a predetermined program table, displays available channels as shown in FIGS. You can choose to play the video stream. Only channels of available video streams may be displayed.

In this embodiment, since a moving image stream that can be used in a communication network is generated and output in a standard manner, programs (moving images) with different resolutions and formats and programs with different audio standards can be viewed continuously. can. Also, complex subtitle services can be handled as normal video streams.

FIG. 11 shows an alternative embodiment of the present invention, in which a communication network distribution subsystem 200B comprises an IP receiver 210, a video/audio transcoder 220, a video/audio distributor 230, a subtitle It has a data extraction unit 231, a caption data distribution unit 250, a message management file holding unit 260, and the like. The video/audio distribution unit 230 transmits the video/audio stream (video stream) to the mobile terminal 300 by the HTTP streaming method as described above. The caption data extraction unit 231 extracts caption data from the broadcast service TS stream, and the video/audio transcoding unit 220 may include that function. Caption data is transmitted to the mobile terminal 300 by HTTP long polling. Subtitle data delivery (HTTP long polling) will be described in detail later.

Broadcaster subsystem 100 or communication network distribution subsystem 200 holds an index file for managing TS packets of a broadcast TS stream in message management file holding unit 260 as a message management file. Broadcaster subsystem 100 or communication network distribution subsystem 200 creates and manages an index (message entry) shown in FIG. 15 each time a TS packet is received. As for the caption data, the caption packet as schematically shown in FIG. 16 is held in the data storage management section as it is, and can be accessed by the path specified by the entity file name attribute of the message.

The video/audio stream reproducing unit 360 (FIG. 8) of the mobile terminal 300 decodes the video/audio packet file distributed from the video/audio distribution unit 240 of the communication network distribution subsystem 200 by HTTP streaming, , the video is displayed in the video viewing area A of the display area of the mobile terminal 300 as shown in FIG. In order to start watching TV broadcasting, a corresponding application is selected and activated, and a channel is selected from an on-screen display or the like similar to that of a normal TV receiver. Channel switching may be performed based on swiping. An authentication dialog is performed, possibly with an authentication server (not shown). Note that application 325A can, for example, obtain channel information for each viewable broadcast channel from an authentication server.

Furthermore, in FIG. 8, the subtitle data reproduction unit 370 reproduces synchronization data such as subtitles. The caption data reproduction unit 370 acquires the synchronization data from the caption data delivery unit 250 of the communication network delivery subsystem 200 by HTTP long polling, and displays captions, superimposed text, etc. at the timing synchronized with the video/audio streaming. It's like Also, the caption data reproducing unit 370 processes the event message, which is also synchronous data, at the timing synchronized with the video/audio streaming. The event message may be used to switch the contents of the BML document.

FIG. 12 illustrates the correction PCR generation section 372 that controls the synchronization timing in the caption data reproduction section 370. As shown in FIG. In FIG. 12 , the subtitle data reproduction unit 370 has a subtitle display unit 371 , a correction PCR generation unit 372 , a message management file holding unit 373 , a subtitle data holding unit 374 and a polling control unit 375 . The corrected PCR generation section 372 generates a PCR (program clock reference) according to the reproduction status of the video/audio stream reproduction section 360 . The polling control unit 375 polls the subtitle data distribution unit 250 of the communication network distribution subsystem 200, extracts a new entry (message) from the message management file holding unit 260, and manages the message of the subtitle data reproduction unit 370. Add to the file holding unit 373 , and add new subtitle data to the subtitle data holding unit 374 . The message management file holding unit 373 and the caption data holding unit 374 delete unnecessary entries. The message management file holding unit 260 of the communication network distribution subsystem 200 also deletes unnecessary entries. The subtitle display unit 371 refers to the display timing (PST) of the subtitle packet in the subtitle data holding unit 374 based on the corrected PCR calculated by the corrected PCR generation unit 372, and starts displaying subtitles (the same applies to superimposed characters). Then, referring to the deletion timing, the subtitle display ends.

The correction PCR generation unit 372 detects the date and time (date and time based on the time of the server that creates the message management file) when the program switching (the stream configuration of the broadcast program in one channel has changed), and the The difference between the date and time of the video/audio stream (date and time on the playback time axis; date and time based on the time of the server that transcodes TS) is calculated, and the elapsed time from the time of program switching to the date and time on the playback time axis (PCR elapsed time) is obtained, and this is multiplied by the resolution of the program reference clock (for example, 90000/sec) to obtain the elapsed clock. Further, the corrected PCR generator 372 holds the PCR when the program switching is detected, and calculates the corrected PCR by adding elapsed clocks based on this (FIG. 14). Such a calculation method is shown in FIG. 13(A). A specific calculation example is shown in FIG. The upper limit of PCR is "8589935102". Here, the exact time of the movie is set in EXT-PROGRAM-DATE-TIME, preferably the time of the server that creates the HLS and transcodes the TS and the server that creates the message management file in units of one frame. It is assumed that there is no deviation. Program switching (a change in the stream configuration of a broadcast program in one channel) occurs when, for example, the mobile terminal 300 detects a change in the version number value of a PMT (Program Map Table) packet and detects this. detect. In a typical example, "pmt_changed" is a message notifying that PMT data has changed, and the detection time of the server is transcribed into the message execution time in this message. Also, the server receives the PMT data extracted from the tuner, acquires the PCR from the location where the PCR is described in the PMT, and transcribes it as additional information in the fourth column of the "pmt_changed" message. When the PMT indicates a program switch (a change in stream composition of broadcast programs within one channel), the previous message management data can be cleared.

In addition, the difference between the PTS and the PCR is obtained, and the difference is added to the time when the PCR is received to convert it to real time, which is output to the message management file, and the subtitles are displayed in real time instead of based on the PCR clock. Display/erasure may be controlled.

FIG. 17 shows still another embodiment of the present invention. In this figure, the broadcaster subsystem 100 has an insertion information sending section 140, and this insertion information sending section 140 is used for commercial video/audio. Information for replacing video/audio infringing copyrights with alternative content is supplied to the insertion control unit 270 of the communication network distribution subsystem 200 . The insertion control unit 270 replaces commercial video/audio or copyright-infringing video/audio with substitute content between the break point and the restart point on a frame-by-frame basis. The breakpoints and restartpoints and alternate content are provided by the insert information sender 140 of the broadcaster subsystem 100 . The alternative content may be placed in a predetermined site in advance, or may be supplied at the same time. Breakpoints and restart points can be determined using PCR and PTS. In the example of FIG. 17, the replacement process may be performed in the demultiplexer 221, decoder 222, standard mode converter 223, and encoder 224 of the video/audio transcoder 220B of the network distribution subsystem 200. FIG. In the configuration example of FIG. 18, the switch 242 in the video/audio transcoding unit 220B converts the alternative content from the alternative content input unit 241 into the insertion control information (switching signal) of the insertion control unit 270 of the communication network distribution subsystem 200. It is designed to be inserted based on

Information for replacing alternative content (insertion control information: start point, end point, address of alternative content) may be sent from outside the broadcaster subsystem 100 .

The video stream has the commercials replaced with alternative content as shown in FIG.

FIG. 24 shows a configuration example of the insertion control unit 270. As shown in FIG. In this configuration example, the upstream system uses insertion control information (organization information) to designate break point times for lid control and content replacement processing in units of hours, minutes, seconds, and milliseconds. Each video frame in the TS stream is assigned a clock time specified by a PTS (presentation time stamp). Based on the program clock value at the timing when the ToT (time offset table) was last received in the TS stream, the time based on the ToT of each frame (format of year, month, day, hour, minute, second, millisecond, hereinafter also referred to as frame PTS time) Ask for When frame data is input to the decoding unit 222 of the TS stream, the frame PTS time is saved in the nondestructive auxiliary data area (frame PTS time file management unit 274) attached to each frame. When encoding into the distribution format, the frame time in the non-destructive auxiliary data area is compared with the breakpoint time to determine whether or not to cut.

24, the insertion control unit 270 includes a composition information file management unit 271, a next composition information entry extraction unit 272, a flake PTS time generation unit 273, a frame PTS time file management unit 274, a processing frame PTS time extraction unit 275, and a It has a comparison unit 276 .

The organization information file management unit 271 manages insertion information (organization information) files, and the insertion information (organization information) is specified for each entry at a specified time (YYYY-MM-DDT12:MM:SS:mm+900 (time difference )), commands, source addresses, etc. An entry is formed for each program and alternative content, and commands include a program command to start encoding a program at a specified time, a mask command to start encoding a still image (black), and a file command to start encoding a specified alternative video. have. The next organization information entry is sequentially retrieved from the organization information management file 271 to the next organization information entry fetching unit 272 in order from the earliest, and the comparison of one organization information entry is performed in the comparison unit 276, and switching is performed by the switch 242. , the next composition information entry is fetched from the composition information management file 271 to the next composition information entry extraction unit 272 to prepare for the next switching.

On the other hand, the TS stream is supplied to the decoding section 222 and the frame PTS time generating section 273 . The frame PTS time generation unit 273 extracts the ToT from the TS stream, holds the clock at that time, and converts the PTS of the frame to be processed based on the latest ToT and the latest ToT reception clock into year-month-day-minute-second format ( YYYY-MM-DDT12:MM:SS:mm+900 format) frame PTS time. This frame PTS time is held and managed by the frame PTS time file management section 274 . The processing target frame PTS time extracting unit 275 sequentially extracts the frame PTS times of the processing target (encoding target) frames, and the comparison unit 276 performs comparison at the frame rate (frame interval). The comparison unit 276 identifies the frame closest to the time of the next composition information entry extracted by the next composition information entry extraction unit 272, and switches the switch 242 at that time (clock).

In the examples of FIGS. 17 and 24, the sub-system for communication network distribution 200 inserts the alternative content, but as shown by the dashed line in FIG. , the introduction operation may be performed in the mobile terminal 300 .

Insertion control data, such as designation of alternative content, may be provided dynamically with reference to the user's profile information of the mobile terminal 300 and various historical information. The user may select alternative content or groups thereof that may be displayed on the mobile terminal 300 using an alternative content designator that may be included as part of the video/audio stream player 360 . Based on the playback history of the alternative content (commercial video), the already played alternative content specifying unit (video/audio stream playback unit 360) may be used to individually play back predetermined played alternative content.

FIG. 20 illustrates an example in which the inserted moving image reproduction unit 380 is configured in a manner similar to the insertion of subtitle data described with reference to FIG. 12 . In the example of FIG. 20, the polling control unit 375 receives an alternative content insertion instruction, the message management file holding unit 373 holds this instruction, and the alternative content insertion process is performed using the alternative content held in the alternative data holding unit 374A. can do That is, the switching control unit 371A controls switching between the video/audio stream (moving image stream) and the alternative content. In this example, the breakpoint and restart point may be determined using the corrected PCR, similar to the example of FIG. The time information of the break point and restart point supplied from the insertion information sending unit 140 is specified in the format of year, month, day, minute, second, and can be converted to and from the correction PCR using ToT (Time Offset Table). is. ToT is also preferably transmitted to the mobile terminal 300 side. The alternative content holding unit 374A may be a buffer device and may be held in a server (storage device) on the communication network 500. FIG.

FIG. 21 illustrates an example of the processing flow using caption data as an example, and in the modification of FIG. 20, similar processing may be performed when inserting other alternative content. In FIG. 21, the IP receiver 210 of the communication network distribution subsystem 200 receives the TS packets of the broadcast service TS stream from the broadcaster subsystem 100 and supplies them to the caption data extraction unit 231 (X01). The extraction unit 231 transmits TS packets of caption data to the caption data distribution unit (server) 250 (X02). The caption data distribution unit 250 stores the caption data in the caption data storage management unit, and correspondingly updates the message management data (message management file) in the message management file holding unit 260 (X03). Application 325A of portable terminal 300 first retrieves the message management data (X05) in long polling processing part X04, and in response to this, caption data delivery unit 250 sends the latest message management data to application 325A. Return (X06). The caption data distribution unit 250 repeats returning the updated portion of the message management data to the application 325A each time it is updated (X07). The application 325A interprets the message management data acquired in steps X06 and X07 line by line, and if it is a caption message, it goes to get the caption data acquired in step X03 (X08). In response, the caption data is sent to the application 325A (X09). The application 325A performs display processing at appropriate timing based on the contents of the message management data and caption data, and captions are displayed to the user (X10, X11).

FIG. 22 shows an example of a message. As shown in FIG. 3, the message has a message execution time (also referred to as firing time) in the first column and a message type (substance) in the second column. type), the actual file name in the third column, and additional information in the fourth column (FIG. 22(A)). In the specific example of FIG. 22B, the message execution time is "2016-04-20T13:02:15.588+0900", the message type is "cap_packet", and the actual file name is "/tvmock/20160420/7fe4". .7fe4.0420/cap/00055002" and contains no additional information. The message type "cap_packet" indicates that the message is about subtitles, and indicates that the subtitle data is stored in the entity file name "/tvmock/20160420/7fe4.7fe4.0420/cap/00055002". . Main message types are as shown in FIG.

"pmt_changed" in FIG. 23 is used to control the display timing of subtitle data as described above.

In FIG. 20, alternative content insertion control data (message) is transferred from the communication network distribution subsystem 200 to the inserted moving image reproduction unit 380 of the mobile terminal 300 to switch the display of the alternative content. A caption display message (caption display instruction) is transferred from the distribution subsystem 200 to the caption data reproduction unit 370 of the mobile terminal 300 to display the caption (overlaid with the video or displayed in a display area separate from the video). However, any character information may be displayed on the mobile terminal 300 in a similar manner. For example, the communication network subsystem 200 holds a display control message for predetermined character information (advertisement, viewer's message, public information, etc.) in the message management file holding unit and transfers it to the mobile terminal 300 side. , the mobile terminal 300 uses this display control message to extract the corresponding character information stored and managed in the communication network subsystem 200 or any other site, and displays the character at the timing instructed by the display control message. Information can be displayed, deleted, or moved. The timing of display, deletion, etc. may conform to the system clock of the broadcaster subsystem 100 (the clock in the broadcast service TS packet) or the system clock of the communication network distribution subsystem 200, and a flag indicates which clock to conform to. You can specify it with This character information may be displayed in an auxiliary viewing area provided separately from video viewing area A of mobile terminal 300 in FIG. 9 (for example, a window labeled "caption" in FIG. 9), but is not limited to this.

This completes the description of the embodiments of the present invention.

The present invention is determined based on the description of the claims, and is not limited to specific configurations, problems, and effects of the embodiments. The present invention is not limited to the above-described embodiments, and various modifications can be made without departing from the scope of the invention.

For example, although the above embodiments have been described in relation to mobile terminals, the present invention may be widely applied to fixed terminals and network television receivers.
Some of the technical features described here are listed below.
[Technical feature 1]
Reconstruction means for receiving a transmission stream obtained by converting a TS stream of a broadcasting service for transmission over a communication network through the communication network and reconstructing the TS stream of the broadcasting service from the transmission stream;
a characteristic determining means for determining characteristics of the TS stream of the broadcasting service reconstructed by the reconstructing means;
conversion means for IP distribution for converting a video stream and an audio stream included in the TS stream of the broadcast service reconstructed by the reconstruction means into a video stream in a format for IP distribution;
transmitting means for transmitting the video stream in the IP distribution format generated by the IP distribution conversion means to the client terminal via the communication network in response to a request from the client terminal on the communication network;
The broadcast service communication network distribution apparatus, wherein the conversion means for IP distribution is configured to generate a moving image stream in the format for IP distribution in a standard format based on the characteristic determined by the characteristic determination means. .
[Technical feature 2]
The broadcast service communication network delivery device according to technical feature 1, wherein the audio mode in the IP delivery format video stream generated in the standard format is a stereo audio mode.
[Technical feature 3]
3. The broadcast service communication network distribution device according to technical feature 1 or 2, wherein the video mode in the video stream of the IP distribution format generated in the standard format is a high-definition mode.
[Technical feature 4]
The converting means for IP distribution generates, from the TS stream of the broadcasting service, N (N is an integer of 2 or more) motion picture streams in the format for IP distribution corresponding to the number of organization channels. Broadcast service communication network distribution apparatus according to any one of the preceding claims.
[Technical feature 5]
The N number of organization channels are two organization channels, and even if the TS stream of the broadcasting service includes only one organization channel, the number of video streams in the IP distribution format corresponding to the two organization channels is generated. Broadcast service communication network distribution device according to technical feature 4 for generating.
[Technical Feature 6]
Broadcast service communication network delivery apparatus according to any one of technical features 1 to 5, wherein the IP delivery conversion means generates a number of video streams in the IP delivery format corresponding to two modes of main audio and secondary audio. .
[Technical Feature 7]
Broadcasting according to technical feature 6, wherein the converting means for IP distribution generates a number of video streams in the format for IP distribution according to two modes even if the TS stream of the broadcasting service does not contain sub-audio. Service communication network distribution equipment.
[Technical Feature 8]
Broadcast service communication according to any one of technical characteristics 1 to 7, wherein the IP distribution converting means generates a number of video streams in the IP distribution format corresponding to the number of viewing selections of subtitle display and subtitle non-display. network distribution equipment.
[Technical feature 9]
According to the technical feature 8, the converting means for IP distribution generates a number of video streams in the format for IP distribution corresponding to the number of the two viewing selections, even if the TS stream of the broadcasting service does not include caption data. Broadcast service communication network distribution apparatus as described.
[Technical feature 10]
10. The broadcast service communication network delivery device according to any one of technical features 1 to 9, wherein the moving image stream comprises a series of moving image files that are reproduced sequentially by means of an index file.
[Technical feature 11]
11. The broadcast service communication network distribution device according to any one of technical features 1 to 10, wherein the IP distribution format moving picture stream is a streaming type moving picture stream.
[Technical feature 12]
12. The broadcast service communication network delivery device according to any one of technical characteristics 1 to 11, wherein the transmission stream is an IP packetized TS stream of the broadcast service.
[Technical feature 13]
The conversion means for IP distribution is
demultiplexing means for demultiplexing the TS stream of the broadcast service reconstructed by the reconstructing means to generate a video stream and an audio stream;
decoding means for decoding the video stream and the audio stream output from the demultiplexing means to generate a video signal and an audio signal;
standard mode conversion means for converting the video signal and the audio signal into a standard mode;
13. The broadcast service communication network delivery device according to any one of the technical features 1 to 12, further comprising encoding means for encoding the standard mode video signal and audio signal to generate the video stream in the IP delivery format.
[Technical feature 14]
Reconstruction means for receiving a transmission stream obtained by converting a TS stream of a broadcasting service for transmission over a communication network through the communication network and reconstructing the TS stream of the broadcasting service from the transmission stream;
conversion means for IP distribution for converting a video stream and an audio stream included in the TS stream of the broadcast service reconstructed by the reconstruction means into a video stream in a format for IP distribution;
transmitting means for transmitting the video stream in the IP distribution format generated by the IP distribution conversion means to the client terminal via the communication network in response to a request from the client terminal on the communication network;
The converting means for IP distribution generates a video stream in the format for IP distribution for the video stream and the audio stream generated by the video/audio stream generating means when subtitle data is included in the TS stream of the broadcasting service. In addition, a broadcasting service characterized by generating another video stream in an IP distribution format from a video stream of a synthesized video obtained by adding subtitles based on subtitle data to the video of the video stream and the audio stream. Communication network distribution equipment.
[Technical feature 15]
Reconstruction means for receiving a transmission stream obtained by converting a TS stream of a broadcasting service for transmission over a communication network through the communication network and reconstructing the TS stream of the broadcasting service from the transmission stream;
conversion means for IP distribution for converting a video stream and an audio stream included in the TS stream of the broadcast service reconstructed by the reconstruction means into a video stream in a format for IP distribution;
transmitting means for transmitting the video stream in the IP distribution format generated by the IP distribution conversion means to the client terminal via the communication network in response to a request from the client terminal on the communication network;
The conversion means for IP distribution receives information designating the start and end of the time interval and alternative content, and replaces the video stream in the format for IP distribution with the alternative content in the section defined by the start and end. A broadcasting service communication network distribution device characterized by being configured as follows.
[Technical feature 16]
16. The broadcast service communication network delivery device according to technical feature 15, wherein the alternative content is a video stream segment and an audio stream segment or a still image and predetermined audio.
[Technical feature 17]
The conversion means for IP distribution has demultiplexing means for demultiplexing the TS stream of the broadcasting service reconstructed by the reconstruction means to generate a video stream and an audio stream, and is defined by the start time and end time. 17. The broadcast service communication network delivery device according to technical feature 15 or 16, wherein alternative content is used in place of the video signal and audio signal decoded from the video stream and audio stream in the section where the video stream and audio stream are decoded.
[Technical feature 18]
18. Broadcast service communication according to technical feature 16 or 17, wherein the start and end of said time interval are expressed in year, month, day, hour, minute, second and are compared with time based on a time offset table and a clock according to the TS stream of said broadcast service. network distribution equipment.
[Technical feature 19]
Reconstruction means for receiving a transmission stream obtained by converting a TS stream of a broadcasting service for transmission over a communication network through the communication network and reconstructing the TS stream of the broadcasting service from the transmission stream;
conversion means for IP distribution for converting a video stream and an audio stream included in the TS stream of the broadcast service reconstructed by the reconstruction means into a video stream in a format for IP distribution;
a transmitting means for transmitting the video stream in the IP distribution format generated by the IP distribution conversion means to the client terminal via the communication network in response to a request from the client terminal on the communication network;
Control information for receiving information specifying the start and end of a time interval and alternative content and supplying control information to the client device to replace the section defined by the start and end of the video stream with the video stream segment. a broadcast service communication network distribution device, comprising: a supply means;
[Technical feature 20]
In a client terminal connected via a communication network together with the broadcast service communication network distribution device according to technical feature 19,
a moving image stream reproducing means for receiving and reproducing a moving image stream in the format for IP distribution from the transmitting means of the broadcasting service communication network distribution apparatus;
The moving image stream reproducing means reproduces the alternative content in place of the moving image stream at reproduction times corresponding to the start and end of the time interval received from the control information supply means of the broadcasting service communication network distribution device. A client terminal, comprising:
[Technical feature 21]
The format for the IP distribution is HLS (HTTP Live Streaming, both trademarks of Apple Inc.), and the moving image stream reproducing means reproduces the moving image stream in compliance with EXT-PROGRAM-DATE-TIME of the file of the moving image stream. 21. The client terminal of technical feature 20, wherein the alternative content is played instead of the content.
[Technical feature 22]
Reconstruction means for receiving a transmission stream obtained by converting a TS stream of a broadcasting service for transmission over a communication network through the communication network and reconstructing the TS stream of the broadcasting service from the transmission stream;
conversion means for IP distribution for converting a video stream and an audio stream included in the TS stream of the broadcast service reconstructed by the reconstruction means into a video stream in a format for IP distribution;
a transmitting means for transmitting the video stream in the IP distribution format generated by the IP distribution conversion means to the client terminal via the communication network in response to a request from the client terminal on the communication network;
alternative content distribution control means for controlling transmission of alternative content to be replaced with a video stream or audio stream in a specified period to the client terminal via the network;
The alternative content distribution control means is
index file storage means for storing an index file that enables access to insertion control information in units of replacement operations;
means for transmitting the index file to the client terminal via the network in response to polling from the client terminal;
A broadcasting service, wherein the client terminal acquires the alternative content from a predetermined alternative content storage means using the insertion control information, and replaces the video stream and the audio stream with the alternative content for a predetermined period. Communication network distribution equipment.
[Technical feature 23]
A client terminal connectable to a network,
a video/audio stream receiving means for receiving, from a transmitting device, a video/audio stream extracted from a broadcast stream and transmitted via the network in a streaming manner;
alternative content receiving means for receiving, via the network, the alternative content stored in the alternative content storage means;
The alternative content receiving means is
index file receiving means for receiving from the transmitting device by polling an index file that enables access to the alternative content stored in the alternative content storage means in replacement operation units;
a means for receiving the alternative content stored in the alternative content storage means in units of the replacement operation using the index file received by the index file receiving means. [Technical feature 24]
A client terminal that can be connected to the network,
a video/audio stream receiving means for receiving, from a transmitting device, a video/audio stream extracted from a broadcast stream and transmitted via the network in a streaming manner;
A computer program used for executing alternative content stored in an alternative content storage means through an alternative content receiving means that receives the alternative content via the network,
The alternative content receiving means is
index file receiving means for receiving from the transmitting device by polling an index file that enables access to the alternative content stored in the alternative content storage means in replacement operation units;
and means for receiving the alternative content stored in the alternative content storage means in units of the replacement operation using the index file received by the index file receiving means.

100 Broadcaster Subsystem 110 Broadcast Service TS Stream Output Unit 120 Uplink Unit 130 IP Transmitting Device 140 Insertion Information Sending Unit 200 Communication Network Distribution Subsystem 210 IP Receiving Device 220 Video/Audio Transcoding Unit 221 Demultiplexing Unit 222 Decoding unit 223 Standard mode conversion unit 224 Encoding unit 225 TS stream characteristic determination unit 228 Program table 229 Video synthesizing unit 230 Video/audio distribution unit 231 Subtitle data extraction unit 240 Video/audio distribution unit 241 Alternative content input unit 242 Switch 250 Subtitle data Distribution unit 260 Message management file holding unit 270 Insertion control unit 300 Mobile terminal 300A Display unit 325A Internet distribution TV broadcast viewing application 360 Video/audio stream reproduction unit 370 Subtitle data reproduction unit 371 Subtitle display unit 372 Correction PCR generation unit 373 Message management file Holding unit 374 Subtitle data holding unit 374A Substitute data holding unit 375 Polling control unit 380 Inserted video playback unit 400 Gateway 500 Communication network 600 Authentication server 700 Line

Claims (10)

Broadcasting service communication network distribution equipment for simultaneously distributing video and audio content provided by broadcasting services using a communication network,
Reconstruction means for receiving a transmission stream obtained by converting a TS stream of a broadcasting service for transmission over a communication network through the communication network and reconstructing the TS stream of the broadcasting service from the transmission stream;
conversion means for IP distribution for converting a video stream and an audio stream included in the TS stream of the broadcast service reconstructed by the reconstruction means into a video stream in a format for IP distribution;
a transmitting means for transmitting the video stream in the IP distribution format generated by the IP distribution conversion means to the client terminal via the communication network in response to a request from the client terminal on the communication network;
Control information supply for receiving information specifying the start and end of a time interval and alternative content, and supplying control information to the client terminal so as to replace the section defined by the start and end of the video stream with the alternative content. and means for broadcasting service communication network distribution. In a broadcasting service communication network distribution method for simultaneously distributing video and audio content provided by a broadcasting service using a communication network,
a reconstruction step of receiving, via the communication network, a transmission stream obtained by converting a TS stream of a broadcasting service for transmission over a communication network and reconstructing the TS stream of the broadcasting service from the transmission stream;
a conversion step for IP distribution of converting a video stream and an audio stream included in the TS stream of the broadcast service reconstructed by the reconstruction step into a video stream in a format for IP distribution;
a transmitting step of transmitting the video stream in the IP distribution format generated by the IP distribution converting step to the client terminal in response to a request from the client terminal on the communication network;
Control information supply for receiving information specifying the start and end of a time interval and alternative content, and supplying control information to the client terminal so as to replace the section defined by the start and end of the video stream with the alternative content. A broadcast service communication network delivery method, comprising the steps of: A computer program for simultaneously distributing video and audio content provided by broadcasting services using a communication network,
The processor of the communication network distribution subsystem,
Reconstruction means for receiving a transmission stream obtained by converting a broadcast service TS stream for transmission over a communication network via the communication network and reconstructing the broadcast service TS stream from the transmission stream;
IP distribution converting means for converting a video stream and an audio stream included in the TS stream of the broadcasting service reconstructed by the reconstructing means into a video stream in a format for IP distribution;
a transmitting means for transmitting the video stream in the IP distribution format generated by the IP distribution conversion means to the client terminal via the communication network in response to a request from the client terminal on the communication network;
Control information supply for receiving information specifying the start and end of a time interval and alternative content, and supplying control information to the client terminal so as to replace the section defined by the start and end of the video stream with the alternative content. A computer program for execution as a means. A client terminal connected to the broadcast service communication network distribution device according to claim 1 via a communication network,
a moving image stream reproducing means for receiving and reproducing a moving image stream in the format for IP distribution from the transmitting means of the broadcasting service communication network distribution apparatus;
The moving image stream reproducing means receives from the control information supplying means of the broadcasting service communication network distribution device and reproduces the alternative content in place of the moving image stream at reproduction times corresponding to the start and end of the time interval. A client terminal, comprising: The format for the IP distribution is HLS (HTTP Live Streaming, both trademarks of Apple Inc.), and the moving image stream reproducing means reproduces the moving image stream in compliance with EXT-PROGRAM-DATE-TIME of the file of the moving image stream. 5. The client terminal according to claim 4, wherein said alternative content is reproduced instead of said content. Broadcasting service communication network distribution equipment that simultaneously distributes video and audio content provided by broadcasting services using a communication network,
Reconstruction means for receiving a transmission stream obtained by converting a TS stream of a broadcasting service for transmission over a communication network through the communication network and reconstructing the TS stream of the broadcasting service from the transmission stream;
conversion means for IP distribution for converting a video stream and an audio stream included in the TS stream of the broadcast service reconstructed by the reconstruction means into a video stream in a format for IP distribution;
a transmitting means for transmitting the video stream in the IP distribution format generated by the IP distribution conversion means to the client terminal via the communication network in response to a request from the client terminal on the communication network;
alternative content distribution control means for controlling transmission of alternative content to be replaced with a video stream or audio stream in a specified period to the client terminal via the network;
The alternative content distribution control means is
index file storage means for storing an index file that enables access to insertion control information in units of replacement operations;
means for transmitting the index file to the client terminal via the network in response to polling from the client terminal;
A broadcasting service, wherein the client terminal acquires the alternative content from a predetermined alternative content storage means using the insertion control information, and replaces the video stream and the audio stream with the alternative content for a predetermined period. Communication network distribution equipment. In a broadcasting service communication network distribution method for simultaneously distributing video and audio content provided by a broadcasting service using a communication network,
a reconstruction step of receiving, via the communication network, a transmission stream obtained by converting a TS stream of a broadcasting service for transmission over a communication network and reconstructing the TS stream of the broadcasting service from the transmission stream;
a conversion step for IP distribution of converting a video stream and an audio stream included in the TS stream of the broadcast service reconstructed by the reconstruction step into a video stream in a format for IP distribution;
a transmitting step of transmitting the video stream in the IP distribution format generated by the conversion step for IP distribution to the client terminal via the communication network in response to a request from the client terminal on the communication network;
an alternative content delivery control step for controlling transmission of alternative content to be replaced with the video stream or audio stream during a specified period to the client terminal via the network;
The alternative content delivery control step is
an index file storage step of storing an index file that makes insertion control information accessible in replacement operation units;
transmitting the index file to the client terminal via the network in response to polling from the client terminal;
A broadcasting service, wherein the client terminal acquires the alternative content from a predetermined alternative content storage means using the insertion control information, and replaces the video stream and the audio stream with the alternative content for a predetermined period. Communication network delivery method. In programs for simultaneous distribution of video and audio content provided by broadcasting services using communication networks ,
The processor of the communication network distribution subsystem,
Reconstruction means for receiving a transmission stream obtained by converting a broadcast service TS stream for transmission over a communication network via the communication network and reconstructing the broadcast service TS stream from the transmission stream;
IP distribution converting means for converting a video stream and an audio stream included in the TS stream of the broadcasting service reconstructed by the reconstructing means into a video stream in a format for IP distribution;
a transmitting means for transmitting the video stream in the IP distribution format generated by the IP distribution conversion means to the client terminal via the communication network in response to a request from the client terminal on the communication network;
A computer program to be executed as alternative content distribution control means for controlling transmission of alternative content to be replaced with a video stream or an audio stream during a specified period to the client terminal via the network,
The alternative content distribution control means is
index file storage means for storing an index file that enables access to insertion control information in units of replacement operations;
means for transmitting the index file to the client terminal via the network in response to polling from the client terminal;
A computer program, wherein the client terminal acquires the alternative content from a predetermined alternative content storage means using the insertion control information, and replaces the video stream and the audio stream with the alternative content for a predetermined period. . A client terminal connectable to a network,
Video/audio stream receiving means for receiving, from a transmitting device, video/audio streams extracted from a broadcast stream and simultaneously transmitted via the network in a streaming manner;
alternative content receiving means for receiving, via the network, the alternative content stored in the alternative content storage means;
The alternative content receiving means is
index file receiving means for receiving from the transmitting device by polling an index file that enables access to the alternative content stored in the alternative content storage means in replacement operation units;
a means for receiving the alternative content stored in the alternative content storage means in units of the replacement operation using the index file received by the index file receiving means. A client terminal that can be connected to the network,
Video/audio stream receiving means for receiving, from a transmitting device, video/audio streams extracted from a broadcast stream and simultaneously transmitted via the network in a streaming manner;
A computer program used for executing alternative content stored in an alternative content storage means as an alternative content receiving means for receiving the alternative content via the network,
The alternative content receiving means is
index file receiving means for receiving from the transmitting device by polling an index file that enables access to the alternative content stored in the alternative content storage means in replacement operation units;
and means for receiving the alternative content stored in the alternative content storage means in units of the replacement operation using the index file received by the index file receiving means.

Images