JP6940125B2 - Broadcast service retransmission system and mobile terminal for viewing - Google Patents

Description

The present invention relates to a broadcast service retransmission system and a mobile terminal for viewing.

Services are provided to retransmit digital television broadcasts using communication networks. This retransmission service provides services such as multimedia data broadcasting, subtitles, and character supermarkets in addition to video and audio broadcasting services, and is compliant with television receivers. By the way, a streaming service that enables viewing of video and audio using a mobile terminal (for example, a smartphone) is widely provided. It is desired to use digital television broadcasting services including data broadcasting on mobile terminals as well as viewing video and audio data.

The IP retransmission of the broadcasting service is described in Patent Document 1 (Japanese Patent Laid-Open No. 2007-274623) and Patent Document 2 (Japanese Patent Laid-Open No. 2012-231383). Patent Document 1 discloses that an IP-retransmitted broadcast program is appropriately scheduled and recorded by using a standard time server and error information. Patent Document 2 discloses that the close caption information in the video content data distributed by the IPTV service is used to synchronize with the related information.

The above-mentioned prior art and its problems are described only to explain a part of the background of the present invention. It should be noted that the present invention is not limited to the above-mentioned prior art and problems.

JP-A-2007-274623 Japanese Unexamined Patent Publication No. 2012-231383

The present invention has been made in consideration of the above circumstances, and an object of the present invention is to provide a desired broadcast service retransmission system and a mobile terminal for viewing.

According to the present invention, in order to achieve the above-mentioned object, the configuration as described in the claims is adopted.

That is, according to one aspect of the present invention, the broadcast service retransmission device: a data stream separating means for separating a data stream from a broadcasting stream; and the data stream separated by the data stream separating means into a series of actual files. An actual file storage means for sequentially storing; a message for managing the reading of the actual file from the actual file storage means, and transmitting the above message for specifying the read timing and the actual file to be read to the terminal via the network. With the message transmitting means; in response to a transfer request from the terminal for each actual file using the above message transmitted to the terminal, the data stream stored in the actual file storage means is described in units of the actual file. It is configured to have a means for transmitting to a terminal.

According to this configuration, a desired broadcast service retransmission device can be realized.

Further, according to another aspect of the present invention, the terminal is a terminal that can be connected to a network, and the terminal is from a physical file storage means that stores a data stream separated from a broadcast stream in a series of physical files. The actual file is acquired via the network and the data stream is displayed. The terminal: A message that manages the reading of the actual file from the actual file storage means, and the timing of reading and the actual file to be read. A message receiving means for receiving the specified message via the network; and a data stream receiving means for receiving the data stream stored in the physical file storage means in units of the physical files using the received message. And; it is configured to have a display means for displaying the received data stream.

According to this configuration, it is possible to realize a terminal that can enjoy a desired broadcasting service.

It should be noted that the present invention can be realized not only as an apparatus or a system but also as a method. Of course, a part of such an invention can be configured as software. It is also natural that software products used to execute such software on a computer are also included in the technical scope of the present invention.

The above-mentioned aspects and other aspects of the present invention are described in the claims and will be described in detail with reference to the following examples.

According to the present invention, the processing load of the broadcast service retransmission device can be reduced. In addition, the load on the viewing terminal of the retransmission service can be reduced.

It is a figure explaining the environment in which the IP retransmission system of the Example of this invention is executed. It is a functional block diagram explaining the outline of the IP retransmission system of FIG. It is a figure explaining the message management file of FIG. It is a figure explaining the caption data. It is a block diagram which shows the configuration example of the mobile terminal of FIG. It is a functional block diagram of the mobile terminal of FIG. It is a figure explaining the display example of the mobile terminal of FIG. It is a figure which shows the example of the channel information which can be acquired from an authentication server. It is a figure explaining the detail of the channel information of FIG. It is a block diagram which shows the structural example of the synchronous data reproduction part of FIG. It is a schematic diagram explaining the operation of the synchronous data reproduction part of FIG. It is a schematic diagram explaining the acquisition operation example of the correction PCR of the synchronous data reproduction part of FIG. It is a flow figure explaining the button selection operation of the user interface part of FIG. It is a figure which shows the screen display example explaining the button selection operation of the user interface part of FIG. It is a figure which shows the BML description example explaining the button selection operation of the user interface part of FIG. It is a flow figure explaining the operation of the 2D bar code processing part of the user interface part of FIG. It is a figure which shows the screen display example explaining the operation of the 2D bar code processing part of the user interface part of FIG. It is a functional block diagram explaining the modification of the said Example. It is a schematic diagram explaining the processing flow of the caption data. It is a figure explaining the message in a message management file. It is a figure explaining the entity type of the message in a message management file.

Hereinafter, examples of the present invention will be described.

FIG. 1 shows the IP retransmission (IP is an abbreviation for Internet protocol, hereinafter also referred to as “Internet retransmission”) of the digital television broadcasting (terrestrial digital television broadcasting, BS, CS digital television broadcasting) of the present invention. The environment in which the embodiment applied to the digital television retransmission system to be performed is implemented is shown as a whole. In this figure, the broadcaster system 100 may be a system operated by a core broadcaster, and before uplinking. Acquires the TS stream of the broadcasting service of the above, or demolishes the received broadcast radio wave to acquire the TS stream, and further demultiplexes it into the video / audio stream and the data stream, and uses a predetermined line for the distributor system 200. And transmit. The distributor system 200 processes the transmitted video / audio stream and data stream for redistribution, and as will be described later, the video / audio stream (MPEG-2 TS) is used for IP redistribution. Synchronized data that is transcoded into a predetermined format (HLS, MPEG-DASH, etc.) and distributed to the mobile terminal 300, and is synchronized with a video / audio stream such as subtitle data, character super data, and event message in the data stream. And other asynchronous data (data broadcasting described in BML etc., electronic program guide, that is, EPG, etc.) are managed individually, the former is distributed using HTTP long polling, and the latter is delivered on demand. It is supposed to be delivered. As will be described later, both synchronous data synchronized with the video / audio stream and other asynchronous data may be distributed using HTTP polling. The distributor system 200 is connected to a communication network 500, typically the Internet. At least a part of the communication network 500 may be composed of a CDN (content delivery network) service. The mobile terminal 300 is connected to the communication network 500 via the gateway 400 of the mobile communication operator. Further, the authentication server 600 may be connected to the communication network 500 to authenticate the request from the mobile terminal 300 regarding the IP retransmission service. The broadcaster system 100 and the distributor system 200 may be integrated and configured.

FIG. 2 illustrates a configuration example of the broadcaster system 100, the distributor system 200, and the mobile terminal 300, and other configuration examples may be adopted for each. In FIG. 2, the broadcaster system 100 has a broadcast video / audio extraction unit 110 and a broadcast data extraction unit 120, and the broadcast video / audio extraction unit 110 extracts a video / audio TS packet from a broadcast TS stream. Extract. The broadcast data extraction unit 120 extracts data-related TS packets other than video and audio from the broadcast TS stream. The distribution company system 200 includes a video / audio transcoding unit 210, a data reception unit 220, a data management DB unit 230, a video / audio distribution unit 240, a synchronous data distribution unit 250, an asynchronous data distribution unit 260, and a message management file holding. It has a part 270 and the like. The video / audio transcoding unit 210 converts the video / audio MPEG-2 TS packet into a streaming file of the HTTP streaming method (typically the HLS method). The video / audio distribution unit 240 distributes the video / audio stream to the mobile terminal 300 by the HTTP streaming method. The data receiving unit 220 typically receives TS packets related to data other than video / audio, and synchronizes synchronized data such as subtitle data, character super data, and event messages with a video / audio stream. It is sent to the distribution unit 250, and the synchronization data distribution unit 250 distributes this synchronization data to the mobile terminal 300 by HTTP long polling. Further, the data receiving unit 220 reconstructs the BML document, the EPG, etc. from the asynchronous data packet and stores the BML document, the EPG, etc. in the data management DB 230, and the asynchronous data distribution unit 260 turns on the BML document, the EPG, etc. from the mobile terminal 300. It is delivered to the mobile terminal 300 based on the demand HTTP request, for example, the HTTP request performed by operating the default button display displayed on the display unit of the mobile terminal 300.

The broadcaster system 100 or the distributor system 200 sends a message as an index file (also referred to as index data, index list, message management data, message management file, message list) for managing TS packets of the broadcast TS stream. It is held in the message management file holding unit 270 as a management file. The broadcaster system 100 or the distributor system 200 creates and manages an index (message entry, message) shown in FIG. 3 each time a TS packet is received. Regarding the caption data, the caption packet as schematically shown in FIG. 4 is held in the data storage management unit, for example, the data management DB 230, the data body storage management unit 280 of FIG. 18 described later, and other storage units as they are. It can be accessed with the path specified by the actual file name attribute of the message.

The mobile terminal 300 displays the video delivered by HTTP streaming on the display unit 300A (FIG. 2), and the subtitle data (300B) delivered using the message management file transmitted by HTTP long polling. ) Is superimposed on the image on the display unit 300A, and the BML document or EPG delivered on demand is displayed on the display unit 300C. The display unit 300A and the display unit 300C are partitioned according to the layout, and may be a part of the display area of the mobile terminal 300 or the entire display area. The display unit 300A may be displayed over the entire display area based on the selectable display mode. Further, based on the selectable display mode, the subtitle data and / or the character super data may be displayed in a different area (window) that does not overlap with the display unit 300A or partially overlaps with the display unit 300A.

An example of HTTP long polling will be described later.

FIG. 5 shows a configuration example of the mobile terminal 300. In this figure, the mobile terminal 300 includes a processing system 310, a memory 320, an input / output subsystem 330, a high frequency circuit unit 340, and a voice circuit unit 350. Each of the components can be realized as appropriate by hardware, software, including signal processing integrated circuits, application-specific integrated circuits, or a combination thereof. The high frequency circuit unit 340 is used to transmit and receive information on a wireless link or network to other devices, and in order to perform this function, an antenna system, an RF transceiver, an amplifier, a tuner, an oscillator, It includes, but is not limited to, digital signal processors, CODEC chipsets, memories, and other well-known circuit configurations. The high frequency circuit unit 340 includes mobile communication such as time division multiple access (TDMA) and code division multiple access (CDMA), wireless LAN (IEEE802.11b, IEEE802.11a, IEEE802.11g and / or IEEE802.11N), Bluetooth ( Communication protocols such as IEEE802.5.1, "Bluetooth" is a trademark), Wi-MAX (IEEE802.16), etc. can be used, but are not limited thereto. The voice circuit unit 350 is connected to the voice speaker 351 and the microphone 352. The processing system 310 includes a processor 311, a memory controller 312, and a peripheral interface 313. The memory 320 stores code and data executed by the processor 311. The memory 320 may include any storage device such as RAM, ROM, FLASH, disk drive, magnetic tape and the like. Processor 311 executes various software components stored in memory 320. For example, software components include an operating system 321, a communication module 322, a contact / operation module 323, a graphics module 324, an application 325, a timer module 326, and a web browser module 327. Application 325 includes positioning functions such as a browser, address book, email, encryption, Global Positioning System (GPS), and a two-dimensional bar code decoder. The Internet retransmission television broadcast viewing application 325A (FIG. 6) of this embodiment is typically implemented as one of the applications 325. The input / output subsystem 330 controls the touch panel 331 and the like. In the mobile terminal 300, the function of viewing the television broadcasting service delivered by retransmitting the Internet is implemented as an application. By installing the corresponding application in the memory 320, the mobile terminal 300 is realized as an Internet retransmission television broadcast viewing terminal.

FIG. 6 schematically shows the functions realized by the Internet retransmission television broadcast viewing application 325A. In the figure, the mobile terminal 300 includes a video / audio stream playback unit 360, a synchronous data playback unit 370, and an asynchronous data viewing unit. 380 and user interface unit 390 are included as functions. The user interface unit 390 includes a button selection unit 391 and a barcode processing unit 392.

The video / audio stream playback unit 360 decodes the video / audio packet file distributed from the video / audio distribution unit 240 of the distributor system 200 by HTTP streaming, and for example, as shown in FIG. 7, the mobile terminal 300. A moving image is displayed in the video viewing area A of the display area of. To start watching TV broadcasts, select and start the corresponding application, and select a channel from an on-screen display or the like similar to a normal TV receiver. Channel switching may be performed based on a swipe. In some cases, an authentication dialog is executed with the authentication server 600 (FIG. 1). Note that the application 325A can acquire channel information for each of the broadcast channels that can be viewed from the authentication server 600, for example, and FIG. 8 shows a specific example of the channel information. The channel information includes information as shown in FIG. Further, in FIG. 7, the "d" button has buttons for switching data broadcasting, the "character" button for switching subtitles, the "main" button for switching audio, and other buttons for switching the vertical and horizontal display. In addition, in relation to the subtitle display, a button for displaying the subtitle etc. in another area and a button for advancing or delaying the timing of the subtitle etc. are provided so that the subtitle display mode and timing can be finely adjusted. May be good.

Further, in FIG. 6, the synchronous data reproduction unit 370 reproduces synchronous data such as subtitles. The synchronous data reproduction unit 370 acquires synchronous data from the synchronous data distribution unit 250 of the distributor system 200 by using HTTP long polling, and displays subtitles, character supermarkets, etc. at the timing synchronized with video / audio streaming. It is designed to do. Further, the synchronous data reproduction unit 370 processes the event message, which is also synchronous data, at the timing synchronized with the video / audio streaming. The contents of the BML document can be switched by the event message.

FIG. 10 illustrates a corrected PCR generation unit 372 that controls the synchronization timing in the synchronization data reproduction unit 370. In FIG. 10, the synchronous data reproduction unit 370 includes a subtitle display unit 371, a correction PCR generation unit 372, a message management file holding unit 373, a subtitle data holding unit 374, and a polling control unit 375. The correction PCR generation unit 372 generates a PCR (program clock reference) according to the reproduction status of the video / audio stream reproduction unit 360. The polling control unit 375 polls the synchronous distribution unit 250 of the distributor system 200, extracts a new entry (message) from the message management file holding unit 270, and retrieves a new entry (message) from the message management file holding unit 370 of the synchronous data reproduction unit 370. It is added to 373, and new subtitle data is added to the subtitle data holding unit 374. The message management file holding unit 373 and the subtitle data holding unit 374 delete unnecessary entries. The message management file holding unit 270 of the distribution company system 200 is also designed to delete unnecessary entries. The subtitle display unit 371 starts displaying subtitles (same for character super) with reference to the display timing (PST) of the subtitle packet in the subtitle data holding unit 374 based on the corrected PCR calculated by the corrected PCR generation unit 372. Then, refer to the deletion timing and end the display of subtitles.

The correction PCR generation unit 372 sets the date and time PRSTS (date and time based on the time of the server that creates the message management file) and playback when the program switching (the stream configuration of the broadcast program in one channel has changed) is detected. Find the difference from the date and time of the video / audio stream (date and time on the playback time axis, which is based on the time of the server that transcodes TS), and the elapsed time from the program switching time to the date and time on the playback time axis ( The elapsed time of PCR) is obtained, and this is multiplied by the resolution of the program reference clock (for example, 90000 / sec) to obtain the elapsed clock. Further, the corrected PCR generation unit 372 holds the PCR (PCRP) at the time when the program switching is detected, and adds the elapsed clock based on this to calculate the corrected PCR. Such a calculation method is shown in FIG. 11 (A). Further, a specific calculation example is shown in FIG. 11 (B). The upper limit of PCR is "8589935102". Here, the exact time of the moving image is set to EXT-PROGRAM-DATE-TIME, and preferably, the time of the server for creating the HLS and TS transcoding and the server for creating the message management file is set in units of one frame. It is assumed that there is no deviation. For program switching (change in stream configuration of broadcast programs in one channel), for example, the mobile terminal 300 detects that the value of the version number of the PMT (program map table) packet has changed, and this is detected. Detect. In a typical example, "pmt_changed" (see FIGS. 21 and 20 described later) is a message notifying that the PMT data has changed, and the detection time of the server is posted to the message execution time in this message. Will be done. In addition, the server receives the PMT data extracted from the tuner, acquires the PCR from the PCR description location described in the PMT, and posts it as additional information in the fourth column of the "pmt_changed" message. When the PMT indicates that the program has been switched (the stream structure of the broadcast program in one channel has changed), the previous message management data may be cleared. FIG. 12 schematically shows an example of the calculation operation of the corrected PCR.

The difference between PTS (Presentation Time Stamp) and the real-time conversion location of PCR is obtained, and this difference is added to the time when PCR is received to convert it to real-time, which is output to a message management file and PCR. The display / erasure of subtitles may be controlled in real time instead of being based on the clock of. In addition, when a button for advancing or delaying the timing of subtitles or the like is provided so that the display mode and timing of subtitles can be finely adjusted, for example, every time the "+" button is operated, the current correction PCR is performed. Add a certain clock increment (ΔPCR, for example, 90,000 clocks per second) to the value for a certain time increment, and each time the "-" button is operated, the current value of the correction PCR is added for a certain time. A constant clock decrement (-ΔPCR) according to the decrement may be added (subtracted), and when the "reset" button is operated, the original corrected PCR may be restored. Not limited to the corrected PCR, the reference PCR set by a predetermined criterion may be increased or decreased in the same manner.

Next, the button selection unit 391 of the user interface unit 390 of FIG. 6 will be described. FIG. 14 shows a display example of television broadcasting, and is a document described in BML except for the video portion. "A", "B", and "C" are operation buttons, and in relation to a normal TV receiver, the cursor movement keys on the remote controller are used to shift the focus position from button to button, and finally the remote controller. Press the OK button to select an item. The user interface unit 390 of the mobile terminal 300 may be provided with a key corresponding to the cursor movement key of the remote controller. In this embodiment, the item is selected when the target button is touched. This will be described in detail below.

FIG. 15 shows a BML document description of the display example of FIG. As you can see, the button element description includes a "nav-index" style attribute. That is, in the example of FIG. 14, the description for displaying the buttons shown in (1), (2), and (3) includes the style attribute of "nav-index" surrounded by (1) of FIG. In this example, when the description of the touched area includes the style attribute of "nav-index", it is determined that it can be selected, and the content is selected.

FIG. 13 shows an operation example of the button selection unit 391. As shown in FIG. 13, when a touch is detected, it is determined whether or not an element is detected in the area (step S01), and if it is not detected, the process ends as it is (the on-screen display may be displayed). ), If it is detected, it is determined whether or not the focus movement description (description of the style attribute of "nav-index") is included (step S02), if it is not detected, it ends as it is, and if it is detected, it ends as it is. Executes the instruction in the description of the button (step S03). After that, the button selection process ends.

Next, the barcode processing unit 392 of the user interface unit 390 of FIG. 6 will be described. FIG. 17 shows a state in which an image of a two-dimensional bar code is displayed on the display unit of the mobile terminal 300. In the normal usage mode of the TV receiver, the image of the two-dimensional bar code displayed on the screen of the TV receiver is imaged by the camera function of the mobile terminal or the like, and this is decoded by the bar code decoding function to acquire the URL. , Start the browser based on the acquired URL and browse the contents of the URL. In this embodiment, by touching the image display portion (part (1) of FIG. 17) of the two-dimensional bar code on the display portion of the mobile terminal 300, the contents of the URL can be browsed as it is. There is.

As shown in FIG. 16, when a touch is detected, it is determined whether or not an element is detected in the area (step S11), and if it is not detected, the process ends as it is (the on-screen display may be displayed). ), If detected, the image of the element is extracted and decoded by the two-dimensional decoding function, and it is determined whether or not the decoding is successful (step S12). If the decoding fails, it ends as it is, and if it succeeds, the content can be viewed on the browser with the decoded content (URL). After that, the barcode processing is finished.

Of course, when the display unit is touched, the button selection process of FIG. 13 and the bar code process of FIG. 16 can be executed back and forth.

This is the end of the description of the examples.

Next, a modified example of the above-described embodiment will be described.

FIG. 18 corresponds to FIG. 2, and the corresponding portions are designated by the corresponding reference numerals. In FIG. 18, not only synchronous data but also asynchronous data (BML document) is delivered to the mobile terminal 300 by long polling. That is, the data receiving unit 220 receives data-related TS packets other than video and audio, generates a processing management message for each of these TS packets, holds the message management file holding unit 270, and holds the main body of the TS packet. , The address that can be specified by the message is stored in the data main body storage management unit 280. The data distribution unit 250A uses a message management file (also referred to as message management data) to synchronize data such as subtitle data, character super data, and video / audio streams such as event messages, BML documents, EPG, and the like. Asynchronous data is delivered to the mobile terminal 300 by HTTP long polling.

FIG. 19 describes an example of a processing flow using subtitle data as an example, and in the modified example of FIG. 18, other data-related TS packets are processed in the same manner. In FIG. 19, the tuner of the broadcast wave receiver 100A of the broadcaster system 100 receives the TS packet and supplies it to the TS separation program 100B of the broadcaster system 100 (X01), and the TS separation program 100B is the subtitle data. The TS packet is transmitted by the data distribution server 200A of the broadcaster system 200 (X02). The data distribution server 200A saves the subtitle data in the data main body storage management unit 280, and in response to this, adds a new message to the message management data (message management file) in the message management file holding unit 270 to add a new message. Update (X03). The application 325A of the mobile terminal 300 first retrieves the message management data (X05) in the long polling processing portion X04, and the data distribution server 200A returns the latest data of the message management data to the application 325A accordingly. (X06). The data distribution server 200A repeatedly returns the updated amount of the message management data to the application 325A each time it is updated (X07). The application 325A interprets the message management data acquired in steps X06 and X07 line by line, and if it is a subtitle message, the application 325A picks up the subtitle data acquired in step X03 (X08), and the data distribution server 200A responds to this. And send the subtitle data to the application 325A (X09). The application 325A performs display processing at an appropriate timing from the contents of the message management data and the subtitle data, and the subtitle is displayed to the user (X10, X11).

FIG. 20 shows an example of a message, and the message is the message execution time (also referred to as firing time) in the first column and the message type (entity) in the second column, as shown with reference to FIG. (Also referred to as a type), the actual file name in the third column, and additional information in the fourth column are included (FIG. 20 (A)). In the specific example of FIG. 20B, the message execution time is "2016-04-20T13: 02: 15.588 + 0900", the message type is "cap_packet", and the actual file name is "/ tvmock / 20160420 / 7fe4". It is .7fe4.0420 / cap / 00055002 "and does not contain any additional information. The message type "cap_packet" indicates that the message is related to subtitles, and that the subtitle data is retained in the actual file name "/ tvmock / 2016042/7fe4.7fe4.0420/cap/00055002". .. The main message types are as shown in FIG. Although the message is formed for each TS packet of the data stream, the TS packet of the video / audio stream may also be generated and used for management.

As described above, “pmt_changed” in FIG. 21 is used to control the display timing of the subtitle data.

It should be noted that the present invention is determined based on the description of the scope of claims, and is not limited to the specific configuration, problems, and effects of the examples. The present invention is not limited to the above-described embodiment, and various modifications can be made without departing from the spirit of the present invention.

For example, although the above-described embodiment has been described in relation to a mobile terminal, the present invention may be widely applied to a fixed terminal or a television receiver. For example, a touch panel is provided for button selection operation and bar code processing. It can also be applied to fixed terminals and TV receivers with a touch panel connected to the Internet.

The technical features described here are listed below.
[Broadcast retransmission method]
[Technical feature 1]
A video / audio stream transmission means that transmits a video / audio stream extracted from a broadcast stream to a terminal via a network by a streaming method.
It has a data stream transmission means for transmitting a data stream extracted from the broadcast stream to a terminal via the network.
The above data stream transmission means
A data stream storage means that stores the above data stream in packet units,
An index file storage means for storing an index file that makes the above data stream stored in packet units accessible in packet units, and
A means for transmitting the index file to the terminal via the network in response to polling from the terminal, and
A means for transmitting the data stream stored in the data stream storage means to the terminal in packet units in response to a packet-by-packet transfer request from the terminal using the index file transmitted to the terminal. A broadcasting service retransmission device characterized by having.
[Technical feature 2]
The broadcasting service retransmission device according to technical feature 1 and means further comprising means for extracting each of a video / audio stream and a data stream from a broadcasting stream.
[Technical feature 3]
The broadcasting service retransmission device according to technical feature 1 or 2, wherein the data stream transmitted by the data stream transmitting means is a data stream synchronized with the video / audio stream.
[Technical feature 4]
The broadcasting service retransmission device according to technical features 1, 2 or 3, wherein the data stream transmitted by the data stream transmitting means is data content asynchronous to the video / audio stream.
[Technical feature 5]
The broadcasting service retransmission device according to any one of technical features 1 to 4, wherein the streaming method is a streaming method compliant with the HTTP protocol.
[Technical feature 6]
The polling is a broadcasting service retransmission device according to any one of technical features 1 to 5, which is an HTTP long polling.
[Technical feature 7]
A terminal that can connect to a network
A video / audio stream receiving means that receives a video / audio stream extracted from a broadcast stream and transmitted via the above network by a streaming method from a transmitting device.
It has a data stream receiving means for receiving a data stream extracted from the broadcast stream and transmitted via the network from the transmitting device.
The above data stream receiving means
An index file receiving means for receiving an index file stored in the transmitting device from the transmitting device by polling an index file that makes the data stream accessible on a packet-by-packet basis.
A terminal having a means for receiving the data stream stored in the transmitting device in packet units using the index file received by the index file receiving means.
[Technical feature 8]
The terminal according to technical feature 8 that performs communication based on mobile communication.
[Technical feature 9]
A terminal that can connect to the network
A video / audio stream receiving means for receiving a video / audio stream extracted from a broadcast stream and transmitted via the above network by a streaming method from a transmitting device, and
A computer program used to execute a data stream extracted from the broadcast stream and transmitted via the network as a data stream receiving means to be received from the transmitting device.
The above data stream receiving means
An index file receiving means for receiving an index file stored in the transmitting device from the transmitting device by polling an index file that makes the data stream accessible on a packet-by-packet basis.
The computer program includes a means for receiving the data stream stored in the transmission device in packet units by using the index file received by the index file receiving means.
[Element selection method]
[Technical feature 1]
A display that displays documents written in markup language,
A touch panel corresponding to the above display unit
A document viewing device having a means for executing a command related to the display element when there is an instruction regarding focus movement in the description of the document regarding the display element at a position corresponding to a touch operation on the touch panel.
[Technical feature 2]
The document viewing device according to technical feature 1, wherein the instruction regarding focus movement corresponds to a cursor movement key on a remote controller.
[Technical feature 3]
The document viewing device according to any one of technical features 1 or 2, wherein the markup language is BML.
[Technical feature 4]
A mobile terminal having a display unit for displaying a document written in a markup language and a touch panel corresponding to the display unit is focused on the description of the document regarding a display element at a position corresponding to a touch operation on the touch panel. A computer program used to implement as a means of executing instructions relating to the above display elements when instructed.
[Barcode processing method]
[Technical feature 1]
Display and
A touch panel corresponding to the above display unit
Decoding means to decrypt barcodes and
A display device having a means for extracting an image at a position corresponding to a touch operation on the touch panel and decoding it by the decoding means.
[Technical feature 2]
Display and
A touch panel corresponding to the above display unit
A display device having a means for extracting an image at a position corresponding to a touch operation on the touch panel and causing the barcode decoding means to decode the image.
[Technical feature 3]
The display device according to technical feature 1 or 2, wherein the bar code is a two-dimensional bar code.
[Technical feature 4]
The display device according to any one of technical features 1, 2, or 3 that executes a process based on the decoding result when the decoding by the decoding means is successful.
[Technical feature 5]
The decoding result is a URL, and the display device according to any one of technical features 1 to 4 for transmitting the URL request.
[Technical feature 6]
The display device according to any one of technical features 1 to 5, which is composed of a mobile communication terminal.
[Technical feature 7]
The display device according to any one of technical features 1 to 6 for displaying a document described in BML.
[Technical feature 8]
A mobile terminal having a display unit and a touch panel corresponding to the display unit.
A computer program used to extract an image at a position corresponding to a touch operation on the touch panel and realize it as a means for decoding it by a barcode decoding means.
[Synchronization method]
[Technical feature 1]
A terminal that can be connected to a broadcast service retransmission device via a network.
A means for receiving a video / audio stream extracted from a broadcast stream and transmitted from the broadcast service retransmission device via the network by the first method, and
Means for playing the above video / audio stream and
A means for obtaining a date and time (playback time axis date and time) based on the broadcast service retransmission device at the time of the current playback of the video / audio stream being played, and
When the program map table (PMT) indicates that the stream configuration of the broadcast program in the channel has changed, the program reference clock (PCRP) obtained from the description of the PMT and the broadcast service transmitter for which the PMT is processed. Means to obtain the date and time (PRESSS) according to
A means for receiving a data stream synchronized with the video / audio stream extracted from the broadcast stream and transmitted via the network by the second method.
Based on the elapsed time from the PRSTS to the reproduction time axis date and time, the number of clocks elapsed during that period is calculated, and the calculated clock number is added to the PCRP to predict the program clock reference of the reproduction time axis date and time. ,
A terminal characterized by having a processing execution means for executing processing of a data stream synchronized with the video / audio stream based on the predicted program clock reference.
[Technical feature 2]
The terminal according to the technical feature 1 in which the data stream synchronized with the video / audio stream includes the subtitle data, and the processing execution means reproduces the subtitle data.
[Technical feature 3]
The data stream synchronized with the video / audio stream includes an event message, and the processing execution means is the terminal according to the technical feature 1 or 2 for processing the event message.
[Technical feature 4]
The terminal according to any one of technical features 1 to 3, wherein the video / audio stream is an HTTP live streaming system stream.
[Technical feature 5]
The terminal according to technical feature 4 in which the playback time axis date and time is calculated by HPDT + MCT from the EXT-PROGRAM-DATE-TIME (HPDT) and the elapsed playback time (MCT) of the HLS file forming the video / audio stream.
[Technical feature 6]
When the resolution of the program clock reference is FHz, the program clock reference of the above playback time axis date and time is
PCRP + (HPDT + MCT-PRSTS) x F
The terminal according to the technical feature 5 calculated by.
[Technical feature 7]
F is 90000. The terminal according to the technical feature 6.
[Technical feature 8]
A terminal that can be connected to the broadcast service retransmission device via a network,
A means for receiving a video / audio stream extracted from a broadcast stream and transmitted from the broadcast service retransmission device via the network by the first method, and
Means for playing the above video / audio stream and
A means for obtaining a date and time (playback time axis date and time) based on the broadcast service retransmission device at the time of the current playback of the video / audio stream being played, and
When the program map table (PMT) indicates that the stream configuration of the broadcast program in the channel has changed, the program reference clock (PCRP) obtained from the description of the PMT and the broadcast service transmitter for which the PMT is processed. Means to obtain the date and time (PRESSS) according to
A means for receiving a data stream synchronized with the video / audio stream extracted from the broadcast stream and transmitted via the network by the second method.
Based on the elapsed time from the PRSTS to the reproduction time axis date and time, the number of clocks elapsed during that period is calculated, and the calculated clock number is added to the PCRP to predict the program clock reference of the reproduction time axis date and time. ,
A computer program used to implement as a processing execution means for executing processing of a data stream synchronized with the video / audio stream based on the predicted program clock reference.
[Technical feature 9]
A terminal that can be connected to a broadcast service retransmission device via a network.
A means for receiving a video / audio stream extracted from a broadcast stream and transmitted from the broadcast service retransmission device via the network by the first method, and
Means for playing the above video / audio stream and
A means for obtaining a date and time (playback time axis date and time) based on the broadcast service retransmission device at the time of the current playback of the video / audio stream being played, and
When a predetermined event occurs, a means for acquiring a program reference clock (PCRP) related to the predetermined event and a date and time (PRSTS) based on the broadcasting service transmitting device in which the predetermined event is processed, and
A means for receiving a data stream synchronized with the video / audio stream extracted from the broadcast stream and transmitted via the network by the second method.
Based on the elapsed time from the PRSTS to the reproduction time axis date and time, the number of clocks elapsed during that period is calculated, and the calculated clock number is added to the PCRP to predict the program clock reference of the reproduction time axis date and time. ,
A terminal characterized by having a processing execution means for executing processing of a data stream synchronized with the video / audio stream based on the predicted program clock reference.

100 Broadcaster system 110 Broadcast video / audio extraction unit 120 Broadcast data extraction unit 200 Distributor system 210 Video / audio transcode unit 220 Data reception unit 230 Data management DB unit 240 Video / audio distribution unit 250 Synchronous data distribution unit 260 Asynchronous data distribution unit 270 Message management file retention unit 280 Data main unit Storage management unit 300 Mobile terminal 310 Processing system 320 Memory 325 Application 360 Video / audio stream playback unit 370 Synchronous data playback unit 371 Subtitle display unit 372 Correction PCR generation unit 373 Message management File holding unit 374 Subtitle data holding unit 375 Polling control unit 380 Asynchronous data viewing unit 390 User interface unit 391 Button selection unit 392 Bar code processing unit

Claims (7)

A data stream separation means that separates the data stream from the broadcast stream,
An entity file storage means for sequentially storing the data streams separated by the data stream separation means in a series of entity files,
A message transmitting means for transmitting the above-mentioned message to the terminal via the network, which is a message for managing the reading of the above-mentioned substance file from the above-mentioned substance file storage means and specifies the timing of reading and the above-mentioned substance file to be read.
A means for transmitting the data stream stored in the actual file storage means to the terminal in units of the actual file in response to a transfer request from the terminal in units of the actual file using the message transmitted to the terminal. A broadcasting service retransmission device characterized by having and. The broadcast service retransmission device according to claim 1, further comprising a video / audio stream extraction means for extracting a video / audio stream from the broadcast stream and supplying the video / audio stream to the terminal via the network. The broadcast service retransmission device according to claim 2, wherein the data stream includes a data stream synchronized with the video / audio stream. On terminals that can connect to the network
The terminal acquires the series of actual files via the network from the actual file storage means that stores the data stream separated from the broadcast stream in a series of actual files, and displays the data stream.
A message receiving means for receiving the message for managing the reading of the substance file from the substance file storage means and specifying the read timing and the substance file to be read via the network.
A data stream receiving means for receiving the data stream stored in the physical file storage means in units of the physical file using the received message, and a data stream receiving means.
A terminal having a display means for displaying the received data stream. The terminal according to claim 4, which communicates based on mobile communication. The terminal according to claim 4 or 5, wherein the display means displays the data stream in a display area different from the display area of the video stream of the broadcast stream. A terminal that is connectable to a network and stores a data stream separated from a broadcast stream as a series of physical files. The data stream is obtained by acquiring the series of physical files via the network from a physical file storage means. Display the above terminal
A message receiving means for receiving the above-mentioned message that manages the reading of the above-mentioned substance file from the above-mentioned substance file storage means and specifies the timing of reading and the above-mentioned substance file to be read via the above-mentioned network.
A data stream receiving means for receiving the data stream stored in the physical file storage means in units of the physical file using the received message, and a data stream receiving means.
A computer program characterized by operating as a display means for displaying the received data stream.

Images