WO2021023281A1

WO2021023281A1 - Receiving device

Info

Publication number: WO2021023281A1
Application number: PCT/CN2020/107560
Authority: WO
Inventors: 尾形涼; 千葉俊一; 竹腰雅俊
Original assignee: 海信视像科技股份有限公司; 东芝视频解决方案株式会社
Priority date: 2019-08-07
Filing date: 2020-08-06
Publication date: 2021-02-11
Also published as: JP2021027514A; CN112771848B; CN112771848A; JP7166996B2

Abstract

An embodiment of the present invention relates to a receiving device. The invention is applicable to scenarios in which constructing transmission data is required for transmitting digital multiplexing data from a receiving device to a client apparatus via a network. The receiving device has: a receiving portion receiving digital multiplexing data; and a control portion used to identify an IP data stream related to IP packet multiplexing, a service-corresponding IP data stream, and a corresponding service shared IP data stream established for the service-corresponding IP data stream. The receiving device further has a transmission portion listing packets of an IP data stream in data passing through and identified by the control portion. Image signal data, sound signal data, and table information required for acquiring an image, sound, or subtitle of the service-corresponding IP data stream, and service shared IP data of the corresponding service shared IP data stream established for the service-corresponding IP data stream are multiplexed and transmitted via a network.

Description

Receiving device

This application claims the priority of a Japanese patent application filed with the Japanese Patent Office, application number 2019-145477, and title of invention "receiving device" on August 7, 2019, the entire content of which is incorporated into this application by reference.

Technical field

The present invention relates to a receiving device capable of receiving broadcast programs. The receiving device transmits received content to other devices (a display device as a client device, a terminal, a television, etc.) via a network, and displays it.

Background technique

Multimedia services in advanced BS digital broadcasting and advanced broadband CS digital broadcasting refer to the general term of caption service, superimpose display service (Superimpose), and data content service, and are performed in accordance with the operating regulations of Non-Patent Document 1.

Prior technical literature

Non-patent literature

Non-Patent Document 1: Regulations on the Operation of Advanced Broadband Digital Satellite Broadcasting ARIB TR-B39 Version 2.1 (Fifth Volume) April 12, 2019 2.1 Amendment, General Corporation Radio Industry Association

Summary of the invention

Regarding data in the digital multiplexing method (TLV method), multiple IP data streams (SI dedicated data streams, at least one or more identical IP data streams corresponding to the service, etc.) data are classified according to the category (Category), in order to make multiplexing Since these multiple types of data can be displayed on the client terminal (display device, TV, etc.) outside the receiving device, it is necessary to form packet data when sending data from the receiving device to the network.

A receiving device including: a receiving unit that receives data in a digital multiplexing method; and a control unit for identifying an IP data stream related to the multiplexing of IP packets, an IP data stream corresponding to a service, and an IP corresponding to the service The data flow establishes the corresponding service to share the IP data flow, and the receiving device also has a sending unit, the sending unit responds to the data identified by the control unit: the packet list (PLT) of the IP data stream; the service corresponds to The image signal data (image MPU), sound signal data (sound MPU) of the IP data stream, table information (MPT) required for obtaining images, sounds, and subtitles; and the service corresponding to the IP data stream corresponding to the service The service sharing the IP data stream shares the IP data (caption superimposed display MPU), multiplexed and sent over the network.

It is possible to display multiple types of data (data of a service common IP data stream, etc.) multiplexed in a digital multiplexing method (TLV method, etc.) on a client terminal (display device, TV, etc.) outside the receiving device.

Description of the drawings

Figure 1 is a diagram showing the configuration of a receiving device;

Fig. 2 is a diagram showing a data editing operation performed in the control unit;

Fig. 3 is a diagram showing an example of position designation in a service common material of a digital multiplexing method.

Description of reference signs

1...receiving device, 2...receiving unit, 3...control unit, 4...sending unit, 5...storage unit, 6...multimedia interface, 7...client device, 8...media device.

detailed description

[Example]

Currently, in advanced BS/CS, the following methods are studied: output TLV/MMT to IP interface, and send from server device to client device.

On the other hand, when a device that has recorded an advanced BS/CS program serves as a server and transmits the recorded data, depending on the structure of the recorded data, there is a possibility that the client device may not be able to obtain the image or sound that should be played.

When processing the data recorded on the server (receiver) and sending it to the client via the IP interface, it needs to be set to enable the client to correctly play the target image and sound.

The program data stored in the HDD is the data received through the broadcast wave. However, in the received data, the data that is not related to the display on the display device directly connected to the receiver (called ECM, EMM related to restricted reception, application data, etc.) are usually deleted. It is not saved with images and sounds.

Various settings can be made in the receiver itself that has performed the recording, so that even if there is no such deleted data, it can be played correctly even if it is displayed on the display device directly connected to the receiver.

However, the devices on the home network need to communicate with each other according to a predetermined protocol, and it is troublesome to exchange such data (data that is not related to the situation displayed on the display device directly connected to the receiver).

Therefore, there is a need for a method and device for combining data (usually part of the data that is deleted during recording) with images, images, and images other than the data directly sent to the display device (TV) without going through the home network. The sound is kept together, and the method and device use the home network, and the network other than the home network to transmit data.

FIG. 1 shows the structure of the receiving device 1 and the equipment connected to the receiving device 1. The receiving device 1 may also be referred to as a digital media server (DMS). The receiving device 1 is composed of a receiving unit 2, a control unit 3, a transmitting unit 4, a storage unit 5, and a multimedia interface 6. As devices connected to the receiving apparatus 1, there are a client device 7 and a media device 8.

The receiving section 2 includes an advanced BS tuner and/or an advanced CS tuner. The receiving unit 2 can receive a digital multiplex method (TLV method) broadcast signal (transponder in FIG. 3) such as advanced BS and/or advanced CS broadcasting.

The control unit 3 performs control of recognizing the data of the received broadcast signal as a media processing unit of various information, images, and sounds related to the IP data stream, and storing it in the storage unit 5. The control unit 3 also performs the following control: Combine various information and data of the media processing unit, so that the content corresponding to the client device 7 and the media device 8 can be displayed. The control unit 3 can control the combination of the data via the storage unit 5, and can also edit the data stream in real time through control.

The sending unit 4 is an IP interface that sends combined data to the client device 7 via the network, where the combined data is data obtained by combining various information and media processing unit data in the control unit 3. This network includes public network, LAN, WAN, etc.

The multimedia interface 6 is an interface for connecting a media device 8 such as a TV and the receiving device 1.

The client device 7 may also be referred to as a digital media platform. The client device 7 is a device for displaying content composed of various information and data of a media processing unit transmitted from the transmission unit 4 via a network.

The storage unit 5 may be provided inside the receiving device 1 or may be provided outside the receiving device 1 as an external device. In addition, the case where the storage unit 5 is installed externally also includes a case where it is connected via a network.

The receiving device 1 includes: a receiving unit 2 that receives data in a digital multiplexing method; and a control unit 3 for identifying IP data streams related to the multiplexing of IP packets, IP data streams corresponding to services, and The service-sharing IP data stream corresponding to the service-corresponding IP data stream is established. The receiving device 1 also has a sending unit 4, which responds to the data identified by the control unit 3: the packet list (PLT) of the IP data stream; The image signal data (image MPU), sound signal data (sound MPU) of the IP data stream, table information (MPT) required for obtaining images, sounds, and subtitles; and the service corresponding to the IP data stream corresponding to the service The service sharing the IP data stream shares the IP data (caption superimposed display MPU), multiplexed and sent over the network.

Next, the operation of FIG. 1 will be described in detail.

In the advanced BS, a service is sent as an IP data stream. In this case, when a single program is selected to record and play the saved program, the flow is as follows.

(1) Refer to the MMT_general_location_info described in the PLT to find the group ID of the PA information that stores the MPT.

(2) Refer to the MMT_general_location_info described in the MPT to find the group ID of the image material (Asset) and the sound material.

(3) Confirm the image material and sound material to be played.

However, for advanced CS, please refer to "Advanced Broadband Digital Satellite Broadcasting Regulation ARIB TR-B39 Version 2.1 (Fifth Volume) April 12, 2019 2.1 Amendment, General Incorporated Corporation Radio Industry Association, Chapter 13, Chapter 13.1 IP data stream and information transmission, as well as the example of location designation in the materials shared by the services in Figure 13-2.” It can be seen that the CA application that is shared by multiple services is used in the advanced CS, that is, the application for notifying disaster information A system in which subtitles are superimposed and displayed, and a guide service for the viewing procedures of non-subscription programs is sent.

As described above, the control unit 3 multiplexes multiple IP data streams corresponding to the service into a single IP data stream when outputting or recording a common IP data stream together with an IP data stream including images and audio materials. Output or save the recorded video data.

On the other hand, when multiple IP data streams are multiplexed and a single recording data is played, after obtaining the PLT, only by referring to MMT_general_location_info and finding the packet ID used to store the PA information of the MPT, it is impossible to determine the desired MPT. .

The reason is that since the packet ID is unique for each IP data stream, there is a possibility that other data may be stored in the data in which multiple IP data streams are multiplexed even if the same packet ID is used.

In this case, when acquiring the MPT of each IP data flow (data flow of each service corresponding to the same IP data flow), it is also necessary to determine each IP data flow.

The flow of determining the IP data flow in the control unit 3 is as follows.

(1) Discover PLT.

(2) Discover the source IP address and destination IP address of the desired IP data stream.

(3) Discover that the received header compresses part of the IPv6 header (IPv6_header_wo_length) of the IP packet.

(4) Determine the pair (pair) of the CID (Context ID) and the IP address of the source and destination.

Regarding part of the IPv6 header (IPv6_header_wo_length), please refer to "ARIB TR-B39 (Fourth Volume), Part One Application Regulations for Advanced Broadband Digital Satellite Broadcasting, Chapter 5 of Volume 7, 5.5.3.3 Header Compression IP Packet Structure and Application Rules, There are provisions in the structure of the header compressed IP packet in Table 5-26 and the structure of the "IPv6 header (IPv6_header_wo_length)" in Table 5-27.

Regarding part of the IPv6 header (IPv6_header_wo_length), in 5.5.3.3 Header Compression IP Packet Structure and Operation Rules, it is stated as follows: "When an IP data stream includes an IP packet for header compression, the context (context) identifies the header type The header compressed IP packet of 0x60 must be sent at least once every 500msec for each IP data stream. However, in hierarchical modulation, the header compressed IP packet sent in the slot allocated to the lower layer is used as The target is to be sent at least once every 500msec.” This becomes the rule for sending at a frequency of about 500msec.

In addition, not all tables are recorded at the time of recording in the control unit 3, and it is also possible to consider the operation of not storing unused tables such as EMM and ECM according to the specifications of the receiving device. That is, since EMM and ECM are information for performing the function of limiting the reception method, it is not preferable to send them to the client device.

In addition, considering that multimedia service data (MH-AIT, DDMT, DAMT), logo data (MH-SDTT), etc. will not be sent to the client device.

In this case, in the client device 7 requesting the data recognized or recorded in the playback control unit 3, there is a possibility that the pairing of the CID (Context ID) of each IP data stream and the transmission source cannot be determined.

The reason is because there is no partial IPv6 header for determining the pairing of the CID and the IP address.

The control unit 3 performs the following procedures when recognizing and recording data.

(1) Find the PLT from the TVL stream.

(2) Determine the source IP address of the IP data stream of the service for recording.

(3) Monitor the header of each IP data stream to compress IP packets.

(4) Discover part of the IPv6 header, and determine the pairing between the CID and the source IP address.

(5) Determine the target service based on the CID recorded in the compressed IP packet.

(6) Save necessary control information (such as PLT and MPT) and materials (such as image, sound, subtitle MPU) corresponding to the determined target service.

(7) Since part of the IPv6 header (IPv6_header_wo_length) is sent every 500msec, the part of the IPv6 header is stored in a header compression packet including PLT and MPT in a way that the necessary control information is stored together with the image and sound. .

As for the client device 7 that plays the content data created as described above, the pairing of the CID and the source IP address can be smoothly determined, and images and sounds can be played.

Or, in the control unit 3, copy (copy) to CAT, MH-SDTT, CMH-TOT, MH-CDT, MH-EIT, MH-SDT, MH-BIT, DDMT, DAMT, other than PLT and MPT. MH-AIT, EMT, part or all of the header compression IP packet. That is, it is copied to a header compressed IP packet that stores data other than ECM and EMM.

Alternatively, the control unit 3 stores a packet including only a part of the IPv6 header (IPv6_header_wo_length). Regarding part of the IPv6 header, it is sent from the transmission source once every 500 msec and includes data containing EMM and/or ECM.

Or, in the response header (Response header) in response to the HTTP GET request sent when the client device 7 starts playing, store or combine: SI dedicated IP data stream; IP data including MPT, image material, and sound material Flow; and the information and/or CID equivalent to the partial IPv6 header (IPv6_header_wo_length) of the common IP data flow, and is sent via the sending unit 4.

Alternatively, in order for the client device 7 to obtain the content information, the control unit 3 stores or combines the response body (Response body) in response to the sent UPnP Content Directly service Browse request: SI dedicated IP data stream; including MPT The information and/or CID corresponding to a part of the IPv6 header (IPv6_header_wo_length) and/or CID of the common IP data stream, including image materials and sound materials, are transmitted via the transmission unit 4.

In all the above methods, when the control unit 3 transmits the partial IPv6 header (IPv6_header_wo_length), it also stores or combines the information of the partial UDP header (UDP_header_wo_length), and transmits it via the transmission unit 4.

FIG. 2 shows the data editing operation performed by the control unit 3. The data 10 (TLV stream) received from the broadcast received by the receiving unit 2 includes an SI dedicated IP data stream 20 and an IP data stream 30 for service transmission. The SI dedicated IP data stream 20 is composed of a compressed IP packet 21, a compressed IP packet 22, and a compressed IP packet 23. The IP data stream 30 for service transmission is composed of a compressed IP packet 31, a compressed IP packet 32, and a compressed IP packet 33. The compressed IP packet 21 includes a full header (Full header) 211. The compressed IP packet 32 includes a complete header 311.

The control unit 3 recognizes each compressed IP packet of the data 10 received by the receiving unit 2 from the broadcast. The control unit 3 edits the data 10 received from the broadcast, thereby being able to configure the data 40 for recording and storing or sending to the client device 7. Specifically, the compressed IP packet 21 and the compressed IP packet 32 are identified. Regarding the compressed IP packet, it is not needed in the content display in the media device 8, so there is no need to record and save. On the other hand, the client device 7 needs to compress the IP packet 21 and the complete header 211 and the complete header 321 contained in the compressed IP packet 32. Therefore, the control unit 3 extracts the complete header 211, and adds the complete header 211 to the compressed IP packet 23 to form a compressed IP packet 23'. In addition, the control unit 3 extracts the complete header 321 and adds the complete header 321 to the compressed IP packet 33 to form a compressed IP packet 33'.

The data 40 edited and constructed by the control unit 3 for record storage or for transmission to the client device 7 is composed of an SI dedicated data stream 20' and an IP data stream 30' for service transmission.

The SI dedicated data stream 20' is composed of compressed IP packets 22' and compressed IP packets 23'. The compressed IP packet 22' of the SI dedicated data stream 20' is the same packet as the compressed IP packet 22. The compressed IP packet 23' of the SI dedicated data stream 20' is a packet in which the compressed IP packet 23 is edited and a complete header 211 is added.

The IP data stream 30' for service transmission is composed of compressed IP packets 31' and compressed IP packets 33'. The compressed IP packet 31' of the IP data stream 30' for service transmission is the same packet as the compressed IP packet 31. The compressed IP packet 33' of the IP data stream 30' for service transmission is a packet in which a complete header 321 is added to the compressed IP packet 33.

As the above description, FIG. 3 illustrates the location of the common material of the IP data stream and the information transmission service.

The transponder (transponder) is composed of a TLV stream (TLV_Stream). TLV_Stream consists of AMT, TLV-NIT and UDP/IP packets.

AMT provides a list of multicast (Multicast) groups of IP packets constituting each service transmitted in the broadcast network. TLV-NIT transmits information related to the physical structure of the multiplex/TLV stream and information related to broadcast programs that are transported through the broadcast network. And, TLV-NIT represents the characteristics of the network itself. UDP/IP is a user datagram protocol/network protocol, and a communication protocol that operates on IP. Since IP packets are transmitted in their original form, high-speed transmission is carried out without performing processing such as error correction detection and ARQ.

Send in UDP/IP format: include NTP dedicated IP data stream including network time control (NTP), SI dedicated IP data stream including service information (SI), at least the same IP data stream corresponding to one service, And services share IP data streams.

The SI dedicated IP data stream contains M2 part information, CA information, and PA information.

M2 partial information is used to transmit part of the extended form of MPEG-2Systems information, including EMM, MH-SDTT, MH-CDT, MH-EIT, MH-SDT, MH-BIT. EMM is used to send individual information including a work key, which is used to crack the cryptographic transmission of each user's contract information and public information.

CA information is a packet identifier (PID) of individual information in the relevant information of paid broadcasting, including CAT. CAT is one of the transmission control signals in the multiplexing mode, and represents a table used to limit the transmission of related information received.

The PA information contains the package list PLT. The package list (PLT) refers to table information for indirectly specifying the MPT table, and the MPT table is information for indirectly specifying each group ID of images, sounds, and subtitles. That is, PLT represents a list of IP data streams and packet IDs used to transmit PA information of MPEG Media Transport (MMT) packets provided as a broadcast service.

The same IP data stream is formed according to each service unit such as image and sound, including image MPU, audio MPU, subtitle MPU, application MPU, data transmission information, M2 part information, and PA information.

MPU is the abbreviation of Media Processing Unit, which is a unit of image and sound processing. The MPU includes more than one access unit, and is a unit that can perform composite processing of images and sounds with a single MPU. MPU belongs to the same material layer. By using a serial number for each MPU, the MPU can be distinguished from other MPUs.

The data transmission information includes the data directory management table DDMT and the data material management table DAMT.

The M2 part of information includes: MH application management table MH-AIT; event information table EMT, which provides a method for sending information from the sending side to the receiver’s application; and entertainment control information ECM, which is used as common information It is sent to the receiver side and contains date and time information and a scramble key.

The PA information includes the MMT package table MPT, and the MMT package table MPT provides package information such as a list of constituent materials and their positions. The MPT package table (Package table) is table information that indirectly designates each packet ID of images, sounds, and subtitles.

The service common IP data stream includes subtitles, subtitle superimposed display MPU, etc., and MPU materials shared by the service stream.

[Industrial availability]

Although several embodiments of the present application have been described, these embodiments are presented as examples and do not limit the scope of the application. The above-mentioned embodiments can also be applied as a receiving device, a receiving method, a transmitting device, a transmitting method, and a transceiving system.

These novel embodiments can be implemented in other various forms, and various omissions, substitutions, and changes can be made without departing from the scope of the application. These embodiments and their modifications are included in the scope and spirit of the application, and are included in the scope equivalent to the invention described in the claims. In addition, in each component of the claims, when the component is divided and expressed, or when a plurality of components are combined and expressed, or when these components are combined and expressed, it is also the scope of the present application. In addition, a plurality of embodiments can be combined, and the examples constituted by the combination are also in the scope of the application. In addition, when a claim is expressed as a control logic, when a claim is expressed as a program including an instruction to be executed by a computer, and as a nonvolatile storage readable by a computer in which the instruction is recorded In the case of displaying as a medium, the device to which this application is applied is also applied. In addition, the names and terms used are also not limited, and even other expressions are included in this application as long as they have substantially the same content and the same subject.

Claims

A receiving device including:

The receiving part, which receives data in a digital multiplexing mode; and

The control unit is used to identify the IP data flow related to the multiplexing of IP packets, the service corresponding IP data flow, and the service common IP data flow corresponding to the service corresponding IP data flow,

And the receiving device also has a transmitting unit,

The sending unit responds to the data identified by the control unit:

The packet list of the IP data flow;

The image signal data, sound signal data of the IP data stream corresponding to the service, and table information required for obtaining images, sounds, and subtitles; and

And the service corresponding to the IP data flow established corresponding to the service common IP data flow service common IP data,

Multiplexing and network transmission.