CN112771848B

CN112771848B - Receiving apparatus

Info

Publication number: CN112771848B
Application number: CN202080002683.8A
Authority: CN
Inventors: 尾形涼; 千叶俊一; 竹腰雅俊
Original assignee: Hisense Visual Technology Co Ltd; Toshiba Visual Solutions Corp
Current assignee: Hisense Visual Technology Co Ltd; Toshiba Visual Solutions Corp
Priority date: 2019-08-07
Filing date: 2020-08-06
Publication date: 2022-12-20
Anticipated expiration: 2040-08-06
Also published as: CN112771848A; WO2021023281A1; JP7166996B2; JP2021027514A

Abstract

Embodiments of the present invention relate to a receiving apparatus. It is necessary to configure transmission data when data of a digital multiplexing system is transmitted from a receiving apparatus to a client device via a network. The receiving device is provided with: a receiving unit that receives data of a digital multiplex system; and a control unit configured to identify an IP data flow related to multiplexing of an IP packet, a service-associated IP data flow, and a service-shared IP data flow associated with the service-associated IP data flow, wherein the reception device further includes a transmission unit configured to transmit a packet list of the IP data flow among data identified by the control unit; the service corresponds to image signal data, sound signal data of an IP data stream, table information required for acquiring images, sounds, and subtitles; and service common IP data of a service common IP data flow corresponding to the service corresponding IP data flow, multiplexing and network transmitting.

Description

Receiving apparatus

This application claims priority from the filing of japanese patent application having application number 2019-145477, entitled "receiving device" by the japanese patent office on 7/8/2019, the entire contents of which are incorporated herein by reference.

Technical Field

The present invention relates to a receiving apparatus capable of receiving a broadcast program, which transmits and displays a reception content to other devices (a display apparatus, a terminal, a television, and the like as client devices) via a network.

Background

The multimedia services in the advanced BS digital broadcasting and the advanced broadband CS digital broadcasting are generic names of a caption service, a caption overlay display service (superior), and a data content service, and are performed according to the operation regulations of non-patent document 1.

Prior art documents

Non-patent document

Non-patent document 1: advanced broadband digital satellite broadcasting (ARIB TR-B39.1 edition (fifth division) 2.1 amendment in 2019, 4 month, 12 days, 2.1 and general society law radio wave industry

Disclosure of Invention

Data in the digital multiplex scheme (TLV scheme) is classified into a plurality of IP data streams (SI-dedicated data streams, at least one same IP data stream corresponding to a service, and the like) according to type (Category), and in order to display the multiplexed data of the plurality of types on a client terminal (a display device, a TV, or the like) outside the receiving device, it is necessary to configure Packet data (Packet data) when transmitting data from the receiving device to the network.

A receiving apparatus includes: a receiving unit that receives data of a digital multiplex system; and a control unit configured to identify an IP data flow related to multiplexing of IP packets, a service-associated IP data flow, and a service-shared IP data flow associated with the service-associated IP data flow, wherein the reception device further includes a transmission unit configured to, out of the data identified by the control unit: a Packet List (PLT) of the IP data stream; video signal data (video MPU), audio signal data (audio MPU), and table information (MPT) necessary for acquiring video, audio, and subtitle data of the service corresponding to the IP data stream; and service common IP data (caption superimposition display MPU) of a service common IP data stream that is associated with the service-associated IP data stream, and multiplexes and transmits the multiplexed data to the network.

A client terminal (a display device, a TV, or the like) outside the receiving device can display data (data of a service-shared IP data stream or the like) in which a plurality of types of data are multiplexed in a digital multiplexing scheme (TLV scheme or the like).

Drawings

Fig. 1 is a diagram showing a configuration of a receiving apparatus;

fig. 2 is a diagram showing a data editing operation performed in the control unit;

fig. 3 is a diagram showing an example of specifying a position in a service shared material of the digital multiplex system.

Description of the reference numerals

1 \8230, a receiving device 2 \8230, a receiving section 3 \8230, a control section 4 \8230, a transmitting section 5 \8230, a storage section 6 \8230, a multimedia interface 7 \8230, a client device 8 \8230anda media device.

Detailed Description

[ examples ] A method for producing a compound

Currently in advanced BS/CS, the following methods are studied: and outputting the TLV/MMT to an IP interface and sending the TLV/MMT to the client device from the server device.

On the other hand, when a device recording a high-grade BS/CS program transmits recorded data as a server, the client device may not obtain an image or sound to be played depending on the configuration of the recorded data.

When data recorded on a server side (receiver) is processed and transmitted to a client via an IP interface, it is necessary to make the client play a target image or sound accurately.

The program data stored in the HDD is data received via broadcast electric waves. However, among the received data, data that is not relevant to the case where the data is displayed on a display device directly connected to the receiver (data related to limited reception, application data, and the like referred to as ECM and EMM) is usually deleted and not stored together with the image and the sound.

In the receiver itself that has performed the video recording, various settings can be made so that the data can be correctly played even when the deleted data is not displayed on the display device directly connected to the receiver.

However, devices on the home network need to communicate with each other according to a predetermined protocol, and it is a trouble to exchange such data (data unrelated to the case of display on a display device directly connected to the receiver).

Therefore, there is a need for a method and apparatus for retaining data (a part of data that is normally deleted at the time of video recording) other than data directly transmitted to a display device (TV) without via a home network together with images and sounds, and transmitting data using the home network, a network other than the home network.

Fig. 1 shows a configuration of a receiving apparatus 1 and a device connected to the receiving apparatus 1. The receiving device 1 may also be referred to as a Digital Media Server (DMS). The receiving apparatus 1 includes a receiving unit 2, a control unit 3, a transmitting unit 4, a storage unit 5, and a multimedia interface 6. As devices connected to the reception apparatus 1, there are a client device 7 and a media device 8.

The receiving section 2 includes an advanced BS tuner and/or an advanced CS tuner. The receiver 2 can receive a broadcast signal of a digital multiplex type (TLV type) (transponder in fig. 3) such as a high-level BS and/or a high-level CS broadcast.

The control unit 3 performs the following control: the data of the received broadcast signal is recognized as a media processing unit of various information, images, and sounds associated with an IP data stream or the like, and stored in the storage unit 5. The control unit 3 also performs the following control: combining various information, data of the media processing unit, enables display of content corresponding to the client device 7, media device 8. The control unit 3 may perform control for combining the data via the storage unit 5, or may edit the data stream in real time by control.

The transmission unit 4 is an IP interface that transmits, to the client device 7 via the network, combined data in which various pieces of information and data of the media processing unit are combined in the control unit 3. The network includes a public network, a LAN, a WAN, etc.

The multimedia interface 6 is an interface for connecting a media device 8 such as a TV and the like to the receiving apparatus 1.

The client device 7 may also be referred to as a digital media platform. The client device 7 is a device for displaying content composed of various information transmitted from the transmission unit 4 via the network and data of the media processing unit.

The storage unit 5 may be provided inside the receiving apparatus 1, or may be provided outside the receiving apparatus 1 as an external apparatus. In addition, when the storage unit 5 is provided externally, the connection via a network is also included.

The receiving apparatus 1 includes: a receiving unit 2 that receives data of a digital multiplex system; and a control unit 3 configured to identify an IP data flow related to multiplexing of an IP packet (IP packet), a service-associated IP data flow, and a service-shared IP data flow associated with the service-associated IP data flow, the reception device 1 further includes a transmission unit 4 configured to transmit, out of data identified by the control unit 3: a Packet List (PLT) of the IP data stream; video signal data (video MPU) serving IP data streams, audio signal data (audio MPU), and table information (MPT) necessary for acquiring video, audio, and subtitles; and service common IP data (caption superimposition display MPU) of a service common IP data stream that is associated with the service-associated IP data stream, and multiplexes and transmits the multiplexed data to the network.

Next, the operation of fig. 1 will be specifically described.

In the advanced BS, a service is used to transmit as one IP data stream. In this case, the following flow is performed when a single program is selected, recorded, and the stored program is played back.

(1) The packet ID of the PA information stored in the MPT is found by referring to the MMT _ general _ location _ info described in the PLT.

(2) The group ID of the image material (Asset) and the audio material is found with reference to MMT _ general _ location _ info described in MPT.

(3) And determining the played image material and the played sound material.

However, as for the advanced CS, a system for transmitting a CA application common to a plurality of services, that is, a guidance service for displaying a caption superimposed notification of disaster information and a viewing procedure of a non-subscription program, which is a common application for a plurality of services, is used in the advanced CS, as can be seen with reference to "an example in which the advanced broadband digital satellite broadcasting operation is specified by ARIB TR-B392.1 version (fifth minute) 2.1 revision at 4/2019, 12/3, the general corporate law radio wave industry, chapter 13, 13.1 of the fourth edition, 13.1IP data stream and information transmission, and a location (location) specification in a material common to the services of fig. 13-2".

As described above, when outputting or recording the common IP data stream together with the IP data stream including the image and audio material, the control unit 3 multiplexes a plurality of IP data streams corresponding to the service and outputs or stores the multiplexed IP data streams as single recorded data.

On the other hand, when a single piece of recorded data is played by multiplexing a plurality of IP data streams, after acquiring a PLT, the packet ID for storing PA information of the MPT is found by simply referring to the MMT _ general _ location _ info, and the desired MPT cannot be specified.

The reason is that, since the packet ID is unique for each IP data stream, there is a possibility that other data is stored even with the same packet ID in data in which a plurality of IP data streams are multiplexed.

In this case, in acquiring the MPTs of the respective IP data flows (data flows of the respective services corresponding to the same IP data flow), it is also necessary to determine the respective IP data flows.

The flow of determining the IP data flow in the control unit 3 is as follows.

(1) PLT was found.

(2) An IP address of a transmission source and an IP address of a transmission destination of a desired IP data flow are found.

(3) A partial IPv6 header (IPv 6_ header _ wo _ length) of the received header compression IP packet is found.

(4) A pair (pair) of a CID (Context ID) and IP addresses of a transmission source and a transmission destination is determined.

With respect to the partial IPv6 header (IPv 6_ header _ wo _ length), there are provisions in the structure of "ARIB TR-B39 (fourth book), first partial advanced broadband digital satellite broadcasting operation provision, seventh edition chapter 5, construction and operation rules of 5.5.3.3 header compression IP packets, construction of header compression IP packets of tables 5 to 26, and partial IPv6 header (IPv 6_ header _ wo _ length) of tables 5 to 27.

Regarding the partial IPv6 header (IPv 6_ header _ wo _ length), the following are described in the construction and operation rules of the 5.5.3.3 header compression IP packet: "in the case of containing an IP packet subjected to header compression in an IP data stream, a context (context) identifies that a header compression IP packet having a header type of 0x60 must be transmitted at least once every 500msec for each IP data stream. However, in the hierarchical modulation, a header compression IP packet to be transmitted in a slot (slot) allocated to a lower hierarchy is transmitted at least once for 500 msec. ", the transmission is performed at a frequency of approximately 500msec once.

Note that, in the control unit 3, not all the tables are recorded, but an operation is conceivable in which unused tables such as EMM and ECM are not stored in accordance with the specification of the receiving apparatus. That is, EMMs and ECMs are information for playing a function of limiting the reception mode, and therefore are not preferable to be retransmitted to the client device.

In addition, it is considered that multimedia service data (MH-AIT, DDMT, DAMT), trademark (logo) data (MH-SDTT), and the like are not sent to the client device any more.

In this case, there is a possibility that the client device 7 that requests the data identified or recorded in the playback control unit 3 cannot identify the pair of the CID (Context ID) and the transmission source of each IP data stream.

The reason is because there is no partial IPv6 header for determining the pairing of CID and IP address.

The control unit 3 recognizes and records the data in the following order.

(1) The PLT is found from the TVL stream.

(2) The source IP address of the IP data stream of the recording service is determined.

(3) Header compression IP packets of the respective IP data flows are monitored.

(4) Part of the IPv6 header is found, and the pairing of the CID and the transmission source IP address is determined.

(5) And determining the target service according to the CID recorded in the compressed IP packet.

(6) Necessary control information (e.g., PLT and MPT) and materials (e.g., image, sound, subtitle MPU) corresponding to the determined target service are saved.

(7) Since the partial IPv6 header (IPv 6_ header _ wo _ length) is transmitted once every 500msec, the partial IPv6 header is stored in a header compression packet including a PLT and an MPT so that necessary control information is stored together with an image and a sound.

The client device 7 that plays the content data created as described above can smoothly determine the pairing of the CID and the transmission source IP address, and can play images and sounds.

Alternatively, the control unit 3 copies (copy) the header compressed IP packet to a part or all of CAT, MH-SDTT, CMH-TOT, MH-CDT, MH-EIT, MH-SDT, MH-BIT, DDMT, DAMT, MH-AIT, and EMT except PLT and MPT. Namely, the header is copied to the header compression IP packet holding data other than the ECM and EMM.

Alternatively, the control section 3 stores a packet including only a partial IPv6 header (IPv 6_ header _ wo _ length). Regarding the partial IPv6 header, it is transmitted from the transmission source once every 500msec and includes data containing EMMs and/or ECMs.

Alternatively, in a Response header (Response header) replied to the HTTP GET request transmitted when the client device 7 starts playing, there are stored or combined: SI private IP data flow; IP data stream containing MPT, image material and sound material; and information and/or CID corresponding to a partial IPv6 header (IPv 6_ header _ wo _ length) of the common IP data stream, and is transmitted via the transmission section 4.

Alternatively, in order for the client device 7 to acquire the information of the Content, the control unit 3 stores or combines, in a Response body (Response body) to which a Browse request for the transmitted UPnP Content direct service is replied: SI private IP data flow; an IP data stream containing MPT, image material and sound material; and information and/or CID corresponding to a partial IPv6 header (IPv 6_ header _ wo _ length) of the common IP data stream, and is transmitted via the transmission section 4.

In all of the above-described embodiments, when transmitting the partial IPv6 header (IPv 6_ header _ wo _ length), the control unit 3 further stores or combines information of the partial UDP header (UDP _ header _ wo _ length), and transmits the partial UDP header (UDP _ header _ wo _ length) via the transmission unit 4.

Fig. 2 shows a data editing operation performed by the control unit 3. The data 10 (TLV stream) received from the broadcast received by the receiving unit 2 includes the SI dedicated IP data stream 20 and the IP data stream 30 for service delivery. The SI private IP data flow 20 is composed of a compressed IP packet 21, a compressed IP packet 22, and a compressed IP packet 23. The IP data flow 30 for service transmission is composed of a compressed IP packet 31, a compressed IP packet 32, and a compressed IP packet 33. The compressed IP packet 21 contains a Full header 211. The compressed IP packet 32 contains a full header 311.

The control unit 3 identifies each compressed IP packet of the data 10 received by the receiving unit 2 from the broadcast. The control unit 3 can compose data 40 for recording, saving, or transmitting to the client device 7 by editing the data 10 received from the broadcast. Specifically, the compressed IP packet 21 and the compressed IP packet 32 are identified. The compressed IP packet is unnecessary for content display in the media device 8, and thus, no record storage is necessary. On the other hand, the compressed IP packet 21, the full header 211 and the full header 321 contained in the compressed IP packet 32 are required in the client device 7. Therefore, the control unit 3 extracts the full header 211 and adds the full header 211 to the compressed IP packet 23 to form a compressed IP packet 23'. The control unit 3 extracts the full header 321, and adds the full header 321 to the compressed IP packet 33 to form a compressed IP packet 33'.

The data 40 edited and composed by the control unit 3 and stored in a record or transmitted to the client device 7 is composed of the SI dedicated data stream 20 'and the IP data stream 30' for service transmission.

The SI private data stream 20' is made up of compressed IP packets 22' and compressed IP packets 23'. The compressed IP packets 22 'of the SI private data flow 20' are the same packets as the compressed IP packets 22. The compressed IP packet 23 'of the SI private data stream 20' is a packet in which the compressed IP packet 23 is edited and the full header 211 is appended.

The IP data stream 30' for service transmission is composed of compressed IP packets 31' and compressed IP packets 33'. The compressed IP packet 31 'of the IP data flow 30' for service transmission is the same packet as the compressed IP packet 31. The compressed IP packet 33 'of the IP data flow 30' for service transmission is a packet in which the full header 321 is added to the compressed IP packet 33.

As the above description, the location of the material shared by the IP data stream and the information transfer service is described in fig. 3.

The responder (transponder) is composed of a TLV Stream (TLV _ Stream). TLV _ Stream is composed of AMT, TLV-NIT and UDP/IP packets.

AMT provides a Multicast (Multicast) group list of IP packets constituting each service transmitted in a broadcast network. The TLV-NIT transmits information related to the physical composition of the multiplexed/TLV stream and information related to the broadcast program carried over the broadcast network. And, TLV-NIT represents the characteristics of the network itself. UDP/IP is a User datagram protocol (User datagram protocol)/network protocol, and is a communication protocol operating on IP. Since IP packets are transmitted in the original form, high-speed transmission is performed without performing processes such as error correction detection and ARQ.

Sending according to UDP/IP form: comprising a network time control (NTP) specific IP data stream comprising NTP, a Service Information (SI) specific IP data stream comprising SI, the same IP data stream corresponding to at least one service, and a service common IP data stream.

The SI private IP data stream includes M2 part information, CA information, and PA information.

M2 partial information is information of partial extension form for transmitting MPEG-2Systems, and includes EMM, MH-SDTT, MH-CDT, MH-EIT, MH-SDT, and MH-BIT. EMMs are used to send individual information containing a Work key (Work key) used to crack the cryptographic transmission of the contract information and public information of each user.

The CA information is a Packet Identifier (PID) of individual information among the related information of the pay broadcast, and contains CAT. The CAT is one of transmission control signals in the multiplexing scheme, and indicates a table for limiting transmission of received related information.

The PA information contains a packet list PLT. The Packet List (PLT) is table information for indirectly specifying a table of MPTs, which is information for indirectly specifying each group ID of video, audio, and subtitle. That is, PLT indicates a list of IP data streams and packet IDs used for transmitting PA information of an MPEG Media Transport (MMT) packet provided as a broadcast service.

The same IP data stream is formed for each service unit such as video and audio, and includes a video MPU, an audio MPU, a subtitle MPU, an application MPU, data transfer information, M2 part information, and PA information.

The MPU is an abbreviation of media processing unit, and is a unit of image and sound processing. The MPU includes one or more access units, and is a unit capable of performing composite processing of images and sounds in a single MPU. MPU belongs to the same elemental layer. By using the serial number for each MPU, the MPU can be distinguished from other MPUs.

The data transmission information includes a data catalog management table DDMT and a data material management table DAMT.

The M2 part information includes: MH application management table MH-AIT; an event information table EMT that provides a method of transmitting information from a transmitting side to an application (application) of a receiver; and an Entertainment (Entertainment) control information ECM which is transmitted to the receiver side as common information and contains date-time piece information, a scrambling key (scramblekey).

The PA information includes an MMT packet table MPT that gives information of a packet (Package) that constitutes a list of materials and a position thereof. The MPT packet table (packet table) is table information that indirectly specifies each group ID of video, audio, and subtitle.

The service-shared IP stream contains MPU materials common to the service streams, such as subtitles and a subtitle superimposition display MPU.

[ industrial applicability ]

A plurality of types of data (data of a service-sharing IP data stream, etc.) multiplexed by a digital multiplexing scheme (TLV scheme, etc.) can be displayed on a client terminal (display device, TV, etc.) outside the receiving device.

Several embodiments of the present application have been described, but these embodiments are provided as examples and do not limit the scope of the application. The above-described embodiments can also be applied as a receiving apparatus, a receiving method, a transmitting apparatus, a transmitting method, and a transmitting/receiving system.

These novel embodiments may be implemented in other various forms, and various omissions, substitutions, and changes may be made without departing from the spirit of the application. These embodiments and modifications thereof are included in the scope and spirit of the claims and are included in the scope equivalent to the inventions described in the claims. In the claims, the scope of the present application is also defined by the individual components being represented by dividing the components, by combining a plurality of the components, or by combining these components. In addition, a plurality of embodiments may be combined, and an embodiment configured by the combination is also a scope of the application. The present invention is also applicable to a case where the claims are expressed as control logic, a case where the claims are expressed as a program including instructions for causing a computer to execute, and a case where the claims are expressed as a computer-readable nonvolatile storage medium in which the instructions are described. The terms and expressions used are not limited, and other expressions are included in the present application as long as they have substantially the same contents and the same subjects.

Claims

1. A receiving apparatus includes:

a receiving unit that receives data of a digital multiplex system; and

a control unit configured to identify an IP data stream related to multiplexing of an IP packet, a service-specific IP data stream, and a service-shared IP data stream corresponding to the service-specific IP data stream, and edit the IP data streams in real time, the control unit including:

the control unit extracts a full header by identifying each compressed IP packet of the data received by the reception unit, adds the full header to a compressed IP packet having no full header of the same IP compressed packet to form a new compressed IP packet, and multiplexes the corresponding plurality of IP data streams to output the multiplexed IP data stream as single video data to a transmission unit or store the multiplexed IP data stream;

and the receiving apparatus is further provided with a transmitting section,

the transmission unit transmits, to the data identified by the control unit:

a packet list of the IP data stream for indicating a list of the IP data stream and a packet ID for transmitting one of information of an MPEG media transport packet provided as a broadcast service;

the service corresponds to the image signal data and the sound signal data of the IP data stream, and table information required for acquiring images, sounds and subtitles; and

service common IP data of a service common IP data flow corresponding to the service corresponding IP data flow is established,

multiplexing and network sending are carried out, so that the subtitles of the client device and the media device which receive the multiplexed common IP data can be displayed in a superimposed mode.