TW201442494A - Data transmitting apparatus, data receiving apparatus and data transceiving system - Google Patents

Abstract

Provided are data transmitting apparatuses and methods, data receiving apparatuses and methods, and data transceiving systems and methods. A data transmitting apparatus includes: a packet generator configured to generate an audio metadata packet; and a transmitter configured to transmit the generated audio metadata packet to a data receiving apparatus, wherein a header of the generated audio metadata packet includes a split screen information field in relation to audio data represented by the generated audio metadata packet.

Description

Data transmission device, data receiving device, data transmission system, transmission Method of sending data and method of receiving data [Cross-Reference to Related Applications]

The present application claims the benefit of U.S. Provisional Application Serial No. 61/802,807, filed on Mar.

The apparatus and method according to the exemplary embodiments are related to the transmission of data, and more particularly, to a data transmission device, a data receiving device, a data transmission system, a method of transmitting data, and a method of receiving data, for transmitting and dividing screen support information .

Recently, with the development of multimedia environments, high-speed cable interface standards for transmitting various materials have been proposed. For example, High Definition Multimedia Interface (HDMI) and mobile high-definition links (Mobile High-Definition Link, MHL) describes the transmission standards for video data, audio data, and control data in various formats. With the development of multi-view technology that allows users to view different content via a single display device, a multi-audio transfer method is required.

In particular, in the case where the user views different content by dividing the screen, it is necessary to share in which format the screen is divided between the source device and the sink device, and which of the audio signal and the split screen are each. Matching information.

Therefore, there is a need for a standard for transmitting split screen support information between a source device and a sink device.

Aspects of one or more exemplary embodiments provide an interface standard for transmitting split screen support information between a source device and a sink device.

According to an aspect of the exemplary embodiments, there is provided a data transfer apparatus comprising: a packet generator for generating an audio relay data packet; and a transmitter for transmitting the generated audio relay data packet to the data And a receiving device, wherein the header of the generated audio relay data packet includes a split screen information field for audio data represented by the audio relay data packet.

The split screen information field may include at least one of: a split screen valid field indicating whether to support split screen; and a split screen type field indicating a type of split screen regarding the transmitted audio material.

The split screen type field may include one of: display a first split mode in which the screen is horizontally divided; a second split mode in which the display screen is vertically divided; a third split mode in which the picture-in-picture (PIP) screen is displayed in the display screen; and the display screen is divided The fourth split mode into three or more screens.

The header of the generated audio relay data packet may further include at least one of: a view type field indicating whether the transmitted content is multi-view content or single-view content; indicating the audio The sequence number field of the serial number of the relay data packet; and the number of audio stream fields indicating information about the number of transmitted audio streams.

The payload of the generated audio relay data packet may include a multi-tone descriptor field indicating relay material for the sub-packet of the multi-audio sample packet.

The multi-audio descriptor may include at least one of: a split screen label field indicating split screen information corresponding to the audio material represented by the generated audio relay data packet; the indication corresponding to Corresponding view ID field of the view of the audio data represented by the generated audio relay data packet; indicating whether the multi-audio descriptor field includes a valid language code field of the valid language code; indicating the main audio data and a mixed audio field in which the supplementary audio material is pre-mixed; a SAT presence field indicating whether the multi-audio descriptor field includes information on a type of valid supplementary audio material; indicating that the generated audio relay data packet is encapsulated a supplementary audio type field of the type of the supplemental audio material of the indicated audio material; and a language code field indicating the language code defined by ISO 639 of the audio material represented by the generated audio relay data packet.

According to another aspect of the exemplary embodiment, a data receiving apparatus is provided, including: a receiver for receiving an audio relay data packet from a data transmission device; and a parser for parsing the received audio relay And a data packet, wherein the header of the received audio relay data packet includes a split screen information field for the audio data represented by the audio relay data packet.

The split screen information field may include at least one of: a split screen valid field indicating whether to support split screen; and a split screen type field indicating a type of split screen regarding the transmitted audio material.

The split screen type field may include one of: a first split mode in which the display screen is horizontally divided; a second split mode in which the display screen is vertically divided; and a PIP screen displayed in the display screen a third split mode; and a fourth split mode in which the display screen is split into three or more screens.

The header of the received audio relay data packet may further include at least one of: a view type field indicating whether the transmitted content is multi-view content or single-view content; indicating the audio The sequence number field of the serial number of the relay data packet; and the number of audio stream fields indicating information about the number of transmitted audio streams.

The payload of the received audio relay data packet may include a multi-tone descriptor field indicating relay material for the sub-packet of the multi-audio sample packet.

The multi-audio descriptor may include at least one of: a split screen label field indicating split screen information corresponding to the audio material represented by the received audio relay data packet; the indication corresponding to The received audio And an associated view ID field of the view of the audio data represented by the relay data packet; indicating whether the multi-audio descriptor field includes a valid language code field of the valid language code; indicating whether the main audio material and the supplementary audio data are pre-mixed a mixed audio field; a SAT presence field indicating whether the multi-audio descriptor field includes information about a type of valid supplemental audio material; indicating supplementation of audio data represented by the received audio relay data packet a supplemental audio type field of the type of the audio material; and a language code field indicating the language code defined by ISO 639 of the audio material represented by the received audio relay data packet.

According to another aspect of the present invention, a data transmission system is provided, including: a data transmission device, configured to generate an audio relay data packet and transmit the generated audio relay data packet to a data receiving device; And the data receiving device, configured to receive the audio relay data packet from the data transmission device, where a header of the audio relay data packet includes audio information about the audio relay data packet Split the screen information field.

According to another aspect of the exemplary embodiments, a data transmission method is provided, including: generating an audio relay data packet; and transmitting the generated audio relay data packet to a data receiving device, wherein the generated The header of the audio relay data packet includes a split screen information field for the audio data represented by the audio relay data packet.

The split screen information field may include at least one of: a split screen valid field indicating whether to support split screen; and a split screen type field indicating a type of split screen regarding the transmitted audio material.

The split screen information field may include one of: a first split mode in which the display screen is horizontally divided; a second split mode in which the display screen is vertically divided; and a PIP screen displayed in the display screen a third split mode; and a fourth split mode in which the display screen is split into three or more screens.

The header of the generated audio relay data packet may further include at least one of: a view type field indicating whether the transmitted content is multi-view content or single-view content; indicating the audio The sequence number field of the serial number of the relay data packet; and the number of audio stream fields indicating information about the number of transmitted audio streams.

The payload of the generated audio relay data packet may include a multi-tone descriptor field indicating relay material for the sub-packet of the multi-audio sample packet.

The multi-audio descriptor may include at least one of: a split screen label field indicating split screen information corresponding to the audio material represented by the generated audio relay data packet; the indication corresponding to Corresponding view ID field of the view of the audio data represented by the generated audio relay data packet; indicating whether the multi-audio descriptor field includes a valid language code field of the valid language code; indicating the main audio data and a mixed audio field in which the supplementary audio material is pre-mixed; a SAT presence field indicating whether the multi-audio descriptor field includes information on a type of valid supplementary audio material; indicating that the generated audio relay data packet is encapsulated a supplementary audio type field of the type of the supplemental audio material of the indicated audio material; and a language code field indicating the language code defined by ISO 639 of the audio material represented by the generated audio relay data packet.

According to another aspect of the exemplary embodiment, a data receiving method is provided, including: receiving an audio relay data packet from a data transmitting device; and parsing the received audio relay data packet, wherein the received audio message The header of the relay data packet includes a split screen information field for the audio data represented by the audio relay data packet.

The split screen information field may include at least one of: a split screen valid field indicating whether to support split screen; and a split screen type field indicating a type of split screen regarding the transmitted audio material.

The split screen information field may include one of: a first split mode in which the display screen is horizontally divided; a second split mode in which the display screen is vertically divided; and a PIP screen displayed in the display screen a third split mode; and a fourth split mode in which the display screen is split into three or more screens.

The header of the received audio relay data packet may further include at least one of: a view type field indicating whether the transmitted content is multi-view content or single-view content; indicating the audio The sequence number field of the serial number of the relay data packet; and the number of audio stream fields indicating information about the number of transmitted audio streams.

The payload of the received audio relay data packet may include a multi-tone descriptor field indicating relay material for the sub-packet of the multi-audio sample packet.

The multi-audio descriptor may include at least one of: a split screen label field indicating split screen information corresponding to the audio material represented by the received audio relay data packet; the indication corresponding to The received audio And an associated view ID field of the view of the audio data represented by the relay data packet; indicating whether the multi-audio descriptor field includes a valid language code field including a valid language code; indicating whether the main audio material and the supplementary audio data are in advance a mixed mixed audio field; indicating whether the multi-audio descriptor field includes a SAT presence field including information about a type of valid supplementary audio material; indicating audio data represented by the received audio relay data packet a supplemental audio type field of the type of supplemental audio material; and a language code field indicating the language code defined by ISO 639 of the audio material represented by the received audio relay data packet.

According to another aspect of the exemplary embodiments, there is provided a data transfer apparatus comprising: a packet generator for generating a packet including a plurality of sub-packets for a multi-audio stream; and a transmitter for generating the packet The packet is transmitted to the receiving device, wherein the header of the generated packet includes a sequence number field for identifying an order of the generated packets in the plurality of packets.

According to another aspect of the exemplary embodiment, there is provided a data receiving apparatus comprising: a receiver for receiving a packet including a plurality of sub-packets for a multi-audio stream; and a parser for parsing the received A packet, wherein the header of the received packet includes a sequence number field for identifying an order of the generated packets in the plurality of packets.

According to another aspect of the exemplary embodiment, a data transmission system is provided, including: a data transmission device, configured to generate a packet including a plurality of sub-packets for a multi-audio stream and transmit the generated packet to a data a receiving device; and the data receiving device, configured to receive, from the data transmitting device, the plurality of The packet of the sub-packet, wherein the header of the received packet includes a sequence number field for identifying an order of the generated packets in the plurality of packets.

According to another aspect of the exemplary embodiments, there is provided a data transfer method comprising: generating a packet including a plurality of sub-packets for a multi-audio stream; and transmitting the generated packet to a data receiving device, wherein The header of the generated packet includes a sequence number field for identifying the order of the generated packets in the plurality of packets.

According to another aspect of the exemplary embodiments, there is provided a data receiving method, comprising: receiving a packet including a plurality of sub-packets for a multi-audio stream; and parsing the received packet, wherein the received packet is The header includes a sequence number field for identifying the order of the generated packets in the plurality of packets.

According to another aspect of the exemplary embodiment, there is provided a data transfer method comprising: a generator for generating a component capability information block including information about a property of the audio material supported by the collection slot device; and a transmitter The component capability information block is configured to transmit the component capability information block to the data receiving device, wherein the component capability information block includes a split screen audio field indicating whether the collection slot device supports reception and processing of multi-tones on the split screen. .

According to another aspect of the exemplary embodiment, there is provided a data receiving apparatus comprising: a receiver for receiving a component capability information block including information about a property of the audio material supported by the collection slot device; and an analyzer And analysing the received component capability information block, wherein the component capability information block includes a message indicating whether the collection slot device supports multi-audio connection on the split screen The split screen audio field received and processed.

According to another aspect of the exemplary embodiment, there is provided a data transmission system comprising: a data transfer device for transmitting a component capability information block including information about a property of the audio material supported by the collection slot device to a data receiving device; and a data receiving device, configured to receive the component capability information block from the data transfer device, wherein the component capability information block includes a message indicating whether the collection slot device supports multi-tone for splitting a screen The split screen audio field received and processed.

According to another aspect of the exemplary embodiment, there is provided a data transfer method comprising: generating a component capability information block including information about a property of the audio material supported by the collection slot device; and the component capability information area The block is transmitted to the data receiving device, wherein the component capability information block includes a split screen audio field indicating whether the sink device supports reception and processing of multiple audio for the split screen.

According to another aspect of the exemplary embodiment, there is provided a data receiving method comprising: receiving a component capability information block including information about a property of an audio material supported by a collection slot device; and analyzing the received component The capability information block, wherein the component capability information block includes a split screen audio field indicating whether the collection slot device supports reception and processing of multi-tones of the split screen.

According to another aspect of the exemplary embodiment, a data receiving apparatus is provided, including: a receiver, configured to receive a packet, where the packet includes a screen splitting information field of the audio data of the packet; and a parser for parsing the received packet.

In accordance with an aspect of the illustrative embodiments, an interface standard for transmitting split screen support information between a source device and a collection slot device is provided.

100-1, 100-2, 100-3‧‧‧ data transfer device

110‧‧‧Package Generator

120‧‧‧Transfer unit

130‧‧‧Generator

200-1, 200-2, 200-3‧‧‧ data receiving device

210‧‧‧ Receiver

220‧‧‧analysis unit

230‧‧‧Analysis unit

1000-1, 1000-2, 1000-3‧‧‧ data collection system

The above and/or other aspects will be more apparent from the exemplary embodiments described herein.

1A and 1B are views illustrating a single audio stream and a multi-stream stream.

2A-2C are views illustrating transmission of a multi-audio from a source device to a collection slot device with respect to a dual window and a split screen, in accordance with one or more exemplary embodiments.

3 is a view illustrating data transfer between a collection slot device and a source device for displaying split screen support information, according to an exemplary embodiment.

4 is a diagram illustrating a state in which a payload of a multi-tone sample packet is being transmitted, according to an exemplary embodiment.

FIG. 5 is a block diagram illustrating a data collection system in accordance with an exemplary embodiment.

FIG. 6 is a block diagram illustrating a material transfer device in accordance with an exemplary embodiment.

FIG. 7 is a block diagram illustrating a data receiving apparatus according to an exemplary embodiment.

8A-8C illustrate a split screen mode associated with an audio stream, in accordance with an illustrative embodiment.

FIG. 9 is a block diagram illustrating a data collection system in accordance with another exemplary embodiment.

FIG. 10 is a block diagram illustrating a material transfer device in accordance with another exemplary embodiment.

FIG. 11 is a block diagram illustrating a data receiving apparatus according to another exemplary embodiment.

12 and 13 are views illustrating a transfer timing of a three-dimensional (3D) audio signal, in accordance with one or more exemplary embodiments.

FIG. 14 is a block diagram illustrating a data collection system in accordance with still another exemplary embodiment.

FIG. 15 is a block diagram illustrating a configuration of a material transfer device according to still another exemplary embodiment.

FIG. 16 is a block diagram illustrating a configuration of a material receiving apparatus according to still another exemplary embodiment.

FIG. 17 illustrates a scenario of a multi-stream audio sample packet in accordance with an illustrative embodiment.

18A through 18C are views illustrating various data transfer formats when four-view video content is transmitted in a 3D interlaced format, in accordance with one or more exemplary embodiments.

19 is a flow chart of a method of data transfer, in accordance with an illustrative embodiment.

20 is a flow chart of a method of receiving data according to an exemplary embodiment.

FIG. 21 is a flowchart of a data transfer method, according to another exemplary embodiment.

FIG. 22 is a flowchart of a data receiving method, according to another exemplary embodiment.

FIG. 23 is a flowchart of a data transfer method according to still another exemplary embodiment.

FIG. 24 is a flowchart of a data receiving method according to still another exemplary embodiment.

It should be understood that the method operations and system components have been represented by the basic symbols in the drawings in order to demonstrate sufficient detail in order to understand the disclosure. In addition, descriptions that are apparent to those of ordinary skill in the art may be omitted herein. In the present disclosure, relational terms such as first, second, and the like may be used to distinguish one entity from another, but do not necessarily imply any actual relationship or order between such entities. It should be understood that in the following, an expression such as "at least one of" is used to modify the entire list of parts before the list of parts, rather than to modify the individual parts of the list.

The aspects of the illustrative embodiments are applicable to various cable interface delivery standards, such as High Definition Multimedia Interface (HDMI) and Mobile High Definition Link (MHL) standards, which are identical to the technical concepts of the present disclosure. Within the scope, and therefore, the scope of the invention includes at least a cable-like interface standard.

This manual refers to the disclosure and has the following documents:

ITU-R BS.2159-4 (05/2012), Multichannel sound technology in home and broadcasting applications.

SMPTE, SMPTE 2036-2: 2008, "UHDTV-Audio characteristics and audio channel mapping for program production", 2008.

IEC, IEC 62574 version 1.0, "Audio, Video and Multimedia Systems -- "Audio, video and multimedia systems-General channel assignment of multichannel audio", April 7, 2001.

Table 1 briefly defines some of the terms used in this disclosure.

1A and 1B are views illustrating a single audio stream and a multi-stream stream.

As illustrated in FIG. 1A, a single audio stream corresponds to at least one video asset. It is expected that there are multiple audio data and the audio data is transmitted to a single stream. In the single stream, all stream data is packetized to share the same packet stream ID.

As illustrated in FIG. 1B, the multi-stream stream is a condition for transmitting a plurality of single AV streams. In a multi-stream stream, there is a plurality of single AV stream groups to which a unique packet stream ID is assigned to each single AV stream. Video data of multiple single AV streams is interdependent.

Each audio stream of a multi-stream stream carries up to two audio channels and is associated with a single audio stream. For example, each audio in the single view mode can be connected to a preset video stream, and the audio in the dual view mode can be connected to the left or right image (or both). Additionally, one or more supplemental audio options can be transmitted as described below. That is, supplemental audio options may include split screen tagging, language indications, and indications for audio/visually impaired people.

The split screen is a view option that is tagged with different audio material and identified by the source device with respect to one or more windows. The split screen is used for picture-in-picture viewing, quick preview, multi-screen games, and more. In this context, a window is a unique display image displayed on an area of the screen of the collection trough device.

Split screen (or multiple windows) is an optional element for use with multi-tone. The split screen mode indicating that the screen is split in the collection slot device will be tagged into the audio stream and mapped to a particular window.

2A, 2B, and 2C are views illustrating transmission of a multi-audio from a source device to a collection slot device with respect to dual windows and split screens, in accordance with one or more exemplary embodiments.

2A illustrates an illustration of transmitting audio data to each of a plurality of screens Illustrative embodiment, FIG. 2B illustrates an exemplary embodiment of transmitting a plurality of audio materials in accordance with a quick preview view or a picture-in-picture (PIP) view, and FIG. 2C illustrates an exemplary embodiment of transmitting a plurality of audio materials in accordance with a multi-screen game. The user of the collection slot device can select and listen to the desired audio material.

3 is a view illustrating data transfer between a collection slot device 320 and a source device 310 for displaying split screen support information, according to an exemplary embodiment.

Referring to FIG. 3, the source device 310 transmits the vendor specific information frame, the multi-tone sample packet, and the multi-audio relay data packet to the collection slot device 320.

The multi-tone sample packet includes a plurality of audio streams. The multi-tone relay data packet includes one or more settings for each audio stream, and the audio stream is related to the video stream and can deliver supplemental audio information. The vendor specific message frame includes the multiview type of the content being delivered. A detailed description will be provided below.

The collection slot device 320 transmits the expansion component capability register to the source device 310 to provide information regarding the multi-tone mode supported by the collection slot device. A detailed description will be provided below.

At the same time, multi-audio support auxiliary audio tracks (for example, multi-language, audio descriptions for visually impaired people or clear audio for hearing impaired people) are added. In this case, up to 16 stereo audio streams can be transmitted simultaneously. A detailed description thereof will be provided below.

Transition-Minimized Differential Signaling (TMDS) and encoding

Data platform packet

3D audio sample packet

The 3D audio is defined as the audio that the speaker can place at a predetermined location for each 3D audio standard (eg, 10.2ch, 22.2ch, 30.2ch, etc.) in 3D space. The 3D audio sample packet includes an audio sample containing 9 to 32 audio channels.

The 3D audio stream includes up to 32 audio channels (or more) and is transmitted via successive packets in the data summation section. Each packet includes up to 8 audio channels. The configuration of the sub-packet is determined by the sequence number in the header and the sample presence bit.

The sequence number field (sequence_number) indicates the order of the current packets. Since multiple 3D audio sample packets include a single 3D audio sample, this field is used to correctly identify the packet order.

Other header fields and sub-package structures are the same or similar to MHL 2.0 The audio sample packet shown in the specification.

Multi-tone sample packet

The multi-tone sample packet includes four audio samples, each of which is associated with an independent audio stream. When the MHL source component simultaneously transmits more than four independent audio streams, the continuous stream of audio is transmitted by a series of consecutive multi-tone sample packets. The sequence number defined in the packet header identifies each multi-tone sample packet and indicates the order in which the current packet is within the packet array. The configuration of the sub-packet is determined by the sequence number in the header and the sample presence bit. This situation will be described in detail in the Multi-Audio Data Encapsulation section below.

For each sub-packet (or audio stream), the descriptor field in the multi-tone relay data packet describes the view mode (ie, single view or multi-view) and optional information (eg, split screen tagging, language) Code, audio for visually impaired people, etc.). These situations will be described in detail below.

The sequence number (sequence_number) indicates the sequence number of the current multi-tone sample packet when there are more than four audio streams to be transmitted from the source to the MHL collection slot. If the sequence number field is set to 0, the packet may include the first four audio streams in the corresponding sub-packets. If the sequence number field is set to 1, the packet may include a second group of four audio streams in the corresponding sub-packets. In a similar manner, when the sequence number field is set to 2 or 3, respectively, the packet includes a third group or a fourth group of four audio streams. in The audio stream carried in sub-packet 0 in the case of sequence_number = 0 can be represented as a preset audio stream.

The stream presence field (stream_present.spX) indicates whether the sub-packet X contains an audio sample of stream X.

The stream flat field (stream_flat.spX) indicates whether sub-packet X represents a "flatline" sample of stream X. The streamlined flat field can be active if "stream_present.spX" is also set.

The other header fields and sub-packets are identical in structure or similar to the audio sample packets shown in the MHL 2.0 specification.

4 is a diagram illustrating a state in which a payload of a multi-tone sample packet is being transmitted, according to an exemplary embodiment.

As illustrated in Figure 4, when four multi-tone sample packets are transmitted, 16 audio streams can be delivered. Since the sequence number consists of 2 bits, up to 16 audio streams can be delivered.

FIG. 5 is a block diagram illustrating a data collection system 1000-1, in accordance with an exemplary embodiment.

Referring to FIG. 5, a data transmission system 1000-1 according to an exemplary embodiment includes a material transfer device 100-1 and a material receiving device 200-1.

The data transfer device 100-1 generates a plurality of sub-packets for the multi-stream stream and transmits the plurality of sub-packets to the data receiving device 200-1.

The header of the transmitted packet includes a sequence number field for identifying the order of the generated packets in all packets.

FIG. 6 is a block diagram illustrating a material transfer device 100-1, in accordance with an exemplary embodiment.

Referring to FIG. 6, a material transfer device 100-1 according to an exemplary embodiment includes a packet generator 110 and a transfer unit 120 (eg, a transmitter).

The packet generator 110 generates a packet including a plurality of sub-packets for the multi-audio stream. As described in the exemplary embodiments above, one packet may include four sub-packets corresponding to four audio streams.

In this case, the header of the generated packet includes a sequence number field for identifying the order of the generated packets in all packets. Exemplary embodiment of FIG. 4 As shown, the sequence number field indicates the order of the transmitted packets.

The transmitting unit 120 transmits the generated packet to the data receiving device 200-1.

FIG. 7 is a block diagram illustrating a data receiving apparatus 200-1 according to an exemplary embodiment.

Referring to FIG. 7, a material receiving apparatus 200-1 according to an exemplary embodiment includes a receiver 210 and a parsing unit 220 (for example, a parser).

The receiver 210 receives a packet including a plurality of sub-packets for the multi-stream stream from the data transmitting device 100-1.

The parsing unit 120 parses the received packet. The header of the received packet includes a sequence number field for identifying the order of the generated packets in all packets. As shown in the exemplary embodiment of FIG. 4, the sequence number field indicates the order of the transmitted packets.

3D audio relay data packet

The 3D audio relay data packet is used to transmit auxiliary data describing the 3D audio data. If the MHL source is capable of transmitting a 3D audio sample packet, the MHL source can always transmit an accurate 3D audio relay data packet at least once for every two video fields.

The following table shows a 3D audio relay data packet in accordance with an exemplary embodiment.

Table 8--3D_CA (3D Audio Channel/Speaker Assignment) field (3D_CAST=0x01 (up to 10.2ch))

Table 10-3D_CA (3D Audio Channel/Speaker Assignment) field (3D_CAST=0x03 (up to 20.2ch))

Multi-audio relay data packet

A multi-tone relay data packet is used to transmit auxiliary data describing the multi-stream stream. The multi-tone relay data packet is used to describe the view type and auxiliary audio options for each audio stream transmitted in the multi-tone sample packet.

If the MHL source is capable of transmitting multiple audio sample packets, the MHL source can always transmit an accurate multi-stream audio relay data packet at least once for every two video fields.

The following table shows a multi-tone relay data packet in accordance with an exemplary embodiment.

The view type field (MA_View_Type) indicates an associated view mode of a multi-stream stream, such as a single view or multiple views.

The sequence number (Sequence_Number) indicates the packet number or serial number of the current multi-audio relay data packet. This field is used to identify up to four unique multi-tone relay data packets. This field uniquely links each multi-tone relay data packet to a multi-tone sample packet having the same Sequence_Number.

The number of audio streams (Num_Audio_Streams) indicates the total number of audio streams transmitted by the multi-tone sample packets.

Split Screen Valid Field (SC_Valid) is about split screen labeling. For example, if the split screen valid field is set to 1, the split screen tagging is supported, and Split_Screen_Config is specified in the next 7 bits. If the split screen valid field is set to 0, split screen tagging is not supported or specified, and the next 7 bits are reserved for other uses.

The Split Screen Type field (Split_Screen_Config) indicates the split screen type associated with the audio stream indicated by the current descriptor. The selectable split screen type in accordance with an illustrative embodiment is set forth in Table 13 below. This field can only be valid if SC_Valid=1.

The multi-audio descriptor field (MA_Descriptor_X) indicates the characteristics of the audio stream transmitted by the sub-packet X corresponding to the multi-tone sample packet. Table 13 shows a detailed structure of a multi-audio descriptor according to an exemplary embodiment.

8A, 8B, and 8C illustrate a split screen mode associated with audio streaming, in accordance with an illustrative embodiment.

The following table shows a multi-stream descriptor definition in accordance with an illustrative embodiment.

The split screen label field (Split_Screen_Tag) indicates a particular window associated with the audio stream indicated by the current multi-audio descriptor (eg Defined by Split_Screen_Config). Details of split screen tab fields in accordance with an illustrative embodiment are shown in Table 15 below. The split screen label field can only be valid if SC_Valid=1, otherwise the MHL collection slot can ignore this field.

The associated view identification field (Associated_View_ID) indicates a particular view associated with the audio stream indicated by the current multi-audio descriptor. The meaning of this field depends on the value of MA_View_Type. Details of the associated view identification fields in accordance with an illustrative embodiment are shown in Table 14 below.

The valid language code field (LC_present) indicates whether a valid language code is included. For example, if the valid language code field is set to 1, the current descriptor includes a valid Language_Code field in subsequent bytes.

The Mixed Audio Field (Mixed_Audio) indicates whether the corresponding audio stream contains general audio and pre-mixed streams of supplementary audio. For example, if the mixed audio field is set to 1, the corresponding audio stream contains general audio and pre-mixed streams of supplemental audio as indicated by Suppl_Audio_Type.

The SAT Presence field (SAT_present) indicates whether the current descriptor includes a valid supplemental audio type field. For example, if the SAT presence field is set to 1, the current descriptor includes a valid Suppl_Audio_Type field in the next 4 bits.

The Supplemental Audio Type field (Suppl_Audio_Type) indicates the type of supplemental audio corresponding to the audio stream. A detailed description of the supplemental audio type field in accordance with an illustrative embodiment is provided below in Table 16. The Supplemental Audio Type field can only be valid if SAT_present=1, otherwise the MHL collection slot can ignore this field.

The language code field (Language_Code) indicates the ISO corresponding to the audio stream. Language code defined by 639. The language code field can only be valid if the LC_present field is set to 1, otherwise the MHL collection slot can ignore this field.

FIG. 9 is a block diagram illustrating a data collection system 1000-2 in accordance with another exemplary embodiment.

Referring to FIG. 9, a data transmission system 1000-2 according to another exemplary embodiment includes a material transfer device 100-2 and a material receiving device 200-2.

The data transfer device 100-2 generates an audio relay data packet and transmits the generated audio relay data packet to the data receiving device 200-2. The audio relay data packet defines the audio specifications transmitted.

The data receiving device 100-2 receives the audio relay data packet from the data transmitting device 100-2.

The header of the audio relay data packet includes a split screen information field for the audio data represented by the audio relay data packet.

The detailed configuration of the material transfer device 100-2 and the material receiving device 200-2 according to the exemplary embodiment will be described in more detail below.

FIG. 10 is a block diagram illustrating a material transfer device 100-2 according to another exemplary embodiment.

Referring to FIG. 10, a material transfer device 100-2 according to another exemplary embodiment includes a packet generator 110 and a transfer unit 120 (eg, a transmitter).

The packet generator 110 generates an audio relay data packet. The audio relay data packet defines the audio specifications transmitted.

In particular, the header of the generated audio relay data packet includes a split screen information field for the audio material represented by the audio relay data packet.

The transmitting unit 120 transmits the generated audio relay data packet to the data receiving device 200-2.

In this case, the split screen information field may include one of the following One less: indicates whether to support the split screen valid field of the split screen; and the split screen type field indicating the type of the split screen regarding the transmitted audio material.

The split screen type field may indicate one of: a first split mode in which the display screen is horizontally divided; a second split mode in which the display screen is vertically divided; and a PIP screen displayed in the display screen a three-division mode; and a fourth segmentation mode in which the display screen is divided into three or more screens.

The header of the generated audio relay data packet may include at least one of: a view type field indicating whether the transmitted content is multi-view content or single-view content; indicating a sequence number of the audio relay data packet a sequence number field; and an audio stream number field indicating information about the number of transmitted audio streams.

The payload of the generated audio relay data packet may include a multi-tone descriptor field indicating relay material for the sub-packet of the multi-audio sample packet.

The multi-audio descriptor may include at least one of: a split screen label field indicating split screen information corresponding to the audio material represented by the generated audio relay data packet; the indication corresponding to the generated audio information An associated view ID field of the view of the audio data represented by the relay data packet; a valid language code field indicating whether the multi-audio descriptor field includes a valid language code; a mixture indicating whether the main audio material and the supplementary audio material are pre-mixed Audio field; a SAT presence field indicating whether the multi-audio descriptor field includes information about the type of valid supplemental audio material; a supplement indicating the type of supplemental audio material of the audio material represented by the generated audio relay data packet An audio type field; and a language indicating an ISO 639 defined language code of the audio material represented by the generated audio relay data packet Code field.

FIG. 11 is a block diagram illustrating a material receiving apparatus 200-2 according to another exemplary embodiment.

Referring to FIG. 11, a material receiving apparatus 200-2 according to another exemplary embodiment includes a receiver 210 and a parsing unit 220 (for example, a parser).

The receiver 210 receives the audio relay data packet from the data transmission device 100-2. The audio relay data packet defines the audio specifications received.

In particular, the header of the audio relay data packet includes a split screen information field for the audio data represented by the audio relay data packet.

The receiver 210 receives the audio relay data packet from the data transmission device 100-2.

In this case, the split screen information field may include at least one of: a split screen valid field indicating whether to support split screen; and a split screen type indicating a type of split screen regarding the transmitted audio material Field.

The split screen type field may indicate one of: a first split mode in which the display screen is horizontally divided; a second split mode in which the display screen is vertically divided; a PIP screen is displayed in the display screen a third split mode; and a fourth split mode in which the display screen is split into three or more screens.

The header of the audio relay data packet may further include at least one of: a view type field indicating whether the transmitted content is multi-view content or single-view content; and a serial number column indicating a serial number of the audio relay data packet Bit; and an audio stream number field indicating information about the number of transmitted audio streams.

The payload of the audio relay data packet may include a multi-stream descriptor field indicating relay data for the sub-packets of the multi-audio sample packet.

The multi-audio descriptor may include at least one of: a split screen label field indicating split screen information corresponding to the audio material represented by the generated audio relay data packet; the indication corresponding to the generated audio information An associated view ID field of the view of the audio data represented by the relay data packet; a valid language code field indicating whether the multi-audio descriptor field includes a valid language code; a mixture indicating whether the main audio material and the supplementary audio material are pre-mixed Audio field; a SAT presence field indicating whether the multi-audio descriptor field includes information about the type of valid supplemental audio material; a supplement indicating the type of supplemental audio material of the audio material represented by the generated audio relay data packet An audio type field; and a language code field indicating a language code defined by ISO 639 of the audio material represented by the generated audio relay data packet.

Multi-audio action indicator

The source component can use the vendor specific information frame (VSIF) to indicate to the collection slot component the exact viewing mode being transmitted. According to an exemplary embodiment, the VSIF can be structured as shown in Table 17.

Table 17 - Vendor Specific Information Frame Packets

MHL_MULTI_VIEW indicates which multiview mode is being transferred. A detailed description of MHL_MULTI_VIEW in accordance with an exemplary embodiment is shown in Table 18.

Video

3D supported 3D video descriptor

Table 19--3D Video Descriptor Data Structure

According to an exemplary embodiment, each supported 3D video mode can be indicated in a 3D video descriptor.

MV_SUPP: If set to "1", the component supports the use of 3D video format for multiview video streaming.

Audio

Channel/speaker assignment

In the case where the MHL collection slot is capable of receiving 3D audio, the 3D channel speaker allocation descriptors described in Tables 38 through 40 below can be used to indicate the configuration of the attached speaker. The indication of the current speaker assignment for the 3D audio transmitted from the MHL source is carried in the 3D_CA field of the 3D audio relay data packet. For details on the 3D_CA field, refer to Table 27 to Table 29.

3D audio data packetization

Each sub-packet of the 3D audio sample packet may contain zero or one frame of IEC 60958. If the MHL source downmixes the 3D audio stream and the downmixed audio stream is also a 3D audio stream, the 3D audio sample packet should also be used to carry the audio stream. If the MHL collection slot does not support the 3D audio feature, the MHL source may not transmit the 3D audio sample packet except for the 3D audio relay data packet.

There are many different sub-packet layouts depending on the number of channels. According to one Or a plurality of exemplary embodiments, Tables 20 through 223 below show 3D audio packet layouts when 12, 24 or 32 channels are transmitted, respectively.

Table 22 - 3D Audio Sample Packet Layout for 32 Channels

There are four sample_present bits in the 3D audio sample packet header, one for each of the sub-packets. Each bit indicates that a sub-package includes a 3D audio sample. In addition, there are four sample_flat.spX bits that are set at the MHL source without the availability of useful audio material during the time period represented by the sample. This can occur during sample rate changes or temporary stream interruptions.

The continuous 3D audio sample packet can be used to carry a 3D audio sample of 9 to 32 channels (i.e., 5 to 16 IEC 60958 frames) containing L-PCM audio.

The first packet of the 3D audio sample is fully loaded with 8 audio channels and has a sequence number field set to zero. The sequence number is incremented by one for each additional packet within the same 3D audio sample. The last packet depends on the total number of channels of the 3D audio sample and contains 8 One or less than eight audio channels.

For 3D audio sample packets, there are only five valid configurations for the sample_present bit.

10 and 11 are views for explaining the timing of transmission of a 3D audio signal.

Figures 10 and 11 illustrate the transmission of three 8-channel 2D audio signal samples at horizontal blank intervals. A 24-channel 3D audio signal transmits one sample during the same time period.

Multi-audio data packetization

MHL allows MHL sources to simultaneously transmit many audio streams for a single AV stream. The plurality of audio streams are associated with a single view or multi-view video stream (eg, a dual view game with different audio streams for each view). Auxiliary audio modes may also be indicated, such as split screen tagging (i.e., tagging different portions of the screen and associated with its own audio stream), language code, or audio for visual/hearing impaired persons. Each audio stream can be associated with only one view mode and contain up to 2 audio channels.

Each sub-packet of a multi-stream audio sample packet may contain zeros of IEC 60958 or IEC 61937 "blocks" or a "frame" defined by IEC 60958.

When there are more than four audio streams to be transmitted, two or more consecutive multi-tone sample packets are used to transmit the plurality of audio streams. The order of each packet in the packet array is identified by the Sequence_Number field. The MHL source can simultaneously transmit up to 16 independent audio streams in a single AV stream.

In accordance with one or more exemplary embodiments, Tables 24 and 25 show examples of multi-tone sample packets and multi-tone relay data packet layouts when the MHL source streams four audio streams in a single view video stream. The multi-tone relay data packet describes the characteristics of each audio stream (eg, supplemental information, language, etc.).

Tables 26 and 27 show examples of multi-tone sample packets and multi-tone relay data packet layouts when the MHL source streams eight audio streams in a dual view video stream. The multi-tone relay data packet describes the characteristics of each audio stream (eg, associated view, supplemental information, language, etc.).

In accordance with one or more exemplary embodiments, Table 28 and Table 29 show multi-tone sample packets and multi-tones when the MHL source transmits six audio streams (where the split screen tagging option is enabled for single view video streams) Following the example of the data packet layout.

Table 24 - Examples of Multi-Audio Sample Packet Layouts with 4 Audio Streams in Single View Mode

Audio for HI: audio streaming for hearing impaired people

Audio for VI: Audio streaming for visually impaired people

Table 27 - Examples of multi-tone relay data packet layout (related to the packet in Figure 26)

Audio for HI: audio streaming for hearing impaired people

Audio for VI: Audio streaming for visually impaired people

Table 29 - Examples of multi-tone relay data packet layout (related to the packet in Figure 28)

Audio for HI: audio streaming for hearing impaired people

Audio for VI: Audio streaming for visually impaired people

3D audio relay data packetization

Whenever a 3D audio stream is transmitted, an accurate 3D audio relay data packet can be transmitted at least once for every two video fields.

After the start of a new 3D audio stream or after any change in the 3D audio stream that can be indicated by the 3D audio relay data packet and the audio information frame, no later than one video after the first affected non-silent audio sample The frame transmits the modified accurate 3D audio relay data packet. Preferably, this transmission occurs just prior to transmitting the first affected audio sample.

The 3D audio relay data packet transmission can occur at any time within the Data Island period (including any horizontal or vertical blank periods).

When the 3D audio is streaming, the MHL collection slot can ignore the CC and CA fields in the audio information frame, and instead refer to 3D_CC and 3D_CA in the 3D audio relay data packet.

Multi-audio relay data packetization

An accurate multi-tone relay data packet can be transmitted at least once every two video fields whenever a multi-stream stream is being transmitted.

After the start of a new multi-stream stream or after any change in the multi-stream stream that can be indicated by the multi-audio relay data packet and the audio information frame, no later than one video after the first affected non-silent audio sample The frame transmits the modified accurate multi-tone relay data packet. For example, this transfer can occur just prior to transmitting the first affected audio sample.

Multi-tone relay data packet transmission can occur at any time during the Data Island period (including any horizontal or vertical blank periods).

WRITE_BURST for 3D/multi-audio support

Support for the 3D audio mode is indicated using a sequence of WRITE_BURST transitions, formatted according to one or more exemplary embodiments, as shown in Table 31 and Table 37.

Table 33 - 3D Audio Descriptors for Audio Format Codes 9 to 13

Table 36 - MHL 3D Channel/Speaker Allocation Descriptor (3D_CSAD) in WRITE_BURST

The bold bit is the designated speaker associated with the 10.2 channel.

The bold bit is the designated speaker associated with the 22.2 channel.

The bold bit is the designated speaker associated with the 30.2 channel.

Table 40--3D_CAST (3D Audio Channel Assignment Standard Type) field

Link control bus

Component register change interrupt

3D_AUD_REQ is used by the MHL source component to request 3D audio support information from the MHL collection slot.

BURST_ID code

The 3D_AD and 3D_CSAD are used by the MHL collection slot to indicate support for audio expansion. See section 7.XX.

Control and configuration

Expansion component capability register

The collection trough device provides an expansion element capability register to the source device. In other words, the source device can read the expansion component capability register of the collection slot device.

As shown in the following table, the address 0x85 of the MHL-compliant extended component capability register can be used to indicate the multi-audio mode supported by the collection slot device.

Multi-audio mode

Each MHL collection slot component can indicate a particular multi-audio mode supported by the collection slot component in the MULTI_AUD_MODE register.

The MULTI_AUD_MODE register includes a split screen audio field indicating whether the sink device supports reception and processing of multi-tones for split screens.

This field can be set to 0 if the component is not capable of supporting multiview video streaming.

FIG. 14 is a block diagram illustrating a data collection system 1000-3 according to still another exemplary embodiment.

Referring to FIG. 14, a data transmission system 1000-3 according to the present exemplary embodiment includes a material transfer device 100-3 and a material receiving device 200-3.

The material transfer device 100-3 transmits a component capability information block including information on the nature of the audio material supported by the sink device to the material receiving device 200-3.

FIG. 15 is a block diagram illustrating a configuration of a material transfer device 100-3 according to still another exemplary embodiment.

Referring to FIG. 15, a material transfer device 100-3 according to the present exemplary embodiment includes a generator 130 and a transfer unit 120 (for example, a transmitter).

The generator 130 generates a component capability information block including information about the nature of the audio material supported by the collection slot device.

The component capability information block may include a split screen audio field indicating whether the sink device supports reception and processing of multiple audio for the split screen.

The transmitting unit 120 transmits the component capability information block to the material receiving device 200-3.

FIG. 16 is a block diagram illustrating a configuration of a material receiving apparatus 200-3 according to still another exemplary embodiment.

Referring to FIG. 16, the material receiving apparatus 200-3 according to the present exemplary embodiment includes a receiver 210 and an analyzing unit 230 (for example, an analyzer).

The receiver 210 receives the component capability information block from the data transfer device 100-3.

The analyzing unit 230 analyzes the received component capability information block.

The component capability information block includes information about the nature of the audio material supported by the collection slot device. Specifically, the component capability information block may include a split screen audio field indicating whether the sink device supports reception and processing of multiple audio for the split screen.

Multi-stream audio

In the following, multi-stream audio will be described in accordance with various exemplary embodiments. The multi-stream audio transmission specifications described below are applicable to various wired/wireless transmission interfaces including HDMI and MHL.

A source device according to an exemplary embodiment can simultaneously transmit 4 audio streams. All audio streams share an information frame about the multi-stream audio sample packets.

The wired interface according to various exemplary embodiments may add support for single view video streaming (eg, multi-lingual support, audio for visual/hearing impaired people, etc.), which may be modified by modifying the audio Relay the data packet or modify the HDMI audio data block to execute.

For example, as shown in Table 45 below, multi-stream audio can support multiple languages, and audio can be supported in 2 channels.

Situation

FIG. 17 illustrates a scenario of a multi-stream audio sample packet in accordance with an illustrative embodiment.

In the case of a multi-stream audio sample packet having four sub-packets, the following scenario may exist. 1) If a single television program is transmitted with a single view audio description, stream 0 may include a normal audio signal, and stream 1 may include an audio description signal for a visually impaired person.

2) If the single view supports two languages, the two audio signal streams of the supported language are transmitted together with the corresponding audio description. For example, if English and Korean are supported, respectively, stream 0 may include a Korean normal audio signal, stream 1 may include a Korean voice description signal for a visually impaired person, and stream 2 may include an English normal audio signal. And stream 3 can include an English audio description signal for a visually impaired person.

3) In a single view, one audio signal stream in one language and two description signals for visually impaired people in different languages can be transmitted. For example, stream 0 may include a Korean or English normal audio signal, respectively, and stream 1 may include The Korean voice message of the visually impaired person describes the signal, and the stream 2 may include an English audio description signal for the visually impaired person.

4) The source device can transmit multi-view audio signals. If dual view is supported, the most basic form is to transmit an audio signal in a transport stream for each view. The dual view includes first and second independent views, and each view provides independent content.

5) For each view, two languages can be supported. In this case, the audio signal stream in the first language of the first view, the audio signal stream in the second language with respect to the first view, and the audio signal stream in the first language of the second view may be separately transmitted. And a stream of audio signals in the second language of the second view. For example, if English and Korean are supported, the stream 0 may include a Korean speech signal regarding the first view, the stream 1 may include an English audio signal with respect to the first view, and the stream 2 may include Korean with respect to the second view. The audio signal, and stream 3 may include an English audio signal with respect to the second view.

6) In the case of dual view, a view can further transmit an audio description signal for a visually impaired person. That is, the audio signal stream for the first view, the normal audio signal stream for the second view, and the audio description signal stream for the visually impaired person with respect to the second view may be separately transmitted. For example, stream 0 can include an audio signal with respect to a first view, stream 1 can include an audio signal with respect to a second view, and stream 3 can include an audio description signal for a second view.

7) A stream can be used to transmit a common audio signal. That is, the common audio signal stream for the first view and the second view, the audio stream dedicated to the first view, and the audio stream dedicated to the second view may be separately transmitted. In this situation, The receiving end is multiplexed and outputs a common audio stream and a dedicated audio stream. This situation can be applied to games. For example, stream 0 may include a common audio signal (eg, background sound, flow-guided speech, etc.) with respect to the first view and the second view, and stream 1 may include an audio signal dedicated to the first view, and streamed 2 may include an audio signal dedicated to the second view.

Referring back to FIG. 5, the data distribution system 1000-1 according to an exemplary embodiment includes a material transfer device 100-1 and a material receiving device 200-1.

The data transfer device 100-1 may transmit the packet including the first sub-packet and the second sub-packet to the data receiving device 200-1.

The data receiving device 200-1 may receive a packet including the first sub-packet and the second sub-packet from the data transmitting device 100-1.

In this case, the first sub-packet and the second sub-packet include different audio materials about the first content.

Hereinafter, the configuration of the material transfer device 100-1 and the material receiving device 200-1 according to one or more exemplary embodiments will be described in more detail.

Referring back to FIG. 6, the material transfer device 100-1 according to an exemplary embodiment includes a packet generator 110 and a transfer unit 120.

The packet generator 110 may generate a packet including the first sub-packet and the second sub-packet. In this case, the first sub-packet and the second sub-packet include different audio materials about the first content.

The transmitting unit 120 transmits the generated packet to the receiving device 200-1. In this case, the first sub-package may include audio data for non-disabled persons, and The second sub-package may include audio material for visually impaired persons.

The first sub-packet and the second sub-packet may include audio materials in different languages.

The first sub-packet may include audio material corresponding to an audio description of the second sub-packet.

The packet may further include a third sub-packet including audio information about the second content different from the first content.

In this case, the audio data included in the first sub-package may be audio information dedicated to the first content, and the audio data included in the third sub-package may be audio information dedicated to the second content, and included in The audio material in the second sub-package may be a common audio material about the first content and the second content.

In addition, the packet may further include a fourth sub-packet, the fourth sub-packet includes audio information about the second content, and the third sub-packet and the fourth sub-packet may include different audio materials.

Referring back to FIG. 7, the data receiving apparatus 200-1 according to an exemplary embodiment includes a receiver 210 and a parsing unit 220.

The receiver 210 can receive the packet including the first sub-packet and the second sub-packet from the data transmitting device 100-1. In this case, the first sub-packet and the second sub-packet may include different audio materials regarding the first content.

The parsing unit 220 is a component for parsing the received first sub-packet and the received second sub-packet.

The first sub-packet and the second sub-package may include audio resources in different languages material.

Unlike the above, the first sub-packet may include audio material corresponding to the audio description of the second sub-packet.

The packet may further include a third sub-packet including audio information about the second content different from the first content.

In this case, the audio data included in the first sub-package may be audio information dedicated to the first content, and the audio data included in the third sub-package may be audio information dedicated to the second content, and included in The audio material in the second sub-package may be a common audio material about the first content and the second content.

In addition, the packet may further include a fourth sub-packet, the fourth sub-packet includes audio information about the second content, and the third sub-packet and the fourth sub-packet may include different audio materials.

Audio relay data packet

According to an exemplary embodiment, the source device transmits the audio relay data packet to the collection slot device to notify the transmitted audio specification. In this case, the header of the audio relay data packet can have the following structure.

The description of each field is as follows.

If the 3D audio field (3D_AUDIO) [1 bit]: 3D_AUDIO=1, the audio relay data packet includes the 3D audio channel count (3D audio channel count: 3D_CC field. See the table below) and channel/speaker assignment information ACAST : Audio channel assignment standard type field (see table below). The field can be set to 1 when the source transmits a 3D audio packet.

The number of views field (NUM_VIEWS) [2 bits] indicates the number of views. If NUM_VIEWS=00, single-view video streaming is supported. If NUM_VIEWS=01, dual view video streaming is supported. This mode can only be used when 3D_DualView=1 in VSIF. Keep the remaining NUM_VIEWS values for future use.

The number of audio streams (NUM_AUDIO_STR) [2 bits] indicates the number of audio streams -1. If NUM_AUDIO_STR=01, 10 or 11, the audio relay data packet includes up to four audio relay descriptors respectively corresponding to the audio stream.

According to an exemplary embodiment, the table below indicates the payload of the audio relay data packet for 3D audio. If 3D_Audio=1, the relay data packet is valid. The load has the following structure.

That is, the 3D_CC field indicates 3D audio channel count information, and the ACAST field indicates the audio channel assignment standard type (ACAST) provided by the source.

Table 49 indicates the audio channel according to the 3D_CC value, and Table 52 indicates the audio channel allocation standard type according to the ACAST field value.

The table below indicates the payload of the audio relay data packet for multi-streaming audio. If 3D_Audio=0, the relay data packet payload has the following structure.

As illustrated in Table 51 above, the payload of the audio relay data packet includes a 5-byte audio relay data descriptor. The audio relay data descriptor (4 fields, 5 bytes per field) indicates audio relay data about the sub-packet X in the multi-stream audio sample packet or a multi-stream one-tone audio sample packet The audio relay data of the sub-packet X. An audio according to an exemplary embodiment will be described below. The structure of the relay data descriptor.

The description of each field is as follows.

Emergency channel (Emergency_Channel) [1 bit]: If Emergency_Channel=1, the emergency alert audio data is transmitted corresponding to the audio stream. The receiving device can notify that there is an emergency broadcast via a script or the like, and the user can output an emergency warning audio signal received via the selection of the audio.

Multi-view field (left) (MultiView_Left) [1 bit]: If Multiview_Left=1, the corresponding audio stream is mapped to the left stereo image of the 3D video format. If Multiview_Left=0, the field can be valid only when NUM_VIEWS=01.

If Multiview_Right=1, the corresponding stereo stream is mapped to the right stereo image of the 3D video format. If Multiview_Right=0, the field can be valid only when NUM_VIEWS=01.

Language code valid field (LC_Valid) [1 bit]: If LC_Valid=1, the language code is valid and the language corresponding to the audio stream is accurately recognized. Otherwise, the language corresponding to the audio stream is considered unspecified.

Supplemental audio valid field (Suppl_A_Valid) [1 bit]: If Suppl_A_Valid=1, the corresponding audio stream includes the supplementary track indicated by Suppl_A_Type.

Pre-mixed supplemental audio field (Suppl_A_Mixed) [1 bit]: If Suppl_A_Mixed=1, the corresponding audio stream may include pre-mixed supplemental audio tracks indicated by the primary audio component and Suppl_A_Type. The bit is only valid when Suppl_A_Valid=1.

The Supplemental Audio Type field (Suppl_A_Type) [3 bits] indicates the supplementary audio type defined in Table 55 below. The field is valid only when Suppl_A_Valid=1. Table 53 indicates a description of the supplemental audio type field values.

Language (Language_Code) [3 bytes] identifies the language of the corresponding audio stream. The language code is defined by ISO 639. In addition, three character codes are located, and the last character code is identical to the last byte of the audio relay data descriptor X (Audio_Metadata_Descriptor_X). This field can only be valid when LC_Valid=1.

Referring back to FIG. 9, the data transmission system 1000-2 according to another exemplary embodiment includes a material transfer device 100-2 and a material receiving device 200-2.

The data transfer device 100-2 generates an audio relay data packet and transmits the generated audio relay data packet to the data receiving device 200-2.

The data receiving device 200-2 receives the audio relay data packet from the data transmitting device 100-2.

In this case, the header of the audio relay data packet includes a 3D audio field indicating whether to transmit the 3D audio sample packet.

Hereinafter, the configuration of the material transfer device 100-2 and the data receiving device 200-2 and the configuration of the audio relay data packet will be described in more detail.

Referring back to FIG. 10, the material transfer device 100-2 according to another exemplary embodiment includes a packet generator 110 and a transfer unit 120.

The packet generator 110 generates an audio relay data packet. The header of the generated audio relay data packet may include a 3D audio field indicating whether to transmit the 3D audio sample packet.

The transmitting unit 120 transmits the generated audio relay data packet to the data receiving device 200-2.

In addition, the header of the generated audio relay data packet may further include an audio stream number field (number field of the audio stream) indicating the number of audio stream information.

In addition, the header of the generated audio relay data packet may further include a view number field (the number of views) indicating information about the number of different contents transmitted. Field.

The payload of the generated audio relay data packet may include an audio relay data descriptor field indicating relay data for a plurality of streams of audio sample packets or a plurality of streams of one-to-one audio sample packets.

The audio relay data descriptor field includes at least one of: an emergency channel field indicating whether there is an emergency broadcast; and whether the audio data corresponding to the left eye image or the right eye image is included in the multiview. a view field; a language code valid field indicating whether the language of the audio material is recognized; a supplementary audio valid field indicating whether the supplementary audio material is present; and a pre-mixed supplementary audio field indicating whether the main audio material and the supplementary audio material are pre-mixed; a supplementary audio type field indicating the type of the supplemental audio material; and a language code field indicating the language code of the audio material.

Referring back to FIG. 11, the data receiving apparatus 200-2 according to another exemplary embodiment includes a receiver 210 and a parsing unit 220.

The receiver 210 is a component for receiving an audio relay data packet from the data transfer device 100-2. The header of the audio relay data packet includes a 3D audio field indicating whether to transmit a 3D audio sample packet.

The parsing unit 220 is a component for parsing the received audio relay data packet.

In addition, the header of the audio relay data packet may further include an audio stream number field (number field of audio streams) indicating information about the number of received audio streams.

The header of the audio relay data packet may further include a view number field (number of fields of view) indicating information about the number of different content received.

The payload of the audio relay data packet may include an audio relay data descriptor field indicating relay data for a plurality of streams of audio sample packets or a plurality of streams of one-to-one audio sample packets.

In this case, the audio relay data descriptor field includes at least one of: an emergency channel field indicating whether there is an emergency broadcast; and whether the audio data corresponding to the left eye image or the right eye image is included in the Multi-view field in multi-view; language code valid field indicating whether to identify the language of the audio material; supplementary audio valid field indicating whether there is supplementary audio data; pre-mixing indicating whether the main audio material and supplementary audio data are pre-mixed a supplemental audio field; a supplementary audio type field indicating the type of the supplemental audio material; and a language code field indicating the language code of the audio material.

Audio data block

Table 54 below indicates an audio data block of Extended Display Identification Data (EDID) according to an exemplary embodiment. Portions regarding the bytes 3 through 4 in Table 54 will be redefined in Table 57 below.

In addition, a new short audio descriptor (SAD) for multi-streaming audio is deleted and the normal SAD defined in the EDID is used instead. Up to two channels can be transmitted depending on the features added.

The table below indicates the configuration of the blocks replacing the bytes 3 to 4 of the above audio data block.

The description of each field is as follows.

Emergency channel field (Supports_MS_Emergency) [1 bit]: If Supports_MS_Emergency=1, the collection slot device supports receiving and processing the emergency warning audio channel. If Supports_MS_Emergency=0, the collection slot device does not support the above operations.

Audio Mixing Field (Supports_MS_Mix) [1 bit]: If Supports_MS_Mix=1, the collection slot device supports combining the main audio and supplementary audio. If Supports_MS_Mix=0, the collection slot device does not support the combination and only supports regenerative mixed audio.

Supplemental Audio Support Field (Supports_MS_Supple) [1 bit]: If Supports_MS_Supple=1, the collection slot device supports multi-stream audio with supplemental audio tracks for visual/hearing impaired people. If Supports_MS_Supple=0, no content is indicated, or the collection slot device is not supported for supplemental audio tracks for visual/hearing impaired persons.

Language Support Field (Supports_MS_Lang) [1 bit]: If Supports_MS_Lang=1, the collection slot device supports multiple streams of audio with various language audio streams. If Supports_MS_Lang=0, no content is indicated, or the collection slot device does not support audio streaming in various languages.

Multi-view audio support field (Supports_MS_MultiView) [1 bit]: If Supports_MS_MultiView=1, the collection slot device supports multi-view Multi-stream audio of video streaming. If Supports_MS_MultiView=0, no content is indicated, or the collection slot device is not supported for multi-stream audio for multi-view video streaming.

The maximum stream count field (Max_Stream_Count-1) [2 bits] indicates the maximum number of audio streams handled by the collection slot device. The Max_Stream_Count-1 value is described in the following table.

The number of audio descriptor fields (NUM_HDMI_3D_AD) [3 bits] indicates the number of 3D audio descriptors.

Referring back to FIG. 12, the data transmission system 1000-3 according to still another exemplary embodiment includes a material transfer device 100-3 and a material receiving device 200-3.

The data transfer device 100-3 generates display identification information including information on the nature of the audio material supported by the collection slot device, and transmits the generated information to the data receiving device 200-3.

The data receiving device 200-3 receives display identification information from the data transmitting device 100-3 and analyzes the information. In this case, the display identification information includes the main information indicating the main audio supported by the collection slot device and the nature of the supplementary audio. Supplement the audio nature field.

Hereinafter, the material transfer device 100-3 and the material receiving device 200-3 will be described in more detail.

Referring back to FIG. 13, the material transfer device 100-3 according to still another exemplary embodiment includes a generator 130 and a transfer unit 120.

The generator 130 is a component for generating display identification information including information about the nature of the audio material supported by the collection slot device.

The transmitting unit 120 transmits the display identification information to the material receiving device 200-3.

In this case, the display identification information includes a primary/supplemental audio property field indicating information about the primary audio supported by the collection slot device and the nature of the supplemental audio.

In this case, the primary/audio nature field includes at least one of the following: an audio mixing field indicating whether the collection slot device supports a combination of primary audio and supplemental audio; and a supplement indicating whether the collection slot device supports supplementary audio. Audio support field; a language support field indicating whether the collection slot device supports audio data in multiple languages; a multi-view audio support field indicating whether the collection slot device supports multi-stream audio data of multi-view content; indication by the collection slot The maximum stream count field of the maximum number of audio streams handled by the device; and the number of audio descriptor fields indicating the number of 3D audio descriptors.

The display identification information may further include an emergency channel field indicating whether the collection slot device supports reception and processing of emergency broadcasts.

Referring back to FIG. 14, the material transfer device 100-3 according to still another exemplary embodiment includes a receiver 210 and an analysis unit 230.

The receiver 210 is means for receiving display identification information including information on the nature of the audio material supported by the collection slot device from the material transfer device 100-3.

The analyzing unit 230 analyzes the received display identification information.

In this case, the display identification information includes a primary/supplemental audio property field indicating information about the primary audio supported by the collection slot device and the nature of the supplemental audio.

In this case, the primary/audio nature field includes at least one of the following: an audio mixing field indicating whether the collection slot device supports a combination of primary audio and supplemental audio; and a supplement indicating whether the collection slot device supports supplementary audio. Audio support field; a language support field indicating whether the collection slot device supports audio data in multiple languages; a multi-view audio support field indicating whether the collection slot device supports multi-stream audio data of multi-view content; indication by the collection slot The maximum stream count field of the maximum number of audio streams handled by the device; and the number of audio descriptor fields indicating the number of 3D audio descriptors.

The display identification information may further include an emergency channel field indicating whether the collection slot device supports reception and processing of emergency broadcasts.

Meanwhile, the wired interface according to various exemplary embodiments can support the transfer of four-view content. The HDMI cable interface standard 3D video format standard is available for four-view transmission.

18A through 18C are views illustrating various data transfer formats when four-view video content is transmitted in a 3D interlaced format, in accordance with one or more exemplary embodiments.

In this case, the vendor-specific information frame and the vendor-specific data block can be modified. In particular, the prior art field extensions used to define the 3D dual view are up to the reserved area.

Hereinafter, a data transmission method according to various exemplary embodiments will be described.

19 is a flowchart of a data transfer method, according to an exemplary embodiment, and FIG. 20 is a flowchart of a data receiving method, according to an exemplary embodiment.

Referring to FIG. 19, a data transfer method according to an exemplary embodiment includes generating an audio relay data packet (operation S1710); and transmitting the generated audio relay data packet to the data receiving device (operation S1720). In this case, the header of the generated audio relay data packet includes a split screen information field for the audio data represented by the audio relay data packet.

In addition, the split screen information field may include at least one of: a split screen valid field indicating whether to support split screen; and a split screen type column indicating a type of split screen regarding the transmitted audio material Bit.

Additionally, the split screen type field may indicate one of: a first split mode in which the display screen is horizontally divided; a second split mode in which the display screen is vertically divided; a PIP screen on the display screen a third split mode displayed therein; and a fourth split mode in which the display screen is divided into three or more screens.

The header of the generated audio relay data packet may include at least one of: a view type field indicating whether the transmitted content is multi-view content or single-view content; indicating the audio a sequence number field following the sequence number of the data packet; and an audio stream number field indicating information about the number of transmitted audio streams.

The payload of the generated audio relay data packet may include a multi-tone descriptor field indicating relay material for the sub-packet of the multi-audio sample packet.

The multi-audio descriptor may include at least one of: indicating a segmentation corresponding to audio data represented by the generated audio relay data packet a split screen label field of the screen information; an associated view ID field indicating a view corresponding to the audio material represented by the generated audio relay data packet; indicating whether the multi-audio descriptor field includes a valid language a valid language code field of the code; a mixed audio field indicating whether the primary audio material and the supplementary audio material are pre-mixed; and a SAT presence field indicating whether the multi-audio descriptor field includes information about a type of valid supplementary audio material a supplementary audio type field indicating a type of the supplemental audio material of the audio data represented by the generated audio relay data packet; and an ISO 639 definition indicating the audio data represented by the generated audio relay data packet The language code field of the language code.

Referring to FIG. 20, a data receiving method according to an exemplary embodiment includes receiving an audio relay data packet from a data transmitting device (operation S1810); and parsing the received audio relay data packet (operation S1820). In this case, the header of the received audio relay data packet includes a split screen information field for audio data represented by the audio relay data packet.

In addition, the split screen information field may include at least one of: a split screen valid field indicating whether to support split screen; and a split screen type column indicating a type of split screen regarding the transmitted audio material Bit.

The split screen type field may indicate one of: a first split mode in which the display screen is horizontally divided; a second split mode in which the display screen is vertically divided; a PIP screen is displayed in the display screen a third split mode; and a fourth split mode in which the display screen is split into three or more screens.

The header of the generated audio relay data packet may further include At least one of the following: a view type field indicating whether the transmitted content is multi-view content or single-view content; a sequence number field indicating a serial number of the audio relay data packet; and an indication about the transmitted audio The number of streams of information for the number of streams of information.

The payload of the generated audio relay data packet may include a multi-tone descriptor field indicating relay material for the sub-packet of the multi-audio sample packet.

21 is a flowchart of a data transfer method according to another exemplary embodiment, and FIG. 22 is a flowchart of a data receiving method according to another exemplary embodiment.

Referring to FIG. 21, a data transfer method according to another exemplary embodiment includes generating a packet including a plurality of sub-packets regarding a multi-audio stream (operation S1910), and transmitting the generated packet to a receiving device (operation S1920) . In this case, the header of the generated packet includes a sequence number field for identifying the order of the generated packets in all packets.

Referring to FIG. 22, a data transfer method according to another exemplary embodiment includes receiving a packet including a plurality of sub-packets regarding a multi-audio stream (operation S2010), and parsing the received packet (operation S2020). In this case, the header of the received packet includes a sequence number field for identifying the order of the generated packets in all packets.

23 is a flowchart of a data transfer method according to still another exemplary embodiment, and FIG. 24 is a flowchart of a data receiving method according to still another exemplary embodiment.

Referring to FIG. 23, a data transfer method according to still another exemplary embodiment includes generating information including information about properties of audio data supported by a collection slot device. The component capability information block (operation S2110), and transmitting the component capability information block to the data receiving device (operation S2120). In this case, the component capability information block includes a split screen audio field indicating whether the collection slot device supports reception and processing of multi-tones on the split screen.

Referring to FIG. 24, a data receiving method according to still another exemplary embodiment includes receiving an element capability information block including information on a property of an audio material supported by a collecting slot device (operation S2210), analyzing the received component. Capability information block (operation S2220). In this case, the component capability information block includes a split screen audio field indicating whether the collection slot device supports reception and processing of multi-tones on the split screen.

The illustrative embodiments may be embodied as computer readable code on a computer readable recording medium, but are not limited thereto. A computer readable recording medium is any data storage component that can store data that can be thereafter read by a computer system. Examples of the computer readable recording medium include read-only memory (ROM), random-access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage elements. The computer readable recording medium can also be distributed over a computer system coupled to the network so that the computer readable code is stored and executed in a distributed manner. The illustrative embodiments can also be written as a computer program that is transmitted via a computer readable transmission medium (such as a carrier wave) and received and executed in a general purpose or special purpose computer that executes the program. In addition, it should be understood that in an exemplary embodiment, one or more of the above-described devices and one or more units or components of the system can include circuitry, a processor, a microprocessor, etc., and can execute a computer stored in a computer readable medium. Program. For example, The computer program can include one or more algorithms corresponding to the methods described above.

The foregoing illustrative embodiments and advantages are merely illustrative and are not to be construed as limiting. The teachings of the present invention can be readily applied to other types of devices. The description of the exemplary embodiments of the present invention is intended to be illustrative, and is not intended to

100-2‧‧‧ data transfer device

110‧‧‧Package Generator

120‧‧‧Transfer unit

Claims (14)

A data transmission device includes: a packet generator for generating an audio relay data packet; and a transmitting unit configured to transmit the generated audio relay data packet to the data receiving device, wherein the generated audio message The header of the relay data packet includes a split screen information field for the audio data represented by the generated audio relay data packet. The device of claim 1, wherein the split screen information field comprises at least one of: a split screen valid field indicating whether to support split screen; and an indication about the transmitted audio material The split screen type field of the split screen type. The device of claim 2, wherein the split screen type field indicates one of: a first split mode in which the display screen is divided left and right; and a second screen in which the display screen is divided up and down a split mode; a third split mode in which the mother screen is displayed in the display screen; and a fourth split mode in which the display screen is divided into three or more screens. The device of claim 1, wherein the header of the generated audio relay data packet further comprises at least one of: indicating whether the transmitted content is multi-view content or a view type field of the view content; a sequence number field indicating the serial number of the audio relay data packet; and an audio stream number field indicating information about the number of the transmitted audio stream. The device of claim 1, wherein the payload of the generated audio relay data packet comprises a multi-tone descriptor field indicating relay data for a sub-packet of the multi-tone sample packet. The apparatus of claim 5, wherein the multi-tone descriptor comprises at least one of: a split screen indicating audio data corresponding to the generated audio relay data packet a split screen label field of information; an associated view identification field indicating a view corresponding to the audio material represented by the generated audio relay data packet; indicating whether the multi-tone descriptor field contains a valid language code a valid language code field; a mixed audio field indicating whether the primary audio material and the supplementary audio material are pre-mixed; and a SAT presence field indicating whether the multi-audio descriptor field contains information about a type of valid supplementary audio material; a supplementary audio type field indicating a type of the supplemental audio material of the audio data represented by the generated audio relay data packet; and an ISO 639 definition indicating the audio data represented by the generated audio relay data packet The language code field of the language code. A data receiving device includes: a receiver for receiving an audio relay data packet from a data transmitting device; and a parsing unit for parsing the received audio relay data packet, wherein the received audio relay The header of the data packet includes a split screen information field for the audio material represented by the received audio relay data packet. A data collection system comprising: a data transmitting device for generating an audio relay data packet and transmitting the generated audio relay data packet to the data receiving device; and the data receiving device for receiving the audio from the data transmitting device Following the data packet, the header of the audio relay data packet includes a split screen information field for the audio data represented by the audio relay data packet. A data transfer apparatus comprising: a packet generator for generating a packet including a plurality of sub-packets for a multi-audio stream; and a transmitting unit for transmitting the generated packet to a receiving device, wherein the generating The header of the packet includes a sequence number field for identifying the order of the generated packets in all packets. A data receiving apparatus includes: a receiver for receiving a packet including a plurality of sub-packets for a multi-audio stream; and a parsing unit for parsing the received packet, wherein a header of the received packet A sequence number field is included for identifying the order of the generated packets in all packets. A data transmission system, comprising: a data transmission device, configured to generate a packet including a plurality of sub-packets for a multi-audio stream and transmit the generated packet to a data receiving device; and the data receiving device Receiving from the data transfer device includes the The transmitted packet of the plurality of sub-packets, wherein the header of the received packet includes a sequence number field for identifying an order of the generated packets in all packets. A data transfer device comprising: a generator for generating a component capability information block including information about a property of the audio material supported by the collection slot device; and a transfer unit for using the generated component capability information The block is transmitted to the data receiving device, wherein the generated component capability information block includes a split screen audio field indicating whether the sink device supports reception and processing of the multi-audio data of the split screen. A data receiving apparatus comprising: a receiver for receiving a component capability information block including information about a property of the audio material supported by the collection slot device; and an analyzing unit for analyzing the received component capability information And a block, wherein the received component capability information block includes a split screen audio field indicating whether the collection slot device supports reception and processing of multi-audio data for the split screen. A data transmission system comprising: a data transmission device for transmitting a component capability information block including information about a property of the audio material supported by the collection slot device to the data receiving device; a data receiving device, configured to receive the transmitted component capability information block from the data transfer device, wherein the component capability information block includes a message indicating whether the collection slot device supports receiving of multi-audio data about a split screen And processed split screen audio fields.