CN104221402A - Data transmitting apparatus, data receiving apparatus, data transreceiving system, data transmitting method, data receiving method and data transreceiving method - Google Patents
Data transmitting apparatus, data receiving apparatus, data transreceiving system, data transmitting method, data receiving method and data transreceiving method Download PDFInfo
- Publication number
- CN104221402A CN104221402A CN201380020188.XA CN201380020188A CN104221402A CN 104221402 A CN104221402 A CN 104221402A CN 201380020188 A CN201380020188 A CN 201380020188A CN 104221402 A CN104221402 A CN 104221402A
- Authority
- CN
- China
- Prior art keywords
- audio
- data
- stream
- exemplary embodiment
- grouping
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims description 37
- 238000005070 sampling Methods 0.000 claims description 86
- 230000005236 sound signal Effects 0.000 claims description 44
- 230000005540 biological transmission Effects 0.000 claims description 35
- 230000000875 corresponding effect Effects 0.000 description 30
- 239000003550 marker Substances 0.000 description 19
- 230000006870 function Effects 0.000 description 18
- 230000008859 change Effects 0.000 description 17
- 230000000694 effects Effects 0.000 description 7
- 230000008901 benefit Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 6
- 238000009826 distribution Methods 0.000 description 6
- 230000008929 regeneration Effects 0.000 description 6
- 238000011069 regeneration method Methods 0.000 description 6
- 230000004069 differentiation Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 238000012856 packing Methods 0.000 description 3
- 239000003795 chemical substances by application Substances 0.000 description 2
- 241000208340 Araliaceae Species 0.000 description 1
- 101100018996 Caenorhabditis elegans lfe-2 gene Proteins 0.000 description 1
- WJXSXWBOZMVFPJ-NENRSDFPSA-N N-[(2R,3R,4R,5S,6R)-4,5-dihydroxy-6-methoxy-2,4-dimethyloxan-3-yl]-N-methylacetamide Chemical compound CO[C@@H]1O[C@H](C)[C@@H](N(C)C(C)=O)[C@@](C)(O)[C@@H]1O WJXSXWBOZMVFPJ-NENRSDFPSA-N 0.000 description 1
- 235000005035 Panax pseudoginseng ssp. pseudoginseng Nutrition 0.000 description 1
- 235000003140 Panax quinquefolius Nutrition 0.000 description 1
- 241000718541 Tetragastris balsamifera Species 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 235000008434 ginseng Nutrition 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000011112 process operation Methods 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R5/00—Stereophonic arrangements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
- H04N21/4363—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network
- H04N21/43632—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network involving a wired protocol, e.g. IEEE 1394
- H04N21/43635—HDMI
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/003—Details of a display terminal, the details relating to the control arrangement of the display terminal and to the interfaces thereto
- G09G5/006—Details of the interface to the display terminal
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04H—BROADCAST COMMUNICATION
- H04H20/00—Arrangements for broadcast or for distribution combined with broadcast
- H04H20/28—Arrangements for simultaneous broadcast of plural pieces of information
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04H—BROADCAST COMMUNICATION
- H04H20/00—Arrangements for broadcast or for distribution combined with broadcast
- H04H20/28—Arrangements for simultaneous broadcast of plural pieces of information
- H04H20/30—Arrangements for simultaneous broadcast of plural pieces of information by a single channel
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04H—BROADCAST COMMUNICATION
- H04H20/00—Arrangements for broadcast or for distribution combined with broadcast
- H04H20/44—Arrangements characterised by circuits or components specially adapted for broadcast
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04H—BROADCAST COMMUNICATION
- H04H20/00—Arrangements for broadcast or for distribution combined with broadcast
- H04H20/44—Arrangements characterised by circuits or components specially adapted for broadcast
- H04H20/46—Arrangements characterised by circuits or components specially adapted for broadcast specially adapted for broadcast systems covered by groups H04H20/53-H04H20/95
- H04H20/47—Arrangements characterised by circuits or components specially adapted for broadcast specially adapted for broadcast systems covered by groups H04H20/53-H04H20/95 specially adapted for stereophonic broadcast systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04H—BROADCAST COMMUNICATION
- H04H20/00—Arrangements for broadcast or for distribution combined with broadcast
- H04H20/44—Arrangements characterised by circuits or components specially adapted for broadcast
- H04H20/46—Arrangements characterised by circuits or components specially adapted for broadcast specially adapted for broadcast systems covered by groups H04H20/53-H04H20/95
- H04H20/47—Arrangements characterised by circuits or components specially adapted for broadcast specially adapted for broadcast systems covered by groups H04H20/53-H04H20/95 specially adapted for stereophonic broadcast systems
- H04H20/48—Arrangements characterised by circuits or components specially adapted for broadcast specially adapted for broadcast systems covered by groups H04H20/53-H04H20/95 specially adapted for stereophonic broadcast systems for FM stereophonic broadcast systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04H—BROADCAST COMMUNICATION
- H04H20/00—Arrangements for broadcast or for distribution combined with broadcast
- H04H20/44—Arrangements characterised by circuits or components specially adapted for broadcast
- H04H20/46—Arrangements characterised by circuits or components specially adapted for broadcast specially adapted for broadcast systems covered by groups H04H20/53-H04H20/95
- H04H20/47—Arrangements characterised by circuits or components specially adapted for broadcast specially adapted for broadcast systems covered by groups H04H20/53-H04H20/95 specially adapted for stereophonic broadcast systems
- H04H20/49—Arrangements characterised by circuits or components specially adapted for broadcast specially adapted for broadcast systems covered by groups H04H20/53-H04H20/95 specially adapted for stereophonic broadcast systems for AM stereophonic broadcast systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04H—BROADCAST COMMUNICATION
- H04H20/00—Arrangements for broadcast or for distribution combined with broadcast
- H04H20/86—Arrangements characterised by the broadcast information itself
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04H—BROADCAST COMMUNICATION
- H04H20/00—Arrangements for broadcast or for distribution combined with broadcast
- H04H20/86—Arrangements characterised by the broadcast information itself
- H04H20/88—Stereophonic broadcast systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/22—Parsing or analysis of headers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/439—Processing of audio elementary streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S3/00—Systems employing more than two channels, e.g. quadraphonic
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2370/00—Aspects of data communication
- G09G2370/04—Exchange of auxiliary data, i.e. other than image data, between monitor and graphics controller
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2370/00—Aspects of data communication
- G09G2370/12—Use of DVI or HDMI protocol in interfaces along the display data pipeline
Abstract
A data transmitting apparatus includes a packet generator which generates a plurality of packets regarding multi-channel audio sample data and a transmitter which transmits the plurality of generated packets to a data receiving apparatus. Each of the plurality of packets includes an identifier field to distinguish a position or an order of the packets.
Description
Technical field
The apparatus and method consistent with exemplary embodiment disclosed herein relate to data source and sink and method, and more specifically, relate in wireline interface environment, send multi-channel audio signal data sending device, data sink, data receiving-transmitting system, data transmission method for uplink, data receive method and data receiving-transmitting method.
Background technology
Because multimedia environment is implemented, the various wireline interface environment for sending data are therefore proposed.Such as, HDMI (High Definition Multimedia Interface) (HDMI) and mobile high definition link (MHL) define the transmission standard of the video data of various form, audio signal and control signal.Especially, according to the development of multimedia environment, the transmission standard of multi-channel audio signal is discussed energetically, to realize the transmission of high quality sound.
Up to the present, the standard about the voice-grade channel of 2 to 8 passages is suggested.But, in multimedia environment, may need to have the transmission standard of 9 or audio signal more than 9 passages.When transmitting multi-channel audio signal, various form and the facility environment of conventional use should be considered.
Summary of the invention
Technical problem
Other shortcomings that exemplary embodiment can overcome above-mentioned shortcoming and not describe above.And exemplary embodiment does not need to overcome above-mentioned shortcoming, and exemplary embodiment can not overcome above-mentioned any problem.
Technical scheme
Propose exemplary embodiment to solve the problem, and the one side of exemplary embodiment provides a kind of data sending device, it can comprise: packet generator, and it generates the multiple groupings about multi-channel audio sampled data; And transmitter, generated multiple groupings are sent to data sink by it.Each in the multiple groupings generated can comprise distinguishes the position of described grouping or the identifier field of order.
Identifier field can comprise the predetermined bit whether grouping that instruction has this field is the first grouping of multi-channel audio sampled data.
Identifier field can comprise the predetermined bit that instruction has the packet index of identifier field.
Each in the multiple groupings generated can comprise at least one subgroup, and at least one subgroup described stores a part for multi-channel audio sampled data.
Each in the multiple groupings generated can comprise at least one that sampling exists in bit (sample present bit) and the flat bit of sampling (sample flat bit), there is bit instruction at least one subgroup described and whether have multi-channel audio sampled data in described sampling, and whether the audio sampling data that described sampling flat bit instruction subgroup comprises is effective.
Each in the multiple groupings generated can comprise multiple subgroup, and each in multiple subgroup can store a part for multi-channel audio sampled data.
Multi-channel audio sampled data can comprise the audio signal of 9 or more passages.
Multi-channel audio sampled data can according to IEC 60958 format configuration.
According to the another aspect of exemplary embodiment, provide a kind of data sink, it can comprise: receiver, and it receives the multiple groupings about multi-channel audio sampled data sent from data sending device; And packet parsing device, it resolves the multiple groupings received.Each in the multiple groupings received can comprise distinguishes the position of described grouping or the identifier field of order.
Identifier field can comprise the predetermined bit whether grouping that instruction has an identifier field is the first grouping of multi-channel audio sampled data.
Each in the multiple groupings received can comprise at least one subgroup, and at least one subgroup described stores a part for multi-channel audio sampled data.
Each in the multiple groupings received can comprise at least one that sampling exists in bit and the flat bit of sampling, there is bit instruction at least one subgroup described and whether have multi-channel audio sampled data in described sampling, and whether the audio sampling data that described sampling flat bit instruction subgroup comprises is effective.
Each in the multiple groupings received can comprise multiple subgroup, and each in multiple subgroup can store a part for multi-channel audio sampled data.
Multi-channel audio sampled data can comprise the audio signal of 9 or more passages.
Multi-channel audio sampled data can according to IEC 60958 format configuration.
According to the another aspect of exemplary embodiment, provide data receiving-transmitting system, it can comprise: data sending device, and it generates the multiple grouping about multi-channel audio sampled data and sends the grouping generated; And data sink, it receives multiple grouping of transmission and resolves the grouping received.Each in multiple grouping can comprise distinguishes the position of described grouping or the identifier field of order.
Identifier field can comprise the predetermined bit whether grouping that instruction has an identifier field is the first grouping of multi-channel audio sampled data.
According to the another aspect of exemplary embodiment, provide a kind of data transmission method for uplink, its can comprise generate about multi-channel audio sampled data multiple grouping and generated multiple groupings are sent to data sink.Each in the multiple groupings generated can comprise distinguishes the position of described grouping or the identifier field of order.
Identifier field can comprise the predetermined bit whether grouping that instruction has an identifier field is the first grouping of multi-channel audio sampled data.
According to the another aspect of exemplary embodiment, provide a kind of data receive method, it can comprise the multiple groupings about multi-channel audio sampled data receiving and send from data sending device, and resolves the multiple groupings received.Each in the multiple groupings received can comprise distinguishes the position of described grouping or the identifier field of order.
Identifier field can comprise the predetermined bit whether grouping that instruction has an identifier field is the first grouping of multi-channel audio sampled data.
According to the another aspect of exemplary embodiment, provide a kind of data receiving-transmitting method, it can comprise display identification data (the Extended Display Identification Data sending expansion from first device to the second device, EDID) block, EDID block comprises at least one in the second sub-block of the first sub-block of the 3D audio frequency characteristics of instruction multichannel audio data and the 3D loud speaker assignment information of instruction multichannel audio data; Send metadata groupings from the second device to first device, it comprises at least one in the 3D passage/loud speaker allocation field of voice-grade channel allocation criterion type (ACAT) field of the channel allocation type of instruction multichannel audio data, the channel counts field of instruction number of active lanes and instruction passage/loud speaker assignment information; The grouping of at least one multi-channel audio sampled data is sent from the second device to first device; And the multi-channel audio sampled data grouping sent at least one in first device performs parsing and carrys out output audio based on the multi-channel audio sampled data grouping that at least one through resolving sends.The grouping of at least one multi-channel audio sampled data can comprise multiple subgroup and distinguish the position of multiple subgroup or the identifier field of order.
According to the another aspect of exemplary embodiment, provide a kind of data receiving-transmitting method, it can comprise display identification data (EDID) block sending expansion from first device to the second device, and EDID block comprises the sub-block of the multi-stream audio feature of instruction multichannel audio data; Send the grouping of audio-frequency information frame from the second device to first device, it comprises at least one in the channel counts field of the number of active lanes of instruction multichannel audio data and the passage/loud speaker allocation field of instruction passage/loud speaker assignment information; The grouping of at least one audio sampling data is sent from the second device to first device; And the audio sampling data grouping sent at least one in first device performs parsing and carrys out output audio based at least one audio sampling data grouping through resolving.The grouping of at least one audio sampling data can comprise multiple subgroup, and multiple subgroup can comprise the voice data corresponding with the arbitrary content in multiple content.
Technique effect
According to above-mentioned various exemplary embodiment, exemplary embodiment can generate the multiple groupings about multi-channel audio sampled data, wherein, each in the multiple groupings generated can comprise identifier field, and therefore provides the transmission standard of the audio signal had more than 9 passages.
Accompanying drawing explanation
Describe some exemplary embodiment by referring to accompanying drawing, above and/or other aspects of exemplary embodiment will be more obvious, in the accompanying drawings:
Fig. 1 shows the transmit timing of 3 dimensions (3D) audio signal;
Fig. 2 is the block diagram of the data receiving-transmitting system according to exemplary embodiment;
Fig. 3 is the block diagram according to the data sending device in the data receiving-transmitting system of exemplary embodiment;
Fig. 4 is the block diagram according to the data sink in the data receiving-transmitting system of exemplary embodiment;
Fig. 5 shows the transport stream of dividing into groups according to the audio sample of exemplary embodiment;
Fig. 6 shows the transport stream of dividing into groups according to the audio sample of another exemplary embodiment;
Fig. 7 shows the transport stream format according to exemplary embodiment;
Fig. 8 shows the transport stream of dividing into groups according to the audio sample of exemplary embodiment;
Fig. 9 and Figure 10 shows the transport stream of the multi-stream audio sampled packet according to exemplary embodiment;
Figure 11 shows the transport stream of the multi-stream audio sampled packet according to exemplary embodiment;
Figure 12 shows the operation sending loudspeaker position according to the use CEC of exemplary embodiment;
Figure 13 shows operation 3D audio sample being sent to TV from BDP according to exemplary embodiment;
Figure 14 shows operation multi-stream audio being sent to TV from BDP according to exemplary embodiment;
Figure 15 shows and arranges according to the loud speaker for 3D voice-grade channel of exemplary embodiment;
Figure 16 to Figure 19 is to provide the flow chart according to the data transmission method for uplink of various exemplary embodiment and the explanation of data receive method.
Embodiment
Some exemplary embodiment is described in detail now with reference to accompanying drawing.
In the following description, even if in different drawings, identical reference marker is also used to identical element.That define in description, such as detailed construction and element item is provided to contribute to complete understanding exemplary embodiment.Therefore, it is evident that, exemplary embodiment can realize when the item not having these specifically to define.In addition, known function or structure is not described in detail, because they can with the fuzzy exemplary embodiment of unnecessary details.
" multi-channel audio " represents to have 2 with the audio signal of upper channel as the term is employed herein.In the following description of exemplary embodiment, multi-channel audio is divided into 2 dimensions (2D) voice-grade channel and 3 dimension (3D) voice-grade channels." 2D voice-grade channel " has the multiple voice-grade channels of 2 passages to 8 passages, and represents such voice-grade channel, and wherein corresponding with each passage loud speaker is placed in the plane.On the other hand, have at " 3D voice-grade channel " and comprise 9 with multiple voice-grade channels of upper channel, and the loud speaker corresponding with each passage is placed in the 3 d space.
For example, exemplary embodiment can be used in TTA (10.2ch), and in SMPTE2036-2 (22.2ch) or IEC62574 (30.2ch), the use channel layout of definition realizes 3D audio frequency.3D audio frequency can comprise downmix as herein defined (down mix) audio stream.
Term " multi-stream audio " represents such audio signal, and it has the audio signal be classified accordingly with each view in multi views environment, can watch two or more distinguishing contents in described multi views environment.The audio signal of each view can be multi-channel audio.Such as, if support multi-view video, such as play with dual-view or four views are played the multi-view video be associated, then multi-stream audio can be a class audio frequency stream relevant to the video flowing that use 3D video format sends.
Hereinafter, by based on the audio extension from HDMI1.4b specification, have 9 to 32 (or more) the 3D audio frequency of passage and the multi-stream audio for multi view display device, explain exemplary embodiment.The more important thing is, comprise change described below to support new audio frequency characteristics.
But, because exemplary embodiment can be applied to the transmission standard of various wireline interface, mobile high definition link (MHL) standard within the equivalent scope of such as the art and high-definition media interface (HDMI) standard, so exemplary embodiment described below also can be effective in similar wireline interface transmission standard.
Description below, by be described through the HDMI grouping that data islands (data island) period sends new definition (comprising the grouping of 3D audio sample, the grouping of 3D mono-bit audio sampled packet, audio metadata, multi-stream audio sampled packet and multithread one bit audio sampled packet), for the definition of the packing process of grouping and the HDMI audio data block in extending display identification data (E-EDID) with the discovery feature of support according to new feature.Unless otherwise defined herein, according to exemplary embodiment, described specification substantially according to HDMI1.4b, and does not change HDMI1.4b.
The explanation contrary with HDMI1.4b can be replaced by the feature of following new definition, but other explanations can consistent with HDMI1.4b.Described specification refers to following specification.
HDMI, HDMI Licensing, LLC, High-Definition Multimedia Interface Specification Version 1.4b, on October 11st, 2011
TTA, TTAK.KO-07.0098, Audio Signal Formats for Ultra High Definition (UHD) Digital TV, on December 21st, 2011
SMPTE,SMPTE?2036-2:2008,UHDTV?Audio?characteristics?and?audio?channel?mapping?for?program?production,2008
IEC, IEC 62574ed.1.0, Audio, video and multimedia systems General channel assignment of multichannel audio, on April 7th, 2011
MHL, LLC, Mobile High-definition Link version in February, 2.0,2012
* TTA: Telecommunications Technology Association (Telecommunications Technology Association)
general introduction
Elementary audio function comprises to sample rate the relevant function of linear pulse code modulation (L-PCM) audio stream of the IEC 60958 being 32kHz, 44.1kHz or 48kHz.This audio stream can comprise ordinary stereo acoustic streaming.Alternatively, HDMI can send the audio frequency with 3 to 32 voice-grade channels with the sample rate of 192kHz.HDMI can reach the IEC 61937 compressed format transmission audio stream of 49.152Mbps (such as, surround sound) with bit rate.HDMI can send a bit audio with 2 to 32 voice-grade channels and direct flow transmission (DST), that is, the bit audio in compressed format.HDMI can send 3D audio stream, and wherein loud speaker can be placed in the 3 d space Anywhere.3D audio stream can comprise at most 32 voice-grade channels, and it sent by dividing into groups continuously in the data islands period.If support multi-view video flow transmission (such as, having dual-view or the game of four views of multiple audio frequency in each view), then HDMI can send multiple audio stream.About this situation, four stereo audio stream can be supported.
data islands grouping (data island packet) definition
Save in packet header at the 5.3.1 of HDMI1.4b specification, table 5-8 can be replaced with following table.
Table 1-packet type
* for the grouping layout of InfoFrame (information frame), should with reference to 8.2 joints of HDMI 1.4b specification.
With reference to table 1, define new grouping from area 0 x0B to 0x0F.The grouping of 3D audio sample is defined in 0x0B.3D mono-bit audio sampled packet is defined in 0x0C.In addition, in 0x0D, define audio metadata grouping, in 0x0E, define multi-stream audio sampled packet, and in 0x0F, define multithread one bit audio sampled packet.The grouping of new definition will be described in detail below.
In addition, also the various interchangeable suggestion of not new definition grouping will be described.Grouping definition in table 1 will be called as the first exemplary embodiment.Various alternative suggestion will be called as the second exemplary embodiment, the 3rd exemplary embodiment, etc.Various alternative suggestion is described based on the difference with the first exemplary embodiment.
1-1.3D audio sample divides into groups
First exemplary embodiment
In the first exemplary embodiment, the 3D audio sample grouping of new definition can be used to send the 3D audio frequency of L-PCM form.As mentioned above, " 3D audio frequency " is defined as such audio frequency: wherein, loud speaker can according to 3D audio standard (such as, 10.2ch, 22.2ch, 30.2ch, or more) be placed on the position of determination in the 3 d space.
3D audio stream can comprise 32 (or more) voice-grade channels, and is sent by continuous print grouping in the data islands period.Each grouping can have nearly 8 voice-grade channels.Packet header can comprise sampling initial (sample-start) and sampling exists (sample-present) bit, and to notify the packet positions in (instruction) 3D audio sample, this will be described below.Following table display 3D audio sample packet header.
Table 2-3D audio sample packet header
Each field comprises following information.
Sample_start:[1 bit] instruction: if sampling initial is 1, then current group is first grouping of 3D audio sample.Therefore, sample_start indicates the beginning of 3D audio stream.Start-up portion and the described sampling of receiver (sink) differentiation sampling are initial.
Sample_start=1, except indicating the grouping of current 3D audio sample to be except first grouping of 3D audio sample, also indicates current 3D audio sample to divide into groups to be bundled to 8 voice-grade channels completely.But, if be sent out lower than the 3D audio frequency of 8 voice-grade channel downmixs, then only have 8 or less voice-grade channel can be packaged.Sample_start=0 indicates: current 3D audio sample grouping is the centre of 3D audio sample or last grouping, and comprises 8 or less voice-grade channel.Only can there is the setting of 5 effective sample_present bits of 3D audio sample grouping.
Sample_present.spX:[4 field, each field 1 bit] indicate subgroup X whether to comprise audio sample.Article one, 3D audio sampling data can be included in the grouping of two or more 3D audio sample, and the grouping of each 3D audio sample can have four subgroups.Therefore, each 3D audio sample packet header can have four samplings altogether and there is (sample-present) bit, and it corresponds to four subgroups.Each sample_present bit represents whether corresponding subgroup has a part for 3D audio sample.
Sample_flat.spX:[4 field, each field 1 bit] whether indicating subgroup X to refer to, flat wire (flatline) is sampled.If sample_present.spX is established, then it is effective.If do not have the audio available data finding to use at source place, then 4 sample_flat.spX bits can be established.When sample rate changes maybe when there is interim stream and interrupting, then can there is described foundation.If sample_flat.spX is established, then subgroup X still refers to sampling periods, but, do not comprise available voice data.Only when corresponding sample_present.spX bit is established, sample_flat.spX is just effective.
Send there is L-PCM audio frequency 9 to 32 passages (or more) a 3D audio sample (that is, frame is 5 to 16 IEC 60958 frames) time, the grouping of adjacent 3D audio sample can be utilized.
Table 3 shows effective sample_present bit value.
Table 3-is used for the effective sample_present bit configuration that 3D audio frequency sends
| sP0 | sP1 | sP2 | sP3 | describe |
| 0 | 0 | 0 | 0 | do not comprise the subgroup of the part of audio sample. |
| 1 | 0 | 0 | 0 | subgroup 0 is only had to comprise a part for audio sample |
| 1 | 1 | 0 | 0 | Subgroup 0 and 1 comprises two continuous parts of audio sample |
| 1 | 1 | 1 | 0 | Subgroup 0,1 and 2 comprises three continuous parts of audio sample |
| 1 | 1 | 1 | 1 | Subgroup 0,1,2 and 3 comprises four continuous parts of audio sample |
BX:[4 field, each field 1 bit] instruction: if subgroup X comprises by the first frame in 192 frames that IEC 60958 pieces is formed, then B.X=1.Otherwise, B.X=0.
The grouping of 3D audio sample comprises audio sample packet header as shown in table 2 and four subgroups.Each subgroup in the grouping of 3D audio sample has the 3D audio sampling data defined according to IEC 60958.
If source requires the downmix of 3D audio stream, then 3D audio sample can be used to divide into groups to send the audio stream of downmix.If 3D audio frequency do not supported by receiver, then source can not send the grouping of 3D audio sample.Be the scope that legacy audio form may exceed this specification by 3D audio conversion.Based on channel number, multiple subgroup layouts different from each other can be there are.Hereinafter, table 4 to table 6 indicates the example of the 3D audio packet layout for 12,24 and 32 passages respectively.
Table 4-is for the example of the 3D audio sample grouping layout of 12 passages
Table 5-is for the example of the 3D audio sample grouping layout of 24 passages
Table 6-is for the example of the 3D audio sample grouping layout of 32 passages (maximum)
Fig. 1 shows the timing sending 3D audio signal.
With reference to Fig. 1, in horizontal blanking interval, send each in three 2D sampled audio signals of 8 passages.In the identical duration that above transmission three 2D sampled audio signals use, send a sampling in the 3D audio signal of 24 passages.
Below, the data receiving-transmitting system 1000 according to the first exemplary embodiment will be described.
Fig. 2 is the block diagram of the configuration of the data receiving-transmitting system 1000 illustrated according to exemplary embodiment, Fig. 3 is the block diagram of the configuration of the data sending device 100 of the data receiving-transmitting system 1000 illustrated according to exemplary embodiment, and Fig. 4 is the block diagram of the configuration of the data sink 200 of the data receiving-transmitting system 1000 illustrated according to exemplary embodiment.
With reference to Fig. 2, comprise data sending device 100 and data sink 200 according to the data receiving-transmitting system 1000 of exemplary embodiment.
With reference to Fig. 3, comprise packet generator 110 and transmitter 120 according to the data sending device 100 of exemplary embodiment.
Packet generator 110 can generate the multiple groupings about multi-channel audio sampled data.As mentioned above, the multiple groupings about the audio sampling data with 9 passages or more passage can be generated.Each in the grouping generated can comprise its position of differentiation or the identifier field of sequence.
Identifier field can comprise the predetermined bit whether grouping that instruction has an identifier field is the first grouping of multi-channel audio sampled data.In the first exemplary embodiment, the example of sample_start bit whether can be grouping that instruction has an identifier field the be predetermined bit of the first grouping.
In addition, identifier field can comprise the predetermined bit that instruction has the index of the grouping of identifier field.This example changes from the first exemplary embodiment, and has the effect more effectively distinguishing grouping.
Generated multiple groupings are sent to data sink 200 by transmitter 120.
With reference to Fig. 4, comprise receiver 210 and packet parsing device 220 according to the data sink 200 of exemplary embodiment.
Receiver 210 can receive the multiple groupings about multi-channel audio sampled data sent from data sending device 100.Similarly, each in the multiple groupings received can comprise its position of differentiation or the identifier field of sequence.
Packet parsing device 220 performs the operation of resolving the multiple groupings received.
video relies on (video dependency)
Table 7 shows the sample rate of various video format timed sending 3D audio frequency that can be used for describing (also having description in D or E) in CEA-861-F.Suppose must be used for content protecting re-synchronization in the 58TMDS clock cycle of horizontal blanking interval.Send 3D audio frequency to be supported by the grouping of 3D audio sample.
Table 7 shows the maximum sample frequency of the 3D audio frequency for 24 bit video form timings.
Table 7-is for the maximum sample frequency of the 3D audio frequency of video format timing
Second exemplary embodiment
According to the second exemplary embodiment being different from the first execution mode, conventional audio sample packet format can be modified and use.
As shown in Table 8 below, the reserve area of conventional audio sample grouping can be used as segment_indicator (section designator).According to exemplary embodiment, segment_indicator can utilize two bits to represent.If segment_indicator=00, then indicate the first grouping.In addition, if segment_indicator=01, then instruction grouping is the strange grouping of intermediate packets, if segment_indicator=10, then instruction grouping is the idol grouping of intermediate packets, if segment_indicator=11, then instruction grouping is last idol grouping.In addition, above-mentioned identifier is only example, and can be different from the grouping of bits match.
No matter whether section is damaged, can find said structure.If a section is damaged, then n-th sampling with the section of damage can be dropped, or only has the audio sample of damage to divide into groups to be dropped.Independent audio sample grouping in the group that section indicates one or more audio sample to divide into groups to be divided into.
Layout (layout) instruction is about the information of the number of the sampling in HDMI1.4b and passage.Such as, an audio sample grouping can comprise four audio samples of two passages or an audio sample of 8 passages.Expand at this specification, the layout_ext field in conventional reserve area is created, and whether this instruction has been provided the information of layout about 3D audio frequency.
Such as, if layout_ext=0 and layout=0,1, then conventionally indicate the number of 2D audio sample and passage similarly.But, if layout_ext=1 and layout=0, then indicate 3D audio sample.If during layout_ext=1 and layout=1, then indicate multi-stream audio sampling.
Except specifically described field, other field in the second exemplary embodiment can be identical with the field in the first exemplary embodiment.
The audio sample grouping of table 8-amendment
Table 8-1segment_indicator field
| Segment_indicator | Describe |
| 00 | The initial segment Start_segment |
| 01 | Interlude (very) mid_segment (odd) |
| 10 | Interlude (idol) mid_segment (even) |
| 11 | Ending segment End_segment |
Relation between table 8-2layout and layout_ext: with reference to table 7-6HDMI 1.4b
| Layout_ext | layout | Describe |
| 0 | 0 | 2 passage/4 samplings |
| 0 | 1 | 8 passage/1 samplings |
| 1 | 0 | 3D audio frequency |
| 1 | 1 | Retain |
Fig. 5 shows the transport stream of dividing into groups according to the audio sample of the second exemplary embodiment.
With reference to Fig. 5, when sending two sampled packet about the 3D audio frequency of 22.2 passages in horizontal blanking interval, each field value is established.In the first grouping, segment_indicator=00, in the second grouping, segment_indicator=10, and in last grouping, segment_indicator=11.Because above-described embodiment is 3D audio signal, so layout_ext=1 and layout=0.Similar field value is found in the 3D audio frequency of 10.2 passages.
3rd exemplary embodiment
According to the 3rd exemplary embodiment, conventional audio sample packet format is also changed and uses, although indicate less information compared with the second exemplary embodiment.
With reference to table 9 below, the reserve area of conventional audio sample grouping can be used as multichannel_indicator (multichannel designator).Different from the segment_indicator of the second exemplary embodiment, whether multichannel_indicator instruction is the information of 3D audio frequency about audio sample grouping.According to the bit information of multichannel_indicator, the information indicated by layout field can change.
Therefore, multichannel_indicator can utilize a bit to represent.If multichannel_indicator=0, then layout field indicates the passage/sampling patters defined in traditional HDMI1.4b.If multichannel_indicator=1, then the instruction of layout field uses the layout sending multi-channel audio sampled data more than 8 passages.In this case, layout is used with reference to the initial of sampling.If layout=1, then present video sampled packet is indicated to comprise the initial of sampling.If layout (start)=0, then present video sampled packet is indicated not comprise the initial of sampling.In addition, above description is only exemplary, and can be different from the grouping of bits match.Except described field, in the 3rd exemplary embodiment, other field can be identical with the field in the first exemplary embodiment.
The audio sample packet header of table 9-amendment
Table 9-1Mmultichannel_indicator and Layout/start
Said structure makes to minimize the change of reserve area of traditional audio sample grouping, indicates the information be included together with whether dividing into groups with audio sample about 3D audio frequency simultaneously.Therefore, simpler than the second embodiment according to the packet configuration of the 3rd exemplary embodiment.
Fig. 6 shows the transport stream of the audio sample grouping in the 3rd exemplary embodiment.
With reference to Fig. 6, when sending two sampled packet about the 3D audio frequency of 22.2 passages in horizontal blanking interval, each field value is established.In the first grouping, layout=1, and in the second grouping and the 3rd grouping, layout=0.But, because each grouping is a part for 3D audio signal, so multichannel_indicator=1.Similar field value is set up in the 3D audio frequency of 10.2 passages.
4th exemplary embodiment
According to the 4th exemplary embodiment, conventional audio sample packet format is also changed and uses, but is different from the second exemplary embodiment, additionally provides the information about whether providing multi-stream audio.
With reference to table 10 below, the reserve area of conventional audio sample grouping can be used as Stream_ID and multiASP_layout.MultiASP_layout performs the function identical with the multichannel_indicator in the 3rd exemplary embodiment.In other words, whether multiASP_layout indicates 3D audio frequency to be provided.According to multiASP_layout bit information, the information indicated by layout field is different.
If provide multi-stream audio, then Stream_ID instruction stream numbering.According to exemplary embodiment, a bit may be used in Stream_ID, and 0 instruction, first stream and 1 indicates second stream.The view of the content that each stream is corresponding different from each other.In addition, above description is only exemplary, and can be different from the grouping of bits match.
If corresponding with multi-stream audio view has the audio signal of 8 or less passages, then in an audio sample grouping, Stream_ID and multiASP_layout can not be 0 simultaneously.
The audio sample packet header that table 10 is revised
The description of table 10-1Stream_ID
| Stream_ID | Describe |
| 0 | Stream 1 |
| 1 | Stream 2 |
Said structure has when the information by both a data sampled packet display multi-stream audio and 3D audio frequency the effect realizing compatibility.In addition, if the identifier of Stream_ID field and stream is created, then multiple stream can be distinguished from each other out when sending.Therefore, can be sent out more than the multi-stream audio sampled data of a packet size.In addition, in the 4th exemplary embodiment, the field except described field is identical with the field in the first exemplary embodiment.
Also the audio data transport stream value of Stream_ID field, multiASP_layout field and layout/start field combined can be considered.If multiASP_layout=1, then indicate 3D audio transport stream packet, and layout/start instruction is about the initial information of grouping.If Stream_ID=1, then indicate multithread, and set up the quantity of passage and sampling according to layout/start.Such as, the receiver of grouping receiving Stream_ID=1 identifies, and multi-stream audio data are sent out and the grouping of current reception is second streaming audio data in two multi-stream audio data.
5th exemplary embodiment
According to the 5th exemplary embodiment, conventional audio sample packet format is also changed and uses.
With reference to table 11 below, the reserve area of conventional audio sample grouping can be used as Supports_Multistream (support multithread) and multiASP_layout (many ASP layout).MultiASP_layout performs the function identical with the multiASP_layout in the 4th exemplary embodiment.In other words, whether multiASP_layout indicates 3D audio frequency to be provided.The information indicated by layout field is different according to the bit information of multiASP_layout.
Supports_Multistream indicates the information whether be provided about multi-stream audio.According to exemplary embodiment, a bit may be used in Supports_Multistream.1 instruction multi-stream audio is provided.In addition, above description is only exemplary, and can be different from the grouping of bits match.
According to the 5th exemplary embodiment, an audio sample grouping maximumly can comprise four multi-stream audio samplings of 2 passages.The audio sample in each view can be sent accordingly with each in four subgroups.
If corresponding with multi-stream audio view has the audio signal of 8 or less passages, then in an audio sample grouping, Supports_Multistream and multiASP_layout can not be 0 simultaneously.
The audio sample packet header of table 11-amendment
Said structure has when the information by both a data sampled packet display multi-stream audio and 3D audio frequency the effect realizing compatibility.In addition, each feature will supported can be written in an audio sample grouping.In addition, in the 5th exemplary embodiment, the field except described field is identical with the field in the first exemplary embodiment.
The feature of the audio data transport stream value of Supports_Multistream field, multiASP_layout field and layout/start field combined can be considered.If Supports_Multistream=0 and multiASP_layout=1, then indicate 3D audio transport stream packet, and layout/start instruction is about the initial information of grouping.If Supports_Multistream=1, then indicate multithread, and set up the quantity of passage and sampling according to layout/start.
6th exemplary embodiment
According to the 6th exemplary embodiment, suggestion and the 4th exemplary embodiment change conventional audio sample packet format similarly.
With reference to table 12 below, the reserve area of conventional audio sample grouping can be used as Stream_ID and multiASP_layout.Stream_ID with multiASP_layout performs the function identical with Stream_ID with multiASP_layout in the 4th exemplary embodiment.The information indicated by layout field is different according to the bit information of multiASP_layout.
Owing to utilizing 2 bits to represent Stream_ID, if therefore multi-stream audio is provided, then can write 4 stream numberings.The combination of bit different from each other corresponds to the view of content different from each other.
If multi-stream audio view has the audio signal of 8 or less passages, then can not find that Stream_ID is greater than 1 and multiASP_layout is 1 in an audio sample grouping.
The audio sample packet header that table 12 is revised
The description of table 12-1Stream_ID
| Stream_ID | Describe |
| 00 | Stream 1 |
| 01 | Stream 2 |
| 10 | Stream 3 |
| 11 | Stream 4 |
Said structure has when the information by both a data sampled packet display multi-stream audio and 3D audio frequency the effect realizing compatibility.Specifically, compared to the 4th exemplary embodiment, the multithread of greater number can be identified.In the 6th exemplary embodiment, the field except the field described is identical with the field in the first exemplary embodiment.
Table 13 illustrates the feature of the audio data transport stream value of Stream_ID field, multiASP_layout field and layout/start field combined.If multiASP_layout=1, then indicate 3D audio transport stream packet, and layout/start instruction is about the initial information of grouping.If Stream_ID=01 ~ 11, then indicate multithread, and set up the quantity of passage and sampling according to layout/start.
Table 13 is according to the ability relevant with the feature proposed of exemplary embodiment
7th exemplary embodiment
According to the 7th exemplary embodiment, the 3D audio sample grouping being used in new definition in the first exemplary embodiment sends the grouping of 3D audio sample and multi-stream audio sampled packet.
7th exemplary embodiment is similar to the first execution mode, and comprises the feature of the ext_layout field whether instruction multi-stream audio is sent out.If ext_layout=0, then this field instruction multi-stream audio is sent out.If ext_layout=1, then this field instruction 3D audio frequency is sent out.
Except sample_start field, sample_present.spX field are identical with the field in first exemplary embodiment with the extra field of sample_flat.spX field, and can not be further described below.Table 14 indicates the audio sample packet configuration according to the 7th exemplary embodiment.
Audio sample grouping (24 passages, frequency=96kHz) of table 14-expansion
| N/ passage 1,2 | N/ passage 9,10 | N/ passage 17,18 | N+1/ passage 1,2 |
| N/ passage 3,4 | N/ passage 11,12 | N/ passage 19,20 | N+1/ passage 3,4 |
| N/ passage 5,6 | N/ passage 13,14 | N/ passage 21,22 | N+1/ passage 5,6 |
| N/ passage 7,8 | N/ passage 15,16 | N/ passage 23,24 | N+1/ passage 7,8 |
The example of the audio sample grouping of table 14-1-expansion
Table 15 indicates the grouping agent structure of the field value according to ext_layout.With reference to table 15, about the example of multithread, the audio signal corresponding with view can comprise 2 passages, and therefore a grouping can comprise the audio signal corresponding with 4 views.In addition, about 3D audio signal, the audio signal about multiple passage can be represented.Each exemplary embodiment above-mentioned describes the audio signal with 32 passages.But exemplary embodiment is not limited to the audio signal with 32 passages, and can create according to other illustrative embodiments the audio signal had greater or less than 32 passages.
Table 15EASP packing
In above-mentioned exemplary embodiment, multi-stream audio signal can be included in the region corresponding with the region being placed with the view data of each view in vertical synchronization blanking interval and to be sent out.Fig. 7 shows above-described transport stream format.With reference to Fig. 7, audio signal corresponds to the left field of each view corresponding with picture signal.
1-2.3D a bit audio sampled packet
First exemplary embodiment
According to the first exemplary embodiment, the 3D mono-bit audio sampled packet of new definition is used to send the 3D audio frequency of a bit audio form.As mentioned above, loud speaker is made can to place any position in the 3 d space according to the definition of the 3D audio frequency of exemplary embodiment.
3D mono-bit audio stream comprises 32 or more voice-grade channels, and it sent by dividing into groups continuously in the data islands period.Packet header has sample_start and sample_present bit, is used to indicate the position be grouped in a bit audio sampling.
Table 16-mono-bit 3D sampled packet head
Sample_start:[1 bit] instruction: if sample_start=1, then current group is first grouping of 3D mono-bit audio sampling.Sample_start is identical with the sample_start described in 3D audio packet above, therefore will not be described further.
Samples_present.spX:[4 field, each field 1 bit] indicate subgroup X whether to comprise audio sample.Four sample_present bits can be included in 3D mono-bit audio sampled packet head, and each sample_present bit is each subgroup creates.If subgroup comprises audio sample, then corresponding bit is established.Sample_present.spX is identical with above-described.
Samples_invalid.spX:[4 field, each field 1 bit] indicate subgroup X whether to refer to invalid sampling.If sample_invalid=1, then the sampling of subgroup X is invalid.The sampling of 0 instruction subgroup X is effective.Only when sample_present.spX is established, above-mentioned bit is just effective.If do not have the audio available data finding to use at source place, then 4 sample_invalid.spX bits are established.If sample_invalid.spX is established, then subgroup X refers to continuous print sampling periods.But, do not comprise any available data.
In 3D mono-bit audio, sampling frequency information to be included in audio-frequency information frame and to be sent out (referring to HDMI1.4b 8.2.2 to save).
The sampled packet of 3D mono-bit audio sampled packet comprises a bit audio sampled packet head shown in table 16 and four subgroups.Each subgroup can comprise the bit audio bit for maximum four voice-grade channels.
When the 3D mono-bit audio sampling of transmission 9 to 32 voice-grade channels, adjacent 3D mono-bit audio sampled packet can be used.Available combination for the sample_present bit of 3D mono-bit audio sampled packet can be determined by distributing the passage allowed.Be different from the grouping of 3D audio sample, 3D mono-bit audio sampled packet does not have B0 ~ B3 field, because 3D mono-bit audio sampled packet does not meet IEC60958 block format.
Various replacement scheme
Meanwhile, about the various exemplary embodiments of 3D audio sample grouping, corresponding 3D mono-bit audio sampled packet can be defined respectively.Except above-mentioned sample_invalid.spX field difference, 3D mono-bit audio sampled packet can be defined as dividing into groups identical with 3D audio sample, and only has B0 ~ B3 field to be got rid of by from the grouping of 3D audio sample.Other explanations are identical with description above, therefore will be not described further.
1-3. multi-stream audio sampled packet
Below, the multi-stream audio sampled packet structure of new suggested will be described.By description first exemplary embodiment, and based on from the different of the first exemplary embodiment, other various interchangeable exemplary embodiment is described.
First exemplary embodiment
According to the first exemplary embodiment, multi-stream audio sampled packet is used to send multiple audio streams of L-PEM and IEC 61937 compressed audio format.The each audio stream comprised in multi-stream audio sampling has two or more voice-grade channels.Determine to set up subgroup by using the stream_present bit of packet header.Table 17 represents the head structure of multi-stream audio sampled packet.
Table 17-multi-stream audio sampled packet head
Stream_present.spX:[4 field, each field 1 bit] indicate subgroup X whether to comprise the audio sample of stream X.Four stream_present bits create in multi-stream audio sampled packet head, and each stream_present bit creates for corresponding subgroup.Stream_present bit indicates corresponding subgroup whether to comprise audio stream.Because stream_present.spX performs the identical function of the sample_present.spX in dividing into groups with 3D audio sample substantially, therefore will the description of this function be described.
Stream_flat.spX:[4 field, each field 1 bit] indicate subgroup X whether to refer to the flat wire sampling of stream X.Only when stream_present.spX is established, stream_flat.spX is only effectively.If do not find available voice data at source place, then 4 stream_flat.spX bits are established.When sample rate changes maybe when there is interim stream and interrupting, then perform the foundation of stream_flat.spX bit.If stream_flat.spX bit is established, then subgroup X continues instruction sampling periods, but, do not comprise available voice data.Due to stream_flat.spX substantially divide into groups with 3D audio sample in stream_flat.spX identical, therefore will not be described this function.
If subgroup X comprises the first frame in 192 frames forming IEC 60958, then B.X=1.Otherwise, B.X=0.
Multi-stream audio sampled packet uses the packet header shown in table 17 and four subgroups.Each subgroup has identical structure.
If support multi-view video flow transmission (such as, having dual-view or the game of four views of different audio frequency in each view), then HDMI allows source can transmit four audio streams simultaneously.
The each audio stream be included in multi-stream audio sampling relates to a single view, and comprises two voice-grade channels.The subgroup of each multi-stream audio sampled packet has the frame configured according to IEC 60958 or the IEC 61937 pieces by 0 or 1 definition.Three subgroup layouts are defined.Table 18 below to table 20 shows the example of the multi-stream audio grouping layout for 2,3 and 4 audio streams.
Table 18 is for the example of the multi-stream audio sampled packet layout of 2 audio streams
Table 19-is for the example of the multi-stream audio sampled packet layout of 3 audio streams
Table 20-is for the example of the multi-stream audio sampled packet layout of 4 audio streams
Fig. 8 shows the transport stream of dividing into groups according to the audio sample of the first exemplary embodiment.
With reference to Fig. 8, about the 2 channel audio sampled packet for dual-view, in horizontal blanking interval, send the sampled packet comprising two samplings.About the 2 channel audio sampled packet for four views, in horizontal blanking interval, send the sampled packet comprising four samplings.Although this Figure illustrates the multi-stream audio sampling sending maximum 2 passages, the multi-stream audio sampling with multiple passage (it comprises two or more passage) can be sent by a multi-stream audio sampled packet according to other exemplary embodiments.In brief, corresponding to each view audio frequency can be sent by corresponding subgroup; In addition, the multi-stream audio sampled data with multiple passage (it comprises two or more passage) can be sent by one or more continuous print multi-stream audio sampled packet.
According to exemplary embodiment, multi-stream audio sampled packet sends four stereo sound frequency samplings.Each sampling corresponds to independent audio stream.Such as, if HDMI source sends two audio streams separated, then can use subgroup 0 when sending the audio sample of stream 0, and subgroup 1 can be used when sending the audio sample of stream 1.
Second exemplary embodiment
According to the second exemplary embodiment, conventional audio sample packet format is changed and uses, and also provides the information whether be provided about multi-stream audio simultaneously.
With reference to table 21 below, the reserve area of conventional audio sample grouping can be used as Stream_Identifier (Stream_ID).If multi-stream audio is provided, then Stream_ID instruction stream numbering.According to exemplary embodiment, Stream_ID can use two bits; 00 instruction is first-class, and 01 instruction second, the rest may be inferred.The view of the content that each stream is corresponding different from each other.In addition, above description is only exemplary, and can be different from the grouping of bits match.
In HDMI1.4b, layout (layout) instruction is about the information of number of sampling and passage.Such as, an audio sample grouping can comprise four samplings of 2 channel audios and a sampling of 8 channel audios.
The audio sample packet header of table 21-amendment
The description of table 21-1-Stream_Identifier
| Stream_Identifer | Describe |
| 00 | Stream 1 |
| 01 | Stream 2 |
| 10 | Stream 3 |
| 11 | Stream 4 |
Said structure achieves the advantage using conventional reserve area to provide the ID of multithread in a straightforward manner.
Fig. 9 and Figure 10 shows the transport stream of the multi-stream audio sampled packet according to the second exemplary embodiment.
With reference to Fig. 9, about the 2 channel audio sampled packet for dual-view, in horizontal blanking interval, send the sampled packet comprising four unit of the sampled data of identical content.In other words, sampled packet comprises the audio signal about a view.About the 2 channel audio sampled packet for four views, in horizontal blanking interval, send four sampled packet for four views.In addition, the sampled packet of arbitrary view can be sent continuously, or sampled packet can be sent in the mode replaced with another view.Fig. 9 shows the example of 2 channel audio sampled packet; But, also can apply the audio sample grouping with multiple passage (it comprises 2 with upper channel).In addition, as shown in the figure, can comprise at each view and send the identical object of fixed number really sampled data; But, also can send the sampled data of different number.
Figure 10 shows the 8 channel audio sampled packet sent in horizontal blanking interval for dual-view, and it comprises the sampled data of instruction 8 passage and two sampled packet.Utilize a sampled packet, the transmission of the sampled data about a view can be completed.Can send continuously, or can send in the mode replaced with the sampled packet of another view, the sampled packet of each view.About the 8 channel audio sampled packet for four views, in horizontal blanking interval, send a sampled packet of the sampled data of the content comprised for a type; But, each sampled packet of four views should be sent.
Be similar to the second exemplary embodiment, if Stream_Identifier is used, and if audio clock regeneration grouping comprises above-mentioned information, then more effectively can realize the operation of synchronization video and audio frequency.Table 22 below provides the structure of the audio clock regeneration grouping according to the amendment of the second exemplary embodiment.
Table 22 audio clock regeneration packet header and subgroup
Table 22-1 audio clock regeneration packet header
Table 22-2 audio clock regeneration subgroup
The description of table 22-3Stream_Identifier
| Stream_Identifer | Describe |
| 00 | Stream 1 |
| 01 | Stream 2 |
| 10 | Stream 3 |
| 11 | Stream 4 |
With reference to table 22, by comprising the information about multithread index at the reserve area of audio clock regeneration grouping, can effectively realize the synchronous of the Audio and Video of multi-view system.Particularly, about the system showing multi views during difference, above-mentioned packet configuration can be useful.
3rd exemplary embodiment
3rd exemplary embodiment is similar to the 3D audio sample grouping of the 4th embodiment.Traditional audio sample packet format is changed and uses, and has the function providing multithread identifying information simultaneously.
With reference to table 23 below, the reserve area of conventional audio sample grouping can be used as Stream_ID and multiASP_layout.Stream_ID with multiASP_layout that Stream_ID with multiASP_layout describes in dividing into groups with the 3D audio sample of the 4th exemplary embodiment is identical.
The audio sample packet header that table 23 is revised
The description of table 23-1Stream_Identifier
| Stream_ID | Describe |
| 0 | Stream 1 |
| 1 | Stream 2 |
Said structure has when the information by both a data sampled packet display multi-stream audio and 3D audio frequency the advantage realizing compatibility.
Identical with the feature dividing into groups to describe relative to the 3D audio sample of the 4th exemplary embodiment above with the feature of the audio data transport stream of the combination of the value of layout/start field according to Stream_ID field, multiASP_layout field.
4th exemplary embodiment
According to the 4th exemplary embodiment, conventional audio sample packet format can be changed and use.4th exemplary embodiment is divided into groups corresponding to the 3D audio sample of the 5th exemplary embodiment.
With reference to table 24 below, the reserve area of conventional audio sample grouping can be used as Supports_Multistream and multiASP_layout.Supports_Multistream with multiASP_layout that Supports_Multistream with multiASP_layout describes in dividing into groups with the 3D audio sample in the 5th exemplary embodiment is identical.
The audio sample packet header that table 24 is revised
Said structure has when the information by both a data sampled packet display multi-stream audio and 3D audio frequency the advantage realizing compatibility.In addition, said structure also realizes another advantage: can will be written into by each feature supported in an audio sample grouping.
The feature of audio data transport stream can realize according to the combination of the value of Supports_Multistream field, multiASP_layout field and layout/start field.The value of each field is identical with the value of the field in the table 13 that above-described 3D audio sample divides into groups.
Meanwhile, in above-mentioned exemplary embodiment, multi-stream audio signal can be included in the region corresponding with the region being placed with the view data of each view in vertical synchronization blanking interval and to be sent out.The description of Fig. 7 provides the detailed description of this feature.
5th exemplary embodiment
5th exemplary embodiment proposes the amending method of the audio sample packet format of the routine similar with the 3rd exemplary embodiment.
With reference to table 25 below, the reserve area of conventional audio sample grouping can be used as Stream_ID and multiASP_layout.Stream_ID with multiASP_layout performs the function identical with Stream_ID with multiASP_layout in the 3rd exemplary embodiment respectively.
Owing to utilizing 2 bits to represent Stream_ID, if therefore multi-stream audio is provided, then 4 can be indicated to flow numbering.Each various combination of bit corresponds to the view of content different from each other.
If multi-stream audio view has the audio signal of 8 or less passages, then can not find that Stream_ID is greater than 1 and multiASP_layout is 1 in an audio sample grouping.
The audio sample packet header that table 25 is revised
The description of table 25-1Stream_Identifer
| Stream_Identifer | Describe |
| 00 | Stream 1 |
| 01 | Stream 2 |
| 10 | Stream 3 |
| 11 | Stream 4 |
Said structure has when the information by both a data sampled packet display multi-stream audio and 3D audio frequency the advantage realizing compatibility.Specifically, compared to the 3rd exemplary embodiment, the multithread of greater number can be distinguished.
Table 26 illustrates the feature of the audio data transport stream value of Stream_ID field, multiASP_layout field and layout/start field combined.If multiASP_layout=1, then indicate 3D audio transport stream packet, and layout/start instruction is about the initial information of grouping.If Stream_ID=01 ~ 11, then indicate multithread, and set up the quantity of passage and sampling according to layout/start.
Table 26 is according to the ability relevant with the feature proposed of exemplary embodiment
6th exemplary embodiment
6th exemplary embodiment proposes Stream_ID to add to divide into groups according to the audio sample of the first exemplary embodiment.Stream_ID is identical with above-described, and other field is identical with the field described in the first exemplary embodiment.Table 27 shows the audio sample packet header according to the 6th exemplary embodiment.But, although utilize 4 bits to set up Stream_ID in table, 1 to 3 bit or 5 bits or more bit also can be utilized to set up Stream_ID.The packet type of the new definition of packet type instruction.
In order to distinguish the audio frequency in each stream, use Stream_ID.Therefore, compared to the first exemplary embodiment, a multi-stream audio sampled packet comprises the audio sampling data flowed for.
Table 27 extended audio sampled packet
7th exemplary embodiment
7th exemplary embodiment proposes the 3D audio sample grouping of new definition in first exemplary embodiment of Section 1.1 and uses the multi-stream audio sampled packet of 3D audio sample grouping.
7th exemplary embodiment is similar to the first embodiment, and comprises the ext_layout field indicating multi-stream audio whether to be provided.Therefore, if ext_layout=0, then this field instruction multi-stream audio is sent out.If ext_layout=1, then this field instruction 3D audio frequency is sent out.
Comprise sample_start field, sample_present.spX field is identical with the field described in first exemplary embodiment with other fields of sample_flat.spX field, and can not further describe.Table 28 illustrates the audio sample packet configuration according to the 7th exemplary embodiment.
Audio sample grouping (2 passages 2 flow frequency=96kHz) that table 28 is expanded
The example of the audio sample grouping of table 28-1 expansion
Table 29 indicates the grouping agent structure of the field value according to ext_layout.It is as shown in the table, and in multithread, the audio signal corresponding with view can comprise 2 passages, and therefore grouping can comprise the audio signal for 4 views.Alternatively, in 3D audio signal, the audio signal of multiple passage can be indicated.Even if each exemplary embodiment described in this manual describes the 3D audio frequency of nearly 32 passages, but exemplary embodiment is not limited thereto.Such as, illustrative embodiments can be applied to having the audio signal of 32 or more passages.
Table 29EASP packing
Table 30 illustrates effective Sample_Present bit.
The effective Sample_Present bit configuration that table 30 sends for Multi-audio-frequency stream
| sP0 | sP1 | sP2 | sP3 | describe |
| 0 | 0 | 0 | 0 | do not comprise the subgroup of audio sample. |
| 1 | 0 | 0 | 0 | subgroup 0 is only had to comprise the audio sample of stream 0 |
| 1 | 1 | 0 | 0 | subgroup 0 and 1 comprises the audio sample of stream 0 and 1 |
| 1 | 1 | 1 | 0 | subgroup 0,1 and 2 comprises the audio sample of stream 0,1 and 2 |
| 1 | 1 | 1 | 1 | all subgroups all comprise the audio sample of stream 0,1,2 and 3 |
Figure 11 shows the transport stream of the multi-stream audio sampled packet in above-mentioned 7th exemplary embodiment.
With reference to Figure 11, about the 2 channel audio sampled packet for dual-view, a sampled packet of the sampling comprising two views can be sent in horizontal blanking interval.About the 2 channel audio sampled packet for four views, in horizontal blanking interval, send the sampled packet comprising four samplings.In other words, a sampled packet comprises and sends the sampling of four views.Although Figure 11 shows the example of 2 channel audio sampled packet, the audio sample grouping with multiple passage (it comprises two or more passage) can be applied according to other exemplary embodiments.
As above relative to described in above each exemplary embodiment, multi-stream audio signal can be included in the region corresponding with the region being placed with the view data of each view in vertical synchronization blanking interval and to be sent out.Figure 11 illustrates transport stream format in this case.In fig. 11, the audio signal corresponding with the left field of the picture signal in each view can be comprised.
1-4. multithread one bit audio is divided into groups
First exemplary embodiment
According to the first exemplary embodiment, the new grouping of multithread one bit audio is defined.This corresponds to the grouping of 3D audio sample.
If send multithread one bit audio, then each subgroup can comprise the bit audio bit for 0,1,2 or more voice-grade channels.The sampling of multithread one bit audio comprises four stream_present bits, and each bit is corresponding subgroup and creating.
If subgroup comprises the audio sample in each stream, then corresponding bit can be established.If do not find operable audio available data, then 4 stream_invalid.spX bits can be established.If stream_invalid.spX bit is established, then subgroup X continues instruction sampling periods, but, do not comprise any available data.
Table 31 multithread one bit audio packet header
Stream_present.spX:[4 field, each field 1 bit] indicate subgroup X whether to comprise the audio sample of stream X.Stream_present.spX performs the function identical with the sample_present.spX dividing into groups to describe relative to above 3D audio sample substantially above, and thus will not be described further.
Stream_invalid.spX:[4 field, each field 1 bit] indicate subgroup X whether to refer to the invalid sampling of stream X.If the sampling be included in subgroup X is invalid, then stream_invalid=1.Otherwise, stream_invalid=0.When relevant stream_present.spX is established, bit is effective.Stream_present.spX performs the function identical with the sample_present.spX dividing into groups to describe relative to above 3D audio sample substantially above, and thus will not be described further.
About multithread one bit audio, according to exemplary embodiment, sampling frequency information to be included in audio-frequency information frame and to be sent out (referring to HDMI1.4b 8.2.2 to save).
Identical four subgroups of subgroup that multithread one bit audio sampled packet uses and the bit audio shown in table 31 is sampled.Because multithread one bit audio sampled packet does not meet IEC 60958 block format, so a bit multi-stream audio sampled packet does not have B0 to B3 field, this is different from multi-stream audio sampled packet.
Various replacement scheme
About the various above-mentioned exemplary embodiment of multi-stream audio sampled packet, a corresponding bit multi-stream audio sampled packet can be defined respectively.In other words, except samples_invalid.spX as above, a bit multi-stream audio sampled packet can also be defined multi-stream audio sampled packet, and can use B0 to the B3 field from multi-stream audio sampled packet.
2-1. is used for the information frame of 3D audio frequency/metadata groupings
First exemplary embodiment
As mentioned above, in the first exemplary embodiment, can divide into groups by utilizing the audio metadata of new definition, instead of information frame, send the additional information relevant with 3D audio frequency.Whenever sending 3D audio stream, source sends an audio metadata at least two video fields.
Audio metadata can indicate various characteristic, the distribution of the passage/loud speaker of the quantity of such as passage, voice-grade channel allocation criterion type (ACAT) and 3D audio stream.Under indicate the audio metadata packet header of new definition.
Table 32 audio metadata packet header
Table 33 audio metadata packet content
Each field in above-mentioned grouping is defined as follows.
3D_CC:[5 bit] channel counts of 3D audio frequency that sends of instruction.If the audio channel count in audio-frequency information frame (CC0 ..., CC2) with audio metadata divide into groups in 3D audio channel count (3D_CCO ..., 3D_CC4) inconsistent, then the channel counts of audio-frequency information frame is left in the basket.Table 34 illustrates the voice-grade channel of the value according to 3D_CC.
ACAT:[4 bit] the voice-grade channel allocation criterion type provided by source is provided.Table 35 shows ACAT field value.Table 36 illustrates: if ACAT is set up as 0x01 (10.2 passage), then distribute loudspeaker position.Similarly, table 37 and table 38 comprise the information for 22.2 passages and 30.2 passages.
3D_CA:[8 bit] instruction is used for the distribution of passage/loud speaker of 3D audio frequency.Further explanation is shown in table 36 to table 38.For IEC61937 compressed audio stream, 3D_CA field is invalid.
Table 343D_CC field
Table 35 voice-grade channel allocation criterion type field
Table 36 is for the 3D_CA field of 10.2 passages (ACAT=0x01)
Table 37 is for the 3D_CA field of 22.2 passages (ACAT=0x02)
Table 38 is for the 3D_CA field of 30.2 passages (ACAT=0x03)
Whenever sending effective 3D audio stream, for two video fields, correct audio metadata grouping at least can be sent once.If new 3D audio stream starts, or comprising at 3D audio stream can by the change that audio metadata divides into groups and audio-frequency information frame indicates, then can send earlier than frame of video ground after initial affected non-mute (non-silent) audio sample change and correct audio metadata divide into groups.The transmission of that change and correct audio metadata grouping can occur just before the audio sample sending initial impact.Audio metadata (can comprise the horizontal blanking interval in data islands interval or vertical blanking interval) at any time and send.If 3D audio frequency is processed by flow transmission, then CC and the CA field be included in audio-frequency information frame ignored by receiver, and with reference to 3D_CC and 3D_CA be included in audio metadata.
But if send above-mentioned audio metadata, then traditional audio-frequency information frame still can be utilized.In other words, if audio metadata is by the new passage for distributing 3D audio frequency, then audio-frequency information frame is used to the passage distributing 2D audio frequency.
In addition, although foregoing exemplary embodiments describe 10.2 passages of ACAT, 22.2 passages and 30.2 passages, the technical field of exemplary embodiment is not limited to this, and can be applied to, such as, 10.2 passages are less than, more than 30.2 passages and 10.2 to 30.2 passages.
Second exemplary embodiment
The difference of the second exemplary embodiment and the first exemplary embodiment is: the change can considering the audio-frequency information frame defined in HDMI1.4b according to the second exemplary embodiment.Table 39 illustrates audio-frequency information frame in this case.The channel counts of the audio frequency that the instruction of CC field sends, and the information that CA field instruction passage/loud speaker distributes.
Usually, three bits are utilized to represent CC field.But the second exemplary embodiment uses two added bits of reserve area.Therefore, channel counts information can by utilizing 5 bits: CC0, CC1, CC2, CC3, CC4 indicate.
In addition, the information that passage/loud speaker distributes is added to the reserve area of CEA861-D, as above as shown in table 20.Compared to the first exemplary embodiment, the second exemplary embodiment does not have ACAT field.
The audio-frequency information frame that table 39 is revised
The audio-frequency information frame packet header of table 39-1 amendment
Table 39-2 audio-frequency information frame packet content
3rd exemplary embodiment
3rd exemplary embodiment extends the second exemplary embodiment, and changes the audio-frequency information frame defined in HDMI1.4b.Table 40 illustrates the audio-frequency information frame structure according to the 3rd exemplary embodiment.Be similar to the second exemplary embodiment, the channel counts of the audio frequency that the instruction of CC field sends, and the information that CA field instruction passage/loud speaker distributes.
3rd exemplary embodiment provides further expanding of CA field, is substantially similar to the second exemplary embodiment simultaneously.A bit of reserve area is set up as channel_extension bit.If channel_extension=0, then CC# and the CA# field defined in CEA861-D is used.In other words, the 3rd exemplary embodiment supports 2D audio mode.If channel_extension=1, then PB2 [7:6] is used as the extended bit (CC4, CC3) of CC, and the reserve area of PB6 is used as CA_ext field.The extended bit of 3D audio frequency is used.
In this case, be similar to the second exemplary embodiment, conventional CC field utilization three bits represent.But the 3rd exemplary embodiment also uses two bits of reserve area.Therefore, channel counts information can by utilizing 5 bits: CC0, CC1, CC2, CC3, CC4, indicate.
In addition, PB6 field can be added and be used to CA bit (PB4).The reserve area of the CEA861-D shown in table 20 (or, the CEA861-E shown in table 28), can comprise the definition of the information of the passage/loud speaker of the audio frequency for having 10.2 an or more passage.Extra table can be defined in each standard.As a result, therefore CA field extension to 16 bits, and, can send multi-channel audio.
In addition, 8 new bit fields can be defined by replacing traditional CA field and be used, and this is different from above description.Such as, new CA bit can use PB6 field or PB7 field to define.
The audio-frequency information frame 2 that table 40 is revised
Table 40-1 audio-frequency information frame packet header
Table 40-2 audio-frequency information frame packet content
4th exemplary embodiment
4th exemplary embodiment combines the second exemplary embodiment and the 3rd exemplary embodiment.According to the 4th exemplary embodiment, traditional audio-frequency information frame comprises 3D_CH_present field, the CA field of PB4 and the 3D_CC field of PB6.
3D_CH_present field performs the function identical with the channel_extension described in the 3rd exemplary embodiment above.Therefore, if 3D_CH_present=0, then CC# and the CA# field defined in CEA861-D is still utilized.In other words, the 4th exemplary embodiment supports 2D audio mode.In addition, if 3D_CH_present=1, then PB6 [4:0] is used as the expansion bit (CC4, CC3, CC2, CC1, CC0) of CC, and the reserve area of PB4 is used as CA field, and this is similar to the second exemplary embodiment.The extended bit of 3D audio frequency is used.Be similar to second and the 3rd exemplary embodiment, ACAT field is not defined.The special further feature described is identical with the feature described to the 3rd exemplary embodiment relative to first.
The audio-frequency information frame 3 that table 41 is revised
The audio-frequency information frame packet header of table 41-1 amendment
The audio-frequency information frame packet content of table 41-2 amendment
2-2. is used for the information frame of multi-stream audio
About multi-stream audio, new metadata groupings can not be defined, and the information frame defined in HDMI1.4b can be used.If use multi-stream audio sampled packet to send multiple effective audio stream, then for two video fields, correct audio-frequency information frame can be sent out at least one times.Audio-frequency information frame can use when describing the audio frequency characteristics of each effective audio stream.
If if new audio data stream starts and comprise the change that can be realized by multiple new audio stream or audio-frequency information frame at audio stream, then can earlier than a video field after the audio sample of initial affected non-mute, send that change with correct audio-frequency information frame.The transmission of stream can realize just before the audio sample sending initial impact.For a bit audio stream, audio-frequency information frame can send before initial affected sampling.
The change of information frame
Compared with above-mentioned exemplary embodiment, about Stream_ID utilization (such as, 4th and the 6th exemplary embodiment of 3D audio sample grouping, and multi-stream audio sampled packet second, third, the 5th and the 6th exemplary embodiment), Stream_ID can be included in audio-frequency information frame, such as, as shown in table 42 below.
With reference to table 42, Stream_ID indicates the stream ID of present video information frame, and Stream_Count indicates the total number of the audio stream that will send.According to exemplary embodiment, replace not using flow identifier, sampling can be loaded and send in four subgroups be made up of multi-stream audio sampled packet main body, and it does not change information frame.
The information frame that table 42 is revised
Table 42-1 audio-frequency information frame packet header
Table 42-2 audio-frequency information frame packet content
3-1. is used for the EDID of 3D audio frequency
By utilizing at least one in following operation: operation 1), change traditional short audio descriptor and loud speaker distribute data block, 2) in reserve area, define the block that new data block is correlated with for the audio frequency on the marker code of expansion, and 3) in reserve area, defining a new data block for the HDMI audio data block on the marker code of expansion, the audio frequency characteristics of 3D audio frequency and the information of distributing loud speaker can be included in EDID.
Such as, the EDID data block described in CEA-861-F (D or E) can be used to instruction two receiver audio frequency characteristics and loud speaker distributes support.Receiver audio frequency characteristics and loud speaker distribute supports that a series of short audio descriptors by being positioned at the data block set that CEA expands indicate.Such data comprise the audio coding list and the parameter relevant to coding supported by receiver, and such as channel number, to support form.Loud speaker distributes descriptor and can be included in data block set, and by supporting the receiver request of multichannel (reaching 8 passages) L-PCM being used for 2D audio frequency or multichannel (reaching 8 passages) 1 bit audio.
First exemplary embodiment
If receiver support sends multi-stream audio and/or 3D audio frequency, then the HDMI audio data block with the marker code 18 of expansion can be used to instruction 3D audio frequency characteristics, 3D loud speaker assignment information and multi-stream audio feature.
If receiver support sends 3D audio frequency, then HDMI audio data block comprises at least one HDMI 3D audio descriptor (HDMI_3D_AD) with four bytes.In addition, HDMI audio data block can comprise HDMI 3D loud speaker distribution descriptor (HDMI_3D_SAD) of following after last HDMI 3D audio descriptor.
If receiver support sends multi-stream audio and do not support to send 3D audio frequency simultaneously, then HDMI audio data block can comprise at least one CEA short audio descriptor (CEA_SAD) of following after 3 bytes.CEA short audio descriptor is instruction in CEA-861-F (D or E).
If receiver support sends multi-stream audio and 3D audio frequency, then HDMI audio data block can comprise at least one CEA short audio descriptor of following after HDMI 3D loud speaker distributes descriptor.Table 43 provides the additional detail according to exemplary embodiment.
HDMI 3D audio descriptor instruction is above supported in the audio coding of definition in CEA-861-F (D or E).HDMI equipment can support the 3D audio format according to TTA (10.2 passage), SMPTE2036-2 (22.2 passage) or IEC62574 (30.2 passage).Table 45 to table 49 provides further explanation.These tables are classified according to the audio format code shown in the table 24 of CEA-861-F (D or E) and table 26.
As mentioned above, HDMI 3D loud speaker distributes descriptor and can be included in HDMI audio data block, and by supporting the receiver request of 3D audio frequency.The structure that HDMI 3D loud speaker distributes descriptor illustrates in the table 50.Receiver is by expressing loud speaker, and such as, a pair loud speaker, carrys out indicative audio ability, and sets up corresponding mark.HDMI 3D loud speaker distributes the ACAT field that descriptor can have four bits, its indicative audio channel allocation type.Table 50 to table 52 provides further details.In addition, CEA short audio descriptor can be included in HDMI audio data block, and is supported to send the receiver request of multi-stream audio.Descriptor above describes the audio frequency characteristics of each audio stream.Largest passages counting can be restricted to 2 passages in each audio stream; But exemplary embodiment is not limited thereto, and according to exemplary embodiment, channel counts can more than 2 passages in each audio stream.
Table 43HDMI audio data block
* the length (in units of byte) of subsequent data block pay(useful) load: 2+4*X+4+3*Y
**3+4*X+1
Being described below of each field of the HDMI audio data block shown in table 43.
NUM_HDMI_3D_AD [3 bit] indicates the quantity of HDMI 3D audio descriptor.
NUM_CEA_SAD [3 bit] indicates the quantity of CEA short audio descriptor.
Max_Stream_Count-1 [2 bit] indicates: the number-1 of number=transmitting data stream.Table 44 provides additional details.
HDMI_3D_AD indicates HDMI 3D audio descriptor.
HDMI_3D_SAD indicates HDMI 3D loud speaker to distribute descriptor.
CEA_SAD CEA indicates CEA short audio descriptor.
Table 44Max_Stream_Count-1 field
| Max_Stream_Count-1 | Describe |
| 00 | Do not support multi-stream audio |
| 01 | 2 audio streams |
| 10 | 3 audio streams |
| 11 | 4 audio streams |
Table 45 is for the HDMI 3D audio descriptor of audio format code=1 (LPCM)
Table 46 is for the HDMI 3D audio descriptor of audio format code 2 to 8
Table 47 is for the HDMI 3D audio descriptor of audio format code 9 to 13
Table 48 is for the HDMI 3D audio descriptor of audio format code 14 (WWA Pro)
Table 49 is for the HDMI 3D audio descriptor of audio format code 15 (expansion)
Table 50 distributes descriptor for the HDMI 3D loud speaker of 10.2 passages (TTA standard)
Runic bit instruction in upper table is according to the loud speaker of 10.2 channel allocations.
Table 51 distributes descriptor for the HDMI 3D loud speaker of 22.2 passages (SMPTE2036-2)
Runic bit instruction in upper table is according to the loud speaker of 22.2 channel allocations.
Table 52 distributes descriptor for the HDMI 3D loud speaker of 30.2 passages (IEC62574/Ed.1)
Runic bit instruction in upper table is according to the loud speaker of 30.2 channel allocations.
Although the loud speaker that the first exemplary embodiment utilizes three bytes to describe multichannel 3D audio tweeter distributes, this is only exemplary.The 3D voice data with 30.2 or more passages may need loud speaker assignment information more more than the information described relative to this exemplary embodiment above.In this case, 3D loud speaker distribution descriptor can use more than four bytes to distribute to indicate loud speaker.
Table 53 voice-grade channel distributes type (ACAT) field
According to the needs of manufacturer, the reservation bit in ACAT field can be assigned with and be used to various channel type, such as, by the Doby (Dolby), USC or the ITU-R form that are standardized.
Second exemplary embodiment
The difference of the second exemplary embodiment and the first exemplary embodiment is: the second exemplary embodiment changes audio data block.Particularly, the reserve area of CEA short audio descriptor may be used for the maximum number expanding and indicate passage.For example, referring to table 54 below, the maximum number of passage can be expanded by utilizing byte 1 [7] and byte 2 [7].By this expansion, 3D audio frequency can be indicated.CEA short audio descriptor can have different field area according to audio format.
Table 54CEA short audio descriptor table 54-1 is used for the CEA short audio descriptor of audio code=1 (LPCM)
Table 54-2 is used for the CEA short audio descriptor of audio code 2 to 8
Table 54-3 is used for the CEA short audio descriptor of audio code 9 to 15
Have nothing to do with above-mentioned second exemplary embodiment, ACAT can set up by changing loud speaker distribute data block.ACAT can use the byte 3 [7:4] in the reserve area of loud speaker distribute data block payload to identify, and the loud speaker distribute data block in every type can be defined as new table.The position of ACAT field differently can define in the scope of byte 2 [7:3] to byte 3 [7:0].
With reference to table 55 below, ACAT=0001 indicates 10.2 passages of TTA standard, and ACAT=0010 indicates 22.2 passages.
Table 55 loud speaker distribute data block payload (with reference to CEA861-E)
Table 55-1ACAT field
| ACAT | Describe |
| 0000 | With reference to CEA861-D (E, F) |
| 0001 | With reference to 10.2 passages (TTA standard) |
| 0010 | With reference to 22.2 passages (SMPTE2036-2) |
| 0011～1111 | Retain |
| 0011～1111 | Retain |
Table 55-2 loud speaker distribute data block payload (for 22.2 passages)
Table 55-3 loud speaker distribute data block payload (for 10.2 passages)
Loud speaker distribute data block differently can define according to manufacturer.Manufacturer can consider that using public loud speaker to distribute improves compatibility.Table 56 below proposes the SMPTE2036-2 standard of the 3D audio frequency with 22.2 passages.The public loud speaker that runic bit refers to some manufacturers distributes.
Table 56 loud speaker distribute data block payload 2 (with reference to CEA861-E)
Table 56-1ACAT field
| ACAT | Describe |
| 0000 | With reference to CEA861-D (E, F) |
| 0001 | With reference to 10.2 passages (TTA standard) |
| 0010 | With reference to 22.2 passages (SMPTE2036-2) |
| 0011～1111 | Retain |
Table 56-2 loud speaker distribute data block payload (for 22.2 passages)
Table 56-3 loud speaker distribute data block payload (for 10.2 passages)
In the above-mentioned exemplary embodiment of loud speaker distribute data block pay(useful) load, the classification of every type, such as, 10.2 passage (TTA), 22.2 passages (SMPTE2036-2) and 13.1 passages (Doby), can determine by referring to the position of the bit arranged in loud speaker distribute data pay(useful) load in source and sequence, and without the need to defining separately ACAT field.Determine that the operation of the classification of type can perform, because the number of passage can utilize the audio data block of change to find.
3rd exemplary embodiment
3rd exemplary embodiment does not define HDMI audio data block, and in EDID, newly define the expansion loud speaker distribute data block type of marker code of expansion.The size of new data block is maximum can be 32 bytes.Table 57 shows the example of 4 bytes.The size of ACAT can change according to the needs of user or manufacturer and define.
ACAT realizes by utilizing reserve area (byte 3 [7:4]), and the loud speaker distribute data block of each type can be defined.Payload can be formed in the mode identical with above-mentioned exemplary embodiment.In addition, ACAT field can be placed in the region being different from above reserve area.
According to manufacturer, the reservation bit in ACAT field can be assigned with and be used to various channel type, such as, by the Doby, USC or the ITU-R form that are standardized.
The loud speaker distribute data block that table 57 is revised
Table 57-1ACAT describes
| ACAT | Describe |
| 0000 | With reference to CEA861-D (E, F) |
| 0001 | With reference to 10.2 passages (TTA standard) |
| 0010 | With reference to 22.2 passages (SMPTE2036-2) |
| 0011～1111 | Retain |
The loud speaker distribute data block payload (for 10.2 passages) of table 57-2 expansion
The loud speaker distribute data block payload (for 22.2 passages) of table 57-3 expansion
The loud speaker distribute data block payload (for 30.2 passages) of table 57-4 expansion
4th exemplary embodiment
4th exemplary embodiment is similar to the 3rd embodiment, but difference part is, according to the 4th exemplary embodiment, each loud speaker allocation criterion type (such as, in 10.2 passages (TTA), 22.2 passages (NHK), 13.1 passages (Doby)) data block be defined, and the data block in every type is added to the marker code of expansion.
Such as, data block marker code 19 indicates the loud speaker distribute data block being used for TTA 10.2 passage, data block marker code 20 indicates the loud speaker distribute data block being used for NHK 22.2 passage, and data block marker code 21 indicates the loud speaker distribute data block being used for Doby 13.1 passage.
The loud speaker distribute data block that table 58 is revised
Table 58-1 loud speaker distribute data block payload (for multichannel)
5th exemplary embodiment
5th exemplary embodiment defines the audio data block of expansion.The audio data block of expansion corresponds to the marker code of expansion.In addition, the audio data block of expansion comprises at least one expansion CEA short audio descriptor.Each expansion CEA short audio descriptor comprises the information of the quantity about passage.The size of each field can be identical with form with the size of the short audio descriptor in audio data block with form, but size and form also can differently define.
The audio data block that table 59 is expanded
The audio data block of table 59-1 expansion
The CEA section audio descriptor of table 59-2 expansion
As above, described in table, the CEA short audio descriptor of expansion can comprise unpressed audio format code.Unpressed audio format code can be defined as foloows.
The unpressed audio format code of table 60
The loud speaker distribute data block of expansion can be defined as the value of the marker code comprising expansion.The loud speaker distribute data block of expansion can comprise ACAT field as shown in the table.Reserve area can be used to expansion.In addition, according to manufacturer, reservation bit can be assigned with and be used to various channel type, such as, by the Doby, USC or the ITU-R form that are standardized.
The loud speaker distribute data block that table 61 is expanded
The loud speaker distribute data block of table 61-1 expansion
Table 61-2ACAT describes
In the exemplified embodiment, the payload of the loud speaker distribute data block of expansion illustrates in the following table.Shadow region is used to as each channel allocation type distributes loud speaker.
Compatibility is joined in table 62 channel allocation
For new loudspeaker position EDID/CEC
Loudspeaker position data block can be defined for transmitting new speaker position information to source.Data block comprises coordinate figure (x, y, z) and the position angle angle value of each loudspeaker position.Utilize above-mentioned information, source can be used in various process operation, in such as downmix or multi-object audio coding.Owing to distributing the value of the marker code expanded in following table according to one of exemplary embodiment, so loudspeaker position data block can utilize data block defined above to define and use.
Table 63 loudspeaker position data block
Loudspeaker position data block can define as in the table below like that.Byte [1] stores the positional information of a loud speaker to byte [5].According to same exemplary embodiment, byte [6] stores the speaker position information of other loud speakers to byte [30].Byte 31 and byte 32 are defined as reserve area.
If use exemplary embodiment above, then data block is maximum can carry six speaker position information.Therefore, for N number of passage, (N/6) individual loudspeaker position data block altogether can be needed.
Table 64 loudspeaker position data block
Table 64-1Speaker_id (loud speaker ID) field
| Speaker_id | Describe |
| 00000 | FL |
| 00001 | FR |
| 00010～11111 | … |
CEC is used to send speaker position information
Figure 12 shows the operation sending speaker position information according to the use CEC of exemplary embodiment.
With reference to Figure 12, if source sends the request to loudspeaker position to receiver, then receiver utilizes speaker position information to respond.
3-1. is used for the EDID of 3D audio frequency
Multi-stream audio data block can be newly defined in the marker code of expansion.Multi-stream audio data block comprises Max_stream_count-1 field and CEA short audio descriptor region.Max_stream_count-1 instruction sends the quantity of stream.CEA short audio descriptor is greater than 1, and can be defined by CEA861-D.
Table 65 multi-stream audio data block
Table 65-1CEA data block marker code
According to exemplary embodiment, whether provide multi-stream video/audio frequency can indicate in the data block of supplier.Multistream_indicator (multithread designator) field is used.If receiver supports multithread, then multistream_indicator=1.In addition, multistream_indicator field can define in another region of data block and HDMI VSDB.
The specific data block of table 66 supplier
If used more than 2 bit definitions multistream_indicator, then can identify each multithread.
Table 67 is specific to the data block of supplier
Second exemplary embodiment
Second exemplary embodiment uses the marker code of expansion newly to define Multi-audio-frequency flow data block.The Multi-audio-frequency flow data block of new definition comprises CEA short audio descriptor region, the length of audio stream, Max_stream_count field and/or out of Memory.Each field can be identical with the field described in exemplary embodiment above, and will not be described further.
Table 68 Multi-audio-frequency flow data block
Table 68-1 Multi-audio-frequency flow data block
3rd exemplary embodiment
Meanwhile, be similar to the first exemplary embodiment, the another kind of method utilizing HDMI audio data block can be considered.
The marker code of expansion is newly defined.Be similar to the first exemplary embodiment, tag identification code 18 can be used to the HDMI audio data block increasing expansion.
Following table provides the structure of the HDMI audio data block of expansion.Comprise the CEA short audio descriptor (ECSAD) of expansion according to the HDMI audio data block of the expansion of the 3rd exemplary embodiment, the loud speaker of expansion distributes descriptor (ESAD) and Multi-audio-frequency flow descriptors (MASD).
If receiver apparatus supports 3D audio-frequency function, then ECSAD comprises the descriptor of number identical with the number of the value of Num_ECSAD field.And if if receiver apparatus supports that the value of 3D voice-grade channel function Num_ECSAD field is greater than 0, then ESAD comprises a descriptor.If receiver apparatus supports multi-stream audio function, then MASD comprises the descriptor of number identical with the number of the value of Num_MASD field.
The maximum number that Max_stream_count-1 field is defined as the stream that receiver apparatus can receive deducts 1.Owing to utilizing an audio sample grouping to send multi-stream audio, the audio stream therefore in each view indicates identical audio frequency characteristics, such as type of coding and sample frequency.
The quantity of the CEA short audio descriptor of Num_MASD Field Definition expansion.The CEA short audio descriptor of nearly seven expansions can be comprised.If this field is 0, then instruction can not support 3D audio-frequency function.
Num_ECSAD Field Definition comprises the quantity of multi-stream audio descriptor within the data block.Nearly four multi-stream audio descriptors can be comprised.If when this field is 0, instruction can not support multi-stream audio.If Max_stream_count-1 is not 0, then should define at least one MASA.If ECSAD comprises the method using and utilize four byte definition, then can define at most six multi-stream audio descriptors according to exemplary embodiment.
The HDMI audio data block that table 69 is expanded
The number of X:ECSAD
The number of Y:MASD
Table 69-1Max_Stream_Count-1 field
| Max_Stream_Count-1 | Describe |
| 00 | Do not support Multi-audio-frequency stream |
| 01 | 2 audio streams |
| 10 | 3 audio streams |
| 11 | 4 audio streams |
The 3rd exemplary embodiment above can comprise following alternative suggestion.
Such as, the HDMI audio data block of expansion only can comprise ECSAD, and other two ESAD and MASD can use other marker code expanded to define.
Two descriptors of the marker code definition utilizing other to expand can be defined as independent data block or be defined as data block different from each other.Define in upper table in the field of PB3, Max_stream_count-1 is comprised in the data block of definition multi-stream audio descriptor.
Superincumbent description is compared, and the HDMI audio data block of expansion can comprise ECSAD and ESAD relevant to 3D audio frequency, and MASD can use other marker code expanded to define.
ECSAD structure describes by referring to following table, and in the following table, ECSAD structure corresponds to wide line character.
With reference to lower-left table, descriptor is current can be selected from two kinds of type of coding such as LPCM and DSD.In addition, the reserve area of UAFC field can be used to add other unpressed audio formats.
The number of passage can utilize 5 bits to distribute, and can select nearly 32 passages.
The CEA short audio descriptor that table 70 is expanded
The HDMI voice data block structure of table 70-1 expansion
The unpressed audio format code field of table 70-2
The CEA short audio descriptor of table 70-3 expansion
In addition, about said method, as follows according to the supplementary features of exemplary embodiment.
The sum of descriptor is expanded to 4 bytes by following table.And, the table ginseng audio format code defined from CEA861-E.Therefore, the compression defined in CEA861-E and unpressed both type of codings can be assigned with.
When descriptor quantity increases, the number that can be included ECSAD is within the data block restricted to maximum 6 descriptors.In addition, above-mentioned exemplary embodiment can comprise 4 descriptors.
According to the change of audio format type of coding, the grammer of PB3 with PB4 is defined as identical with 3 to the byte 2 of table 49 with the table 45 in CEA861-E.
The CEA short audio descriptor that table 71 is expanded
The HDMI voice data block structure of table 71-1 expansion
The CEA short audio descriptor of table 71-2 expansion
According to the 3rd exemplary embodiment, ESAD structure is described.
Wide line character instruction ESAD structure below in table.
Current, ESAD can select the loud speaker assignment information of nearly 30.2 passages.But, use the reserve area of ACAT field, another loud speaker can be comprised in addition and place form.
The loud speaker that table 72 is expanded distributes descriptor
The HDMI audio block structure of table 72-1 expansion
Table 72-2 voice-grade channel distributes type field
The loud speaker of table 72-3 expansion distributes descriptor
Following table instruction ESAD.The wide line character of each table is used to the loud speaker distributing respective channel distribution type.
The loud speaker that table 73 is expanded distributes descriptor
The following describes the structure of the ESAD according to the 3rd exemplary embodiment.The structure of the wide line character instruction ESAD in table.
Be used in the CEA short audio descriptor defined in CEA861-E according to the rules.In addition, although comprise each field in CEA short audio descriptor, the format partly changing/revise defined field and arrange or measure can be used.When sending multi-stream audio, can only comprise described descriptor.If used, then comprise at least one in described descriptor.
Table 74 Multi-audio-frequency flow descriptors
The HDMI voice data block structure of table 74-1 expansion
Table 74-2 Multi-audio-frequency flow descriptors
Following table newly defines the structure of multi-stream audio descriptor.Replace using CEA short audio descriptor according to the rules, new descriptor can be used.
Number of active lanes in multi-stream audio is restricted to 2.Therefore, in these descriptors, unnecessary channel counts field is deleted, and the maximum number-1 of stream is defined as 2 bits.The Max_stream_count-1 specified in the PB3 of the HDMI audio data block of expansion is defined as the maximum of the Max_stream_count-1 in each descriptor.
Descriptor in each audio format code of each table instruction below.
Table 75 Multi-audio-frequency flow descriptors
Table 75-1 is used for the Multi-audio-frequency flow descriptors of audio code 1 (LPCM)
Table 75-2 is used for the Multi-audio-frequency flow descriptors of audio format code 2 to 8
Table 75-3 is used for the Multi-audio-frequency flow descriptors of audio format code 9 to 13
Table 75-4 is used for the Multi-audio-frequency flow descriptors of audio format code 14 (WWA Pro)
Table 75-5 is used for the Multi-audio-frequency flow descriptors of audio format code 15 (expansion)
the application scenarios of 4-1.3D audio frequency and multi-stream audio
In the following description, provide for 3D audio frequency and the application scenarios according to the multi-stream audio in the first exemplary embodiment.Exemplary embodiment below shows the ability of acceptor device transmission HDMI2.0 source, 3D audio frequency and multi-stream audio.
For the scene of 3D audio frequency
Figure 13 shows 3D audio sample and is sent to TV by from Blu-ray player (BDP).This exemplary embodiment hypothesis is as follows.
The source of such as BDP and the receiver of such as TV are the equipment meeting HDMI 2.0.
Source sends the audio stream of L-PCM 48kHz 22.2 passage to receiver.
Receiver receives the audio sample of L-PCM 48kHz 22.2 passage, and by each audio streams to corresponding loud speaker.According to exemplary embodiment, the video format of transmission is 1080p/60Hz.
TV comprises the E-EDID data structure meeting CEA-861-F (D or E), and it can utilize DDC to access.In order to support to send 3D audio frequency, except the data block of other necessity, E-EDID also comprises HDMI audio data block.BDP receives HDMI audio data block, and identifies the 3D audio capability of the TV described in table 76.
Table 76 is for the example of the HDMI audio data block of 22.2 passages
Byte 1,2,3 indicates HDMI audio data block head.NUM_HDMI_3D_AD is set up as 1, and its instruction sends 3D audio frequency.NUM_CEA_SAD and Max_stream_count-1 is set to 0, because BDP does not process multi-stream audio in this exemplary scenario.
Byte 4,5,6,7 forms the HDMI 3D audio descriptor of the 3D audio frequency characteristics describing TV.Audio format code, maximum number of channels-1, sample frequency and sample size are defined.
Byte 8,9,10,11 forms the HDMI 3D describing the effective loud speaker (SMPEG 2036-2) being used for 22.2 passages and distributes descriptor.
BDP receives EDID from TV, and sends audio-frequency information frame and audio metadata grouping to TV.In this case, audio metadata grouping is used to the audio-frequency information frame replacing sendaisle counting and passage/loud speaker assignment information.
In audio metadata grouping, included 3D_CC and 3D_CA describes channel counts for 22.2 channel audio streams and passage/loud speaker assignment information respectively.Table 77 below gives the example of the audio-frequency information frame payload of transmission 22.2 channel audio.Table 78 gives the audio metadata grouping payload of transmission 22.2 channel audio.
Table 77 is for the example of the audio-frequency information frame payload of 22.2 passages
Table 78 audio metadata grouping payload
BDP is by the sampling of 3D audio sample grouping transmission 22.2 channel audio.Nearly 8 voice-grade channels are supported in each 3D audio sample grouping, and therefore, need three continuous print 3D audio sample groupings to send 22.2 channel audio samplings.Sample_start is used to distribution first 3D audio sample grouping.In the exemplified embodiment, three 3D audio sample groupings can be defined as table 79 to table 81 defined.
Table 79 is for the example of first 3D audio sample grouping of 22.2 passages
Table 80 is for the example of second 3D audio sample grouping of 22.2 passages
Table 81 is for the example of the 3rd 3D audio sample grouping of 22.2 passages
4-2 is used for the example of the scene of multi-stream audio
Figure 14 show according to exemplary embodiment, multi-stream audio is sent to TV by from BDP.This exemplary embodiment hypothesis is as follows.
The source of such as BDP and the receiver of such as TV are the equipment meeting HDMI 2.0.
Source/receiver enters dual-view game mode.
Source sends two audio streams of each view.
Receiver can send two audio streams to different from each other two earphones.
The video format sent is HDMI 3D 1080p/60Hz.
TV comprises the E-EDID data structure meeting CEA-861-F (D or E), and it can utilize DDC to access.In order to support multi-stream audio, except the data block of other necessity, E-EDID also comprises HDMI audio data block.BDP receives HDMI audio data block, and identifies the multi-stream audio ability of the TV described in table 76.
Table 82 is for the example of the HDMI audio data block of two audio streams
Byte 1,2,3 indicates HDMI audio data block head.NUM_CEA_SAD is set up as 2, because receiver support is used for the audio format code of two types of multi-stream audio.Max_stream_count-1 is set up as 1, because receiver can process two independently audio streams as described above.NUM_HDMI_3D_AD is set up as 0, because BDP can process transmission 3D audio frequency in this exemplary scenario.
Byte 4,5,6 forms a CEA short audio descriptor of description audio feature.About transmission multi-stream audio, largest passages counting is restricted to 2.Therefore, the maximum quantity-1 of passage is 1.
Byte 7,8,9 indicates the 2nd CEA short audio descriptor of description audio feature.As mentioned above, the maximum quantity-1 of passage is 1.BDP, after receiving EDID from TV, can send audio-frequency information frame to TV.To send scene contrary with 3D audio frequency, CC and CA is respectively applied for sendaisle counting and passage/loud speaker assignment information.Audio metadata grouping can not be used to send multi-stream audio.Table 83 shows the example of the audio-frequency information frame payload of transmission two audio streams.
Table 83 is for the example of the audio-frequency information frame payload of two audio streams
BDP sends the multi-stream audio sampled packet with stereo sound frequency sampling being used for two independently audio streams.Therefore, the first subgroup has the stereo sound frequency sampling from the first audio stream, and the second subgroup has the stereo sound frequency sampling from the second audio stream.In the exemplified embodiment, multi-stream audio sampled packet can be defined as shown in table 84.
Table 84 is for the example of the multi-stream audio sampled packet of two audio streams
3D audio tweeter is placed and channel allocation
In the following description, will illustrate that the loud speaker being used for 3D voice-grade channel places (placement) and channel allocation.
Figure 15 shows and places according to the loud speaker for 3D voice-grade channel of exemplary embodiment.
According to the exemplary embodiment described in table 85, when IEC 30.2 channel standard type, FL represents front left speaker, FR represents front right loud speaker, LFF1 represents low-frequency effect 1 loud speaker, loud speaker in before FC represents, BL represents rear left speaker, BR represents rear right loud speaker, FLW represents the broadening loud speaker of front left, FRW represents the broadening loud speaker of front right, TpFL represents left speaker before top, TPFR represents top front right loud speaker, BC represents rear middle loud speaker, LS represents left circulating loudspeaker, RS represents right circulating loudspeaker, LFE2 represents low-frequency effect 2 loud speaker, FLC indicates loud speaker in front left, FRC represents loud speaker in front right, TpFC represents loud speaker in before top, TpC represents loud speaker in top, SiL represents left speaker, SiR represents right speaker, TpBL represents left speaker behind top, TpBR represents top rear right loud speaker, TpSiL represents top left side loud speaker, TpSiR represents top right side loud speaker, BtFC represents loud speaker in before bottom, BtFL represents left speaker before bottom, BtFR represents bottom front right loud speaker, TpBC represents loud speaker in behind top, TpLS represents top left circulating loudspeaker, TpRS represents top right circulating loudspeaker, LSd represents left around direct loud speaker, RSd represents right around direct loud speaker.
But according to type, loud speaker title can be different from each other.Such as, front middle loud speaker is written as FC in above-mentioned IEC standard, but front middle loud speaker is written as C by TTA standard.Other various loud speaker title except the title described in table below also can be used.The description of following table and Figure 15 describes one of exemplary embodiment; Loud speaker and channel allocation differently can configure according to other exemplary embodiment.
Be different from 2D voice data, utilize the 3D voice data of multichannel support to have common trait: to have loud speaker different from each other respectively in the top of 3d space, central authorities and bottom.Figure 15 shows the exemplary embodiment that the loud speaker in a region is placed.
Table 85 voice-grade channel describes and abbreviation is compared (CEA/TTA/SMPTE/IEC)
5 data transmission method for uplink and data receive method
Hereinafter, the method transmitted and receive data meeting above-mentioned standard is explained with reference to Figure 16 to Figure 19.
Figure 16 to Figure 19 is the flow chart that data transmission method for uplink according to various exemplary embodiment and data receive method are shown.
First, with reference to Figure 16, can be included in operation S1610 according to the data transmission method for uplink of various exemplary embodiment and generate about the multiple groupings for multi-channel audio sampled data, and in operation S1620, generated multiple groupings are sent to data sink.Each in the multiple groupings generated can comprise for identifying their positions in the middle of grouping of differentiation and/or the identifier field of order.As mentioned above, therefore repeated description will no longer be explained in each operation.
With reference to Figure 17, according to the data receive method of various exemplary embodiment can be included in operation S1710 in receive from data transmitter send about the multiple groupings for multi-channel audio sampled data, and operation S1720 in parsing is performed to the multiple groupings received.Each in the multiple groupings received can comprise for distinguishing their positions in the middle of grouping and/or the identifier field of order.Each operation as mentioned above, therefore will no longer be explained.
Identifier field can comprise predetermined bit, and whether the grouping that its instruction has identification field is that first of multi-channel audio sampled data is divided into groups.
With reference to Figure 18, can be included in operation S1810 according to the data transmission method for uplink of various exemplary embodiment and generate the grouping comprising multiple subgroup, and in operation S1820, generated grouping is sent to data sink.Each operation as mentioned above, therefore will no longer be explained.
With reference to Figure 19, can be included in operation S1910 according to the data receive method of various exemplary embodiment and receive the grouping comprising multiple subgroup, and in operation S1920, parsing be performed to the grouping received.Each operation as mentioned above, therefore will no longer be explained.
Each in multiple subgroup can comprise the voice data corresponding with the arbitrary content in multiple content.
Foregoing example embodiment and advantage are only exemplary, and should not be interpreted as limiting exemplary embodiment.This instruction easily can be applied to the device of other type.In addition, the description of exemplary embodiment is intended to be illustrative, instead of the scope of restriction claims, and manyly to substitute, modifications and variations will be apparent to those skilled in the art.
Claims (15)
1. a data sending device, comprising:
Packet generator, it generates the multiple groupings about multi-channel audio sampled data; And
Transmitter, generated multiple groupings are sent to data sink by it,
Wherein, each in the multiple groupings generated comprises distinguishes the position of described grouping or the identifier field of order.
2. data sending device as claimed in claim 1, wherein, described identifier field comprises the predetermined bit whether grouping that instruction has an identifier field is the first grouping of multi-channel audio sampled data.
3. data sending device as claimed in claim 1, wherein, described identifier field comprises the predetermined bit that instruction has the packet index of identifier field.
4. data sending device as claimed in claim 1, wherein, each in the multiple groupings generated comprises at least one subgroup, and at least one subgroup described stores a part for multi-channel audio sampled data.
5. data sending device as claimed in claim 4, wherein, each in the multiple groupings generated comprises at least one that sampling exists in bit and the flat bit of sampling, there is bit instruction at least one subgroup described and whether have multi-channel audio sampled data in described sampling, and whether the audio sampling data that described sampling flat bit instruction subgroup comprises is effective.
6. data sending device as claimed in claim 1, wherein, described multi-channel audio sampled data comprises the audio signal of 9 or more passages.
7. data sending device as claimed in claim 1, wherein, described multi-channel audio sampled data is according to International Electrotechnical Commission (IEC) 60958 format configuration.
8. a data sink, comprising:
Receiver, it receives the multiple groupings about multi-channel audio sampled data sent from data sending device; And
Packet parsing device, it resolves the multiple groupings received,
Wherein, each in the multiple groupings received comprises distinguishes the position of described grouping or the identifier field of order.
9. data sink as claimed in claim 8, wherein, described identifier field comprises the predetermined bit whether grouping that instruction has an identifier field is the first grouping of a multi-channel audio sampled data.
10. data sink as claimed in claim 8, wherein, each in the multiple groupings received comprises at least one subgroup, and at least one subgroup described stores a part for multi-channel audio sampled data.
11. data sinks as claimed in claim 10, wherein, each in the multiple groupings received comprises at least one that sampling exists in bit and the flat bit of sampling, there is bit instruction at least one subgroup described and whether have multi-channel audio sampled data in described sampling, and whether the audio sampling data that described sampling flat bit instruction subgroup comprises is effective.
12. data sinks as claimed in claim 8, wherein, described multi-channel audio sampled data comprises the audio signal of 9 or more passages.
13. data sinks as claimed in claim 8, wherein, described multi-channel audio sampled data is according to International Electrotechnical Commission (IEC) 60958 format configuration.
14. 1 kinds of data transmission method for uplink, comprising:
Generate the multiple groupings about multi-channel audio sampled data; And
Generated multiple groupings are sent to data sink,
Wherein, each in the multiple groupings generated comprises distinguishes the position of described grouping or the identifier field of order.
15. 1 kinds of data receive methods, comprising:
Receive the multiple groupings about multi-channel audio sampled data sent from data sending device; And
Resolve the multiple groupings received,
Wherein, each in the multiple groupings received comprises distinguishes the position of described grouping or the identifier field of order.
Applications Claiming Priority (25)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US201261599154P | 2012-02-15 | 2012-02-15 | |
| US61/599,154 | 2012-02-15 | ||
| US201261602975P | 2012-02-24 | 2012-02-24 | |
| US201261602978P | 2012-02-24 | 2012-02-24 | |
| US61/602,975 | 2012-02-24 | ||
| US61/602,978 | 2012-02-24 | ||
| US201261604844P | 2012-02-29 | 2012-02-29 | |
| US201261604892P | 2012-02-29 | 2012-02-29 | |
| US61/604,844 | 2012-02-29 | ||
| US61/604,892 | 2012-02-29 | ||
| US201261611822P | 2012-03-16 | 2012-03-16 | |
| US61/611,822 | 2012-03-16 | ||
| US201261613629P | 2012-03-21 | 2012-03-21 | |
| US61/613,629 | 2012-03-21 | ||
| US201261636879P | 2012-04-23 | 2012-04-23 | |
| US201261636901P | 2012-04-23 | 2012-04-23 | |
| US61/636,879 | 2012-04-23 | ||
| US61/636,901 | 2012-04-23 | ||
| US201261641580P | 2012-05-02 | 2012-05-02 | |
| US61/641,580 | 2012-05-02 | ||
| US201261647628P | 2012-05-16 | 2012-05-16 | |
| US61/647,628 | 2012-05-16 | ||
| KR10-2012-0123638 | 2012-11-02 | ||
| KR1020120123638A KR102047800B1 (en) | 2012-02-15 | 2012-11-02 | Data transmitting apparatus, data receiving apparatus, data transreceiving system, data transmitting method, data receiving method and data transreceiving method |
| PCT/KR2013/001129 WO2013122386A1 (en) | 2012-02-15 | 2013-02-13 | Data transmitting apparatus, data receiving apparatus, data transreceiving system, data transmitting method, data receiving method and data transreceiving method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104221402A true CN104221402A (en) | 2014-12-17 |
| CN104221402B CN104221402B (en) | 2017-05-24 |
Family
ID=49218119
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201380020188.XA Expired - Fee Related CN104221402B (en) | 2012-02-15 | 2013-02-13 | Data transmitting apparatus, data receiving apparatus, data transreceiving system, data transmitting method, data receiving method and data transreceiving method |
| CN201380020186.0A Expired - Fee Related CN104221401B (en) | 2012-02-15 | 2013-02-13 | Data sending device and method, data sink and method, data receiving-transmitting system and method |
Family Applications After (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201380020186.0A Expired - Fee Related CN104221401B (en) | 2012-02-15 | 2013-02-13 | Data sending device and method, data sink and method, data receiving-transmitting system and method |
Country Status (2)
| Country | Link |
|---|---|
| KR (4) | KR102012231B1 (en) |
| CN (2) | CN104221402B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111478825A (en) * | 2020-04-10 | 2020-07-31 | 深圳市风云实业有限公司 | Extensible network traffic generation and analysis method and system |
| CN112436898A (en) * | 2020-11-09 | 2021-03-02 | 西安全志科技有限公司 | Voice data transmission method, computer device and computer readable storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050220193A1 (en) * | 2004-04-02 | 2005-10-06 | Sony Corporation | Transmission apparatus, reception apparatus and transmission/reception system |
| CN101491002A (en) * | 2006-05-17 | 2009-07-22 | 国家Ict澳大利亚有限公司 | Transmitting and receiving media packet streams |
| US20120014396A1 (en) * | 2010-07-14 | 2012-01-19 | Electronics And Telecommunications Research Institute | Method and apparatus for transmitting/receiving multiplexed packet stream over single transmission channel |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004364171A (en) * | 2003-06-06 | 2004-12-24 | Mitsubishi Electric Corp | Multichannel audio system, as well as head unit and slave unit used in same |
| JP2006317575A (en) * | 2005-05-11 | 2006-11-24 | Matsushita Electric Ind Co Ltd | Audio decoding device |
| US20070186015A1 (en) * | 2006-02-08 | 2007-08-09 | Taft Frederick D | Custom edid content generation system and method |
| WO2008132811A1 (en) * | 2007-04-17 | 2008-11-06 | Panasonic Corporation | Communication system |
| KR100942142B1 (en) * | 2007-10-11 | 2010-02-16 | 한국전자통신연구원 | Method and apparatus for transmitting and receiving of the object based audio contents |
| US20120113113A1 (en) * | 2009-06-30 | 2012-05-10 | Yeon Hyuk Hong | Method of processing data for 3d images and audio/video system |
| JP2011124925A (en) | 2009-12-14 | 2011-06-23 | Sony Corp | Output control apparatus, output control method, program, and output control system |
-
2012
- 2012-11-02 KR KR1020120123642A patent/KR102012231B1/en active IP Right Grant
- 2012-11-02 KR KR1020120123638A patent/KR102047800B1/en active IP Right Grant
- 2012-12-28 KR KR1020120157114A patent/KR102011474B1/en active IP Right Grant
-
2013
- 2013-01-02 KR KR1020130000373A patent/KR101765566B1/en active IP Right Grant
- 2013-02-13 CN CN201380020188.XA patent/CN104221402B/en not_active Expired - Fee Related
- 2013-02-13 CN CN201380020186.0A patent/CN104221401B/en not_active Expired - Fee Related
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050220193A1 (en) * | 2004-04-02 | 2005-10-06 | Sony Corporation | Transmission apparatus, reception apparatus and transmission/reception system |
| CN101491002A (en) * | 2006-05-17 | 2009-07-22 | 国家Ict澳大利亚有限公司 | Transmitting and receiving media packet streams |
| US20120014396A1 (en) * | 2010-07-14 | 2012-01-19 | Electronics And Telecommunications Research Institute | Method and apparatus for transmitting/receiving multiplexed packet stream over single transmission channel |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111478825A (en) * | 2020-04-10 | 2020-07-31 | 深圳市风云实业有限公司 | Extensible network traffic generation and analysis method and system |
| CN111478825B (en) * | 2020-04-10 | 2023-04-18 | 深圳市风云实业有限公司 | Extensible network traffic generation and analysis method and system |
| CN112436898A (en) * | 2020-11-09 | 2021-03-02 | 西安全志科技有限公司 | Voice data transmission method, computer device and computer readable storage medium |
| CN112436898B (en) * | 2020-11-09 | 2022-06-14 | 西安全志科技有限公司 | Voice data transmission method, computer device and computer readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104221401A (en) | 2014-12-17 |
| CN104221401B (en) | 2018-07-06 |
| KR102011474B1 (en) | 2019-08-16 |
| KR20130094163A (en) | 2013-08-23 |
| KR102047800B1 (en) | 2019-11-22 |
| KR20130094224A (en) | 2013-08-23 |
| KR20130094172A (en) | 2013-08-23 |
| KR20130094162A (en) | 2013-08-23 |
| KR101765566B1 (en) | 2017-08-07 |
| CN104221402B (en) | 2017-05-24 |
| KR102012231B1 (en) | 2019-08-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103269476B (en) | Data transmitting/receiving equipment and data receiving-transmitting system | |
| CN103269475B (en) | Data transmitting/receiving equipment and data receiving-transmitting method | |
| US9497297B2 (en) | Data transmitting apparatus, data receiving apparatus, data transreceiving system, data transmitting method, data receiving method and data transreceiving | |
| CN105308977B (en) | Sending device and method, reception device and method and computer readable storage medium | |
| CN104053039B (en) | Data transmitter-receiver set, data receiving-transmitting system and data receiving-transmitting method | |
| US9723245B2 (en) | Data transmitting apparatus, data receiving apparatus, data transceiving system, method for transmitting data, and method for receiving data | |
| US9661107B2 (en) | Data transmitting apparatus, data receiving apparatus, data transceiving system, data transmitting method, data receiving method and data transceiving method configured to distinguish packets | |
| US10986070B2 (en) | Transmission apparatus, transmission method, reception apparatus, and reception method | |
| US20120075420A1 (en) | Method and apparatus for generating datastream for displaying three-dimensional user recognition information, and method and apparatus for reproducing the datastream | |
| CN104221402A (en) | Data transmitting apparatus, data receiving apparatus, data transreceiving system, data transmitting method, data receiving method and data transreceiving method | |
| TWI666931B (en) | Data transmitting apparatus, data receiving apparatus and data transceiving system | |
| US20170289613A1 (en) | Transmission apparatus, transmission method, reception apparatus, and reception method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20170524 |