WO2021155869A1 - Method for improving hdmi display data stream compression and interconnection - Google Patents

Method for improving hdmi display data stream compression and interconnection Download PDF

Info

Publication number
WO2021155869A1
WO2021155869A1 PCT/CN2021/078559 CN2021078559W WO2021155869A1 WO 2021155869 A1 WO2021155869 A1 WO 2021155869A1 CN 2021078559 W CN2021078559 W CN 2021078559W WO 2021155869 A1 WO2021155869 A1 WO 2021155869A1
Authority
WO
WIPO (PCT)
Prior art keywords
dsc
hdmi
display device
improving
interconnection
Prior art date
Application number
PCT/CN2021/078559
Other languages
French (fr)
Chinese (zh)
Inventor
黄炯
龙仕强
Original Assignee
广东博华超高清创新中心有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 广东博华超高清创新中心有限公司 filed Critical 广东博华超高清创新中心有限公司
Publication of WO2021155869A1 publication Critical patent/WO2021155869A1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/765—Interface circuits between an apparatus for recording and another apparatus
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2389—Multiplex stream processing, e.g. multiplex stream encrypting
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2389—Multiplex stream processing, e.g. multiplex stream encrypting
    • H04N21/23895—Multiplex stream processing, e.g. multiplex stream encrypting involving multiplex stream encryption
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/426—Internal components of the client ; Characteristics thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
    • H04N21/43632—Adapting the video stream to a specific local network, e.g. a Bluetooth® network involving a wired protocol, e.g. IEEE 1394
    • H04N21/43635—HDMI
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/438—Interfacing the downstream path of the transmission network originating from a server, e.g. retrieving encoded video stream packets from an IP network
    • H04N21/4385—Multiplex stream processing, e.g. multiplex stream decrypting
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/438—Interfacing the downstream path of the transmission network originating from a server, e.g. retrieving encoded video stream packets from an IP network
    • H04N21/4385—Multiplex stream processing, e.g. multiplex stream decrypting
    • H04N21/43853—Multiplex stream processing, e.g. multiplex stream decrypting involving multiplex stream decryption
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440263—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440281—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the temporal resolution, e.g. by frame skipping
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4781—Games
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/015—High-definition television systems

Definitions

  • the present invention relates to the technical field of display data stream compression (DSC, Display Stream Compression) specified by the HDMI (High Definition Media Interface) 2.1 standard, in particular to a method for improving the compression and interconnection of HDMI display data streams.
  • This method improves the DSC in HDMI
  • the interconnection and intercommunication at the system level can solve the problem of the mismatch of the capabilities of the receiving and sending end caused by the existing technology.
  • FIG. 1 is a basic HDMI functional block diagram, including three TMDS (Transmission Minimized Differential Signal) data channels and a TMDS clock channel, as well as the transceiver communication DDC (Display Data Channel) and connection indication HPD (Hot Plug Detection).
  • TMDS Transmission Minimized Differential Signal
  • DDC Display Data Channel
  • HPD Hot Plug Detection
  • FIG. 2 is a functional diagram of the HDMI FRL (Fixed Rate Link) mode, which includes 4 FRL data channels. Among them, the fourth FRL data channel multiplexes the clock channel of the TMDS mode. DDC and HPD are the same as the TMDS mode.
  • the VESA Video Electronics Standard Association
  • DSC Display Stream Compress
  • the prerequisite for DSC application is that the transceiver must communicate to ensure that their DSC capabilities are matched, otherwise it will cause the system to increase unnecessary complexity or reduce system efficiency.
  • Figure 3 is a diagram of HDMI transmission data structure, including 4 transmission periods: video data period, data island period, scrambling control period, and scrambling synchronization control period.
  • each frame/field data For each frame/field data, it should include a Vsync signal as the start signal for frame/field synchronization. Each row of data should contain an Hsync signal.
  • Each frame/field can be divided into active and inactive areas. When in the active area, it transmits display pixel data according to the horizontal and vertical active ranges. When in the inactive area, it transmits non-display data such as data islands, scrambled control data, and scrambled synchronization control data.
  • Figure 4 is a video compression timing diagram.
  • the DSC data stream is transmitted in the video active area, and then transmitted downstream by the FRL link.
  • the DSC module contains multiple DSC slice processing units, and each DSC slice processing unit processes part of the video data of each frame according to a predefined parameter set.
  • Figure 5 is a typical HDMI2.1 system diagram with DSC capability, which includes a sending device, a receiving device and connecting lines.
  • Video decoder which decodes the video data stream provided by the program provider, such as AVS3 8K120 video data content.
  • VESA DSC works when it is enabled.
  • the FRL/TMDS encoding module encodes the data according to the FRL/TMDS protocol
  • the FRL/TMDS decoding module decodes the data according to the FRL/TMDS protocol
  • the non-coding protocol module processes audio, video and other data
  • VESA DSC decompresses the display data, DSC can choose not to work
  • the HDMI cable connects the source device at the sending end of the HDMI and the display device at the receiving end.
  • HDMI2.1 has a good definition of VESA DSC application, but there is a problem that will cause the DSC capability of the HDMI transceiver to be mismatched.
  • Table 1 is the display capability data structure defined by the HDMI 2.1 standard. For details, see Chapter 10.3.2 of the HDMI 2.1a Standard, Table 10-7 (Sink Capability Data Structure, SCDS). This data structure is located in the EDID ( Extended Display Identification Data). Byte 8 to byte 10 describe the DSC capability of the display device in detail.
  • DSC_10bpc of 1 indicates that the display device can decode 10bpc compressed display data stream, otherwise it does not support it.
  • the DSC_12bpc value of 1 indicates that the display device can decode the 12bpc compressed display data stream, otherwise it does not support it.
  • DSC_16bpc can only be set to 0 at present.
  • a value of 0 for DSC_All_bpp means that the display device can decode the main formats of 4:4:4 and 4:2:2 specified in chapter 7.8.3.1 of the HDMI2.1a Standard.
  • a value of 1 means that it can decode HDMI2.1 chapter 7.8.3.1
  • the display device can also decode more compressed display data streams in steps of 1/16bpp.
  • DSC_Native_420 of 1 indicates that the display device can decode the video compression transmission in 4:2:0 format, otherwise it does not support it.
  • DSC_1p2 of 1 indicates that the display device uses the VESA DSC1.2a standard, otherwise it is not supported.
  • the 4th and 5th bits of byte 8 are reserved, and the current value is 0.
  • DSC_MaxSlices is used to define the number of DSC processing units, the possible values are 0, 1, 2, 4, 8, 12, 16, etc.
  • DSC_Max_FRL_Rate is used to define the highest FRL rate of DSC usage scenarios, which may be 3Gbps, 3-channel 6Gbps, 4-channel 6Gbps, 8Gbps, 10Gbps and 12Gbps.
  • DSC_TotalChunkKBytes defines the line width of the DSC processing unit, in units of 1024 bytes.
  • the transmitting end reads the capability parameters of the receiving end, including the DSC decompression capability (table 1 byte 8-10). According to these parameters of the receiving end, the sender decides how to configure the sender DSC compression parameters to maximize the system performance and resource utilization.
  • Manufacturers may choose according to the product usage scenario. For example, a monitor with powerful game functions is more likely to use 12 DSC film processing units than ordinary TVs. , Support smooth screen.
  • the purpose of the present invention is to provide a method for improving the compression and interconnection of HDMI display data streams, and to improve the display data compression algorithm used in HDMI transmission in terms of interconnection and interconnection, and this method can solve the problem of the VESA DSC capability mismatch of the HDMI transceiver terminal.
  • Step 1 Device connection
  • Step 2 The source device sends out +5V
  • Step 3 The display device returns to HPD high level
  • Step 4 Read EDID
  • Step 5 EDID content analysis
  • Step 7 Software and hardware settings
  • Step 8 Send content
  • Step 9 Decompression on the display side, other signal processing and display.
  • the present invention proposes to amend the HDMI2.1 text, and conditionally allow the DSC YCbCr 4:2:2 strain mode on the source device side.
  • this description can be added in chapter 7.8.3 of the future revision of HDMI2.1:
  • HDMI2.1 allows 4:2:2 DSC compression transmission.
  • the method of the present invention is to add a new option to the HDMI2.1 protocol, allowing HDMI2.1 display devices to clearly indicate that they are conditionally supporting the YCbCr 4:2:2 strain mode, so as to ensure that the connected devices are in certain modes (For example, AVS3 8K120) It can use 4:2:2 strain mode to transmit the display data stream to ensure the normal operation of the system, so that the problem of mismatch can be solved.
  • Table 2 is the definition of the improved SCDS (Sink Capability Data Structure) table, namely: HDMI2.1a Table 10-7 of the present invention: Display Capability Data Structure (Sink Capability Data Structure, SCDS),
  • the display device can strain 4:2:2 DSC compression, so that it can be connected to source devices that cannot perform 4:4:4 DSC compression. Use 4:2:2 DSC compression instead, and send the corresponding display data .
  • the display device does not accept 4:2:2 DSC compression.
  • the source device needs to downgrade the video content, such as using 4:2:0 encoding, using a lower frame rate or Lower resolution.
  • Table 2 is improved based on Table 1. After the HDMI device is successfully connected, the SCDS is provided to the source device through DDC transmission, so that the source device can make the most reasonable configuration of resources after learning the capabilities of the downstream display device.
  • the improved part is in the 4th bit of PB8, which was originally reserved.
  • DSC_422_Option is added, which is used to describe under certain conditions (such as: FRL rate, number of DSC slice units, pixel rate, etc.), affirm It can support 4:2:2 DSC mode.
  • the originator sends the corresponding 4:2:2 video stream (such as AVS3 8K120).
  • the DSC resource usage rate of the video source device can be Reach 100%.
  • This new feature is optional, ensuring backward compatibility. Backward compatibility can ensure that existing compliant products will continue to be compliant in the future after new features are added to industrial standards.
  • New functions can be realized by software, which is convenient for product upgrade and maintenance.
  • Figure 1 is a traditional HDMI block diagram (Legacy HDMI Block Diagram)
  • FIG. 2 is the HDMI2.1FRL mode ( FRL Mode)
  • FIG 3 is a schematic diagram of HDMI data transmission (HDMI Data Transport Overview)
  • FIG 4 is a schematic diagram of HDMI compressed video transmission (HDMI Compressed Video Transport)
  • FIG. 5 is a schematic diagram of an HDMI system with DSC function (HDMI System with DSC Functionality)
  • FIG. 6 is a detailed flow chart of the present invention (HDMI System Initialization Flow Chart)
  • FIG. 6 is a detailed flow chart of the method of the present invention.
  • the method improves the use of the HDMI display data compression algorithm in terms of intercommunication and includes 9 steps.
  • the following describes how the present invention helps HDMI devices to better communicate and match.
  • Step 1 The source device and the display device are physically linked through an HDMI cable
  • Step 2 The source device sends a +5V signal to the display device
  • Step 3 After the display device receives the +5V signal, it starts to start, first prepares the EDID content, and returns the HPD high level to the source device after the EDID is ready;
  • Step 4 After receiving the HPD high-level signal, the receiving end starts to read the EDID content of the display device through DDC;
  • Step 5 The source device parses the EDID content to understand the overall capabilities of the display device.
  • the capabilities of the display device on the DSC including the maximum rate of the FRL, and how many DSC chip processing units (for example, 8) there are;
  • the 4th bit in the 8th byte of SCDS is DSC_422_Option. If it is 1, it means that the display device can support 4:2:2 DSC under certain conditions (such as 8K120), so the required DSC resources are more than 4:4:4 DSC Less; if it is 0, it means that the display device does not support 4:2:2 DSC under this specific condition.
  • the source device needs to downgrade 8K120, such as converting 4:2:0 format, or reducing the resolution (such as reducing To 4K120), or lower the refresh rate (for example, to 8K60).
  • Step 7 After the judgment is formed, the source device performs software and hardware settings according to the functions described in Figure 1.
  • Step 8 After the settings are ready, the source device sends content to the display device through the HDMI cable according to the function described in Figure 1, such as the 8K120 4:2:2 format compressed by DSC.
  • Step 9 After the display device receives the HDMI video stream, it includes DSC decompression according to the function described in Figure 1, and then displays it, such as 8K120, using a 4-channel 10Gpbs FRL transmission rate in real time, and a throughput of 40Gbps.
  • the time to complete the above 9 steps is probably between 200ms and 2s, and this method is used in steps 5 and 6. Because of the simplicity of this method, the response time at the system level will not cause significant additional overhead.
  • HDMI high-definition audio and video interface
  • TMDS transmit differential signal
  • FRL fixed rate connection
  • DSC a digital video stream compression algorithm
  • DDC HDMI transceiver communication channel
  • HPD hot plug detection
  • EDID extended display to indicate data
  • AVS3 China's third-generation digital audio and video codec standard
  • CEC Consumer device user control message communication protocol.
  • the present invention is applicable to the technical field of Display Stream Compression (DSC, Display Stream Compression) specified by the HDMI (High Definition Media Interface) 2.1 standard, especially a method for improving the compression and interconnection of HDMI display data stream.
  • This method improves the performance of DSC
  • the interconnection and intercommunication at the HDMI system level solves the problem of the mismatch of the capabilities of the transceivers caused by the prior art.
  • the present invention is a method for improving the compression and interconnection of HDMI display data streams, and improves the display data compression algorithm used in HDMI transmission in terms of interconnection and interconnection. The method can solve the problem of the mismatch of VESA DSC capabilities of the HDMI transceiver terminal.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Theoretical Computer Science (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

Provided is a data compression method for improving HDMI transmission in terms of interconnection, comprising in particular: a source device parsing EDID content so as to understand the overall capabilities of the display device, understanding in particular, by means of parsing the SCDS data structure, display device capability in terms of DSC, comprising the maximum FRL rate, and the number of DSC slice processing units (e.g. 8); if DSC_422_Option, at the 4th bit of the 8th byte of the SCDS, is 1, this indicates that under certain conditions (e.g. 8K 120) the display device may support 4:2:2 DSC, hence required DSC resources are less than 4:4:4 DSC; if 0, this indicates that under these particular conditions the display device does not support 4:2:2 DSC. The present method allows HDMI 2.1 devices to conditionally support up to 8 DSC slice units, ensuring the normal operation of 8K 120 422 video streams, while not influencing other scenarios; backward compatibility is ensured, and the mismatch problem of VESA/DSC capability and HDMI transceiving terminals is resolved.

Description

改进HDMI显示数据流压缩互通互联的方法Improved HDMI display data stream compression and interconnection method 技术领域Technical field
本发明涉及HDMI(High Definition Media Interface)2.1标准指定的显示数据流压缩(DSC,Display Stream Compression)技术领域，特别是一种改进HDMI显示数据流压缩互通互联的方法，这个方法改进了DSC在HDMI系统层面的互联互通，以解决现有技术导致收发端能力不匹配的问题。The present invention relates to the technical field of display data stream compression (DSC, Display Stream Compression) specified by the HDMI (High Definition Media Interface) 2.1 standard, in particular to a method for improving the compression and interconnection of HDMI display data streams. This method improves the DSC in HDMI The interconnection and intercommunication at the system level can solve the problem of the mismatch of the capabilities of the receiving and sending end caused by the existing technology.
背景技术Background technique
图1是基本的HDMI功能框图，包含3个TMDS(Transmission Minimized Differential Signal)数据通道和一个TMDS时钟通道，以及收发端通信DDC(Display Data Channel)和连接指示HPD(Hot Plug Detection)。Figure 1 is a basic HDMI functional block diagram, including three TMDS (Transmission Minimized Differential Signal) data channels and a TMDS clock channel, as well as the transceiver communication DDC (Display Data Channel) and connection indication HPD (Hot Plug Detection).
图2是HDMI FRL(Fixed Rate Link)模式的功能图，包含4个FRL数据通道，其中，第四个FRL数据通道复用了TMDS模式的时钟通道，DDC和HPD跟TMDS模式一样。Figure 2 is a functional diagram of the HDMI FRL (Fixed Rate Link) mode, which includes 4 FRL data channels. Among them, the fourth FRL data channel multiplexes the clock channel of the TMDS mode. DDC and HPD are the same as the TMDS mode.
HDMI标准在从2.0版到2.1版的演进过程中，为了在不增加FRL带宽的前提下提高产品性能，采用了VESA(Video Electronics Standard Association)DSC(Display Stream Compress)算法。DSC应用的前提是收发端必须进行通信，保证他们的DSC能力是匹配的，否则会导致系统增加不必要的复杂度，或者降低系统效率。During the evolution of the HDMI standard from version 2.0 to version 2.1, in order to improve product performance without increasing the FRL bandwidth, the VESA (Video Electronics Standard Association) DSC (Display Stream Compress) algorithm is adopted. The prerequisite for DSC application is that the transceiver must communicate to ensure that their DSC capabilities are matched, otherwise it will cause the system to increase unnecessary complexity or reduce system efficiency.
图3是HDMI传输数据结构图，包含4个传输期：视频数据期、数据孤岛期、加扰控制期和加扰同步控制期。Figure 3 is a diagram of HDMI transmission data structure, including 4 transmission periods: video data period, data island period, scrambling control period, and scrambling synchronization control period.
针对每一帧/场数据，为了帧/场同步其应包含一个Vsync信号作为起始信号。每一行数据，应包含一个Hsync信号。每帧/场可以分为激活和非激活区。在激活区时，它按照水平和垂直激活范围传输显示像素数据，在非激活区时，它传输非显示数据如：数据孤岛、加扰控制数据、加扰同步控制数据。For each frame/field data, it should include a Vsync signal as the start signal for frame/field synchronization. Each row of data should contain an Hsync signal. Each frame/field can be divided into active and inactive areas. When in the active area, it transmits display pixel data according to the horizontal and vertical active ranges. When in the inactive area, it transmits non-display data such as data islands, scrambled control data, and scrambled synchronization control data.
图4是视频压缩时序图，在视频激活区传输DSC数据流，之后由FRL链路传到下游。DSC模块包含多个DSC片处理单元，每一个DSC片处理单元根据预定义参数集来处理每帧的部分视频数据。Figure 4 is a video compression timing diagram. The DSC data stream is transmitted in the video active area, and then transmitted downstream by the FRL link. The DSC module contains multiple DSC slice processing units, and each DSC slice processing unit processes part of the video data of each frame according to a predefined parameter set.
图5是一个典型的具备DSC能力的HDMI2.1系统图，它包含一个发送设备、一个接收设备和连接线。Figure 5 is a typical HDMI2.1 system diagram with DSC capability, which includes a sending device, a receiving device and connecting lines.
发送设备端功能和处理顺序：The function and processing sequence of the sending device:
a.视频解码器，解码节目提供商提供的视频数据流，如：AVS3 8K120视频数据内容。a. Video decoder, which decodes the video data stream provided by the program provider, such as AVS3 8K120 video data content.
b.如果解压后的视频数据超出了HDMI的物理传输能力，则需把数据送到VESA DSC做浅压缩。VESA DSC是在使能的情况下工作。b. If the decompressed video data exceeds the physical transmission capacity of HDMI, the data needs to be sent to VESA DSC for shallow compression. VESA DSC works when it is enabled.
c.未编码HDMI协议模块，处理音视频和其它相关信号；c. Uncoded HDMI protocol module, processing audio, video and other related signals;
d.内容加密；d. Content encryption;
e.FRL/TMDS编码模块根据FRL/TMDS协议对数据进行编码；e. The FRL/TMDS encoding module encodes the data according to the FRL/TMDS protocol;
g.SerDes(Serializer & De-serializer)封包FRL/TMDS数据流；g.SerDes (Serializer & De-serializer) packet FRL/TMDS data stream;
接收端功能和处理顺序：Receiver function and processing sequence:
a.SerDes解包FRL/TMDS数据流；a. SerDes unpacks FRL/TMDS data stream;
b.FRL/TMDS解码模块根据FRL/TMDS协议对数据进行解码；b. The FRL/TMDS decoding module decodes the data according to the FRL/TMDS protocol;
c.内容解密；c. Content decryption;
d.非编码协议模块处理音视频和其它数据；d. The non-coding protocol module processes audio, video and other data;
e.VESA DSC解压显示数据，DSC可以选择不工作；e. VESA DSC decompresses the display data, DSC can choose not to work;
f.视频处理模块后处理。f. Post-processing of video processing module.
HDMI线缆链接HDMI发送端源设备和接收端显示设备。The HDMI cable connects the source device at the sending end of the HDMI and the display device at the receiving end.
HDMI2.1对VESA DSC应用进行了很好的使用定义，但是有一个问题会导致HDMI收发端DSC能力不匹配。HDMI2.1 has a good definition of VESA DSC application, but there is a problem that will cause the DSC capability of the HDMI transceiver to be mismatched.
表1是HDMI2.1标准定义的显示能力数据结构，详见《HDMI 2.1a标准》第10.3.2章，表10-7(Sink Capability Data Structure,SCDS).这个数据结构位于显示设备的EDID(Extended Display Identification Data)里。字节8到字节10对显示设备的DSC能力做出了详细描述。Table 1 is the display capability data structure defined by the HDMI 2.1 standard. For details, see Chapter 10.3.2 of the HDMI 2.1a Standard, Table 10-7 (Sink Capability Data Structure, SCDS). This data structure is located in the EDID ( Extended Display Identification Data). Byte 8 to byte 10 describe the DSC capability of the display device in detail.
DSC_10bpc数值为1表明显示设备能够解码10bpc压缩显示数据流，否则不支持。The value of DSC_10bpc of 1 indicates that the display device can decode 10bpc compressed display data stream, otherwise it does not support it.
DSC_12bpc数值为1表明显示设备能够解码12bpc压缩显示数据流，否则不支持。The DSC_12bpc value of 1 indicates that the display device can decode the 12bpc compressed display data stream, otherwise it does not support it.
DSC_16bpc目前只能设置为0。DSC_16bpc can only be set to 0 at present.
DSC_All_bpp数值为0表示显示设备能够解码《HDMI2.1a标准》章节7.8.3.1所规定的4:4:4和4:2:2主要格式，数值为1表示除了能够解码HDMI2.1章节7.8.3.1所规定的4:4:4和4:2:2主要格式，显示设备还能以1/16bpp为步长，解码更多的压缩显示数据流。A value of 0 for DSC_All_bpp means that the display device can decode the main formats of 4:4:4 and 4:2:2 specified in chapter 7.8.3.1 of the HDMI2.1a Standard. A value of 1 means that it can decode HDMI2.1 chapter 7.8.3.1 For the main formats of 4:4:4 and 4:2:2, the display device can also decode more compressed display data streams in steps of 1/16bpp.
DSC_Native_420数值为1表明显示设备能够解码4:2:0格式的视频压缩传输，否则不支持。The value of DSC_Native_420 of 1 indicates that the display device can decode the video compression transmission in 4:2:0 format, otherwise it does not support it.
DSC_1p2数值为1表明显示设备使用VESA DSC1.2a标准，否则不支持。The value of DSC_1p2 of 1 indicates that the display device uses the VESA DSC1.2a standard, otherwise it is not supported.
字节8的第4、5位是预留的，目前数值为0。The 4th and 5th bits of byte 8 are reserved, and the current value is 0.
DSC_MaxSlices用来定义DSC处理单元的数目，可能的数值为0，1，2，4，8，12，16等。DSC_MaxSlices is used to define the number of DSC processing units, the possible values are 0, 1, 2, 4, 8, 12, 16, etc.
DSC_Max_FRL_Rate用来定义DSC使用场景的最高FRL速率，可能是3Gbps,3通道6Gbps，4通道6Gbps，8Gbps，10Gbps和12Gbps.DSC_Max_FRL_Rate is used to define the highest FRL rate of DSC usage scenarios, which may be 3Gbps, 3-channel 6Gbps, 4-channel 6Gbps, 8Gbps, 10Gbps and 12Gbps.
DSC_TotalChunkKBytes定义DSC处理单元的线宽，以1024字节为单位。DSC_TotalChunkKBytes defines the line width of the DSC processing unit, in units of 1024 bytes.
表1.显示能力数据结构(SCDS)Table 1. Display Capability Data Structure (SCDS)
Figure PCTCN2021078559-appb-000001
Figure PCTCN2021078559-appb-000001
当HDMI收端连接到发端，收端使能HPD信号后，发端读取收端的能力参数，包括DSC解压缩能力(表1字节8-10)。发端根据收端这些参数，决定怎么配置发端DSC压缩参数，以使系统性能最好和资源利用最优。When the HDMI receiving end is connected to the transmitting end, after the receiving end enables the HPD signal, the transmitting end reads the capability parameters of the receiving end, including the DSC decompression capability (table 1 byte 8-10). According to these parameters of the receiving end, the sender decides how to configure the sender DSC compression parameters to maximize the system performance and resource utilization.
中国最新的音视频标准AVS3支持8K120。当前HDMI2.1标准规定，针对8K120应用场景，因为需要的数据吞吐量超出目前FRL的上限，所以必须使用DSC压缩传输。发端传输需要至少4通道10Gbps FRL，也必须使用12个DSC片单元，以4:4:4或者YCbCr 4:2:2格式压缩显示数据；但是目前的HDMI2.1标准允许收端自行设定DSC能力参数(表1字节8-10)，如果DSC_Max_FRL_Rate数值设定为5(表示在显示数据流压缩的应用中，FRL速率为10Gbps),DSC_MaxSlices数值设定为5(表示具备8个DSC处理单元)，这样的组合能力最多解压8K120 YCbCr 4:2:2显示数据。允许显示设备自行设定DSC能力参数实际上让8K120 444在显示设备上成为了选项，制造商可能根据产品使用场景选用，比如具备强大游戏功能的显示器比普通电视更可能使用12个DSC片处理单元，支持流畅的画面。China's latest audio and video standard AVS3 supports 8K120. The current HDMI2.1 standard stipulates that for 8K120 application scenarios, because the required data throughput exceeds the current upper limit of FRL, DSC compression transmission must be used. Sending transmission requires at least 4 channels of 10Gbps FRL, and 12 DSC chip units must also be used to compress display data in 4:4:4 or YCbCr 4:2:2 format; but the current HDMI2.1 standard allows the receiving end to set DSC by itself Capability parameters (table 1 byte 8-10), if the value of DSC_Max_FRL_Rate is set to 5 (indicating that the FRL rate is 10Gbps in the application of display data stream compression), the value of DSC_MaxSlices is set to 5 (indicating that there are 8 DSC processing units ), this combination ability can decompress up to 8K120 YCbCr 4:2:2 display data. Allowing the display device to set the DSC capability parameters by itself actually makes 8K120 444 an option on the display device. Manufacturers may choose according to the product usage scenario. For example, a monitor with powerful game functions is more likely to use 12 DSC film processing units than ordinary TVs. , Support smooth screen.
这个在HDMI发送端和接收端的不匹配会在系统层面造成混淆，引起互联互通性冲突，导致发端设备产生不必要的复杂度，在AVS3 8K120这样的使用场景下，DSC资源利用率只有75％。也就是说，发端有12个DSC片单元，只有8个用于视频压缩传输，这非常不合理。This mismatch between the HDMI sender and receiver will cause confusion at the system level, cause interconnection conflicts, and cause unnecessary complexity for the originating device. In a usage scenario such as AVS3 8K120, the DSC resource utilization rate is only 75%. In other words, there are 12 DSC slice units at the sender, and only 8 are used for video compression transmission, which is very unreasonable.
不匹配问题不仅仅在8K120上有，对于其它格式，如8K100，8K60,8K50,8K48,10K30,10K25,10K24等，都会有这个问题。可以说这个问题具有普遍性。The problem of mismatch is not only on 8K120, but also for other formats, such as 8K100, 8K60, 8K50, 8K48, 10K30, 10K25, 10K24, etc., will have this problem. It can be said that this problem is universal.
工业界为了解决这个不匹配问题，需要引入新的特性和机制，修正HDMI2.1标准，开发对应的产品，新的方法必须能够向后兼容。In order to solve this mismatch problem, the industry needs to introduce new features and mechanisms, revise the HDMI2.1 standard, and develop corresponding products. The new methods must be backward compatible.
发明的公开Disclosure of invention
本发明的目的在于提供一种改进HDMI显示数据流压缩互通互联的方法，在互通互联方面改进HDMI传输使用的显示数据压缩算法，该方法可以解决HDMI收发端VESA DSC能力不匹配问题。The purpose of the present invention is to provide a method for improving the compression and interconnection of HDMI display data streams, and to improve the display data compression algorithm used in HDMI transmission in terms of interconnection and interconnection, and this method can solve the problem of the VESA DSC capability mismatch of the HDMI transceiver terminal.
本发明主要技术方案是：The main technical solutions of the present invention are:
步骤1：设备连接；Step 1: Device connection;
步骤2：源设备送出+5V；Step 2: The source device sends out +5V;
步骤3：显示设备返回HPD高电平；Step 3: The display device returns to HPD high level;
步骤4：读取EDID；Step 4: Read EDID;
步骤5：EDID内容解析；Step 5: EDID content analysis;
步骤6：综合判断；Step 6: Comprehensive judgment;
步骤7：软硬件设置；Step 7: Software and hardware settings;
步骤8：发送内容；Step 8: Send content;
步骤9：显示端解压缩，其他信号处理及显示。Step 9: Decompression on the display side, other signal processing and display.
对于视频流场景，比如AVS3，由8个DSC片单元完成的8K120 422解压缩性能在很长一段时间内是令人满意的。但在游戏场景并非如此，游戏为了避免在色彩上的瑕疵，更愿意使用RGB444格式，就算是8K120这样的高分辨率和高帧率，情况也如此，所以需要使用12个片单元。这两种8K120压缩场景都需要4通道FRL速率至少在10Gpbs.For video streaming scenes, such as AVS3, the 8K120422 decompression performance completed by 8 DSC slice units is satisfactory for a long time. But this is not the case in the game scene. In order to avoid color flaws, the game prefers to use the RGB444 format, even with high resolution and high frame rate such as 8K120, so it needs to use 12 slices. Both of these 8K120 compression scenarios require a 4-channel FRL rate of at least 10Gpbs.
如果一个发端设备设计12个DSC片单元但是实际应用只使用8个片单元，多余的4个片单元将增加发端设备实现的复杂度，但是没有任何性能提升。If an originating device designs 12 DSC chip units but the actual application only uses 8 chip units, the extra 4 chip units will increase the complexity of the originating device's implementation, but there will be no performance improvement.
为了解决这个问题，本发明提出对HDMI2.1的文本进行修正，在源设备端有条件允许DSC YCbCr 4:2:2应变模式。比如，可以在HDMI2.1未来的修订版本第7.8.3章节中增加这样的描述：In order to solve this problem, the present invention proposes to amend the HDMI2.1 text, and conditionally allow the DSC YCbCr 4:2:2 strain mode on the source device side. For example, this description can be added in chapter 7.8.3 of the future revision of HDMI2.1:
“在FRL速率不超过12Gbps/通道的情况下，针对像速率超过3200MHz的视频格式，如果HDMI设备只具备最多8个DSC片处理单元，或者DSC功能最多只使用10Gbps/通道的FRL速率，这样的功能组合将无法支持4:4:4 DSC压缩传输。有鉴于此，HDMI2.1允许4:2:2 DSC压缩传输。”"In the case that the FRL rate does not exceed 12Gbps/channel, for video formats with an image rate exceeding 3200MHz, if the HDMI device only has a maximum of 8 DSC chip processing units, or the DSC function only uses the FRL rate of 10Gbps/channel at most, such The combination of functions will not be able to support 4:4:4 DSC compression transmission. In view of this, HDMI2.1 allows 4:2:2 DSC compression transmission."
这样的HDMI2.1标准修订可以在架构和系统的高度为HDMI互联设备的能力匹配增加弹性。Such revisions to the HDMI2.1 standard can increase flexibility in matching the capabilities of HDMI interconnected devices at the height of the architecture and system.
同时，本发明的方法是在HDMI2.1协议中增加一个新的可选项，允许HDMI2.1显示设备明确标志其有条件支持YCbCr 4:2:2应变模式，以保障互联设备在某些模式下(比如AVS3 8K120)能使用4:2:2应变模式传输显示数据流，确保系统正常工作，这样不匹配的问题可以得到解决。At the same time, the method of the present invention is to add a new option to the HDMI2.1 protocol, allowing HDMI2.1 display devices to clearly indicate that they are conditionally supporting the YCbCr 4:2:2 strain mode, so as to ensure that the connected devices are in certain modes (For example, AVS3 8K120) It can use 4:2:2 strain mode to transmit the display data stream to ensure the normal operation of the system, so that the problem of mismatch can be solved.
表2为改进后的SCDS(Sink Capability Data Structure)表定义,即：本发明的HDMI2.1a表10-7:显示能力数据结构(Sink Capability Data Structure,SCDS)，Table 2 is the definition of the improved SCDS (Sink Capability Data Structure) table, namely: HDMI2.1a Table 10-7 of the present invention: Display Capability Data Structure (Sink Capability Data Structure, SCDS),
表2：改进后的显示能力数据结构(SCDS)Table 2: Improved display capability data structure (SCDS)
Figure PCTCN2021078559-appb-000002
Figure PCTCN2021078559-appb-000002
Figure PCTCN2021078559-appb-000003
Figure PCTCN2021078559-appb-000003
表2中：DSC_422_Option[1位]In Table 2: DSC_422_Option[1 bit]
＝1表示在特定情况下，显示设备可以应变4:2:2 DSC压缩，这样可以对接无法进行4:4:4 DSC压缩的源设备，改用4:2:2 DSC压缩,发送对应显示数据。=1 means that under certain circumstances, the display device can strain 4:2:2 DSC compression, so that it can be connected to source devices that cannot perform 4:4:4 DSC compression. Use 4:2:2 DSC compression instead, and send the corresponding display data .
＝0表示在特定情况下，显示设备不接受应变4:2:2 DSC压缩，换句话说，源设备需要对视频内容进行降级处理，比如使用4:2:0编码，使用较低帧率或者较低分辨率。=0 means that under certain circumstances, the display device does not accept 4:2:2 DSC compression. In other words, the source device needs to downgrade the video content, such as using 4:2:0 encoding, using a lower frame rate or Lower resolution.
表2是基于表1进行了改进。在HDMI设备连接成功之后，SCDS通过DDC传输提供给源设备，这样源设备在了解了下游显示设备的能力之后，可以对资源进行最合理的配置。Table 2 is improved based on Table 1. After the HDMI device is successfully connected, the SCDS is provided to the source device through DDC transmission, so that the source device can make the most reasonable configuration of resources after learning the capabilities of the downstream display device.
改进的部分是在PB8的第4位，原本是预留的，现在新增功能DSC_422_Option,用于描述在一定条件下(如：FRL速率，DSC片单元个数，像素率，等等)，申明能够支持应变4:2:2 DSC模式，当这个特性被使能并提供到发端，发端发送相应的4:2:2视频流(比如AVS3 8K120)，这个时候视频源设备的DSC资源使用率可以达到100％。The improved part is in the 4th bit of PB8, which was originally reserved. Now a new function DSC_422_Option is added, which is used to describe under certain conditions (such as: FRL rate, number of DSC slice units, pixel rate, etc.), affirm It can support 4:2:2 DSC mode. When this feature is enabled and provided to the originator, the originator sends the corresponding 4:2:2 video stream (such as AVS3 8K120). At this time, the DSC resource usage rate of the video source device can be Reach 100%.
由于采用本发明的方法，与现有技术相比具有如下有益技术效果：Due to the adoption of the method of the present invention, compared with the prior art, it has the following beneficial technical effects:
1、降低了视频产品的设计复杂度，提高了系统资源利用率，在比如AVS3 8K120 422压缩传输的场景下，DSC片处理器数目可由目前要求的12个降到8个，其利用率可以达到100％。1. Reduce the design complexity of video products and improve the utilization of system resources. In scenarios such as AVS3 8K120 422 compression transmission, the number of DSC film processors can be reduced from the currently required 12 to 8, and the utilization rate can reach 100%.
2、这个新的功能是可选项，确保了向后兼容。向后兼容可以确保现有合规的产品，在工业标准增加了新特性之后，将来会继续保持合规。2. This new feature is optional, ensuring backward compatibility. Backward compatibility can ensure that existing compliant products will continue to be compliant in the future after new features are added to industrial standards.
3、新功能可以由软件实现，便于产品升级和维护。3. New functions can be realized by software, which is convenient for product upgrade and maintenance.
以下结合附图通过具体实施例对本发明进行详细说明。Hereinafter, the present invention will be described in detail through specific embodiments with reference to the accompanying drawings.
附图的简要说明Brief description of the drawings
图1是传统HDMI框图(Legacy HDMI Block Diagram)Figure 1 is a traditional HDMI block diagram (Legacy HDMI Block Diagram)
图2是HDMI2.1FRL模式(
Figure PCTCN2021078559-appb-000004
FRL Mode) Figure 2 is the HDMI2.1FRL mode (
Figure PCTCN2021078559-appb-000004
FRL Mode)
图3是HDMI数据传输示意图(HDMI Data Transport Overview)Figure 3 is a schematic diagram of HDMI data transmission (HDMI Data Transport Overview)
图4是HDMI压缩视频传输示意图(HDMI Compressed Video Transport)Figure 4 is a schematic diagram of HDMI compressed video transmission (HDMI Compressed Video Transport)
图5是具备DSC功能的HDMI系统示意图(HDMI System with DSC Functionality)Figure 5 is a schematic diagram of an HDMI system with DSC function (HDMI System with DSC Functionality)
图6是本发明的详细流程图(HDMI System Initialization Flow Chart)Figure 6 is a detailed flow chart of the present invention (HDMI System Initialization Flow Chart)
实现本发明的最佳方式The best way to implement the invention
图6是本发明方法的详细流程图，该方法在互通互联方面改进了HDMI显示数据压缩算法的使用，包括9个步骤，下面阐述本发明如何帮助HDMI设备更好地沟通和匹配。Figure 6 is a detailed flow chart of the method of the present invention. The method improves the use of the HDMI display data compression algorithm in terms of intercommunication and includes 9 steps. The following describes how the present invention helps HDMI devices to better communicate and match.
步骤1：源设备与显示设备通过HDMI线缆进行物理链接；Step 1: The source device and the display device are physically linked through an HDMI cable;
步骤2：源设备向显示设备送出+5V信号；Step 2: The source device sends a +5V signal to the display device;
步骤3：显示设备在收到+5V信号后，开始启动，首先准备EDID内容，并在EDID准备好之后向源设备返回HPD高电平；Step 3: After the display device receives the +5V signal, it starts to start, first prepares the EDID content, and returns the HPD high level to the source device after the EDID is ready;
步骤4：接收端收到HPD高电平信号之后，开始通过DDC读取显示设备的EDID内容；Step 4: After receiving the HPD high-level signal, the receiving end starts to read the EDID content of the display device through DDC;
步骤5：源设备对EDID内容进行解析，了解显示设备的整体能力。特别是通过对SCDS数据结构的解析，了解显示设备在DSC上面的能力，包括FRL最大速率，有多少DSC片处理单元(比如8个)；Step 5: The source device parses the EDID content to understand the overall capabilities of the display device. In particular, through the analysis of the SCDS data structure, we can understand the capabilities of the display device on the DSC, including the maximum rate of the FRL, and how many DSC chip processing units (for example, 8) there are;
在SCDS的第8字节第4位，是DSC_422_Option，如果是1，说明显示设备在特定条件下(比如8K120)可以支持4:2:2 DSC，因此需要的DSC资源比4:4:4 DSC少；如果是0，说明显示设备在这种特定条件下不支持4:2:2 DSC。The 4th bit in the 8th byte of SCDS is DSC_422_Option. If it is 1, it means that the display device can support 4:2:2 DSC under certain conditions (such as 8K120), so the required DSC resources are more than 4:4:4 DSC Less; if it is 0, it means that the display device does not support 4:2:2 DSC under this specific condition.
步骤6：综合其它条件，具备有限资源(比如8个DSC片处理单元)的视频源设备端可以做出判断：在DSC_422_Option＝1的情况下，针对8K120的视频内容进行4:2:2 DSC压缩；在 DSC_422_Option＝0的情况下,表示8K120的视频内容无法用4:2:2 DSC压缩，那么源设备需要对8K120进行降级处理，比如转化4:2:0格式，或者降低分辨率(比如降到4K120)，或者降低刷新率(比如降到8K60)。Step 6: Based on other conditions, the video source device with limited resources (such as 8 DSC film processing units) can make a judgment: in the case of DSC_422_Option=1, perform 4:2:2 DSC compression for 8K120 video content ; In the case of DSC_422_Option=0, it means that the video content of 8K120 cannot be compressed by 4:2:2 DSC, then the source device needs to downgrade 8K120, such as converting 4:2:0 format, or reducing the resolution (such as reducing To 4K120), or lower the refresh rate (for example, to 8K60).
具备更多资源(比如12个DSC片处理单元)的游戏类源设备端也可以做出判断：如果显示端有同样的DSC资源(比如12个DSC片处理单元)，在DSC_422_Option＝0的情况下，针对8K120的显示数据进行4:4:4 DSC压缩。如果显示端具有较少的DSC资源(比如8个DSC片处理单元)在DSC_422_Option＝1的情况下,表示8K120的显示数据可以用4:2:2 DSC压缩，那么源设备既可以进行4:2:2 DSC压缩，也可以对8K120进行降级处理，比如转化4:2:0格式，或者降低分辨率(比如降到4K120)，或者降低刷新率(比如降到8K60)。考虑游戏类设备在4:2:2编码上有明显的瑕疵，这类设备会更倾向于降级处理。Game source devices with more resources (such as 12 DSC film processing units) can also make a judgment: if the display side has the same DSC resources (such as 12 DSC film processing units), in the case of DSC_422_Option=0 , Perform 4:4:4 DSC compression for 8K120 display data. If the display side has fewer DSC resources (for example, 8 DSC slice processing units) and DSC_422_Option=1, it means that the display data of 8K120 can be compressed with 4:2:2 DSC, then the source device can perform 4:2 :2 DSC compression, 8K120 can also be downgraded, such as converting the 4:2:0 format, or reducing the resolution (for example, to 4K120), or reducing the refresh rate (for example, to 8K60). Considering that gaming devices have obvious flaws in 4:2:2 encoding, such devices are more prone to downgrade processing.
步骤7：判断形成之后，源设备根据图一描述的功能，进行软硬件设置。Step 7: After the judgment is formed, the source device performs software and hardware settings according to the functions described in Figure 1.
步骤8：设置就绪之后，源设备根据图一描述的功能，通过HDMI线缆向显示设备发送内容，比如DSC压缩后的8K120 4:2:2格式。Step 8: After the settings are ready, the source device sends content to the display device through the HDMI cable according to the function described in Figure 1, such as the 8K120 4:2:2 format compressed by DSC.
步骤9：显示设备在收到HDMI视频流之后根据图一描述的功能，包括DSC解压缩，之后进行显示，比如8K120，实时使用4通道10Gpbs的FRL传输速率，吞吐量为40Gbps。Step 9: After the display device receives the HDMI video stream, it includes DSC decompression according to the function described in Figure 1, and then displays it, such as 8K120, using a 4-channel 10Gpbs FRL transmission rate in real time, and a throughput of 40Gbps.
根据不同HDMI系统的复杂度，完成上述9个步骤的时间大概在200ms到2s之间，其中在步骤5和6使用了本方法。因为本方法的简洁性，在系统层面的响应时间不会产生明显额外开销。According to the complexity of different HDMI systems, the time to complete the above 9 steps is probably between 200ms and 2s, and this method is used in steps 5 and 6. Because of the simplicity of this method, the response time at the system level will not cause significant additional overhead.
需要说明的是：It should be noted:
本说明书对HDMI2.1的修订文本提出了建议，其核心是在设备资源有限的情况下做出折衷。HDMI2.1的最后文本可能在具体的折衷条件或者其他细节上使用不同的描述。只要原理相同，本发明方法应该保持其有效性。This manual provides suggestions for the revised text of HDMI2.1, the core of which is to make a compromise under the condition of limited equipment resources. The final text of HDMI2.1 may use different descriptions on specific compromise conditions or other details. As long as the principle is the same, the method of the present invention should maintain its effectiveness.
本说明书多次使用8K120，并不代表8K120是唯一出现不匹配问题的视频格式。在不同组合条件下，其它的视频格式，比如8K60，8K50等等，都有可能出现这样的系统不匹配。由于本发明使用8K60和8K50等视频格式时，方法原理基本相同和相似，在此不在赘述。This manual uses 8K120 many times, but it does not mean that 8K120 is the only video format with mismatch problems. Under different combination conditions, other video formats, such as 8K60, 8K50, etc., may have such system mismatches. Since the present invention uses video formats such as 8K60 and 8K50, the method and principle are basically the same and similar, so I will not repeat them here.
本说明书指出了是因为显示设备独立设定DSC片处理单元最大数目(DSC_MaxSlices)这个参数，从而引起系统不匹配。但是引起系统不匹配的原因不仅限于这个参数，类似的独立设定参数都有可能造成系统不匹配，本发明方法普遍适用。This manual points out that it is because the display device independently sets the parameter of the maximum number of DSC slice processing units (DSC_MaxSlices), which causes system mismatch. However, the cause of system mismatch is not limited to this parameter, and similar independent setting parameters may cause system mismatch, and the method of the present invention is generally applicable.
本说明指出HDMI在使用显示数据压缩(DSC)算法上的系统不匹配问题，并提出发明方法，也适用于在非HDMI(比如Display Port)技术中使用非DSC压缩算法可能导致的系统不匹配问题。This note points out the system mismatch problem of HDMI in the use of display data compression (DSC) algorithms, and proposes the inventive method, which is also applicable to the system mismatch problems that may be caused by the use of non-DSC compression algorithms in non-HDMI (such as DisplayPort) technologies .
本申请公布实施例的目的在于帮助进一步理解本发明，但是本领域的技术人员可以理解：在不脱离本发明及所附权利要求的精神和范围内，各种替换和修改都是可能的。因此，本发明不应局限于实施例所公开的内容，本发明要求保护的范围以权利要求书界定的范围为准。The purpose of the embodiments disclosed in this application is to help further understand the present invention, but those skilled in the art can understand that various substitutions and modifications are possible without departing from the spirit and scope of the present invention and the appended claims. Therefore, the present invention should not be limited to the content disclosed in the embodiments, and the scope of protection claimed by the present invention is subject to the scope defined by the claims.
本发明中技术术语的含义是：The meaning of the technical terms in the present invention is:
HDMI：高清音视频接口；HDMI: high-definition audio and video interface;
TMDS：传输差分信号；TMDS: transmit differential signal;
FRL：固定速率连接；FRL: fixed rate connection;
DSC：一种数字视频流压缩算法；DSC: a digital video stream compression algorithm;
DDC：HDMI收发端通信通道；DDC: HDMI transceiver communication channel;
HPD：热拔插检测；HPD: hot plug detection;
EDID：扩展显示表示数据；EDID: extended display to indicate data;
AVS3：中国第三代数字音视频编解码标准；AVS3: China's third-generation digital audio and video codec standard;
CEC：消费类设备用户控制消息通信协议。CEC: Consumer device user control message communication protocol.
工业应用性Industrial applicability
本发明适用于HDMI(High Definition Media Interface)2.1标准指定的显示数据流压缩(DSC,Display Stream Compression)技术领域，特别是一种改进HDMI显示数据流压缩互通互联的方法，这个方法改进了DSC在HDMI系统层面的互联互通，以解决现有技术导致收发端能力不匹配的问题。本发明一种改进HDMI显示数据流压缩互通互联的方法，在互通互联方面改进HDMI传输使用的显示数据压缩算法，该方法可以解决HDMI收发端VESA DSC能力不匹配问题。The present invention is applicable to the technical field of Display Stream Compression (DSC, Display Stream Compression) specified by the HDMI (High Definition Media Interface) 2.1 standard, especially a method for improving the compression and interconnection of HDMI display data stream. This method improves the performance of DSC The interconnection and intercommunication at the HDMI system level solves the problem of the mismatch of the capabilities of the transceivers caused by the prior art. The present invention is a method for improving the compression and interconnection of HDMI display data streams, and improves the display data compression algorithm used in HDMI transmission in terms of interconnection and interconnection. The method can solve the problem of the mismatch of VESA DSC capabilities of the HDMI transceiver terminal.

Claims (9)

  1. 一种改进HDMI显示数据流压缩互通互联的方法，包含如下步骤：A method for improving the compression and interconnection of HDMI display data streams, including the following steps:
    步骤1：设备连接；Step 1: Device connection;
    步骤2：源设备送出+5V；Step 2: The source device sends out +5V;
    步骤3：显示设备返回HPD高电平；Step 3: The display device returns to HPD high level;
    步骤4：读取EDID；Step 4: Read EDID;
    步骤5：EDID内容解析；Step 5: EDID content analysis;
    步骤6：综合判断；Step 6: Comprehensive judgment;
    步骤7：软硬件设置；Step 7: Software and hardware settings;
    步骤8：发送内容；Step 8: Send content;
    步骤9：显示段解压缩，其他信号处理及显示。Step 9: Display segment decompression, other signal processing and display.
  2. 根据权利要求1所述的一种改进HDMI显示数据流压缩互通互联的方法，其特征在于：The method for improving the compression and interconnection of HDMI display data streams according to claim 1, characterized in that:
    所述的步骤5：源设备对EDID内容进行解析，了解显示设备的整体能力；特别是通过对SCDS数据结构的解析，了解显示设备在DSC上面的能力，包括FRL最大速率，有多少DSC片处理单元(比如8个)。Said step 5: The source device analyzes the content of the EDID to understand the overall capabilities of the display device; especially through the analysis of the SCDS data structure, to understand the capability of the display device on the DSC, including the maximum rate of FRL and how many DSC slices are processed Units (for example, 8).
  3. 根据权利要求2所述的一种改进HDMI数据压缩互通互联的方法，其特征在于：The method for improving HDMI data compression and interconnection according to claim 2, characterized in that:
    所述的DSC片处理单元是在SCDS的第8字节第4位，是DSC_422_Option，如果是1，说明显示设备在特定条件下(比如8K120)可以支持4:2:2 DSC，因此需要的DSC资源比4:4:4 DSC少；The DSC slice processing unit is the 4th bit in the 8th byte of the SCDS, which is DSC_422_Option. If it is 1, it means that the display device can support 4:2:2 DSC under certain conditions (such as 8K120), so DSC is needed Resources are less than 4:4:4 DSC;
    如果是0，说明显示设备在这种特定条件下不支持4:2:2 DSC。If it is 0, it means that the display device does not support 4:2:2 DSC under this specific condition.
  4. 根据权利要求1所述的一种改进HDMI数据压缩互通互联的方法，其特征在于：The method for improving HDMI data compression and interconnection according to claim 1, characterized in that:
    所述的步骤6：综合其它条件，具备有限资源(比如8个DSC片处理单元)的视频源设备端可以做出判断：在DSC_422_Option＝1的情况下，针对8K120的视频内容进行4:2:2 DSC压缩；Said step 6: Based on other conditions, a video source device with limited resources (such as 8 DSC film processing units) can make a judgment: in the case of DSC_422_Option=1, 4:2 is performed for 8K120 video content: 2 DSC compression;
    所述的在DSC_422_Option＝0的情况下,表示8K120的视频内容无法用4:2:2 DSC压缩，那么源设备需要对8K120进行降级处理，比如转化4:2:0格式，或者降低分辨率(比如降到4K120)，或者降低刷新率(比如降到8K60)。In the case of DSC_422_Option=0, it means that the video content of 8K120 cannot be compressed by 4:2:2 DSC, so the source device needs to downgrade the 8K120, such as converting the 4:2:0 format, or reducing the resolution ( For example, down to 4K120), or reduce the refresh rate (for example, down to 8K60).
  5. 根据权利要求1所述的一种改进HDMI数据压缩互通互联的方法，其特征在于：The method for improving HDMI data compression and interconnection according to claim 1, characterized in that:
    所述的步骤1：源设备与显示设备通过HDMI线缆进行物理链接。Said step 1: the source device and the display device are physically linked through an HDMI cable.
  6. 根据权利要求1所述的一种改进HDMI数据压缩互通互联的方法，其特征在于：The method for improving HDMI data compression and interconnection according to claim 1, characterized in that:
    所述的步骤3：显示设备在收到+5V信号后，开始启动，首先准备EDID内容，并在EDID准备好之后向源设备返回HPD高电平。Said step 3: The display device starts to start after receiving the +5V signal, first prepares the EDID content, and returns the HPD high level to the source device after the EDID is ready.
  7. 根据权利要求1所述的一种改进HDMI数据压缩互通互联的方法，其特征在于：所述的步骤4：接收端收到HPD高电平信号之后，开始通过DDC读取显示设备的EDID内容。The method for improving HDMI data compression and interconnection according to claim 1, wherein said step 4: after receiving the HPD high level signal, the receiving end starts to read the EDID content of the display device through DDC.
  8. 根据权利要求1所述的一种改进HDMI数据压缩互通互联的方法，其特征在于：The method for improving HDMI data compression and interconnection according to claim 1, characterized in that:
    所述的步骤8：设置就绪之后，源设备根据图一描述的功能，通过HDMI线缆向显示设备发送内容，比如DSC压缩后的8K120 4:2:2格式。Said step 8: After the settings are ready, the source device sends content to the display device through the HDMI cable according to the function described in Figure 1, such as the 8K120 4:2:2 format compressed by the DSC.
  9. 根据权利要求1所述的一种改进HDMI数据压缩互通互联的方法，其特征在于：The method for improving HDMI data compression and interconnection according to claim 1, characterized in that:
    所述的步骤9：显示设备在收到HDMI视频流之后根据图一描述的功能，包括DSC解压缩，之后进行显示，比如8K120。Said step 9: After receiving the HDMI video stream, the display device includes DSC decompression according to the function described in Figure 1, and then displays it, such as 8K120.
PCT/CN2021/078559 2020-02-07 2021-03-02 Method for improving hdmi display data stream compression and interconnection WO2021155869A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010083645.1 2020-02-07
CN202010083645 2020-02-07

Publications (1)

Publication Number Publication Date
WO2021155869A1 true WO2021155869A1 (en) 2021-08-12

Family

ID=77199688

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/078559 WO2021155869A1 (en) 2020-02-07 2021-03-02 Method for improving hdmi display data stream compression and interconnection

Country Status (2)

Country Link
CN (1) CN113259613B (en)
WO (1) WO2021155869A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113784074B (en) * 2021-09-24 2023-06-27 广东博华超高清创新中心有限公司 Method for improving enhanced audio return channel intercommunication and interconnection

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080151119A1 (en) * 2006-12-22 2008-06-26 Kabushiki Kaisha Toshiba Video display device, video display system, and video display method
CN101448123A (en) * 2007-11-30 2009-06-03 索尼株式会社 Transmitting device, receiving device, and method for transmitting operational information in receiving device
US20110304522A1 (en) * 2010-06-15 2011-12-15 Henry Zeng Dynamic edid generation
US20130215142A1 (en) * 2012-02-21 2013-08-22 Pantech Co., Ltd. Apparatus and method for displaying an image on a sink device
EP2947560A1 (en) * 2014-05-20 2015-11-25 LG Electronics Inc. Video data processing method and device for display adaptive video playback
EP2983354A1 (en) * 2014-08-08 2016-02-10 LG Electronics Inc. Video data processing method and device for display adaptive video playback

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101627625A (en) * 2007-03-13 2010-01-13 索尼株式会社 Communication system, transmitter, transmission method, receiver, and reception method
US8253860B2 (en) * 2008-04-07 2012-08-28 Mediatek Inc. System, method and devices for HDMI transmission using a commonly supported media format
US9508282B2 (en) * 2014-12-10 2016-11-29 Ati Technologies Ulc Virtualized display output ports configuration
US10078997B2 (en) * 2016-11-14 2018-09-18 Icron Technologies Corporation Devices and methods for bridging video information over an extension medium

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080151119A1 (en) * 2006-12-22 2008-06-26 Kabushiki Kaisha Toshiba Video display device, video display system, and video display method
CN101448123A (en) * 2007-11-30 2009-06-03 索尼株式会社 Transmitting device, receiving device, and method for transmitting operational information in receiving device
US20110304522A1 (en) * 2010-06-15 2011-12-15 Henry Zeng Dynamic edid generation
US20130215142A1 (en) * 2012-02-21 2013-08-22 Pantech Co., Ltd. Apparatus and method for displaying an image on a sink device
EP2947560A1 (en) * 2014-05-20 2015-11-25 LG Electronics Inc. Video data processing method and device for display adaptive video playback
EP2983354A1 (en) * 2014-08-08 2016-02-10 LG Electronics Inc. Video data processing method and device for display adaptive video playback

Also Published As

Publication number Publication date
CN113259613A (en) 2021-08-13
CN113259613B (en) 2022-12-06

Similar Documents

Publication Publication Date Title
US8090030B2 (en) Method, apparatus and system for generating and facilitating mobile high-definition multimedia interface
US8582028B2 (en) Multi-monitor control
US10085058B2 (en) Device and method for transmitting and receiving data using HDMI
US7893998B2 (en) Audio over a standard video cable
US20150189109A1 (en) Apparatus and methods for packing and transporting raw data
US8565252B2 (en) Wireless transmission system, device and method for efficiently transmitting associated data
US9167282B2 (en) Enhanced HDMI system and method
US20100177016A1 (en) Multi-monitor display
JP6008141B2 (en) Baseband video data transmission device, reception device, and transmission / reception system
CN107205176B (en) Signal conversion device and method
WO2022033013A1 (en) Method and device for determining and outputting hdmi 8k100/120 video
CN110121887B (en) Video stream branching apparatus for bandwidth management and method of bandwidth management
WO2021155869A1 (en) Method for improving hdmi display data stream compression and interconnection
US20140204994A1 (en) Auxiliary data encoding in video data
US7474315B1 (en) Deep pixel display
EP2995080B1 (en) Devices and methods for communicating sideband data with non-compressed video
KR100987387B1 (en) Apparatus and method for wirelwss HDMI over WLAN
TW200929919A (en) Display signal extender and a method of transmitting display signal by using the same
US9609268B1 (en) Electronic apparatus
CN212413302U (en) Multichannel high definition video DVI signal distributor
US20220060781A1 (en) Display Of Video Content On A Sink Device Using Advanced Features

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21750414

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21750414

Country of ref document: EP

Kind code of ref document: A1