US20170078739A1 - Device and method for transmitting and receiving data using hdmi - Google Patents

Device and method for transmitting and receiving data using hdmi Download PDF

Info

Publication number
US20170078739A1
US20170078739A1 US15/125,519 US201515125519A US2017078739A1 US 20170078739 A1 US20170078739 A1 US 20170078739A1 US 201515125519 A US201515125519 A US 201515125519A US 2017078739 A1 US2017078739 A1 US 2017078739A1
Authority
US
United States
Prior art keywords
audio
hdmi
stream audio
stream
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US15/125,519
Inventor
Hyeonjae LEE
Dokyun Kim
Jangwoong Park
Hyunsik YANG
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
LG Electronics Inc
Original Assignee
LG Electronics Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by LG Electronics Inc filed Critical LG Electronics Inc
Priority to US15/125,519 priority Critical patent/US20170078739A1/en
Assigned to LG ELECTRONICS INC. reassignment LG ELECTRONICS INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: KIM, DOKYUN, LEE, HYEONJAE, PARK, JANGWOONG, YANG, Hyunsik
Publication of US20170078739A1 publication Critical patent/US20170078739A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network
    • H04N21/43632—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network involving a wired protocol, e.g. IEEE 1394
    • H04N21/43635—HDMI
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/003—Details of a display terminal, the details relating to the control arrangement of the display terminal and to the interfaces thereto
    • G09G5/006—Details of the interface to the display terminal
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L1/00—Arrangements for detecting or preventing errors in the information received
    • H04L1/004—Arrangements for detecting or preventing errors in the information received by using forward error control
    • H04L1/0045—Arrangements at the receiver end
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4341—Demultiplexing of audio and video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439—Processing of audio elementary streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439—Processing of audio elementary streams
    • H04N21/4394—Processing of audio elementary streams involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/4425—Monitoring of client processing errors or hardware failure
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/61—Network physical structure; Signal processing
    • H04N21/615—Signal processing at physical level
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/8126—Monomedia components thereof involving additional data, e.g. news, sports, stocks, weather forecasts
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/84—Generation or processing of descriptive data, e.g. content descriptors
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2370/00—Aspects of data communication
    • G09G2370/04—Exchange of auxiliary data, i.e. other than image data, between monitor and graphics controller
    • G09G2370/045—Exchange of auxiliary data, i.e. other than image data, between monitor and graphics controller using multiple communication channels, e.g. parallel and serial
    • G09G2370/047—Exchange of auxiliary data, i.e. other than image data, between monitor and graphics controller using multiple communication channels, e.g. parallel and serial using display data channel standard [DDC] communication
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2370/00—Aspects of data communication
    • G09G2370/06—Consumer Electronics Control, i.e. control of another device by a display or vice versa
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2370/00—Aspects of data communication
    • G09G2370/12—Use of DVI or HDMI protocol in interfaces along the display data pipeline

Definitions

  • the present invention is related to a device and a method for transmitting and receiving data using HDMI (High Definition Multimedia Interface) and more specifically, a device and a method for transmitting and receiving data using HDMI, controlling a multi-stream audio output through a remote controller of an HDMI sink device in case multi-stream audio-enabled content is played.
  • HDMI High Definition Multimedia Interface
  • HDMI is an interface/standard that develops a Digital Visual Interface (DVI) which is an interface standard of personal computers and displays for a use of AV electronic products. Since the HDMI transmits video/audio from a player to a display device without compressing it, there is very little latency between a source device and a sink device. And the HDMI has high format compatibility since the HDMI does not require separate decoder chip or software. In addition, the HDMI is available to make wirings between AV devices be simplified, which were complicated because video signals, audio signals and control signals are transmitted on only one cable, and the HDMI provides a High-bandwidth Digital Content Protection (HDCP) technique, thereby providing the copyright protection function.
  • HDMI High-bandwidth Digital Content Protection
  • HDMI can support multi-stream audio transmission when a source device transmits video/audio data.
  • a CEC message/operation for a sink device to control selecting/changing the aforementioned multi-stream audio data by using a remote controller has not been proposed yet. Therefore, although multi-stream audio data can be transmitted from a source device to a sink device through HDMI, there is still an inconvenience/disadvantage that a remote controller of the sink device is incapable of controlling the multi-stream audio data.
  • a method for transmitting and receiving data of a sink device by using HDMI comprises receiving at least one of video data or audio data from a source device through HDMI wherein the audio data include multi-stream audio data; transmitting a CEC message requesting multi-stream audio information to the source device; and receiving a response CEC message including multi-stream audio information from the source device.
  • the multi-stream audio information can include at least one of channel information or attribute information of multi-stream audio.
  • a method for transmitting and receiving data of a sink device by using HDMI can further comprise providing a UI showing the multi-stream audio information; and in case a user input selecting one audio stream from the multi-stream audio, transmitting a CEC message requesting change of a multi-stream audio channel to the source device.
  • a CEC message requesting change of the multi-stream audio channel can include channel information of at least one audio among the multi-stream audio, and the multi-stream audio can include four audio channels.
  • a sink device transmitting and receiving data by using HDMI comprises an HDMI receiver; and a controller controlling transmission and reception of data of the HDMI receiver, wherein the sink device receives at least one of video data or audio data through HDMI from a source device, wherein the audio data include multi-stream audio; transmits a CEC message requesting multi-stream audio information to the source device; and receives a response CEC message including multi-stream audio information from the source device.
  • a method for transmitting and receiving data of a source device by using HDMI comprises transmitting at least one of video data or audio data to a sink device through HDMI, wherein the audio data include multi-stream audio; receiving a CEC message requesting multi-stream audio information from the sink device; and transmitting a response CEC message including multi-stream audio information to the sink device.
  • the multi-stream audio information can include at least one of channel information or attribute information of multi-stream audio.
  • a method for transmitting and receiving data of a source device by using HDMI can further comprise receiving a CEC message requesting change of a multi-stream audio channel from the sink device; and controlling transmission of the multi-stream audio according to the received CEC message.
  • the CEC message requesting change of a multi-stream audio channel can include channel information of at least one audio among the multi-stream audio, and the multi-stream audio can include four audio channels.
  • a source device transmitting and receiving data by using HDMI comprises an HDMI transmitter transmitting and receiving data through HDMI; and a controller controlling data transmission and reception of the HDMI transmitter, wherein the source device transmits at least one of video data or audio data through HDMI to a sink device, wherein the audio data include multi-stream audio; receives a CEO message requesting multi-stream audio information from the sink device; and transmits a response CEC message including multi-stream audio information to the source device.
  • the user can control multi-stream audio transmitted from a source device by using a remote controller that transmits commands to a sink device.
  • the user can control multi-audio stream outputs of a source device by entering commands to a sink device through a remote controller.
  • a sink device may show information about multi-stream audio that can be provided or that is currently provided through a UI.
  • a source device may stop other audio stream outputs, thereby improving efficiency of utilizing HDMI bandwidth.
  • FIG. 1 illustrates an HDMI system according to one embodiment of the present invention and data transmission and reception channels included in the HDMI system.
  • FIG. 2 illustrates devices of an HDMI system according to one embodiment of the present invention and physical addresses assigned to the devices.
  • FIG. 3 illustrates devices of another HDMI system according to one embodiment of the present invention and logical addresses assigned to the devices.
  • FIG. 4 illustrates a header/data block as an HDMI CEC data format according to an embodiment of the present invention.
  • FIG. 5 illustrates an HDMI CEC sequence according to an embodiment of the present invention.
  • FIGS. 6 to 11 illustrate embodiments of various scenarios for controlling a source device by using the HDMI CEC protocol.
  • FIG. 12 illustrates HDMI CEC communication devices according to one embodiment of the present invention.
  • FIG. 13 is a flow diagram illustrating a method for controlling multi-stream audio by using the HDMI CEC protocol according to one embodiment of the present invention.
  • FIG. 14 illustrates a TV UI according to an embodiment of the present invention.
  • FIG. 15 illustrates a CEC message format according to an embodiment of the present invention.
  • FIG. 1 illustrates an HDMI system and data transmission and reception channels included in the HDMI system according to one embodiment of the present invention.
  • HDMI system Devices that transmit and receive video/audio/control data using HDMI can be called collectively an HDMI system, and the HDMI system can comprise a source device 1010 , a sink device 1020 , and a cable.
  • a device that transmits video/audio data through HDMI corresponds to the source device 1010
  • a device that receives video/audio data through HDMI corresponds to the sink device 1020
  • an HDMI cable supporting data transmission and reception connects the two devices.
  • a source device 1010 can include an HDMI transmitter transmitting and receiving data through HDMI; and a controller controlling the HDMI transmitter and data communication through HDMI of the source device.
  • the sink device 1020 can include an HDMI receiver transmitting and receiving data through HDMI; and a controller controlling the HDMI receiver and data communication through HDMI of the sink device.
  • the HDMI cables and the connectors may perform pairing of four channels that provides a Transition Minimized Differential Signaling (TMDS) data channel and a TMDS clock channel.
  • TMDS data channels may be used for forwarding video data, audio data and auxiliary data. These channels can be used to deliver video data, audio data, and auxiliary data.
  • the HDMI system provides a VESA (Video Electronics Standards Association) DDC (Display Data Channel).
  • the DDC is used for configuration of one source device and one sink device and exchange of status information between them.
  • a CEC protocol can provide a high-level control function among various audio-visual products in a user environment and may be used optionally.
  • an optional HEAC HDMI Ethernet and Audio Return Channel
  • Video data, audio data and supplementary data may be transmitted and received through three TDMS data channels.
  • a TMDS clock runs a video pixel rate, and is transmitted through a TMDS clock channel.
  • the TMDS clock may be used as a reference frequency for data recovery in three TMDS data channels in an HDMI receiver.
  • the data of 8 bits per TMDS data channel may be transformed into a sequence of 10 bits of which transition is minimized, which is DC balanced, and transmitted in serial manner with a rate of 10 bits per TMDS clock period.
  • the HDMI uses a packet structure.
  • data may be transmitted in word of 10 bits which is generated by using a BCH error correction code and an error reduction coding.
  • the source device can figure out configuration information and available functions of the sink device by reading out E-EDID (Enhanced Extended Display Identification Data) of the sink device in the DDC (Display Data Channel).
  • E-EDID Enhanced Extended Display Identification Data
  • DDC Display Data Channel
  • a utility line can be used for an optional extension function such as HEAC.
  • CEC Consumer Electronics Control
  • the user can control a source device connected to a sink device through HDMI as well as the sink device itself by using a control device of the sink device (for example, remote controller).
  • a control device of the sink device for example, remote controller
  • Table 1 and 2 below illustrate the structure/features that the HDMI-CEC protocol provides.
  • Table 1 illustrates an end-user structure/features that the HDMI-CEC protocol provides.
  • One Touch Play Video play is started by one click of a button, and device is switched to an active source state. System Standby All of the connected devices are switched to a waiting mode.
  • One Touch Record Control the function of recording a program played in TV Timer Programming Set up the timer of a different device from one device Deck Control Control a play device from a different device Tuner Control Control the tuner of a different device Device Menu Control Make menus of a device controlled by using a TV remote controller Remote Control Transmit the command received from the Pass Through remote controller to a different device System Audio Control Transmit a command that controls audio play
  • Table 2 illustrates a structure/features that the HDMI-CEC protocol supports.
  • Devices of the HDMI system have physical addresses to perform addressing specific physical devices and to control switching by using the HDMI-CEC protocol.
  • a physical address is determined by a physical address recovery operation, and the sink device can generate and utilize a unique physical address comprising 4 numbers, each of which consisting of 4 bits (n.n.n.n).
  • CEC-enabled devices can have logical addresses according to their respective features.
  • initiator and follower can be used in addition to the terms of source device and sink device.
  • An initiator is a device that has transmitted or transmits a CEC message and depending on situations, indicates a device waiting for a response from a follower while the follower is a device that has received a CEO message and indicates a device that has to respond to the received message.
  • FIG. 2 illustrates devices of an HDMI system according to one embodiment of the present invention and physical addresses assigned to the devices.
  • a physical address may refer to the address system for indicating positions of devices used on the CEC bus. As described in detail above, a physical address can comprise four number, each of which consists of 4 bits (n.n.n.n), and a source device can check the physical address through EDID (Extended Display Identification Data) of a sink device.
  • EDID Extended Display Identification Data
  • a device operating as a CEC root device such as the sink device or repeater can have a physical address as 0.0.0.0.
  • a sink device can generate physical addresses for individual source devices by assigning port numbers to the unique physical addresses of connected source devices and set the generated address values to the EDID of the corresponding ports. In other words, if a new device is connected, the sink device can assign an address to the source device through CEA (Consumer Electronics Association) extension of the E-EDID (Enhanced EDID).
  • CEA Consumer Electronics Association
  • FIG. 3 illustrates devices of another HDMI system according to one embodiment of the present invention and logical addresses assigned to the devices.
  • the sink device can assign a logical address to the connected device.
  • the assigned logical address can be used as a source address and a destination address when a CEC message is transmitted.
  • Table 3 illustrates an embodiment of a logical address assigned according to the features of a device.
  • a physical address 0.0.0.0 is assigned to the main TV and a logical address 0 is assigned thereto.
  • logical addresses can be assigned according to the types of the connected devices as shown in FIG. 3 .
  • the sink device can inform other devices about the assigned logical addresses through broadcasting.
  • FIG. 4 illustrates a header/data block as an HDMI CEC data format according to an embodiment of the present invention.
  • the HDMI CEC performs control operations by transmitting and receiving a CEC message through a CEC line.
  • the data by which the CEC messages are transmitted can be transmitted and received in the form of a frame format.
  • a CEC frame can include a start bit, header block, and at least one optional data block.
  • size of one block can be 10 bit
  • size of the maximum message can be 16*10 bit (excluding the start bit).
  • Table 4 provides a brief description of the blocks included in the CEC frame.
  • the information bits field can be data, opcode, or address. Control bits such as EOM and ACK can always be defined within a block and used in the same way.
  • the information bits can include a logical address ( 4 bits) of an initiator and a logical address ( 4 bits) of a target device.
  • the data block follows subsequent to the header block, and data such as operands can be transmitted after the opcode is transmitted.
  • the EOM (End of Message) bit indicates whether the corresponding block is the last one or a succeeding data block exists. As an example, in case there is a succeeding data block, the EOM bit can be set to 0 while a message is completed in the corresponding data block, the EOM can be set to 1.
  • the ACK (Acknowledge) bit can be used for a follower to check reception of data or a header block.
  • reception of data or a header block can be checked by the initiator's sending the ACK bit by setting it to 1 and the follower's setting it to 0.
  • An opcode (operation code) is part of machine commands and describes an operation that has to be performed.
  • an opcode is used as a name to identify a CEC message and can have a unique identifier/value.
  • commands can have the corresponding data values in the form of operands.
  • FIG. 5 illustrates an HDMI CEC sequence according to an embodiment of the present invention.
  • the source device and the sink device can check HDMI cable connection S 5010 . As shown in FIG. 5 , if it is checked that 5V is applied to pin 18 of the source device, and 5V is applied to pin 19 (HPD) of the sink device, it can be determined that an HDMI cable has been connected between the source device and the sink device.
  • HDMI cable connection S 5010 As shown in FIG. 5 , if it is checked that 5V is applied to pin 18 of the source device, and 5V is applied to pin 19 (HPD) of the sink device, it can be determined that an HDMI cable has been connected between the source device and the sink device.
  • HPD pin 19
  • the source device and the sink device can transmit/receive information of connected devices S 5020 .
  • the source device can read the EDID of the sink device.
  • EDID Enhanced Display Identification Data
  • the source device and the sink device can exchange keys required for encrypting data transmission for the purpose of security S 5030 .
  • This step is optional, and the source device and the sink device can exchange HDCP keys through the DDC.
  • FIG. 5 is an embodiment in which deck control is performed by using the HDMI CEC protocol.
  • the sink device can check the deck status of the source device. And if the user inputs ‘play’ through an input device such as a remote controller, a play command (argument: “Forward”) can be transmitted to the source device. The source device can recognize the received CEC command and transmit video data and audio data to the sink device. Now, if the user additionally inputs ‘Next Chapter’, the sink device can transmit a deck control command (argument: “Skip Forward”) to the source device, and the source device can recognize this CEC command and transmit video data and audio data of the next chapter to the sink device.
  • a play command (argument: “Forward”) can be transmitted to the source device.
  • the source device can recognize the received CEC command and transmit video data and audio data to the sink device.
  • the sink device can transmit a deck control command (argument: “Skip Forward”) to the source device, and the source device can recognize this CEC command and transmit video data and audio data of the next chapter to the sink device.
  • FIGS. 6 to 11 illustrate embodiments of various scenarios for controlling a source device by using the HDMI CEC protocol.
  • FIG. 6( a ) illustrates a scenario in which deck control is performed through the sink device
  • FIG. 6( b ) illustrates a scenario in which a new service is selected through the sink device.
  • FIG. 7( a ) illustrates a scenario in which TV initiate system audio control
  • FIG. 7( b ) illustrates a scenario in which an amplifier initiates system audio control.
  • FIG. 8( a ) illustrates a scenario in which a vendor-specific scenario is transmitted to the source device
  • FIG. 8( b ) illustrates a scenario in which the timer of the source device is programmed.
  • FIG. 9 illustrates a message exchange scenario for obtaining a TV menu language
  • FIG. 9( b ) illustrates a scenario in which the user changes a menu language setting.
  • FIG. 10 illustrates a scenario in which one-touch display is performed
  • FIG. 10( b ) illustrates a broadcast system standby scenario.
  • FIG. 11 illustrates a routing control scenario
  • FIG. 11( b ) illustrates a one-touch record scenario.
  • FIG. 12 illustrates HDMI CEC communication devices according to one embodiment of the present invention.
  • the HDMI system can be described as comprising an initiator 12020 that transmits a CEC message and a follower 12010 that receives a CEC message and responds to the received CEC message.
  • an initiator 12020 can refer to a device which initiates a CEC command and delivers the CEO command to a follower, thereby controlling the follower while a follower 12010 can refer to a device that responds to the CEC command, performs a request, and informs the initiator of the performance result.
  • Both devices comprise the same sub-modules by default, and thus descriptions about the same modules will not be repeated.
  • a module refers to a logical or physical unit within a device performing a specific operation; one module may correspond to one or more components, or one or more modules may correspond to one component.
  • the bus interface module 12030 represents a physical device that enables transmission of a command between devices; a message such as request, action, or response; or data.
  • the micom module 12040 represents a physical device that generates a signal for data transmission; or manages priorities, retransmission for reliable transmission, and the like.
  • the mode protocol 12050 refers to the protocol used for efficient resource management required for high speed/low speed data transmission.
  • the high mode module 12060 represents a logical device responsible for processing high speed data transmission in a bus interface architecture.
  • the low mode module 12070 represents a logical device responsible for processing low speed data transmission in the bus interface architecture.
  • the buffer module 12080 represents a physical device temporarily storing transmitted messages or data to improve reliability thereof.
  • the bus protocol layer module 12090 is a logical device processing data transmitted through a bus-based transmission method and delivering necessary information to an upper layer and can include a module determination component module 12100 .
  • the upper layer module 12110 represents a logical/physical device actually processing commands.
  • Multi-Stream Audio refers to a collection of audio streams related to at least one video stream.
  • MSA is a data communication method defined for the HDMI system to support multi-view video streaming or multi-video streams.
  • the HDMI 2.0 system is capable of transmitting up to four stereo audio streams simultaneously.
  • content played in a source device can support multi-stream audio: for example, 1) English, 2) Korean, 3) English commentary, and 4) Korean commentary.
  • a sink device or a remote controller in the current HDMI system that controls the sink device is unable to select/change the multi-stream audio. Therefore, the present invention proposes a method for selecting/changing multi-stream audio by using a remote controller of the sink device by newly defining/adding CEC commands in case multi-stream audio-enabled content is played.
  • FIG. 13 is a flow diagram illustrating a method for controlling multi-stream audio by using the HDMI CEC protocol according to one embodiment of the present invention.
  • TV is the sink device
  • a set-top box (STB) is the source device.
  • TV can be an initiator while the set-top box can be a follower.
  • information request/response/command between the initiator and the follower is transmitted and received in the form of a CEC message through the CEO channel.
  • FIG. 13 mainly illustrates communication between the sink device and the source device, and corresponding CEO messages will be described in more detail later.
  • TV can request information about multi-stream audio (MSA) of content to be played or being played in the set-top box S 13010 ⁇ Request MSA info>.
  • TV may perform this step automatically when content is played or when the user enters a multi-audio related function by using a TV remote controller.
  • MSA multi-stream audio
  • the STB can transmit multi-stream audio information in response to the request for multi-stream audio information received from the TV S 13020 .
  • TV can receive a multi-stream audio information response from the STB S 13020 .
  • Multi-stream audio information is related to multi-stream audio of the content played in the STB and can include the number and attributes (or descriptions) of supported multi-stream audio, such as 1) Korean, 2) English, 3) Korean commentary, and 4) English commentary.
  • TV can provide information about received multi-stream audio; and output at least one of the received audio streams or provide a UI (User Interface) by which output audio can be changed S 13030 .
  • TV can parse information about multi-stream audio received from the STB, inform the user about the parsed information by displaying the information or outputting the information as a sound output, and receive an input selecting at least one audio from among the multi-stream audio S 13040 .
  • These steps (S 13030 and S 13040 ) may be performed optionally.
  • TV can transmit a multi-stream audio change command to the set-top box S 13050 .
  • the multi-stream audio change command as a CEC command, can include a multi-stream audio ID (MSA chID).
  • An audio ID may be identified as a channel number or channel ID of the corresponding audio.
  • the set-top box can change an audio output into the audio having an ID included in the received command S 13060 .
  • the set-top box may stop other multi-stream audio outputs other than the audio having an ID included in the received CEC message. For example, if a CEC message commanding to output only one audio stream, the ID of which is 1, is received as shown in FIG. 13 while four audio streams, the audio channel IDs of which are 1, 2, 3, and 4 respectively are transmitted together or about to be transmitted, only the audio stream with an ID of 1 may be transmitted while transmitted of the remaining audio streams of which the IDs range from 2 to 4 may be stopped. In this case, bandwidth required for outputting other multi-stream audio may be redirected to be used for outputting video, thereby improving utilization efficiency of HDMI bandwidth.
  • FIG. 14 illustrates a TV UI according to an embodiment of the present invention.
  • TV can provide multi-audio stream information and a UI by which the user can select audio.
  • TV can provide such a UI in the lower part of the screen.
  • the UI shown in FIG. 13 can display attributes of the multi-stream audio respectively as “1. English, 2. Korean, 3. English commentary, and 4. Korean commentary”.
  • the user can select one of the four audio streams as output audio by using a left-right movement button or a selection button or by entering a number key by using an input device such as a remote controller.
  • TV can receive an audio selection/change input of the user according to the displayed UI.
  • FIG. 14 adopts a GUI (Graphical User Interface) as a UI for providing/selecting multi-stream audio information
  • the UI for providing/selecting information may be implemented by a voice UI.
  • FIG. 15 illustrates a CEC message format according to an embodiment of the present invention.
  • FIG. 15 illustrates an embodiment in which CEC messages of FIG. 13 are defined; the CEC messages defined in the present invention are defined only to describe the corresponding operations and are not necessarily defined according to the same syntax.
  • an operator represents a CEC command
  • opcode represents a name by which a CEC message is identified
  • operand represents data values corresponding to a CEO command/message.
  • an operand can correspond to the data specific to a particular opcode.
  • ⁇ Request MSA Info> opcode representing a CEC message/command requesting multi-stream audio information of current content
  • ⁇ Report MSA Info> opcode representing a CEC message/command reporting multi-stream audio information of current content. This opcode can be transmitted together with the operand [MSA Info].
  • ⁇ Change MSA ch> opcode representing a CEO message/command changing a multi-stream audio channel. This opcode can be transmitted together with the operand [MSA ch].
  • [MSA Info] operand representing multi-stream audio information. This operand can be transmitted together with the opcode ⁇ Report MSA Info> and as a multi-stream audio parameter, can represent such information as language, commentary, or audio channel.
  • [MSA ch] operand representing an audio channel selected for multi-stream audio. This operand can be transmitted together with the opcode ⁇ Change MSA ch> and can represent at least one of the provided multi-stream audio as a channel.
  • a channel number/ID can correspond to at least one of the entire channel numbers provided by the [MSA Info] operand.
  • the operand [MSA Info] has been defined by assuming a multi-stream audio environment comprising a maximum of four audio streams. This is so because the current HDMI system limits the size of a CEC operand up to 14 bytes in order to prevent channel monopoly. Therefore, in case the present invention is performed on multi-stream audio (MSA) comprising four or more audio streams under the aforementioned limitation, the opcode ⁇ Request MSA Info> can be performed many times to obtain the operand [MSA Info].
  • the ISO639.2 code serial number may be applied to the operand [Ch name] to save data bits. In this case, the length of the operand [Ch name] can be reduced from 3 bytes to 1 byte.
  • FIGS. 13 to 15 illustrate embodiments of multi-audio streams. However, in addition to audio, the embodiments as shown in FIGS. 13 to 15 can be applied to multi-subtitles in which multiple subtitles are provided.
  • TV can request multi-subtitle information from a set-top box, and in response to the request, TV can receive multi-subtitle information from the set-top box.
  • Multi-subtitle information can include a plurality of subtitles that are transmitted/supported by current content and attribute information of the plurality of subtitles.
  • TV can provide multi-subtitle information in the form of a UI and if receiving an input selecting/changing a particular subtitle from a remote controller, transmit a subtitle change command to the set-top box.
  • opcode/operands of FIG. 15 can be modified to be suited for multi-subtitles, respectively. Individual opcodes/operands can still be used by replacing audio information of FIG. 15 such as ⁇ Request MST Info>, ⁇ Report MST Info>, ⁇ Change MST ch>, [MST Info], and [MST ch] with subtitle information.
  • the present invention is used in a series of HDMI fields.

Abstract

A method for transmitting and receiving data of a sink device by using HDMI is disclosed. A method for transmitting and receiving data of a sink device by using HDMI according to the present invention comprises receiving at least one of video data or audio data from a source device through HDMI wherein the audio data include multi-stream audio data; transmitting a CEC message requesting multi-stream audio information to the source device; and receiving a response CEC message including multi-stream audio information from the source device.

Description

    TECHNICAL FIELD
  • The present invention is related to a device and a method for transmitting and receiving data using HDMI (High Definition Multimedia Interface) and more specifically, a device and a method for transmitting and receiving data using HDMI, controlling a multi-stream audio output through a remote controller of an HDMI sink device in case multi-stream audio-enabled content is played.
    • BACKGROUND ART
  • HDMI is an interface/standard that develops a Digital Visual Interface (DVI) which is an interface standard of personal computers and displays for a use of AV electronic products. Since the HDMI transmits video/audio from a player to a display device without compressing it, there is very little latency between a source device and a sink device. And the HDMI has high format compatibility since the HDMI does not require separate decoder chip or software. In addition, the HDMI is available to make wirings between AV devices be simplified, which were complicated because video signals, audio signals and control signals are transmitted on only one cable, and the HDMI provides a High-bandwidth Digital Content Protection (HDCP) technique, thereby providing the copyright protection function.
    • INVENTION CONTENT Technical Problem
  • HDMI can support multi-stream audio transmission when a source device transmits video/audio data. However, a CEC message/operation for a sink device to control selecting/changing the aforementioned multi-stream audio data by using a remote controller has not been proposed yet. Therefore, although multi-stream audio data can be transmitted from a source device to a sink device through HDMI, there is still an inconvenience/disadvantage that a remote controller of the sink device is incapable of controlling the multi-stream audio data.
    • Technical Solution
  • To solve the technical problem above, a method for transmitting and receiving data of a sink device by using HDMI according to the present invention comprises receiving at least one of video data or audio data from a source device through HDMI wherein the audio data include multi-stream audio data; transmitting a CEC message requesting multi-stream audio information to the source device; and receiving a response CEC message including multi-stream audio information from the source device.
  • Also, in a method for transmitting and receiving data of a sink device by using HDMI according to the present invention, the multi-stream audio information can include at least one of channel information or attribute information of multi-stream audio.
  • Also, a method for transmitting and receiving data of a sink device by using HDMI according to the present invention can further comprise providing a UI showing the multi-stream audio information; and in case a user input selecting one audio stream from the multi-stream audio, transmitting a CEC message requesting change of a multi-stream audio channel to the source device.
  • Also, in a method for transmitting and receiving data of a sink device by using HDMI according to the present invention, a CEC message requesting change of the multi-stream audio channel can include channel information of at least one audio among the multi-stream audio, and the multi-stream audio can include four audio channels.
  • A sink device transmitting and receiving data by using HDMI according to the present invention comprises an HDMI receiver; and a controller controlling transmission and reception of data of the HDMI receiver, wherein the sink device receives at least one of video data or audio data through HDMI from a source device, wherein the audio data include multi-stream audio; transmits a CEC message requesting multi-stream audio information to the source device; and receives a response CEC message including multi-stream audio information from the source device.
  • To solve the technical problem above, a method for transmitting and receiving data of a source device by using HDMI according to the present invention comprises transmitting at least one of video data or audio data to a sink device through HDMI, wherein the audio data include multi-stream audio; receiving a CEC message requesting multi-stream audio information from the sink device; and transmitting a response CEC message including multi-stream audio information to the sink device.
  • Also, in a method for transmitting and receiving data of a source device by using HDMI according to the present invention, the multi-stream audio information can include at least one of channel information or attribute information of multi-stream audio.
  • Also, a method for transmitting and receiving data of a source device by using HDMI according to the present invention can further comprise receiving a CEC message requesting change of a multi-stream audio channel from the sink device; and controlling transmission of the multi-stream audio according to the received CEC message.
  • Also, in a method for transmitting and receiving data of a source device by using HDMI according to the present invention, the CEC message requesting change of a multi-stream audio channel can include channel information of at least one audio among the multi-stream audio, and the multi-stream audio can include four audio channels.
  • In a source device transmitting and receiving data by using HDMI according to the present invention, a source device transmitting and receiving data by using HDMI comprises an HDMI transmitter transmitting and receiving data through HDMI; and a controller controlling data transmission and reception of the HDMI transmitter, wherein the source device transmits at least one of video data or audio data through HDMI to a sink device, wherein the audio data include multi-stream audio; receives a CEO message requesting multi-stream audio information from the sink device; and transmits a response CEC message including multi-stream audio information to the source device.
    • Advantageous Effect
  • According to the present invention, the user can control multi-stream audio transmitted from a source device by using a remote controller that transmits commands to a sink device.
  • Also, according to the present invention, by newly defining CEO messages for controlling multi-audio streams, the user can control multi-audio stream outputs of a source device by entering commands to a sink device through a remote controller.
  • Also, according to the present invention, by requesting/receiving multi-audio stream information in the form of a CEO message, a sink device may show information about multi-stream audio that can be provided or that is currently provided through a UI.
  • Also, if an output audio is determined among multi-stream audio, a source device may stop other audio stream outputs, thereby improving efficiency of utilizing HDMI bandwidth.
    • DESCRIPTION OF DRAWINGS
  • FIG. 1 illustrates an HDMI system according to one embodiment of the present invention and data transmission and reception channels included in the HDMI system.
  • FIG. 2 illustrates devices of an HDMI system according to one embodiment of the present invention and physical addresses assigned to the devices.
  • FIG. 3 illustrates devices of another HDMI system according to one embodiment of the present invention and logical addresses assigned to the devices.
  • FIG. 4 illustrates a header/data block as an HDMI CEC data format according to an embodiment of the present invention.
  • FIG. 5 illustrates an HDMI CEC sequence according to an embodiment of the present invention.
  • FIGS. 6 to 11 illustrate embodiments of various scenarios for controlling a source device by using the HDMI CEC protocol.
  • FIG. 12 illustrates HDMI CEC communication devices according to one embodiment of the present invention.
  • FIG. 13 is a flow diagram illustrating a method for controlling multi-stream audio by using the HDMI CEC protocol according to one embodiment of the present invention.
  • FIG. 14 illustrates a TV UI according to an embodiment of the present invention.
  • FIG. 15 illustrates a CEC message format according to an embodiment of the present invention.
    •  BEST MODE FOR INVENTION
  • In what follows, preferred embodiments of the present invention will be described in detail with reference to appended drawings. Detailed descriptions given below with reference to appended drawings are not limited only to those embodiments that can be realized according to the embodiments of the present invention, but they are intended to describe preferred embodiments of the present invention. The following descriptions include specific details to provide thorough understanding of the present invention. However, it should be clearly understood by those skilled in the art that the present invention can be implemented without employing the specific details.
  • Most terms used in this document are used widely in the corresponding technical field, but part of the terms have been chosen arbitrarily by the applicant, of which the meaning will be described in detail in the following description depending on the needs. Therefore, the present invention should be understood by the intended meaning of used terms rather than their apparent names or immediate implication.
  • FIG. 1 illustrates an HDMI system and data transmission and reception channels included in the HDMI system according to one embodiment of the present invention.
  • Devices that transmit and receive video/audio/control data using HDMI can be called collectively an HDMI system, and the HDMI system can comprise a source device 1010, a sink device 1020, and a cable. In the HDMI system, a device that transmits video/audio data through HDMI corresponds to the source device 1010, a device that receives video/audio data through HDMI corresponds to the sink device 1020, and an HDMI cable supporting data transmission and reception connects the two devices.
  • Though illustrated briefly in FIG. 1, a source device 1010 can include an HDMI transmitter transmitting and receiving data through HDMI; and a controller controlling the HDMI transmitter and data communication through HDMI of the source device. Also, the sink device 1020 can include an HDMI receiver transmitting and receiving data through HDMI; and a controller controlling the HDMI receiver and data communication through HDMI of the sink device.
  • As shown in FIG. 1, the HDMI cables and the connectors may perform pairing of four channels that provides a Transition Minimized Differential Signaling (TMDS) data channel and a TMDS clock channel. The TMDS data channels may be used for forwarding video data, audio data and auxiliary data. These channels can be used to deliver video data, audio data, and auxiliary data.
  • Additionally, the HDMI system provides a VESA (Video Electronics Standards Association) DDC (Display Data Channel). The DDC is used for configuration of one source device and one sink device and exchange of status information between them. A CEC protocol can provide a high-level control function among various audio-visual products in a user environment and may be used optionally. Also, an optional HEAC (HDMI Ethernet and Audio Return Channel) may provide Ethernet-compatible data networking among an ARC (Audio Return Channel) and connected devices in the opposite direction from a TMDS.
  • Video data, audio data and supplementary data may be transmitted and received through three TDMS data channels. Commonly, a TMDS clock runs a video pixel rate, and is transmitted through a TMDS clock channel. The TMDS clock may be used as a reference frequency for data recovery in three TMDS data channels in an HDMI receiver. In a source device, the data of 8 bits per TMDS data channel may be transformed into a sequence of 10 bits of which transition is minimized, which is DC balanced, and transmitted in serial manner with a rate of 10 bits per TMDS clock period.
  • In order to transmit audio data and supplementary data through the TMDS channel, the HDMI uses a packet structure. In order to attain high reliability for audio data and control data, data may be transmitted in word of 10 bits which is generated by using a BCH error correction code and an error reduction coding.
  • The source device can figure out configuration information and available functions of the sink device by reading out E-EDID (Enhanced Extended Display Identification Data) of the sink device in the DDC (Display Data Channel).
  • A utility line can be used for an optional extension function such as HEAC.
  • CEC (Consumer Electronics Control) specifies interoperability between devices within the HDMI system and can include various features that reinforce functionality of the devices. By using the HDMI-CEC protocol, the user can control a source device connected to a sink device through HDMI as well as the sink device itself by using a control device of the sink device (for example, remote controller). In what follows, the HDMI-CEC protocol will be described in more detail.
  • Table 1 and 2 below illustrate the structure/features that the HDMI-CEC protocol provides.
  • Table 1 illustrates an end-user structure/features that the HDMI-CEC protocol provides.
  • TABLE 1
    One Touch Play Video play is started by one click of a
    button, and device is switched to an active
    source state.
    System Standby All of the connected devices are switched
    to a waiting mode.
    One Touch Record Control the function of recording a program
    played in TV
    Timer Programming Set up the timer of a different device from
    one device
    Deck Control Control a play device from a different device
    Tuner Control Control the tuner of a different device
    Device Menu Control Make menus of a device controlled by using
    a TV remote controller
    Remote Control Transmit the command received from the
    Pass Through remote controller to a different device
    System Audio Control Transmit a command that controls audio play
  • Table 2 illustrates a structure/features that the HDMI-CEC protocol supports.
  • TABLE 2
    Device OSD Name Transmit a configured device name to a TV set
    Transfer
    Device Power Status Check the current power status of a device
    OSD Display Transmit text from a device to display the
    text on the screen of a TV set
    Routing Control Control routing of an HDMI network when a
    CEC switch is used
    System Information Set by a device to use the same OSD and menu
    language as the TV.
    Vendor Specific Commands defined by a vendor
    Commands
    Audio Rate Control Move an audio source slightly forward or
    backward
    Audio Return Channel Used to control Audio Return Channel (ARC)
    Control
    Capability Discovery Used to control HDMI Ethernet Channel
    and Control (HEC)
  • Devices of the HDMI system have physical addresses to perform addressing specific physical devices and to control switching by using the HDMI-CEC protocol. A physical address is determined by a physical address recovery operation, and the sink device can generate and utilize a unique physical address comprising 4 numbers, each of which consisting of 4 bits (n.n.n.n). In addition, CEC-enabled devices can have logical addresses according to their respective features.
  • In what follows, related to the HDMI CEC protocol, terms such as initiator and follower can be used in addition to the terms of source device and sink device. An initiator is a device that has transmitted or transmits a CEC message and depending on situations, indicates a device waiting for a response from a follower while the follower is a device that has received a CEO message and indicates a device that has to respond to the received message.
  • FIG. 2 illustrates devices of an HDMI system according to one embodiment of the present invention and physical addresses assigned to the devices.
  • A physical address may refer to the address system for indicating positions of devices used on the CEC bus. As described in detail above, a physical address can comprise four number, each of which consists of 4 bits (n.n.n.n), and a source device can check the physical address through EDID (Extended Display Identification Data) of a sink device.
  • As shown in FIG. 2, a device operating as a CEC root device such as the sink device or repeater can have a physical address as 0.0.0.0. A sink device can generate physical addresses for individual source devices by assigning port numbers to the unique physical addresses of connected source devices and set the generated address values to the EDID of the corresponding ports. In other words, if a new device is connected, the sink device can assign an address to the source device through CEA (Consumer Electronics Association) extension of the E-EDID (Enhanced EDID).
  • FIG. 3 illustrates devices of another HDMI system according to one embodiment of the present invention and logical addresses assigned to the devices.
  • As described with reference to FIG. 2, in case a new physical address is found as a device is connected to the HDMI system, and the connected device supports the CEC, the sink device can assign a logical address to the connected device. The assigned logical address can be used as a source address and a destination address when a CEC message is transmitted.
  • Table 3 illustrates an embodiment of a logical address assigned according to the features of a device.
  • TABLE 3
    Logical
    address Device
    0 TV
    1 Recording device 1 (Recording Device 1)
    2 Recording device 2 (Recording Device 1)
    3 Tuner 1
    4 Playback device 1 (Playback Device 1)
    5 Audio system
    6 Tuner 2
    7 Tuner 3
    8 Playback device 2
    9 Recording device 3
    10 Tuner 4
    11 Playback device 3
    12 Back-up 1 (For device types of “playback devices o
    “recording device of “tunerding de “processor devn case
    all of the specified logical addresses are assigned)
    13 Back-up 2 (For device types of “playback device”,
    “recording device”, “tuner”, and “processor”, in case
    all of the specified logical addresses are assigned)
    14 Specific Use
    15 Unregistered (Initiator Address)
    Broadcast (Destination Address)
  • In case one CEC line is used as shown in FIG. 3(a) and a primary CEC line and a secondary CEC line are used as shown in FIG. 3(b), a physical address 0.0.0.0 is assigned to the main TV and a logical address 0 is assigned thereto. And for other connected devices, logical addresses can be assigned according to the types of the connected devices as shown in FIG. 3. The sink device can inform other devices about the assigned logical addresses through broadcasting.
  • FIG. 4 illustrates a header/data block as an HDMI CEC data format according to an embodiment of the present invention.
  • The HDMI CEC performs control operations by transmitting and receiving a CEC message through a CEC line. The data by which the CEC messages are transmitted can be transmitted and received in the form of a frame format.
  • A CEC frame can include a start bit, header block, and at least one optional data block. As an embodiment, size of one block can be 10 bit, and size of the maximum message can be 16*10 bit (excluding the start bit). Table 4 provides a brief description of the blocks included in the CEC frame.
  • TABLE 4
    Name Description
    Start Special start ‘biti
    Header Block Source and Destination addresses;
    Logical Address
    Data Block 1(opcode block) Opcode (optional)
    Data Block 2(operand blocks) Operand(s) specific to opcode
    (optional, depending on opcode)
  • All of the header blocks and data blocks have 10 bit-length and can have a basic structure which is the same as shown in FIG. 4. As shown in FIG. 4, the information bits field can be data, opcode, or address. Control bits such as EOM and ACK can always be defined within a block and used in the same way. In the case of the header block, the information bits can include a logical address ( 4 bits) of an initiator and a logical address ( 4 bits) of a target device. The data block follows subsequent to the header block, and data such as operands can be transmitted after the opcode is transmitted.
  • The EOM (End of Message) bit indicates whether the corresponding block is the last one or a succeeding data block exists. As an example, in case there is a succeeding data block, the EOM bit can be set to 0 while a message is completed in the corresponding data block, the EOM can be set to 1.
  • The ACK (Acknowledge) bit can be used for a follower to check reception of data or a header block. As an example, reception of data or a header block can be checked by the initiator's sending the ACK bit by setting it to 1 and the follower's setting it to 0.
  • An opcode (operation code) is part of machine commands and describes an operation that has to be performed. In other words, an opcode is used as a name to identify a CEC message and can have a unique identifier/value. In addition to opcodes, commands can have the corresponding data values in the form of operands.
  • FIG. 5 illustrates an HDMI CEC sequence according to an embodiment of the present invention.
  • First, the source device and the sink device can check HDMI cable connection S5010. As shown in FIG. 5, if it is checked that 5V is applied to pin 18 of the source device, and 5V is applied to pin 19 (HPD) of the sink device, it can be determined that an HDMI cable has been connected between the source device and the sink device.
  • And the source device and the sink device can transmit/receive information of connected devices S5020. As shown in FIG. 5, by transmitting an EDID (Enhanced Display Identification Data) request to the sink device through a DDC (Display Data Channel) and receiving EDID information and EDID extension information from the sink device, the source device can read the EDID of the sink device.
  • Next, the source device and the sink device can exchange keys required for encrypting data transmission for the purpose of security S5030. This step is optional, and the source device and the sink device can exchange HDCP keys through the DDC.
  • And data transmission status can be controlled through the sequence based on the HDMI CEC protocol according to the command that the user has entered S5040. FIG. 5 is an embodiment in which deck control is performed by using the HDMI CEC protocol.
  • First, requesting and receiving deck status information, the sink device can check the deck status of the source device. And if the user inputs ‘play’ through an input device such as a remote controller, a play command (argument: “Forward”) can be transmitted to the source device. The source device can recognize the received CEC command and transmit video data and audio data to the sink device. Now, if the user additionally inputs ‘Next Chapter’, the sink device can transmit a deck control command (argument: “Skip Forward”) to the source device, and the source device can recognize this CEC command and transmit video data and audio data of the next chapter to the sink device.
  • FIGS. 6 to 11 illustrate embodiments of various scenarios for controlling a source device by using the HDMI CEC protocol.
  • In FIG. 6, FIG. 6(a) illustrates a scenario in which deck control is performed through the sink device, and FIG. 6(b) illustrates a scenario in which a new service is selected through the sink device.
  • In FIG. 7, FIG. 7(a) illustrates a scenario in which TV initiate system audio control, and FIG. 7(b) illustrates a scenario in which an amplifier initiates system audio control.
  • In FIG. 8, FIG. 8(a) illustrates a scenario in which a vendor-specific scenario is transmitted to the source device, and FIG. 8(b) illustrates a scenario in which the timer of the source device is programmed.
  • In FIG. 9, FIG. 9(a) illustrates a message exchange scenario for obtaining a TV menu language, and FIG. 9(b) illustrates a scenario in which the user changes a menu language setting.
  • In FIG. 10, FIG. 10(a) illustrates a scenario in which one-touch display is performed, and FIG. 10(b) illustrates a broadcast system standby scenario.
  • In FIG. 11, FIG. 11(a) illustrates a routing control scenario, and FIG. 11(b) illustrates a one-touch record scenario.
  • FIG. 12 illustrates HDMI CEC communication devices according to one embodiment of the present invention.
  • As described above, in view of CEO communication, the HDMI system can be described as comprising an initiator 12020 that transmits a CEC message and a follower 12010 that receives a CEC message and responds to the received CEC message. In other words, an initiator 12020 can refer to a device which initiates a CEC command and delivers the CEO command to a follower, thereby controlling the follower while a follower 12010 can refer to a device that responds to the CEC command, performs a request, and informs the initiator of the performance result. Both devices comprise the same sub-modules by default, and thus descriptions about the same modules will not be repeated. A module refers to a logical or physical unit within a device performing a specific operation; one module may correspond to one or more components, or one or more modules may correspond to one component.
  • The bus interface module 12030 represents a physical device that enables transmission of a command between devices; a message such as request, action, or response; or data.
  • The micom module 12040 represents a physical device that generates a signal for data transmission; or manages priorities, retransmission for reliable transmission, and the like. The mode protocol 12050 refers to the protocol used for efficient resource management required for high speed/low speed data transmission. The high mode module 12060 represents a logical device responsible for processing high speed data transmission in a bus interface architecture. The low mode module 12070 represents a logical device responsible for processing low speed data transmission in the bus interface architecture.
  • The buffer module 12080 represents a physical device temporarily storing transmitted messages or data to improve reliability thereof.
  • The bus protocol layer module 12090 is a logical device processing data transmitted through a bus-based transmission method and delivering necessary information to an upper layer and can include a module determination component module 12100.
  • The upper layer module 12110 represents a logical/physical device actually processing commands.
  • In what follows, described will be a method for transmitting and receiving multi-stream audio and controlling the multi-stream audio in the HDMI system in which a source device and a sink device transmitting audio/video data by using HDMI are connected to each other.
  • Multi-Stream Audio (MSA) refers to a collection of audio streams related to at least one video stream. MSA is a data communication method defined for the HDMI system to support multi-view video streaming or multi-video streams. In particular, the HDMI 2.0 system is capable of transmitting up to four stereo audio streams simultaneously.
  • In an embodiment, content played in a source device such as an STB (Set-Top Box) can support multi-stream audio: for example, 1) English, 2) Korean, 3) English commentary, and 4) Korean commentary. In this case, although multi-stream audio is being received, a sink device or a remote controller in the current HDMI system that controls the sink device is unable to select/change the multi-stream audio. Therefore, the present invention proposes a method for selecting/changing multi-stream audio by using a remote controller of the sink device by newly defining/adding CEC commands in case multi-stream audio-enabled content is played.
  • FIG. 13 is a flow diagram illustrating a method for controlling multi-stream audio by using the HDMI CEC protocol according to one embodiment of the present invention.
  • In the embodiment of FIG. 13, it is assumed that TV is the sink device, and a set-top box (STB) is the source device. According to the HDMI CEC protocol, TV can be an initiator while the set-top box can be a follower. As shown in FIG. 13, information request/response/command between the initiator and the follower is transmitted and received in the form of a CEC message through the CEO channel. FIG. 13 mainly illustrates communication between the sink device and the source device, and corresponding CEO messages will be described in more detail later.
  • TV can request information about multi-stream audio (MSA) of content to be played or being played in the set-top box S13010 <Request MSA info>. TV may perform this step automatically when content is played or when the user enters a multi-audio related function by using a TV remote controller.
  • The STB can transmit multi-stream audio information in response to the request for multi-stream audio information received from the TV S13020. In other words, TV can receive a multi-stream audio information response from the STB S13020. Multi-stream audio information is related to multi-stream audio of the content played in the STB and can include the number and attributes (or descriptions) of supported multi-stream audio, such as 1) Korean, 2) English, 3) Korean commentary, and 4) English commentary.
  • TV can provide information about received multi-stream audio; and output at least one of the received audio streams or provide a UI (User Interface) by which output audio can be changed S13030. TV can parse information about multi-stream audio received from the STB, inform the user about the parsed information by displaying the information or outputting the information as a sound output, and receive an input selecting at least one audio from among the multi-stream audio S13040. These steps (S13030 and S13040 ) may be performed optionally.
  • Receiving an audio selection/change input from a remote controller, TV can transmit a multi-stream audio change command to the set-top box S13050. The multi-stream audio change command, as a CEC command, can include a multi-stream audio ID (MSA chID). An audio ID may be identified as a channel number or channel ID of the corresponding audio.
  • According to the received multi-stream audio change command, the set-top box can change an audio output into the audio having an ID included in the received command S13060. At this time, the set-top box may stop other multi-stream audio outputs other than the audio having an ID included in the received CEC message. For example, if a CEC message commanding to output only one audio stream, the ID of which is 1, is received as shown in FIG. 13 while four audio streams, the audio channel IDs of which are 1, 2, 3, and 4 respectively are transmitted together or about to be transmitted, only the audio stream with an ID of 1 may be transmitted while transmitted of the remaining audio streams of which the IDs range from 2 to 4 may be stopped. In this case, bandwidth required for outputting other multi-stream audio may be redirected to be used for outputting video, thereby improving utilization efficiency of HDMI bandwidth.
  • FIG. 14 illustrates a TV UI according to an embodiment of the present invention. As described in FIG. 13, if TV receives multi-audio stream information from the set-top box, TV can provide multi-audio stream information and a UI by which the user can select audio.
  • As shown in FIG. 13, TV can provide such a UI in the lower part of the screen. The UI shown in FIG. 13 can display attributes of the multi-stream audio respectively as “1. English, 2. Korean, 3. English commentary, and 4. Korean commentary”. And the user can select one of the four audio streams as output audio by using a left-right movement button or a selection button or by entering a number key by using an input device such as a remote controller. TV can receive an audio selection/change input of the user according to the displayed UI.
  • Although the embodiment of FIG. 14 adopts a GUI (Graphical User Interface) as a UI for providing/selecting multi-stream audio information, the UI for providing/selecting information may be implemented by a voice UI.
  • FIG. 15 illustrates a CEC message format according to an embodiment of the present invention.
  • FIG. 15 illustrates an embodiment in which CEC messages of FIG. 13 are defined; the CEC messages defined in the present invention are defined only to describe the corresponding operations and are not necessarily defined according to the same syntax.
  • As described above, an operator represents a CEC command, opcode represents a name by which a CEC message is identified, and operand represents data values corresponding to a CEO command/message. In particular, an operand can correspond to the data specific to a particular opcode.
  • First, opcodes of the operator of FIG. 15(a) defined according to the present invention will be described.
  • <Request MSA Info>: opcode representing a CEC message/command requesting multi-stream audio information of current content <Report MSA Info>: opcode representing a CEC message/command reporting multi-stream audio information of current content. This opcode can be transmitted together with the operand [MSA Info].
  • <Change MSA ch>: opcode representing a CEO message/command changing a multi-stream audio channel. This opcode can be transmitted together with the operand [MSA ch].
  • Next, operands of FIG. 15(b) defined according to the present invention will be described.
  • [MSA Info]: operand representing multi-stream audio information. This operand can be transmitted together with the opcode <Report MSA Info> and as a multi-stream audio parameter, can represent such information as language, commentary, or audio channel.
  • [MSA ch]: operand representing an audio channel selected for multi-stream audio. This operand can be transmitted together with the opcode <Change MSA ch> and can represent at least one of the provided multi-stream audio as a channel. A channel number/ID can correspond to at least one of the entire channel numbers provided by the [MSA Info] operand.
  • In the embodiment of FIG. 15, the operand [MSA Info] has been defined by assuming a multi-stream audio environment comprising a maximum of four audio streams. This is so because the current HDMI system limits the size of a CEC operand up to 14 bytes in order to prevent channel monopoly. Therefore, in case the present invention is performed on multi-stream audio (MSA) comprising four or more audio streams under the aforementioned limitation, the opcode <Request MSA Info> can be performed many times to obtain the operand [MSA Info]. According to embodiments, the ISO639.2 code serial number may be applied to the operand [Ch name] to save data bits. In this case, the length of the operand [Ch name] can be reduced from 3 bytes to 1 byte.
  • FIGS. 13 to 15 illustrate embodiments of multi-audio streams. However, in addition to audio, the embodiments as shown in FIGS. 13 to 15 can be applied to multi-subtitles in which multiple subtitles are provided.
  • For example, TV can request multi-subtitle information from a set-top box, and in response to the request, TV can receive multi-subtitle information from the set-top box. Multi-subtitle information can include a plurality of subtitles that are transmitted/supported by current content and attribute information of the plurality of subtitles. TV can provide multi-subtitle information in the form of a UI and if receiving an input selecting/changing a particular subtitle from a remote controller, transmit a subtitle change command to the set-top box.
  • In this embodiment, opcode/operands of FIG. 15 can be modified to be suited for multi-subtitles, respectively. Individual opcodes/operands can still be used by replacing audio information of FIG. 15 such as <Request MST Info>, <Report MST Info>, <Change MST ch>, [MST Info], and [MST ch] with subtitle information.
  • It will be understood by those skilled in the art to which the present invention belongs that the present invention can be modified or changed in various ways without departing from the technical principles or scope of the present invention. Therefore, it is intended that the present invention includes modifications and changes of the present invention provided within the technical scope defined by appended claims and their equivalents.
  • In this document, the device and the method according to the present invention have been described fully, and descriptions for the device and method can be applied to each other in a complementary manner.
    • MODE FOR INVENTION
  • Various embodiments are described in Best mode for invention.
    • INDUSTRIAL APPLICABILITY
  • The present invention is used in a series of HDMI fields.
  • It is apparent to an ordinary skilled person in the art that various modifications and changes may be made without departing from the spirit and scope of the present invention. Accordingly, the present invention is intended to include the modifications and changes of the present invention within the attached claims and the equivalent scope.

Claims (20)

1. In a method for transmitting and receiving data of a sink device by using HDMI, a method for transmitting and receiving data of a sink device, comprising:
receiving at least one of video data or audio data from a source device through HDMI wherein the audio data include multi-stream audio data;
transmitting a CEC message requesting multi-stream audio information to the source device; and
receiving a response CEC message including multi-stream audio information from the source device.
2. The method of claim 1, wherein the multi-stream audio information includes at least one of channel information or attribute information of multi-stream audio.
3. The method of claim 2, further comprising
providing a UI showing the multi-stream audio information; and
in case a user input selecting one audio stream from the multi-stream audio, transmitting a CEC message requesting change of a multi-stream audio channel to the source device.
4. The method of claim 3, wherein a CEC message requesting change of the multi-stream audio channel includes channel information of at least one audio among the multi-stream audio.
5. The method of claim 1, wherein the multi-stream audio includes four audio channels.
6. In a sink device transmitting and receiving data by using HDMI, a sink device comprising:
an HDMI receiver; and
a controller controlling transmission and reception of data of the HDMI receiver, wherein the sink device
receives at least one of video data or audio data through HDMI from a source device, wherein the audio data include multi-stream audio;
transmits a CEC message requesting multi-stream audio information to the source device; and
receives a response CEC message including multi-stream audio information from the source device.
7. The device of claim 6, wherein the multi-stream audio information includes at least one of channel information or attribute information of multi-stream audio.
8. The device of claim 7,
providing a UI showing the multi-stream audio information; and
in case a user input selecting one audio stream from the multi-stream audio, transmitting a CEC message requesting change of a multi-stream audio channel to the source device.
9. The device of claim 8, wherein a CEC message requesting change of the multi-stream audio channel includes channel information of at least one audio among the multi-stream audio.
10. The device of claim 6, wherein the multi-stream audio includes four audio channels.
11. In a method for transmitting and receiving data of a source device by using HDMI, a method for transmitting and receiving data of a source device, comprising:
transmitting at least one of video data or audio data to a sink device through HDMI, wherein the audio data include multi-stream audio;
receiving a CEC message requesting multi-stream audio information from the sink device; and
transmitting a response CEC message including multi-stream audio information to the sink device.
12. The method of claim 11, wherein the multi-stream audio information includes at least one of channel information or attribute information of multi-stream audio.
13. The method of claim 12, further comprising
receiving a CEC message requesting change of a multi-stream audio channel from the sink device; and
controlling transmission of the multi-stream audio according to the received CEC message.
14. The method of claim 13, wherein the CEC message requesting change of a multi-stream audio channel includes channel information of at least one audio among the multi-stream audio.
15. The method of claim 11, wherein the multi-stream audio includes four audio channels.
16. In a source device transmitting and receiving data by using HDMI, a source device comprising:
an HDMI transmitter transmitting and receiving data through HDMI; and
a controller controlling data transmission and reception of the HDMI transmitter, wherein the source device
transmits at least one of video data or audio data through HDMI to a sink device, wherein the audio data include multi-stream audio;
receives a CEO message requesting multi-stream audio information from the sink device; and
transmits a response CEC message including multi-stream audio information to the source device.
17. The device of claim 16, wherein the multi-stream audio information includes at least one of channel information or attribute information of multi-stream audio.
18. The device of claim 17,
receiving a CEC message requesting change of a multi-stream audio channel from the sink device; and
controlling transmission of the multi-stream audio according to the received CEC message.
19. The device of claim 18, wherein the CEO message requesting change of a multi-stream audio channel includes channel information of at least one audio among the multi-stream audio.
20. The device of claim 16, wherein the multi-stream audio includes four audio channels.
US15/125,519 2014-03-12 2015-03-11 Device and method for transmitting and receiving data using hdmi Abandoned US20170078739A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US15/125,519 US20170078739A1 (en) 2014-03-12 2015-03-11 Device and method for transmitting and receiving data using hdmi

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201461952109P 2014-03-12 2014-03-12
US15/125,519 US20170078739A1 (en) 2014-03-12 2015-03-11 Device and method for transmitting and receiving data using hdmi
PCT/KR2015/002343 WO2015137717A1 (en) 2014-03-12 2015-03-11 Device and method for transmitting and receiving data using hdmi

Publications (1)

Publication Number Publication Date
US20170078739A1 true US20170078739A1 (en) 2017-03-16

Family

ID=54072081

Family Applications (2)

Application Number Title Priority Date Filing Date
US15/125,563 Active US9942605B2 (en) 2014-03-12 2015-03-11 Devices and methods for transmitting and receiving data of a sink device to change video display resolution based on error counter value detected at the sink device using HDMI
US15/125,519 Abandoned US20170078739A1 (en) 2014-03-12 2015-03-11 Device and method for transmitting and receiving data using hdmi

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US15/125,563 Active US9942605B2 (en) 2014-03-12 2015-03-11 Devices and methods for transmitting and receiving data of a sink device to change video display resolution based on error counter value detected at the sink device using HDMI

Country Status (6)

Country Link
US (2) US9942605B2 (en)
EP (1) EP3160152A4 (en)
JP (1) JP6232146B2 (en)
KR (2) KR20160132900A (en)
CN (1) CN106105248A (en)
WO (2) WO2015137716A1 (en)

Families Citing this family (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6254297B2 (en) * 2014-03-24 2017-12-27 エルジー エレクトロニクス インコーポレイティド Data transmission / reception device and method using HDMI (registered trademark)
KR102463418B1 (en) 2016-01-06 2022-11-08 삼성전자 주식회사 Video content providing apparatus and control method thereof, and system
US10334254B2 (en) * 2016-09-23 2019-06-25 Apple Inc. Feed-forward and feed-back metadata exchange in image processing pipelines to improve image quality
CN109844615B (en) 2016-10-13 2021-01-15 株式会社Lg化学 Optical isolator
KR20180068470A (en) * 2016-12-14 2018-06-22 삼성전자주식회사 Display apparatus consisting a multi display system and control method thereof
US10142521B2 (en) 2017-03-22 2018-11-27 Cisco Technology, Inc. System and method for using HDMI arc for estimating latency
US10931722B2 (en) 2017-04-04 2021-02-23 Lattice Semiconductor Corporation Transmitting common mode control data over audio return channel
JP6915401B2 (en) 2017-06-21 2021-08-04 船井電機株式会社 Video / audio output device
JP7310604B2 (en) * 2017-07-24 2023-07-19 ソニーグループ株式会社 cable
JP2020036135A (en) * 2018-08-29 2020-03-05 沖電気工業株式会社 Video transmitting device, information processing method, and program
CN111601099B (en) * 2019-02-21 2021-12-21 南宁富桂精密工业有限公司 High-definition multimedia interface cable detection system and detection method thereof
KR102599365B1 (en) * 2019-05-17 2023-11-08 삼성전자주식회사 Electronic apparatus and control method thereof
KR20210001762A (en) * 2019-06-28 2021-01-06 삼성전자주식회사 An electronic device for processing image and image processing method thereof
TWI740654B (en) * 2019-09-18 2021-09-21 矽創電子股份有限公司 Video data displaying device
KR20210039551A (en) * 2019-10-02 2021-04-12 삼성전자주식회사 Method for establishing Mirroring Status between Master Device and Client Device, and Electrical Device performing the same
KR20210075724A (en) * 2019-12-13 2021-06-23 삼성전자주식회사 Display device and operating method for the same
US20230199246A1 (en) * 2020-05-14 2023-06-22 Lg Electronics Inc. Video data transmission and reception method using high-speed interface, and apparatus therefor
EP4246960A4 (en) * 2021-02-01 2024-04-03 Samsung Electronics Co Ltd Display device and operating method therefor
US11895359B2 (en) 2021-04-13 2024-02-06 Samsung Electronics Co., Ltd. Electronic device and operating method thereof
KR20220165395A (en) * 2021-06-08 2022-12-15 엘지전자 주식회사 Method for controlling hdmi and source device and sink device
TWI769046B (en) * 2021-08-10 2022-06-21 瑞昱半導體股份有限公司 Signal relay apparatus and method having frequency calibration mechanism
CN115174971B (en) * 2022-06-06 2023-08-11 青岛信芯微电子科技股份有限公司 Audio return method, chip system and display device
EP4311246A1 (en) * 2022-07-21 2024-01-24 Stryker Corporation Systems and methods for routing multimedia signals

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100132001A1 (en) * 2008-03-05 2010-05-27 Sony Corporation Transmission device and reception device
US20100177245A1 (en) * 2007-07-10 2010-07-15 Atsushi Ohnuma Display system and dsiplay apparatus
US20100315553A1 (en) * 2008-02-06 2010-12-16 Panasonic Corporation Audio-video data synchronization method, video output device, audio output device, and audio-video output system

Family Cites Families (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3966159B2 (en) * 2001-12-26 2007-08-29 株式会社日立製作所 Video processing apparatus and television receiver
JP2005109703A (en) * 2003-09-29 2005-04-21 Pioneer Electronic Corp Apparatus and method for outputting image, image display system, image output program and information recording medium
JP2006179973A (en) * 2004-12-20 2006-07-06 Toshiba Corp Electronic equipment and method of controlling the same
CN102065262B (en) * 2006-11-07 2013-04-03 索尼株式会社 Electronic device and control information reception method
JP2008193168A (en) * 2007-01-31 2008-08-21 Toshiba Corp Video image communication equipment, video image communication system, and video image communication method
JP5240491B2 (en) * 2007-06-26 2013-07-17 ソニー株式会社 Transmitter and receiver
KR101411107B1 (en) * 2007-10-16 2014-06-27 엘지전자 주식회사 Media sink device and method for controlling of the same
JP4535161B2 (en) * 2008-04-01 2010-09-01 ソニー株式会社 Electronic device, communication system, communication method, and program
US8253860B2 (en) * 2008-04-07 2012-08-28 Mediatek Inc. System, method and devices for HDMI transmission using a commonly supported media format
KR20100032735A (en) * 2008-09-18 2010-03-26 엘지전자 주식회사 Source device and method for setting audio out of source device
JP2010108372A (en) * 2008-10-31 2010-05-13 Toshiba Corp Video display device, video display method and video system
KR20100104025A (en) * 2009-03-16 2010-09-29 삼성전자주식회사 Apparatus to process signal of digital multimedia interface and method thereof
KR101061130B1 (en) 2009-06-23 2011-08-31 엘지전자 주식회사 Source equipment, sink equipment, and HDM control method for setting the optimum resolution
KR20110049083A (en) * 2009-11-04 2011-05-12 한국전자통신연구원 Portable multimedia apparatus, audio reproducing apparatus and audio system for reproducing digital audio signal
KR20110085606A (en) 2010-01-21 2011-07-27 엘지전자 주식회사 A display device and method of setting audio path of dvi/hdmi
JP5771986B2 (en) * 2010-12-28 2015-09-02 ソニー株式会社 Electronic device, electronic device control method, and electronic device system
US9412330B2 (en) * 2011-03-15 2016-08-09 Lattice Semiconductor Corporation Conversion of multimedia data streams for use by connected devices
US8918544B2 (en) * 2011-03-31 2014-12-23 Logitech Europe S.A. Apparatus and method for configuration and operation of a remote-control system
JP2013102325A (en) * 2011-11-08 2013-05-23 Olympus Corp Image transmission device, image transmission method, and program
US20130250180A1 (en) * 2012-03-21 2013-09-26 Cheng-Si Wang Hdmi signal distributor
JP2014011734A (en) * 2012-07-02 2014-01-20 Toshiba Corp Video processing device
KR20140007698A (en) 2012-07-10 2014-01-20 삼성전자주식회사 Hdmi signal adjustment method, hdmi signal receiving apparatus, hdmi signal transmitting apparatus and hdmi signal processing system
US8982281B2 (en) * 2013-08-12 2015-03-17 Hydraconnect Sales Llc HDMI switch system with video alerts

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100177245A1 (en) * 2007-07-10 2010-07-15 Atsushi Ohnuma Display system and dsiplay apparatus
US20100315553A1 (en) * 2008-02-06 2010-12-16 Panasonic Corporation Audio-video data synchronization method, video output device, audio output device, and audio-video output system
US20100132001A1 (en) * 2008-03-05 2010-05-27 Sony Corporation Transmission device and reception device

Also Published As

Publication number Publication date
KR20160132900A (en) 2016-11-21
EP3160152A1 (en) 2017-04-26
KR20160132843A (en) 2016-11-21
JP2017515331A (en) 2017-06-08
US20170006336A1 (en) 2017-01-05
CN106105248A (en) 2016-11-09
JP6232146B2 (en) 2017-11-15
WO2015137717A1 (en) 2015-09-17
US9942605B2 (en) 2018-04-10
WO2015137716A1 (en) 2015-09-17
EP3160152A4 (en) 2017-11-15

Similar Documents

Publication Publication Date Title
US20170078739A1 (en) Device and method for transmitting and receiving data using hdmi
US10999554B2 (en) Communication device and communication method
US8248530B2 (en) Electronic device, communication system, method of communication, and program
JP4091073B2 (en) Home appliance control (CEC) protocol compatible device, CEC command management method, CEC compatible system, and audio / video entertainment system
US8903523B2 (en) Audio processing device, audio processing method, and program
KR102397289B1 (en) Method and apparatus for transmitting and receiving data by using hdmi
US8984555B2 (en) Display device, program information display method in display device, receiving device, and signal transmission method in receiving device
US10085058B2 (en) Device and method for transmitting and receiving data using HDMI
CN102024445B (en) Show the method and apparatus from the vision signal of multiple input source
US10474241B2 (en) Method and device for transmitting/receiving data using HDMI
US20150134860A1 (en) System for improving hdmi cec performance, and method for controlling same
JP2007311884A (en) Communication system, transmission apparatus and reception apparatus, communication method, and program
JP2008067024A (en) Display device and display system
US10162769B2 (en) Method and apparatus for transmitting and receiving data using HDMI
US20110167465A1 (en) Device control apparatus, device control method and computer program
US9973787B2 (en) Communication device and communication method
JP2012213131A (en) Input switching device
JP2020150445A (en) Electronic apparatus
US20170238050A1 (en) Method for transmitting and receiving data using hdmi and device therefor
JP2010130543A (en) Communication apparatus and communication method
US20240073355A1 (en) Sink device, source device, and method for controlling the same
JP5698945B2 (en) Display device and signal processing method
KR20240029322A (en) Sink device, source device and method thereof
JP2020036135A (en) Video transmitting device, information processing method, and program

Legal Events

Date Code Title Description
AS Assignment

Owner name: LG ELECTRONICS INC., KOREA, REPUBLIC OF

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:LEE, HYEONJAE;KIM, DOKYUN;PARK, JANGWOONG;AND OTHERS;REEL/FRAME:040090/0201

Effective date: 20161005

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION