JP6304417B2 - Receiving method and receiving apparatus - Google Patents

Description

  The present invention relates to a receiving method and a receiving apparatus.

  In recent years, for example, digital video signals, that is, uncompressed (DVD) (Digital Versatile Disc) recorders, set-top boxes, and other AV sources (Audio Visual source) from television receivers, projectors, and other displays. As a communication interface for transmitting a baseband video signal (image data) and a digital audio signal (audio data) accompanying the video signal at high speed, HDMI (High Definition Multimedia Interface) is becoming widespread. For example, Non-Patent Document 1 describes details of the HDMI standard.

  FIG. 42 shows a configuration example of an AV (Audio Visual) system 10. The AV system 10 includes a disc player 11 as a source device and a television receiver 12 as a sink device. The disc player 11 and the television receiver 12 are connected via an HDMI cable 13. The disc player 11 is provided with an HDMI terminal 11a to which an HDMI transmission unit (HDMI TX) 11b is connected. The television receiver 12 is provided with an HDMI terminal 12a to which an HDMI receiving unit (HDMI RX) 12b is connected. One end of the HDMI cable 13 is connected to the HDMI terminal 11 a of the disc player 11, and the other end of the HDMI cable 13 is connected to the HDMI terminal 12 a of the television receiver 12.

  In the AV system 10 shown in FIG. 42, uncompressed image data obtained by being reproduced by the disc player 11 is transmitted to the television receiver 12 via the HDMI cable 13, and is transmitted from the disc player 11 by the television receiver 12. An image based on the processed image data is displayed. Further, uncompressed audio data obtained by being reproduced by the disc player 11 is transmitted to the television receiver 12 via the HDMI cable 13, and the audio by the audio data transmitted from the disc player 11 is received by the television receiver 12. Is output.

  FIG. 43 shows a configuration example of the HDMI transmission unit (HDMI source) 11b of the disc player 11 and the HDMI reception unit (HDMI sink) 12b of the television receiver 12 in the AV system 10 of FIG.

  The HDMI transmission unit 11b is an effective image section (hereinafter also referred to as an active video section as appropriate) that is a section obtained by removing a horizontal blanking section and a vertical blanking section from a section from one vertical synchronization signal to the next vertical synchronization signal. ), The differential signal corresponding to the pixel data of the uncompressed image for one screen is transmitted to the HDMI receiving unit 12b in one direction through a plurality of channels, and in the horizontal blanking interval or the vertical blanking interval, At least a differential signal corresponding to audio data, control data, other auxiliary data, etc. associated with an image is transmitted to the HDMI receiving unit 12b in one direction through a plurality of channels.

  That is, the HDMI transmission unit 11 b includes the HDMI transmitter 81. The transmitter 81 converts, for example, pixel data of an uncompressed image into a corresponding differential signal, and an HDMI cable via three TMDS (Transition Minimized Differential Signaling) channels # 0, # 1, and # 2 as a plurality of channels. 13 is serially transmitted in one direction to the HDMI receiving unit 12b connected via the H.13.

  The transmitter 81 converts audio data accompanying uncompressed images, further necessary control data and other auxiliary data, etc. into corresponding differential signals, and converts them into three TMDS channels # 0, # 1, #. 2 is serially transmitted in one direction to the HDMI receiving unit 12b connected via the HDMI cable 13.

  Further, the transmitter 81 transmits the pixel clock synchronized with the pixel data transmitted through the three TMDS channels # 0, # 1, and # 2 to the HDMI receiving unit 12b connected via the HDMI cable 13 using the TMDS clock channel. Send. Here, in one TMDS channel #i (i = 0, 1, 2), 10-bit pixel data is transmitted during one pixel clock.

  The HDMI receiving unit 12b receives a differential signal corresponding to the pixel data transmitted in one direction from the HDMI transmitting unit 11b through a plurality of channels in the active video period, and also receives a horizontal blanking period or a vertical blanking. In a section, differential signals corresponding to audio data and control data transmitted in one direction from the HDMI transmission unit 11b are received through a plurality of channels.

  That is, the HDMI receiving unit 12b includes an HDMI receiver 82. The receiver 82 transmits TMDS channels # 0, # 1, and # 2 in one direction from the HDMI transmission unit 11b connected via the HDMI cable 13 and the differential signal corresponding to the pixel data and the audio. Similarly, differential signals corresponding to data and control data are received in synchronization with the pixel clock transmitted from the HDMI transmission unit 11b through the TMDS clock channel.

  In the transmission channel of the HDMI system including the HDMI source transmission unit 11b and the HDMI reception unit 12b, pixel data and audio data are transmitted in one direction from the HDMI transmission unit 11b to the HDMI reception unit 12b in synchronization with the pixel clock. In addition to three TMDS channels # 0 to # 2 as transmission channels for serial transmission and TMDS clock channels as transmission channels for transmitting pixel clocks, a DDC (Display Data Channel) 83 and CEC (Consumer Electronics Control) ) There is a transmission channel called line 84.

  The DDC 83 includes two signal lines (not shown) included in the HDMI cable 13, and the HDMI transmission unit 11 b is connected to the HDMI reception unit 12 b connected via the HDMI cable 13 with E-EDID (Enhanced Extended Display Identification Data). Used to read

  That is, in addition to the HDMI receiver 81, the HDMI receiving unit 12b has an EDID ROM (Read Only Memory) 85 that stores E-EDID that is performance information related to its performance (configuration / capability). . The HDMI transmission unit 11b reads the E-EDID of the HDMI reception unit 12b from the HDMI reception unit 12b connected via the HDMI cable 13 via the DDC 83, and based on the E-EDID, the HDMI reception unit 12b For example, an image format (profile) supported by the electronic device having the HDMI receiving unit 12b, for example, RGB, YCbCr4: 4: 4, YCbCr4: 2: 2, and the like.

  The CEC line 84 is composed of one signal line (not shown) included in the HDMI cable 13 and is used for bidirectional communication of control data between the HDMI transmission unit 11b and the HDMI reception unit 12b.

  The HDMI cable 13 includes a line (HPD line) 86 connected to a pin called HPD (Hot Plug Detect). The source device can detect the connection of the sink device using the line 86. Further, the HDMI cable 13 includes a line (power supply line) 87 used for supplying power from the source device to the sink device. Further, the HDMI cable 13 includes a reserved line 88.

  FIG. 44 shows an example of TMDS transmission data. FIG. 44 shows sections of various transmission data when image data of horizontal × vertical 1920 pixels × 1080 lines is transmitted in TMDS channels # 0, # 1, and # 2.

  A video field (Video Field) in which transmission data is transmitted through the three TMDS channels # 0, # 1, and # 2 of HDMI includes a video data period and a data island period according to the type of transmission data. There are three types of sections: (Data Island period) and Control period.

  Here, the video field period is a period from a rising edge (active edge) of a certain vertical synchronizing signal to a rising edge of the next vertical synchronizing signal, and includes a horizontal blanking period (horizontal blanking) and a vertical blanking period (vertical blanking period). ), And an active video section (Active Video) that is a section obtained by removing the horizontal blanking period and the vertical blanking period from the video field section.

  The video data section is assigned to the active video section. In this video data section, 1920 pixel (pixel) × 1080 line effective pixel (Active pixel) data constituting uncompressed image data for one screen is transmitted.

  The data island period and the control period are assigned to the horizontal blanking period and the vertical blanking period. In the data island section and the control section, auxiliary data (Auxiliary data) is transmitted. That is, the data island period is assigned to a part of the horizontal blanking period and the vertical blanking period. In this data island period, for example, audio data packets, which are data not related to control, of auxiliary data are transmitted.

  The control period is allocated to other parts of the horizontal blanking period and the vertical blanking period. In this control period, for example, vertical synchronization signals, horizontal synchronization signals, control packets, and the like, which are data related to control, of auxiliary data are transmitted.

  FIG. 45 shows an example of a packing format when image data (24 bits) is transmitted through the three TMDS channels # 0, # 1, and # 2 of HDMI. Three image data transmission schemes are shown: RGB 4: 4: 4, YCbCr 4: 4: 4, and YCbCr 4: 2: 2. Here, the relationship between the TMDS clock and the pixel clock is a relationship of TMDS clock = pixel clock.

  In the RGB 4: 4: 4 system, 8-bit blue (B) data, 8-bit green (G) data, 8 in the data area of each pixel (pixel) in TMDS channels # 0, # 1, and # 2. Bit red (R) data is arranged. In the YCbCr 4: 4: 4 system, 8-bit blue difference (Cb) data, 8-bit luminance (Y) data, 8 bits are stored in the data area of each pixel (pixel) in the TMDS channels # 0, # 1, and # 2. Bit red difference (Cr) data is arranged.

  In the YCbCr 4: 2: 2 system, bits 0 to 3 of luminance (Y) data are arranged in the data area of each pixel (pixel) of the TMDS channel # 0, and blue difference (Cb) data The data of bit 0 to bit 3 and the data of bit 0 to bit 3 of the red color difference (Cr) data are alternately arranged for each pixel. In the YCbCr 4: 2: 2 system, bits 4 to 11 of luminance (Y) data are arranged in the data area of each pixel (pixel) of the TMDS channel # 1. In the YCbCr 4: 2: 2 system, bits 4 to 11 of the blue color difference (Cb) data and bit 4 of the red color difference (Cr) data are set in the data area of each pixel (pixel) of the TMDS channel # 2. To bit 11 data are alternately arranged for each pixel.

  FIG. 46 shows an example of packing format when deep color image data (48 bits) is transmitted through the three TMDS channels # 0, # 1, and # 2 of HDMI. As the image data transmission system, RGB 4: 4: 4 and YCbCr 4: 4: 4 are shown. Here, the relationship between the TMDS clock and the pixel clock is TMDS clock = 2 × pixel clock.

  In the RGB 4: 4: 4 system, 16 bits of blue (B) data bits 0 to 7 and bits 8 to 8 are placed in the first half and second half of each pixel (pixel) in TMDS channel # 0. Fifteen data are arranged. In the RGB 4: 4: 4 system, 16 bits of green (G) data bits 0 to 7 and bits 8 are placed in the first half and second half of each pixel (pixel) in the TMDS channel # 1. ~ Data of bit 15 is arranged. In the RGB 4: 4: 4 system, 16 bits of red (R) data bits 0 to 7 and bits 8 are placed in the first half and second half of each pixel (pixel) in the TMDS channel # 2. ~ Data of bit 15 is arranged.

  In the YCbCr 4: 4: 4 system, 16 bits of blue difference (Cb) data bits 0 to 7 and data bits are placed in the first half and second half data areas of each pixel (pixel) in TMDS channel # 0. Data of 8 to 15 is arranged. In the YCbCr 4: 4: 4 scheme, 16-bit luminance (Y) data bits 0 to 7 and bits 8 are placed in the first half and second half of each pixel (pixel) in the TMDS channel # 1. ~ Data of bit 15 is arranged. In the YCbCr 4: 4: 4 system, 16 bits of red-difference (Cr) data bits 0 to 7 and bits are stored in the first half and second half of each pixel (pixel) in the TMDS channel # 2. Data of 8 to 15 is arranged.

  Since there is no transmission specification of stereoscopic image data to be put into practical use between devices connected by HDMI, it could be realized only by connection between the same manufacturers. In particular, there is no guarantee of interconnection for connections with other companies' sets. For example, Patent Document 1 proposes a transmission method and determination of stereoscopic image data, but does not propose transmission using a digital interface such as HDMI. Patent Document 2 proposes a transmission method using a television broadcast radio wave of stereoscopic image data, but does not propose transmission using a digital interface.

JP 2003-111101 A Japanese Patent Laid-Open No. 2005-6114

High-Definition Multimedia Interface Specification Version 1.3a, November 10 2006

  As described above, conventionally, there has been no proposal regarding the transmission specification of stereoscopic image data with a dedigital interface such as HDMI.

  An object of the present invention is to enable good transmission of stereoscopic image data between devices.

The concept of this invention is
A receiving method in a receiving apparatus connected to an external device via a main link and an auxiliary channel,
The main link consists of one, two or four double terminated differential signal pairs,
The auxiliary channel is a channel for half duplex bidirectional communication,
A transmission method information transmission step of transmitting transmission method information of stereoscopic image data that can be supported to the external device through the auxiliary channel;
The transmission method information includes a field sequential method for transmitting at least left-eye image data and right-eye image data by sequentially switching each field,
A data receiving step of receiving stereoscopic image data as an 8B / 10B encoded data stream embedded with a clock from the external device via the main link;
A transmission method information receiving step for extracting transmission method information of the stereoscopic image data from a blanking period of the stereoscopic image data received in the data receiving step;
The data processing step further includes processing the stereoscopic image data received in the data receiving step based on the transmission method information extracted in the transmission method information receiving step to generate left eye image data and right eye image data. Is in the way.

  According to this invention, transmission of stereoscopic image data between devices can be performed satisfactorily.

1 is a block diagram showing a configuration example of an AV system as an embodiment of the present invention. It is a figure which shows the "field sequential system" and the "phase difference plate system" which are the example of a display system of a stereoscopic vision image. It is a block diagram which shows the structural example of the disc player (source device) which comprises AV system. It is a block diagram which shows the structural example of the television receiver (sink apparatus) which comprises AV system. It is a block diagram which shows the structural example of an HDMI transmission part (HDMI source) and an HDMI receiving part (HDMI sink). It is a block diagram which shows the structural example of the HDMI transmitter which comprises an HDMI transmission part, and the HDMI receiver which comprises an HDMI receiving part. It is a figure which shows the example of a structure of TMDS transmission data (when the image data of horizontal x length is 1920 pixels x 1080 lines is transmitted). It is a figure which shows the pin arrangement (type A) of the HDMI terminal to which the HDMI cable of the source device and the sink device is connected. FIG. 5 is a connection diagram illustrating a configuration example of a high-speed data line interface that is an interface of a bidirectional communication path configured using a reserve line of an HDMI cable and an HDD line in a source device and a sink device. It is a figure which shows the image data (Image data of a 1920 * 1080p pixel format) of the left eye (L) and the right eye (R). 3D (stereoscopic) image data transmission method, (a) a method of sequentially switching pixel data of left eye image data and pixel data of right eye image data for each TMDS clock, and (b) left eye image data. For alternately transmitting one line of right eye image data and one line of right eye image data, and (c) a method of sequentially switching and transmitting left eye image data and right eye image data for each field. FIG. 3D (stereoscopic) image data transmission method, (a) a method of alternately transmitting one line of left eye image data and one line of right eye image data, (b) the left eye in the first half of the vertical direction A method of transmitting data of each line of image data, and transmitting data of each line of left eye image data in the second half of the vertical direction, (c) transmitting pixel data of left eye image data in the first half of the horizontal direction, and horizontally It is a figure for demonstrating the system which transmits the pixel data of left eye image data in the latter half of a direction. It is a figure which shows the TMDS transmission data example in the system (system (1)) which switches pixel data of left eye image data and pixel data of right eye image data sequentially for every TMDS clock, and transmits. It is a figure which shows the example of a packing format at the time of transmitting 3D image data of a system (1) with three TMDS channels # 0, # 1, and # 2 of HDMI. It is a figure which shows the TMDS transmission data example in the system (system (2)) which transmits one line of left eye image data and one line of right eye image data alternately. It is a figure which shows the example of a packing format at the time of transmitting 3D image data of a system (2) with three TMDS channels # 0, # 1, and # 2 of HDMI. It is a figure which shows the TMDS transmission data example in the system (system (3)) which switches and transmits left-eye image data and right-eye image data sequentially for every field. It is a figure which shows the packing format example of the odd field at the time of transmitting 3D image data of a system (3) with three TMDS channels # 0, # 1, and # 2 of HDMI. It is a figure which shows the example of a packing format of the even field at the time of transmitting 3D image data of a system (3) with three TMDS channels # 0, # 1, and # 2 of HDMI. It is a figure which shows the TMDS transmission data example in the system (system (4)) which transmits one line of left eye image data and one line of right eye image data alternately. It is a figure which shows the example of a packing format at the time of transmitting 3D image data of a system (4) with three TMDS channels # 0, # 1, and # 2 of HDMI. The figure which shows the TMDS transmission data example in the system (method (5)) which transmits the data of each line of left eye image data in the first half of a vertical direction, and transmits the data of each line of left eye image data in the second half of a vertical direction. It is. It is a figure which shows the packing format example of the vertical first half at the time of transmitting 3D image data of a system (5) with three TMDS channels # 0, # 1, and # 2 of HDMI. It is a figure which shows the packing format example of the vertical second half at the time of transmitting 3D image data of a system (5) with three TMDS channels # 0, # 1, and # 2 of HDMI. It is a figure which shows the TMDS transmission data example in the system (scheme (6)) which transmits the pixel data of left eye image data in the first half of a horizontal direction, and transmits the pixel data of left eye image data in the second half of a horizontal direction. It is a figure which shows the example of a packing format at the time of transmitting 3D image data of a system (6) with three TMDS channels # 0, # 1, and # 2 of HDMI. It is a figure which shows the two-dimensional (2D) image data and depth data which comprise 3D image data of an MPEG-C system. It is a figure which shows the example of TMDS transmission data in an MPEG-C system. It is a figure for demonstrating the example of a packing format at the time of transmitting 3D image data of an MPEG-C system with three TMDS channels # 0, # 1, and # 2 of HDMI. It is a figure for demonstrating the decoding process in the sink apparatus (television receiver) which received 3D image data of an MPEG-C system. It is a figure which shows the data structural example of E-EDID memorize | stored in the sink apparatus (television receiver). It is a figure which shows the example of a data structure of the Vender Specific area | region of E-EDID. It is a figure which shows the example of a data structure of the AVI InfoFrame packet arrange | positioned at a data island area. It is a figure which shows the example of video format data. It is a figure which shows the structural example of the GCP (General Control Protocol) packet which transmits Deep Color information. It is a figure which shows the data structure example of the Audio InfoFrame packet arrange | positioned at a data island area. It is a flowchart which shows the process sequence at the time of the connection of the television receiver (sink apparatus) in a disc player (source apparatus). It is a figure which shows the procedure of the determination process of the transmission system of 3D image data in a disc player (source device). It is a figure which shows the structural example of DP system using DP interface as a baseband digital interface. It is a figure which shows the structural example of the wireless system using a wireless interface as a baseband digital interface. It is a figure which shows the structural example of the transmission system which confirms the transmission rate of a transmission line and determines the transmission system of 3D image data. It is a figure which shows the structural example of the AV system using the conventional HDMI interface. It is a figure which shows the structural example of the HDMI transmission part of a disc player (source device), and the HDMI reception part of a television receiver (sink device). It is a figure which shows the example of TMDS transmission data in case image data of horizontal x vertical 1920 pixels x 1080 lines is transmitted. It is a figure which shows the example of a packing format at the time of transmitting image data (24 bits) by three TMDS channels # 0, # 1, and # 2 of HDMI. It is a figure which shows the example of a packing format at the time of transmitting deep color image data (48 bits) with three TMDS channels # 0, # 1, and # 2 of HDMI.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 shows a configuration example of an AV (Audio Visual) system 200 as an embodiment. The AV system 200 includes a disc player 210 as a source device and a television receiver 250 as a sink device.

  The disc player 210 and the television receiver 250 are connected via an HDMI cable 350. The disc player 210 is provided with an HDMI terminal 211 to which an HDMI transmission unit (HDMI TX) 212 and a high-speed data line interface (I / F) 213 are connected. The television receiver 250 is provided with an HDMI terminal 251 to which an HDMI receiving unit (HDMI RX) 252 and a high-speed data line interface (I / F) 253 are connected. One end of the HDMI cable 350 is connected to the HDMI terminal 211 of the disc player 210, and the other end of the HDMI cable 350 is connected to the HDMI terminal 251 of the television receiver 250.

  In the AV system 200 shown in FIG. 1, uncompressed (baseband) image data obtained by being reproduced by the disc player 210 is transmitted to the television receiver 250 via the HDMI cable 350, and the television receiver 250 receives the disc data. An image based on the image data transmitted from the player 210 is displayed. In addition, uncompressed audio data obtained by being played back by the disc player 210 is transmitted to the television receiver 250 via the HDMI cable 350, and the audio by the audio data transmitted from the disc player 210 is received by the television receiver 250. Is output.

  When the image data transmitted from the disc player 210 is 3D image data (stereoscopic image data) for displaying a stereoscopic image, the television receiver 250 provides a stereoscopic image to the user. A stereoscopic image is displayed.

  This example of a stereoscopic image display method will be further described. As a stereoscopic image display method, for example, as shown in FIG. 2A, a left-eye (L) image and a right-eye (R) image are alternately displayed for each field, so-called “field sequential”. There is "method". In this display method, it is necessary to drive twice the normal frame rate. In this display method, it is not necessary to attach an optical film to the display unit, but it is necessary to switch the polarizing filter in synchronization with the field of the display unit on the side of the glasses worn by the user.

  In addition, as a stereoscopic image display method, for example, as shown in FIG. 2B, a method of switching and displaying a left eye (L) image and a right eye (R) image for each line, so-called “position”. "Phase difference plate method". In this display method, stereoscopic vision is realized by attenuating the light of the image of the reverse eye with polarized glasses worn by the user.

  FIG. 3 shows a configuration example of the disc player 210. The disc player 210 includes an HDMI terminal 211, an HDMI transmission unit 212, a high-speed data line interface 213, and a DTCP (Digital Transmission Content Protection) circuit 230. The disc player 210 includes a CPU (Central Processing Unit) 214, a CPU bus 215, a flash ROM (Read Only Memory) 216, an SDRAM (Synchronous DRAM) 217, a remote control receiver 218, and a remote control transmitter 219. And have.

  The disc player 210 also has an IDE interface 220, a BD (Blu-ray Disc) drive 221, an internal bus 222, an Ethernet interface (Ethernet I / F) 223, and a network terminal 224. The disc player 210 includes an MPEG (Moving Picture Expert Group) decoder 225, a graphic generation circuit 226, a video output terminal 227, an audio output terminal 228, and a 3D signal processing unit 229. “Ethernet” and “Ethernet” are registered trademarks.

  CPU 214, flash ROM 216, SDRAM 217, and remote control receiving unit 218 are connected to CPU bus 215. Further, the CPU 214, the IDE interface 220, the Ethernet interface 223, the DTCP circuit 230, and the MPEG decoder 225 are connected to the internal bus 222.

  The CPU 214 controls the operation of each unit of the disc player 210. The flash ROM 216 stores control software and data. The SDRAM 217 constitutes a work area for the CPU 214. The CPU 214 develops software and data read from the flash ROM 216 on the SDRAM 217 to activate the software, and controls each unit of the disc player 210. The remote control receiving unit 218 receives the remote control signal (remote control code) transmitted from the remote control transmitter 219 and supplies it to the CPU 214. The CPU 214 controls each part of the disc player 210 according to the remote control code.

  The BD drive 221 records content data on a BD (not shown) as a disc-shaped recording medium, or reproduces content data from the BD. The BD drive 221 is connected to the internal bus 222 via the IDE interface 220. The MPEG decoder 225 performs decoding processing on the MPEG2 stream reproduced by the BD drive 221 to obtain image and audio data.

  The DTCP circuit 230 is necessary when content data reproduced by the BD drive 221 is transmitted to the network via the network terminal 224 or to the bidirectional communication path from the high-speed data line interface 213 via the HDMI terminal 211. Encrypt accordingly.

  The graphics generation circuit 226 performs graphics data superimposing processing on the image data obtained by the MPEG decoder 225 as necessary. The video output terminal 227 outputs image data output from the graphic generation circuit 226. The audio output terminal 228 outputs the audio data obtained by the MPEG decoder 225.

  The HDMI transmission unit (HDMI source) 212 transmits baseband image (video) and audio data from the HDMI terminal 211 by communication conforming to HDMI. Details of the HDMI transmission unit 212 will be described later. The high-speed data line interface 213 is an interface of a bidirectional communication path configured using predetermined lines (in this embodiment, a reserved line and an HPD line) constituting the HDMI cable 350.

  The high-speed data line interface 213 is inserted between the Ethernet interface 223 and the HDMI terminal 211. The high-speed data line interface 213 transmits the transmission data supplied from the CPU 214 to the counterpart device from the HDMI terminal 211 via the HDMI cable 350. In addition, the high-speed data line interface 213 supplies received data received from the counterpart device from the HDMI cable 350 via the HDMI terminal 211 to the CPU 214. Details of the high-speed data line interface 213 will be described later.

  When the 3D signal processing unit 229 transmits 3D image data for displaying a stereoscopic image through the HDMI TMDS channel among the image data obtained by the MPEG decoder 225, the 3D signal processing unit 229 selects the 3D image data according to the transmission method. Process to the state. Here, the 3D image data is composed of left-eye image data and right-eye image data, or is composed of two-dimensional image data and depth data corresponding to each pixel (MPEG-C system). Details of the type of 3D image data transmission method, selection of the transmission method, and the packing format of each method will be described later.

  The operation of the disc player 210 shown in FIG. 3 will be briefly described. At the time of recording, an MPEG stream of a digital tuner (not shown), or content data to be recorded is acquired from the network terminal 224 via the Ethernet interface 223 or from the HDMI terminal 211 via the high-speed data line interface 213 and the Ethernet interface 223. . This content data is input to the IDE interface 220 and recorded on the BD by the BD drive 221. In some cases, recording may be performed on an HDD (hard disk drive) (not shown) connected to the IDE interface 220.

  At the time of reproduction, content data (MPEG stream) reproduced from the BD by the BD drive 221 is supplied to the MPEG decoder 225 via the IDE interface 220. In the MPEG decoder 225, the reproduced content data is decoded, and baseband image and audio data is obtained. The image data is output to the video output terminal 227 through the graphic generation circuit 226. Also, the audio data is output to the audio output terminal 228.

  In addition, when the image and audio data obtained by the MPEG decoder 225 is transmitted through the HDMI TMDS channel at the time of reproduction, the image and audio data are supplied to the HDMI transmission unit 212 and packed. The data is output from the HDMI transmission unit 212 to the HDMI terminal 211. When the image data is 3D image data, the 3D image data is processed by the 3D signal processing unit 229 into a state corresponding to the selected transmission method, and then supplied to the HDMI transmission unit 212. The

  When the content data reproduced by the BD drive 221 is sent to the network during reproduction, the content data is encrypted by the DTCP circuit 230 and then output to the network terminal 224 via the Ethernet interface 223. Is done. Similarly, when the content data reproduced by the BD drive 221 is sent to the bidirectional communication path of the HDMI cable 350 during reproduction, the content data is encrypted by the DTCP circuit 230, and then the Ethernet interface 223, The data is output to the HDMI terminal 211 via the high-speed data line interface 213.

  FIG. 4 shows a configuration example of the television receiver 250. The television receiver 250 includes an HDMI terminal 251, an HDMI receiving unit 252, a high-speed data line interface 253, and a 3D signal processing unit 254. In addition, the television receiver 250 includes an antenna terminal 255, a digital tuner 256, a demultiplexer 257, an MPEG decoder 258, a video signal processing circuit 259, a graphic generation circuit 260, a panel drive circuit 261, and a display panel 262. And have.

  The television receiver 250 includes an audio signal processing circuit 263, an audio amplification circuit 264, a speaker 265, an internal bus 270, a CPU 271, a flash ROM 272, and a DRAM (Dynamic Random Access Memory) 273. Yes. The television receiver 250 includes an Ethernet interface (Ethernet I / F) 274, a network terminal 275, a remote control receiving unit 276, a remote control transmitter 277, and a DTCP circuit 278.

  The antenna terminal 255 is a terminal for inputting a television broadcast signal received by a receiving antenna (not shown). The digital tuner 256 processes the television broadcast signal input to the antenna terminal 255 and outputs a predetermined transport stream corresponding to the user's selected channel. The demultiplexer 257 extracts a partial TS (Transport Stream) (a TS packet of video data and a TS packet of audio data) corresponding to the user's selected channel from the transport stream obtained by the digital tuner 256.

  Further, the demultiplexer 257 extracts PSI / SI (Program Specific Information / Service Information) from the transport stream obtained by the digital tuner 256 and outputs it to the CPU 271. A plurality of channels are multiplexed in the transport stream obtained by the digital tuner 256. The process of extracting the partial TS of an arbitrary channel from the transport stream by the demultiplexer 257 can be performed by obtaining the packet ID (PID) information of the arbitrary channel from the PSI / SI (PAT / PMT). .

  The MPEG decoder 258 obtains image data by performing decoding processing on a video PES (Packetized Elementary Stream) packet constituted by a TS packet of video data obtained by the demultiplexer 257. Also, the MPEG decoder 258 performs a decoding process on the audio PES packet configured by the TS packet of the audio data obtained by the demultiplexer 257 to obtain audio data.

  The video signal processing circuit 259 and the graphic generation circuit 260 perform scaling processing (resolution conversion processing) and graphic processing on the image data obtained by the MPEG decoder 258 or the image data received by the HDMI receiving unit 252 as necessary. Data superimposition processing is performed. In addition, when the image data received by the HDMI receiving unit 252 is 3D image data, the video signal processing circuit 259 performs a stereoscopic image (see FIG. 2) on the left eye image data and the right eye image data. ) Is displayed. The panel drive circuit 261 drives the display panel 262 based on the video (image) data output from the graphic generation circuit 260.

  The display panel 262 includes, for example, an LCD (Liquid Crystal Display), a PDP (Plasma Display Panel), or the like. The audio signal processing circuit 263 performs necessary processing such as D / A conversion on the audio data obtained by the MPEG decoder 258. The audio amplifier circuit 264 amplifies the audio signal output from the audio signal processing circuit 263 and supplies the amplified audio signal to the speaker 265.

  The CPU 271 controls the operation of each unit of the television receiver 250. The flash ROM 272 stores control software and data. The DRAM 273 constitutes a work area for the CPU 271. The CPU 271 develops software and data read from the flash ROM 272 on the DRAM 273 to activate the software, and controls each unit of the television receiver 250.

  The remote control receiving unit 276 receives the remote control signal (remote control code) transmitted from the remote control transmitter 277 and supplies it to the CPU 271. The CPU 271 controls each unit of the television receiver 250 based on the remote control code. The network terminal 275 is a terminal connected to the network, and is connected to the Ethernet interface 274. The CPU 271, flash ROM 272, DRAM 273, and Ethernet interface 274 are connected to the internal bus 270.

  The DTCP circuit 278 decrypts the encrypted data supplied from the network terminal 275 or the high-speed data line interface 253 to the Ethernet interface 274.

  The HDMI receiving unit (HDMI sink) 252 receives baseband image (video) and audio data supplied to the HDMI terminal 251 via the HDMI cable 350 by communication conforming to HDMI. Details of the HDMI receiving unit 252 will be described later. Similar to the high-speed data line interface 213 of the disc player 210 described above, the high-speed data line interface 253 is configured using predetermined lines (reserved line and HPD line in this embodiment) constituting the HDMI cable 350. It is an interface for bidirectional communication.

  The high-speed data line interface 253 is inserted between the Ethernet interface 274 and the HDMI terminal 251. The high-speed data line interface 253 transmits the transmission data supplied from the CPU 271 to the counterpart device from the HDMI terminal 251 via the HDMI cable 350. In addition, the high-speed data line interface 253 supplies reception data received from the counterpart device from the HDMI cable 350 via the HDMI terminal 251 to the CPU 271. Details of the high-speed data line interface 253 will be described later.

  The 3D signal processing unit 254 performs processing (decoding processing) corresponding to the transmission method on the 3D image data received by the HDMI receiving unit 252 to generate left eye image data and right eye image data. That is, the 3D signal processing unit 254 performs processing opposite to that of the 3D signal processing unit 229 of the disc player 210 described above to form left-eye image data and right-eye image data, or two-dimensional data constituting 3D image data. Obtain image data and depth data. In addition, when the 2D image data and the depth data are acquired (MPEG-C method), the 3D signal processing unit 229 further uses the 2D image data and the depth data to generate the left eye image data and the right data. An operation for generating eye image data is performed.

  The operation of the television receiver 250 shown in FIG. 4 will be briefly described. The television broadcast signal input to the antenna terminal 255 is supplied to the digital tuner 256. The digital tuner 256 processes the television broadcast signal, outputs a predetermined transport stream corresponding to the user's selected channel, and supplies the predetermined transport stream to the demultiplexer 257. The demultiplexer 257 extracts a partial TS (video data TS packet, audio data TS packet) corresponding to the user's selected channel from the transport stream, and supplies the partial TS to the MPEG decoder 258.

  In the MPEG decoder 258, the video PES packet constituted by the TS packet of the video data is decoded to obtain video data. The video data is subjected to scaling processing (resolution conversion processing), scaling processing, graphics data superimposition processing, and the like in the video signal processing circuit 259 and the graphic generation circuit 260 as necessary, and then the panel drive circuit 261. To be supplied. Therefore, the display panel 262 displays an image corresponding to the user's selected channel.

  Also, in the MPEG decoder 258, audio data is obtained by performing a decoding process on the audio PES packet configured by the TS packet of audio data. The audio data is subjected to necessary processing such as D / A conversion by the audio signal processing circuit 263, further amplified by the audio amplification circuit 264, and then supplied to the speaker 265. Therefore, sound corresponding to the user's selected channel is output from the speaker 265.

  Also, encrypted content data (image data, audio data) supplied from the network terminal 275 to the Ethernet interface 274 or supplied from the HDMI terminal 251 via the high-speed data line interface 253 to the Ethernet interface 274. Is decoded by the DTCP circuit 274 and then supplied to the MPEG decoder 258. Thereafter, the operation is the same as when the above-described television broadcast signal is received, an image is displayed on the display panel 262, and sound is output from the speaker 265.

  Also, the HDMI receiving unit 252 acquires image data and audio data transmitted from the disc player 210 connected to the HDMI terminal 251 via the HDMI cable 350. The image data is supplied to the video signal processing circuit 259 via the 3D signal processing unit 254. The audio data is directly supplied to the audio signal processing circuit 263. Thereafter, the operation is the same as when the above-described television broadcast signal is received, an image is displayed on the display panel 262, and sound is output from the speaker 265.

  When the image data received by the HDMI receiving unit 252 is 3D image data, the 3D signal processing unit 254 performs processing (decoding processing) corresponding to the transmission method on the 3D image data. Left eye image data and right eye image data are generated. Then, the left eye image data and the right eye image data are supplied from the 3D signal processing unit 254 to the video signal processing unit 259. Also, in the video signal processing circuit 259, when left-eye image data and right-eye image data constituting 3D image data are supplied, a stereoscopic image (FIG. 2) is generated. Therefore, a stereoscopic image is displayed on the display panel 262.

  FIG. 5 shows a configuration example of the HDMI transmission unit (HDMI source) 212 of the disc player 210 and the HDMI reception unit (HDMI sink) 252 of the television receiver 250 in the AV system 200 of FIG.

  The HDMI transmission unit 212 is an effective image section (hereinafter also referred to as an active video section as appropriate) that is a section obtained by removing a horizontal blanking section and a vertical blanking section from a section from one vertical synchronization signal to the next vertical synchronization signal. ), The differential signal corresponding to the pixel data of the uncompressed image for one screen is transmitted to the HDMI receiving unit 252 in one direction through a plurality of channels, and in the horizontal blanking interval or the vertical blanking interval, A differential signal corresponding to at least audio data, control data, other auxiliary data, etc. associated with the image is transmitted to the HDMI receiving unit 252 in one direction through a plurality of channels.

  That is, the HDMI transmission unit 212 includes the HDMI transmitter 81. The transmitter 81 converts, for example, pixel data of an uncompressed image into a corresponding differential signal, and is connected via the HDMI cable 350 with three TMDS channels # 0, # 1, and # 2 that are a plurality of channels. Serial transmission in one direction to the HDMI receiving unit 252.

  The transmitter 81 converts audio data accompanying uncompressed images, further necessary control data and other auxiliary data, etc. into corresponding differential signals, and converts them into three TMDS channels # 0, # 1, #. 2 is serially transmitted in one direction to the HDMI receiving unit 252 connected via the HDMI cable 350.

  Further, the transmitter 81 transmits the pixel clock synchronized with the pixel data transmitted through the three TMDS channels # 0, # 1, and # 2 to the HDMI receiving unit 252 connected via the HDMI cable 350 using the TMDS clock channel. Send. Here, in one TMDS channel #i (i = 0, 1, 2), 10-bit pixel data is transmitted during one pixel clock.

  The HDMI receiving unit 252 receives a differential signal corresponding to pixel data transmitted in one direction from the HDMI transmitting unit 212 using a plurality of channels in the active video section, and also receives a horizontal blanking section or a vertical blanking. In a section, differential signals corresponding to audio data and control data transmitted in one direction from the HDMI transmission unit 212 are received through a plurality of channels.

  That is, the HDMI receiving unit 252 includes an HDMI receiver 82. The receiver 82 is transmitted in one direction from the HDMI transmission unit 212 connected via the HDMI cable 350 via the TMDS channels # 0, # 1, and # 2. Similarly, differential signals corresponding to data and control data are received in synchronization with the pixel clock transmitted from the HDMI transmission unit 212 via the TMDS clock channel.

  In the transmission channel of the HDMI system including the HDMI transmission unit 212 and the HDMI reception unit 252, pixel data and audio data are transmitted in one direction from the HDMI transmission unit 212 to the HDMI reception unit 252 in synchronization with the pixel clock. In addition to three TMDS channels # 0 to # 2 as transmission channels for serial transmission and a TMDS clock channel as a transmission channel for transmitting a pixel clock, transmission called a DDC (Display Data Channel) 83 and a CEC line 84 There is a channel.

  The DDC 83 includes two signal lines (not shown) included in the HDMI cable 350, and the HDMI transmission unit 212 is connected to the HDMI reception unit 252 connected via the HDMI cable 350 from the E-EDID (Enhanced Extended Display Identification Data). Used to read

  That is, the HDMI receiving unit 252 has an EDID ROM (Read Only Memory) 85 that stores E-EDID, which is performance information related to its own performance (configuration / capability), in addition to the HDMI receiver 81. . For example, in response to a request from the CPU 214, the HDMI transmission unit 212 reads the E-EDID of the HDMI reception unit 252 from the HDMI reception unit 252 connected via the HDMI cable 350 via the DDC 83. The HDMI transmission unit 212 sends the read E-EDID to the CPU 214. The CPU 214 stores this E-EDID in the flash ROM 272 or the DRAM 273.

  The CPU 214 can recognize the performance setting of the HDMI receiving unit 252 based on the E-EDID. For example, the CPU 214 recognizes an image format (profile) supported by the electronic device having the HDMI receiving unit 252, for example, RGB, YCbCr 4: 4: 4, YCbCr 4: 2: 2, and the like. In this embodiment, the CPU 214 recognizes a 3D image / audio data transmission method that can be supported by the electronic apparatus having the HDMI receiving unit 252 based on the 3D image data transmission method information included in the E-EDID. .

  The CEC line 84 includes one signal line (not shown) included in the HDMI cable 350, and is used to perform bidirectional communication of control data between the HDMI transmission unit 212 and the HDMI reception unit 252.

  The HDMI cable 350 includes a line (HPD line) 86 connected to a pin called HPD (Hot Plug Detect). The source device can detect the connection of the sink device using the line 86. Also, the HDMI cable 350 includes a line 87 used for supplying power from the source device to the sink device. Further, the HDMI cable 350 includes a reserved line 88.

  FIG. 6 shows a configuration example of the HDMI transmitter 81 and the HDMI receiver 82 of FIG.

  The HDMI transmitter 81 has three encoder / serializers 81A, 81B, and 81C corresponding to the three TMDS channels # 0, # 1, and # 2, respectively. Each of the encoders / serializers 81A, 81B, and 81C encodes the image data, auxiliary data, and control data supplied thereto, converts the parallel data into serial data, and transmits the data by a differential signal. Here, when the image data has, for example, three components of R (red), G (green), and B (blue), the B component (B component) is supplied to the encoder / serializer 81A, and the G component (G component). Is supplied to the encoder / serializer 81B, and the R component (R component) is supplied to the encoder / serializer 81C.

  The auxiliary data includes, for example, audio data and control packets. The control packets are supplied to, for example, the encoder / serializer 81A, and the audio data is supplied to the encoder / serializers 81B and 81C.

  Further, the control data includes a 1-bit vertical synchronization signal (VSYNC), a 1-bit horizontal synchronization signal (HSYNC), and 1-bit control bits CTL0, CTL1, CTL2, and CTL3. The vertical synchronization signal and the horizontal synchronization signal are supplied to the encoder / serializer 81A. The control bits CTL0 and CTL1 are supplied to the encoder / serializer 81B, and the control bits CTL2 and CTL3 are supplied to the encoder / serializer 81C.

  The encoder / serializer 81A transmits the B component of the image data, the vertical synchronization signal and the horizontal synchronization signal, and auxiliary data supplied thereto in a time division manner. That is, the encoder / serializer 81A converts the B component of the image data supplied thereto into 8-bit parallel data that is a fixed number of bits. Further, the encoder / serializer 81A encodes the parallel data, converts it into serial data, and transmits it through the TMDS channel # 0.

  The encoder / serializer 81A encodes the 2-bit parallel data of the vertical synchronization signal and horizontal synchronization signal supplied thereto, converts the data into serial data, and transmits the serial data through the TMDS channel # 0. Furthermore, the encoder / serializer 81A converts the auxiliary data supplied thereto into parallel data in units of 4 bits. Then, the encoder / serializer 81A encodes the parallel data, converts it into serial data, and transmits it through the TMDS channel # 0.

  The encoder / serializer 81B transmits the G component of the image data, control bits CTL0 and CTL1, and auxiliary data supplied thereto in a time division manner. That is, the encoder / serializer 81B sets the G component of the image data supplied thereto as parallel data in units of 8 bits, which is a fixed number of bits. Further, the encoder / serializer 81B encodes the parallel data, converts it into serial data, and transmits it through the TMDS channel # 1.

  The encoder / serializer 81B encodes the 2-bit parallel data of the control bits CTL0 and CTL1 supplied thereto, converts the data into serial data, and transmits the serial data through the TMDS channel # 1. Furthermore, the encoder / serializer 81B converts the auxiliary data supplied thereto into parallel data in units of 4 bits. Then, the encoder / serializer 81B encodes the parallel data, converts it into serial data, and transmits it through the TMDS channel # 1.

  The encoder / serializer 81C transmits the R component of the image data, control bits CTL2 and CTL3, and auxiliary data supplied thereto in a time division manner. That is, the encoder / serializer 81C sets the R component of the image data supplied thereto as parallel data in units of 8 bits, which is a fixed number of bits. Further, the encoder / serializer 81C encodes the parallel data, converts it into serial data, and transmits it through the TMDS channel # 2.

  The encoder / serializer 81C encodes 2-bit parallel data of the control bits CTL2 and CTL3 supplied thereto, converts the data into serial data, and transmits the serial data through the TMDS channel # 2. Furthermore, the encoder / serializer 81C converts the auxiliary data supplied thereto into parallel data in units of 4 bits. Then, the encoder / serializer 81C encodes the parallel data, converts it into serial data, and transmits it through the TMDS channel # 2.

  The HDMI receiver 82 has three recovery / decoders 82A, 82B, and 82C corresponding to the three TMDS channels # 0, # 1, and # 2, respectively. Then, each of the recovery / decoders 82A, 82B, and 82C receives image data, auxiliary data, and control data transmitted as differential signals through the TMDS channels # 0, # 1, and # 2. Further, each of the recovery / decoders 82A, 82B, and 82C converts the image data, auxiliary data, and control data from serial data to parallel data, and further decodes and outputs them.

  That is, the recovery / decoder 82A receives the B component of the image data, the vertical synchronization signal, the horizontal synchronization signal, and the auxiliary data that are transmitted as differential signals through the TMDS channel # 0. Then, the recovery / decoder 82A converts the B component of the image data, the vertical synchronization signal, the horizontal synchronization signal, and the auxiliary data from serial data to parallel data, and decodes and outputs them.

  The recovery / decoder 82B receives the G component of the image data, the control bits CTL0 and CTL1, and the auxiliary data transmitted by the differential signal through the TMDS channel # 1. Then, the recovery / decoder 82B converts the G component of the image data, the control bits CTL0 and CTL1, and the auxiliary data from serial data to parallel data, and decodes and outputs them.

  The recovery / decoder 82C receives the R component of the image data, the control bits CTL2 and CTL3, and the auxiliary data transmitted by the differential signal through the TMDS channel # 2. Then, the recovery / decoder 82C converts the R component of the image data, the control bits CTL2 and CTL3, and the auxiliary data from serial data to parallel data, and decodes and outputs them.

  FIG. 7 shows an example of the structure of TMDS transmission data. FIG. 7 shows sections of various transmission data when image data of horizontal × vertical 1920 pixels × 1080 lines is transmitted on the TMDS channels # 0, # 1, and # 2.

  A video field (Video Field) in which transmission data is transmitted through the three TMDS channels # 0, # 1, and # 2 of HDMI includes a video data period and a data island period according to the type of transmission data. There are three types of sections: (Data Island period) and Control period.

  Here, the video field period is a period from a rising edge (active edge) of a certain vertical synchronizing signal to a rising edge of the next vertical synchronizing signal, and includes a horizontal blanking period (horizontal blanking) and a vertical blanking period (vertical blanking period). ), And an active video section (Active Video) that is a section obtained by removing the horizontal blanking period and the vertical blanking period from the video field section.

  The video data section is assigned to the active video section. In this video data section, 1920 pixel (pixel) × 1080 line effective pixel (Active pixel) data constituting uncompressed image data for one screen is transmitted.

  The data island period and the control period are assigned to the horizontal blanking period and the vertical blanking period. In the data island section and the control section, auxiliary data (Auxiliary data) is transmitted. That is, the data island period is assigned to a part of the horizontal blanking period and the vertical blanking period. In this data island period, for example, audio data packets, which are data not related to control, of auxiliary data are transmitted.

  The control period is allocated to other parts of the horizontal blanking period and the vertical blanking period. In this control period, for example, vertical synchronization signals, horizontal synchronization signals, control packets, and the like, which are data related to control, of auxiliary data are transmitted.

  FIG. 8 shows an example of the pin arrangement of the HDMI terminals 211 and 251. The pin arrangement shown in FIG. 8 is called type A (type-A).

  Two lines, which are differential lines through which TMDS Data # i + and TMDS Data # i−, which are differential signals of TMDS channel #i, are transmitted are pins to which TMDS Data # i + is assigned (the pin number is 1). , 4, 7) and pins assigned with TMDS Data # i− (pin numbers 3, 6, 9).

  A CEC line 84 through which a CEC signal as control data is transmitted is connected to a pin having a pin number of 13, and a pin having a pin number of 14 is a reserved pin. A line through which an SDA (Serial Data) signal such as E-EDID is transmitted is connected to a pin having a pin number of 16 and is an SCL (Serial Clock) which is a clock signal used for synchronization when transmitting and receiving the SDA signal. A line through which a signal is transmitted is connected to a pin having a pin number of 15. The above-described DDC 83 includes a line for transmitting the SDA signal and a line for transmitting the SCL signal.

  Further, as described above, the HPD line 86 for detecting the connection of the sink device by the source device is connected to the pin having the pin number 19. Further, as described above, the line 87 for supplying power is connected to a pin having a pin number of 18.

  Next, the high-speed data line interface 213 of the disc player 210 and the high-speed data line interface 253 of the television receiver 250 will be described. Here, the disc player 210 will be described as a source device, and the television receiver 250 will be described as a sink device.

  FIG. 9 shows a configuration example of the high-speed data line interface of the source device and the sink device. This high-speed data line interface constitutes a communication unit that performs LAN (Local Area Network) communication. This communication unit is a pair of differential transmission lines among a plurality of lines constituting the HDMI cable. In this embodiment, a reserve line (Ether + line) corresponding to a vacant (Reserve) pin (14 pins), Communication is performed using a bidirectional communication path constituted by HPD lines (Ether-lines) corresponding to the HPD pins (19 pins).

  The source device includes a LAN signal transmission circuit 411, a termination resistor 412, AC coupling capacitors 413 and 414, a LAN signal reception circuit 415, a subtraction circuit 416, a pull-up resistor 421, a resistor 422 and a capacitor 423 constituting a low-pass filter, and a comparator 424. , A pull-down resistor 431, a resistor 432 and a capacitor 433 forming a low-pass filter, and a comparator 434. Here, the high-speed data line interface (high-speed data line I / F) includes a LAN signal transmission circuit 411, a terminating resistor 412, AC coupling capacitors 413 and 414, a LAN signal reception circuit 415, and a subtraction circuit 416.

  A series circuit of a pull-up resistor 421, an AC coupling capacitor 413, a termination resistor 412, an AC coupling capacitor 414, and a pull-down resistor 431 is connected between the power supply line (+5.0 V) and the ground line. A connection point P1 between the AC coupling capacitor 413 and the termination resistor 412 is connected to the positive output side of the LAN signal transmission circuit 411 and to the positive input side of the LAN signal reception circuit 415. The connection point P2 between the AC coupling capacitor 414 and the termination resistor 412 is connected to the negative output side of the LAN signal transmission circuit 411 and to the negative input side of the LAN signal reception circuit 415. A transmission signal (transmission data) SG411 is supplied to the input side of the LAN signal transmission circuit 411.

  The output signal SG412 of the LAN signal receiving circuit 415 is supplied to the positive side terminal of the subtraction circuit 416, and the transmission signal (transmission data) SG411 is supplied to the negative side terminal of the subtraction circuit 416. In the subtracting circuit 416, the transmission signal SG411 is subtracted from the output signal SG412 of the LAN signal receiving circuit 415 to obtain a reception signal (reception data) SG413.

  In addition, a connection point Q1 between the pull-up resistor 421 and the AC coupling capacitor 413 is connected to the ground line through a series circuit of the resistor 422 and the capacitor 423. The output signal of the low-pass filter obtained at the connection point between the resistor 422 and the capacitor 423 is supplied to one input terminal of the comparator 424. In the comparator 424, the output signal of the low-pass filter is compared with a reference voltage Vref1 (+ 3.75V) supplied to the other input terminal. The output signal SG414 of the comparator 424 is supplied to the control unit (CPU) of the source device.

  Further, a connection point Q2 between the AC coupling capacitor 414 and the pull-down resistor 431 is connected to the ground line via a series circuit of the resistor 432 and the capacitor 433. The output signal of the low-pass filter obtained at the connection point between the resistor 432 and the capacitor 433 is supplied to one input terminal of the comparator 434. In the comparator 434, the output signal of the low-pass filter is compared with a reference voltage Vref2 (+1.4 V) supplied to the other input terminal. The output signal SG415 of the comparator 434 is supplied to the control unit (CPU) of the source device.

  The sink device includes a LAN signal transmission circuit 441, a termination resistor 442, AC coupling capacitors 443 and 444, a LAN signal reception circuit 445, a subtraction circuit 446, a pull-down resistor 451, a resistor 452 and a capacitor 453 constituting a low-pass filter, a comparator 454, A choke coil 461, a resistor 462, and a resistor 463 are provided. Here, the high-speed data line interface (high-speed data line I / F) includes a LAN signal transmission circuit 441, a terminating resistor 442, AC coupling capacitors 443 and 444, a LAN signal reception circuit 445, and a subtraction circuit 446.

  A series circuit of a resistor 462 and a resistor 463 is connected between the power supply line (+5.0 V) and the ground line. A series circuit of a choke coil 461, an AC coupling capacitor 444, a termination resistor 442, an AC coupling capacitor 443, and a pull-down resistor 451 is connected between the connection point of the resistors 462 and 463 and the ground line. The

  A connection point P3 between the AC coupling capacitor 443 and the termination resistor 442 is connected to the positive output side of the LAN signal transmission circuit 441 and to the positive input side of the LAN signal reception circuit 445. A connection point P4 between the AC coupling capacitor 444 and the termination resistor 442 is connected to the negative output side of the LAN signal transmission circuit 441 and to the negative input side of the LAN signal reception circuit 445. A transmission signal (transmission data) SG417 is supplied to the input side of the LAN signal transmission circuit 441.

  The output signal SG418 of the LAN signal receiving circuit 445 is supplied to the positive terminal of the subtracting circuit 446, and the transmission signal SG417 is supplied to the negative terminal of the subtracting circuit 446. In the subtracting circuit 446, the transmission signal SG417 is subtracted from the output signal SG418 of the LAN signal receiving circuit 445 to obtain a reception signal (reception data) SG419.

  The connection point Q3 between the pull-down resistor 451 and the AC coupling capacitor 443 is connected to the ground line via a series circuit of the resistor 452 and the capacitor 453. The output signal of the low-pass filter obtained at the connection point between the resistor 452 and the capacitor 453 is supplied to one input terminal of the comparator 454. In this comparator 454, the output signal of the low-pass filter is compared with a reference voltage Vref3 (+1.25 V) supplied to the other input terminal. The output signal SG416 of the comparator 454 is supplied to the control unit (CPU) of the sink device.

  The reserved line 501 and the HPD line 502 included in the HDMI cable constitute a differential twisted pair. The source side end 511 of the reserved line 501 is connected to pin 14 of the HDMI terminal of the source device, and the sink side end 521 of the reserved line 501 is connected to pin 14 of the HDMI terminal of the sink device. The source side end 512 of the HPD line 502 is connected to the 19th pin of the HDMI terminal of the source device, and the sink side end 522 of the HPD line 502 is connected to the 19th pin of the HDMI terminal of the sink device.

  In the source device, the connection point Q1 between the pull-up resistor 421 and the AC coupling capacitor 413 described above is connected to the 14th pin of the HDMI terminal, and the connection point Q2 between the pull-down resistor 431 and the AC coupling capacitor 414 described above. Is connected to the 19th pin of the HDMI terminal. On the other hand, in the sink device, the connection point Q3 between the pull-down resistor 451 and the AC coupling capacitor 443 described above is connected to the 14th pin of the HDMI terminal, and the connection point Q4 between the choke coil 461 and the AC coupling capacitor 444 described above. Is connected to the 19th pin of the HDMI terminal.

  Next, the operation of LAN communication using the high-speed data line interface configured as described above will be described.

  In the source device, the transmission signal (transmission data) SG411 is supplied to the input side of the LAN signal transmission circuit 411, and a differential signal (positive output signal, negative output signal) corresponding to the transmission signal SG411 is output from the LAN signal transmission circuit 411. Is output. The differential signal output from the LAN signal transmission circuit 411 is supplied to the connection points P1 and P2, and transmitted to the sink device through a pair of differential transmission lines (reserved line 501 and HPD line 502) of the HDMI cable. Is done.

  In the sink device, the transmission signal (transmission data) SG417 is supplied to the input side of the LAN signal transmission circuit 441, and the differential signal (positive output signal, negative output signal) corresponding to the transmission signal SG417 from the LAN signal transmission circuit 441. ) Is output. The differential signal output from the LAN signal transmission circuit 441 is supplied to the connection points P3 and P4, and transmitted to the source device through a pair of lines (reserved line 501 and HPD line 502) of the HDMI cable.

  In the source device, since the input side of the LAN signal receiving circuit 415 is connected to the connection points P1 and P2, the difference output from the LAN signal transmitting circuit 411 is output as the output signal SG412 of the LAN signal receiving circuit 415. An addition signal of the transmission signal corresponding to the motion signal (current signal) and the reception signal corresponding to the differential signal transmitted from the sink device as described above is obtained. In the subtracting circuit 416, the transmission signal SG411 is subtracted from the output signal SG412 of the LAN signal receiving circuit 415. Therefore, the output signal SG413 of the subtraction circuit 416 corresponds to the transmission signal (transmission data) SG417 of the sink device.

  In the sink device, since the input side of the LAN signal receiving circuit 445 is connected to the connection points P3 and P4, the difference output from the LAN signal transmitting circuit 441 as the output signal SG418 of the LAN signal receiving circuit 445 concerned. An addition signal of the transmission signal corresponding to the motion signal (current signal) and the reception signal corresponding to the differential signal transmitted from the source device as described above is obtained. In the subtracting circuit 446, the transmission signal SG417 is subtracted from the output signal SG418 of the LAN signal receiving circuit 445. For this reason, the output signal SG419 of the subtraction circuit 446 corresponds to the transmission signal (transmission data) SG411 of the source device.

  In this way, bidirectional LAN communication can be performed between the high-speed data line interface of the source device and the high-speed data line interface of the sink device.

  In FIG. 9, the HPD line 502 transmits to the source device that the HDMI cable is connected to the sink device at the DC bias level in addition to the LAN communication described above. That is, the resistors 462 and 463 and the choke coil 461 in the sink device bias the HPD line 502 to about 4V via the 19th pin of the HDMI terminal when the HDMI cable is connected to the sink device. The source device extracts the DC bias of the HPD line 502 with a low-pass filter including a resistor 432 and a capacitor 433, and compares it with a reference voltage Vref2 (for example, 1.4V) by a comparator 434.

  The 19-pin voltage of the HDMI terminal of the source device is lower than the reference voltage Vref2 because the pull-down resistor 431 exists if the HDMI cable is not connected to the sink device. Conversely, the HDMI cable is connected to the sink device. Is higher than the reference voltage Vref2. Therefore, the output signal SG415 of the comparator 434 is at a high level when the HDMI cable is connected to the sink device, and is at a low level otherwise. Thereby, the control unit (CPU) of the source device can recognize whether or not the HDMI cable is connected to the sink device based on the output signal SG415 of the comparator 434.

  In FIG. 9, devices connected to both ends of the HDMI cable at the DC bias potential of the reserved line 501 are devices capable of LAN communication (hereinafter referred to as “eHDMI compatible devices”), or LAN communication is not possible. It has a function of mutually recognizing possible devices (hereinafter “eHDMI non-compliant devices”).

  As described above, the source device pulls up the reserve line 501 with the resistor 421 (+5 V), and the sink device pulls down the reserve line 501 with the resistor 451. The resistors 421 and 451 do not exist in devices that do not support eHDMI.

  As described above, the source device uses the comparator 424 to compare the DC potential of the reserved line 501 that has passed through the low-pass filter including the resistor 422 and the capacitor 423 with the reference voltage Vref1. When the sink device is an eHDMI-compatible device and has a pull-down resistor 451, the voltage of the reserved line 501 is 2.5V. However, when the sink device is an eHDMI non-compliant device and does not have the pull-down resistor 451, the voltage of the reserve line 501 becomes 5V due to the presence of the pull-up resistor 421.

  Therefore, when the reference voltage Vref1 is set to 3.75 V, for example, the output signal SG414 of the comparator 424 is at a low level when the sink device is an eHDMI-compatible device, and is at a high level otherwise. Thereby, the control unit (CPU) of the source device can recognize whether or not the sink device is an eHDMI-compatible device based on the output signal SG414 of the comparator 424.

  Similarly, as described above, the sink device uses the comparator 454 to compare the DC potential of the reserved line 501 that has passed through the low-pass filter including the resistor 452 and the capacitor 453 with the reference voltage Vref3. When the source device is an eHDMI compatible device and has a pull-up resistor 421, the voltage of the reserved line 501 is 2.5V. However, when the source device is a device that does not support eHDMI and does not have the pull-up resistor 421, the voltage of the reserved line 501 becomes 0 V due to the presence of the pull-down resistor 451.

  Therefore, when the reference voltage Vref3 is set to 1.25 V, for example, the output signal SG416 of the comparator 454 is at a high level when the source device is an eHDMI compatible device, and is at a low level otherwise. Accordingly, the control unit (CPU) of the sink device can recognize whether or not the source device is an eHDMI-compatible device based on the output signal SG416 of the comparator 454.

  According to the configuration example shown in FIG. 9, LAN communication is performed in an interface that performs image (video) and audio data transmission, connection device information exchange and authentication, device control data communication, and LAN communication using a single HDMI cable. Since the connection state of the interface is notified by the DC bias potential of at least one of the transmission lines through bidirectional communication via a pair of differential transmission lines, the SCL line and the SDA line are physically connected to the LAN. Spatial separation that does not involve communication can be performed. As a result, a circuit for LAN communication can be formed irrespective of the electrical specifications defined for DDC, and stable and reliable LAN communication can be realized at low cost.

  Note that the pull-up resistor 421 shown in FIG. 9 may be provided not in the source device but in the HDMI cable. In such a case, each of the terminals of the pull-up resistor 421 is connected to each of the reserved line 501 and the line (signal line) connected to the power supply (power supply potential) among the lines provided in the HDMI cable. The

  Furthermore, the pull-down resistor 451 and the resistor 463 shown in FIG. 9 may be provided not in the sink device but in the HDMI cable. In such a case, each of the terminals of the pull-down resistor 451 is connected to each of the reserved line 501 and the line (ground line) connected to the ground (reference potential) among the lines provided in the HDMI cable. . Each of the terminals of the resistor 463 is connected to each of the HPD line 502 and a line (ground line) connected to the ground (reference potential) among lines provided in the HDMI cable.

  Next, a 3D image data transmission method will be described. First, the case where the 3D image data of the original signal is composed of left eye (L) image data and right eye (R) image data will be described. Here, as shown in FIG. 10, an example will be described in which the image data of the left eye (L) and the right eye (R) are each image data of a 1920 × 1080p pixel format. When transmitting this original signal through the baseband digital interface, for example, the following six transmission methods are conceivable.

  Methods (1) to (3) are the most desirable because they can be transmitted without degrading the quality of the original signal. However, since the transmission band is twice as large as the current state, this is possible when there is a margin in the transmission band. Further, methods (4) to (6) are methods for transmitting 3D image data in the current 1920 × 1080p transmission band.

  As shown in FIG. 11A, the method (1) is a method in which the pixel data of the left eye image data and the pixel data of the right eye image data are sequentially switched and transmitted every TMDS clock. In this case, the frequency of the pixel clock may be the same as the conventional one, but a switching circuit for each pixel is required. In FIG. 11A, the number of pixels in the horizontal direction is 3840 pixels, but it may be composed of 2 lines of 1920 pixels.

  In the method (2), as shown in FIG. 11B, one line of left eye image data and one line of right eye image data are alternately transmitted, and the line is switched by a line memory. In this case, a new video format definition of 1920 × 2160 is required as the video format.

  The method (3) is a method in which left-eye image data and right-eye image data are sequentially switched and transmitted for each field as shown in FIG. In this case, a field memory is required for the switching process, but signal processing at the source device is the simplest.

  Method (4) is a method of alternately transmitting one line of left eye image data and one line of right eye image data as shown in FIG. In this case, the left eye image data and the right eye image data are each thinned by half. This method is the video signal itself of the stereoscopic image display method referred to as the “phase difference plate method” described above, and is the simplest method for signal processing on the display unit of the sink device. The vertical resolution is halved.

  In the method (5), as shown in FIG. 12B, the data of each line of the left eye image data is transmitted in the first half in the vertical direction, and the data of each line of the left eye image data is transmitted in the second half in the vertical direction. It is a method to do. In this case, as in the method (4) described above, the lines of the left eye image data and the right eye image data are thinned out to ½, so the vertical resolution is halved with respect to the original signal. Switching is not necessary.

  The method (6) is a “Side By Side” method that is currently used in experimental broadcasting. As shown in FIG. 12C, in the first half of the horizontal direction, pixel data of the left eye image data is transmitted, and the horizontal direction In the latter half, the pixel data of the right eye image data is transmitted. In this case, the left eye image data and the right eye image data are each decimated in half of the pixel data in the horizontal direction, so that the horizontal resolution is higher than in the above methods (4) and (5). 1/2. However, the content can be determined even by a sink device that does not support 3D image data, and is highly compatible with the display unit of a conventional sink device.

  The 3D signal processing unit 229 of the above-described disc player 210, when any one of the methods (1) to (6) is selected, 3D image data of the original signal (left eye (L) image and right eye (R)) From the image data, a process of generating composite data (see FIGS. 11A to 11C and FIGS. 12A to 12C) corresponding to the selected transmission method is performed. In that case, the 3D signal processing unit 254 of the television receiver 250 described above performs a process of separating and extracting the left eye (L) image data and the right eye (R) image data from the combined data.

  Next, transmission data and its packing format in the systems (1) to (6) described above will be described.

  FIG. 13 shows an example of TMDS transmission data of method (1). In this case, data of active pixels corresponding to 3840 pixels (pixels) × 1080 lines (composition of left eye (L) image data and right eye (R) image data) in an active video section of 1920 pixels × 1080 lines. Data) is arranged.

  FIG. 14 shows an example of packing format when transmitting 3D image data of the method (1) through the three TMDS channels # 0, # 1, and # 2 of HDMI. As the image data transmission system, RGB 4: 4: 4 and YCbCr 4: 4: 4 are shown. Here, the relationship between the TMDS clock and the pixel clock is TMDS clock = 2 × pixel clock.

  In the RGB 4: 4: 4 system, 8-bit data that constitutes pixel data of right-eye (R) image data in the first half data area of each pixel (pixel) in TMDS channels # 0, # 1, and # 2. Blue (B) data, 8-bit green (G) data, and 8-bit red (R) data are arranged. Further, in the RGB 4: 4: 4 system, pixel data of left eye (L) image data is configured in the second half data area of each pixel (pixel) in TMDS channels # 0, # 1, and # 2, respectively. 8 bits of blue (B) data, 8 bits of green (G) data, and 8 bits of red (R) data are arranged.

  In the YCbCr 4: 4: 4 system, 8-bit data that constitutes pixel data of right eye (R) image data in the first half data area of each pixel (pixel) in TMDS channels # 0, # 1, and # 2, respectively. Blue difference (Cb) data, 8-bit luminance (Y) data, and 8-bit red difference (Cr) data are arranged. Further, in this YCbCr 4: 4: 4 system, pixel data of left eye (L) image data is configured in the second half data area of each pixel (pixel) in TMDS channels # 0, # 1, and # 2, respectively. 8-bit blue difference (Cb) data, 8-bit luminance (Y) data, and 8-bit red difference (Cr) data are arranged.

  In the method (1), the left eye image data may be arranged in the first half data area of each pixel, and the right eye image data may be arranged in the second half data area of each pixel.

  FIG. 15 shows an example of TMDS transmission data of method (2). In this case, 1920 pixels × 2160 lines of active video section, 1920 pixels (pixels) × 2160 lines of effective pixel (active pixel) data (composition of left eye (L) image data and right eye (R) image data) Data) is arranged.

  FIG. 16 shows an example of packing format when transmitting 3D image data of the method (2) using the three TMDS channels # 0, # 1, and # 2 of HDMI. As the image data transmission system, RGB 4: 4: 4 and YCbCr 4: 4: 4 are shown. Here, the relationship between the TMDS clock and the pixel clock is a relationship of TMDS clock = pixel clock.

  In the RGB 4: 4: 4 system, the pixel data of the left eye (L) image data is configured in the data area of each pixel (pixel) of the odd line in the TMDS channels # 0, # 1, and # 2, respectively. 8-bit blue (B) data, 8-bit green (G) data, and 8-bit red (R) data are arranged. Also, in this RGB 4: 4: 4 system, pixel data of right eye (R) image data is respectively stored in the data area of each pixel (pixel) of even lines in TMDS channels # 0, # 1, and # 2. The 8-bit blue (B) data, 8-bit green (G) data, and 8-bit red (R) data are arranged.

  In the YCbCr 4: 4: 4 system, the pixel data of the left eye (L) image data is configured in the data area of each pixel (pixel) of the odd line in the TMDS channels # 0, # 1, and # 2, respectively. Bit blue difference (Cb) data, 8-bit luminance (Y) data, and 8-bit red difference (Cr) data are arranged. Further, in this YCbCr 4: 4: 4 system, pixel data of right eye (R) image data is formed in the data area of each pixel (pixel) of even lines in TMDS channels # 0, # 1, and # 2, respectively. 8 bits of blue color difference (Cb) data, 8 bits of luminance (Y) data, and 8 bits of red color difference (Cr) data are arranged.

  In the method (2), the right eye image data may be arranged on the odd lines and the left eye image data may be arranged on the even lines.

  FIG. 17 shows an example of TMDS transmission data of method (3). In this case, left-eye (L) image data of effective pixels (active pixels) corresponding to 1920 pixels × 1080 lines is arranged in an active video section of 1920 pixels × 1080 lines in an odd field. Also, right-eye (R) image data of effective pixels (active pixels) for 1920 pixels × 1080 lines is arranged in an active video section of 1920 pixels × 1080 lines in the even field.

  FIGS. 18 and 19 show examples of packing formats when transmitting 3D image data of the method (3) using the three TMDS channels # 0, # 1, and # 2 of HDMI. As the image data transmission system, RGB 4: 4: 4 and YCbCr 4: 4: 4 are shown. Here, the relationship between the TMDS clock and the pixel clock is a relationship of TMDS clock = pixel clock.

  In the RGB 4: 4: 4 system, the pixel data of the left eye (L) image data is configured in the data area of each pixel (pixel) in the odd field in the TMDS channels # 0, # 1, and # 2, respectively. 8-bit blue (B) data, 8-bit green (G) data, and 8-bit red (R) data are arranged. Further, in this RGB 4: 4: 4 system, pixel data of right eye (R) image data is respectively stored in the data area of each pixel (pixel) in the even field in TMDS channels # 0, # 1, and # 2. The 8-bit blue (B) data, 8-bit green (G) data, and 8-bit red (R) data are arranged.

  In the YCbCr 4: 4: 4 system, the pixel data of the left eye (L) image data is configured in the data area of each pixel (pixel) in the odd field in the TMDS channels # 0, # 1, and # 2, respectively. Bit blue difference (Cb) data, 8-bit luminance (Y) data, and 8-bit red difference (Cr) data are arranged. Further, in this YCbCr 4: 4: 4 system, pixel data of right eye (R) image data is respectively stored in the second half data area of each pixel (pixel) of the even field in TMDS channels # 0, # 1, and # 2. 8 bit blue difference (Cb) data, 8 bit luminance (Y) data, and 8 bit red difference (Cr) data are arranged.

  In this method (3), the right eye image data may be arranged in the data area of each pixel in the odd field, and the left eye image data may be arranged in the data area of each pixel in the even field.

  FIG. 20 shows an example of TMDS transmission data of method (4). In this case, 1920 pixel × 1080 line active video section, 1920 pixel × 1080 line effective pixel (active pixel) data (the synthesis of left eye (L) image data and right eye (R) image data). Data) is arranged.

  In the case of this method (4), as described above, in the left eye image data and the right eye image data, the vertical line is thinned out to 1/2. Here, the left eye image data to be transmitted is either an odd line or an even line, and similarly, the right eye image data to be transmitted is either an odd line or an even line. Therefore, as a combination, both the left eye image data and the right eye image data are odd lines, both the left eye image data and the right eye image data are even lines, the left eye image data is an odd line, and the right eye image data is There are four types of even lines, left eye image data, even lines, and right eye image data, odd lines. FIG. 20 shows a case where the left eye image data is an odd line and the right eye image data is an even line.

  FIG. 21 shows an example of a packing format when transmitting 3D image data of the method (4) through the three TMDS channels # 0, # 1, and # 2 of HDMI. Three image data transmission schemes are shown: RGB 4: 4: 4, YCbCr 4: 4: 4, and YCbCr 4: 2: 2. Here, the relationship between the TMDS clock and the pixel clock is a relationship of TMDS clock = pixel clock.

  In the RGB 4: 4: 4 system, the pixel data of the left eye (L) image data is configured in the data area of each pixel (pixel) of the odd line in the TMDS channels # 0, # 1, and # 2, respectively. 8-bit blue (B) data, 8-bit green (G) data, and 8-bit red (R) data are arranged. Also, in this RGB 4: 4: 4 system, pixel data of right eye (R) image data is respectively stored in the data area of each pixel (pixel) of even lines in TMDS channels # 0, # 1, and # 2. The 8-bit blue (B) data, 8-bit green (G) data, and 8-bit red (R) data are arranged.

  In the YCbCr 4: 4: 4 system, the pixel data of the left eye (L) image data is configured in the data area of each pixel (pixel) of the odd line in the TMDS channels # 0, # 1, and # 2, respectively. Bit blue difference (Cb) data, 8-bit luminance (Y) data, and 8-bit red difference (Cr) data are arranged. Further, in this YCbCr 4: 4: 4 system, pixel data of right eye (R) image data is formed in the data area of each pixel (pixel) of even lines in TMDS channels # 0, # 1, and # 2, respectively. 8 bits of blue color difference (Cb) data, 8 bits of luminance (Y) data, and 8 bits of red color difference (Cr) data are arranged.

  In the YCbCr 4: 2: 2 system, bit 0 of luminance (Y) data that forms pixel data of left eye (L) image data in the data area of each pixel (pixel) of an odd line in TMDS channel # 0. -Bit 3 data is arranged, and bits 0 to 3 of the blue difference (Cb) data and bits 0 to 3 of the red difference (Cr) data are alternately arranged for each pixel. Has been. Further, in the YCbCr 4: 2: 2 system, the luminance (Y) data bits 4 to 11 of the left eye (L) image data are set in the data area of each pixel (pixel) of the odd line in the TMDS channel # 1. Data is arranged. In the YCbCr 4: 2: 2 system, bits 4 to 11 of the blue difference (Cb) data of the left eye (L) image data are placed in the data area of each pixel (pixel) of the odd line in the TMDS channel # 2. And the data of bit 4 to bit 11 of the red color difference (Cr) data are alternately arranged for each pixel.

  Further, in the YCbCr 4: 2: 2 system, luminance (Y) data that constitutes pixel data of right-eye (R) image data in the data area of each pixel (pixel) of even-numbered lines in TMDS channel # 0. Bit 0 to bit 3 data are arranged, and bit 0 to bit 3 of blue difference (Cb) data and bit 0 to bit 3 of red difference (Cr) data are alternated for each pixel. Is arranged. Further, in the YCbCr 4: 2: 2 system, the bit (4) to bit 11 of the luminance (Y) data of the right eye (R) image data is placed in the data area of each pixel (pixel) of the even line in the TMDS channel # 1. Data is arranged. In the YCbCr 4: 2: 2 system, bits 4 to 11 of the blue difference (Cb) data of the right eye (R) image data are placed in the data area of each pixel (pixel) of the even line in the TMDS channel # 2. And the data of bit 4 to bit 11 of the red color difference (Cr) data are alternately arranged for each pixel.

  In the method (4), the right eye image data may be arranged on the odd lines and the left eye image data may be arranged on the even lines.

  FIG. 22 shows an example of TMDS transmission data of method (5). In this case, 1920 pixel × 1080 line active video section, 1920 pixel × 1080 line effective pixel (active pixel) data (the synthesis of left eye (L) image data and right eye (R) image data). Data) is arranged.

  In the case of this method (5), as described above, in the left eye image data and the right eye image data, the vertical line is thinned out to 1/2. Here, the left eye image data to be transmitted is either an odd line or an even line, and similarly, the right eye image data to be transmitted is either an odd line or an even line. Therefore, as a combination, both the left eye image data and the right eye image data are odd lines, both the left eye image data and the right eye image data are even lines, the left eye image data is an odd line, and the right eye image data is There are four types of even lines, left eye image data, even lines, and right eye image data, odd lines. FIG. 22 shows a case where the left eye image data is an odd line and the right eye image data is an even line.

  FIG. 23 and FIG. 24 show an example of packing format when transmitting 3D image data of the method (5) through the three TMDS channels # 0, # 1, and # 2 of HDMI. Three image data transmission schemes are shown: RGB 4: 4: 4, YCbCr 4: 4: 4, and YCbCr 4: 2: 2. Here, the relationship between the TMDS clock and the pixel clock is a relationship of TMDS clock = pixel clock.

  In the RGB 4: 4: 4 system, the pixel data of the left eye (L) image data is configured in the data area of each pixel (pixel) in the vertical first half in TMDS channels # 0, # 1, and # 2, respectively. 8-bit blue (B) data, 8-bit green (G) data, and 8-bit red (R) data are arranged. Also, in this RGB 4: 4: 4 system, pixel data of right eye (R) image data is respectively stored in the data area of each pixel (pixel) in the second half of the vertical in TMDS channels # 0, # 1, and # 2. The 8-bit blue (B) data, 8-bit green (G) data, and 8-bit red (R) data are arranged.

  In the YCbCr 4: 4: 4 system, the pixel data of the left eye (L) image data is configured in the data area of each pixel (pixel) in the first vertical half in TMDS channels # 0, # 1, and # 2, respectively. Bit blue difference (Cb) data, 8-bit luminance (Y) data, and 8-bit red difference (Cr) data are arranged. Further, in this YCbCr 4: 4: 4 system, pixel data of right eye (R) image data is configured in the data area of each pixel in the second half of the vertical direction in TMDS channels # 0, # 1, and # 2. 8 bits of blue color difference (Cb) data, 8 bits of luminance (Y) data, and 8 bits of red color difference (Cr) data are arranged.

  In the YCbCr 4: 2: 2 system, bit 0 of luminance (Y) data that constitutes pixel data of left-eye (L) image data in the data area of each pixel (pixel) in the first half of the vertical direction in TMDS channel # 0. -Bit 3 data is arranged, and bits 0 to 3 of the blue difference (Cb) data and bits 0 to 3 of the red difference (Cr) data are alternately arranged for each pixel. Has been.

  Further, in the YCbCr 4: 2: 2 system, bits 4 to 11 of the luminance (Y) data of the left eye (L) image data are stored in the data area of each pixel (pixel) in the vertical first half in the TMDS channel # 1. Data is arranged. Further, in the YCbCr 4: 2: 2 system, bits 4 to 11 of the blue difference (Cb) data of the left eye (L) image data are placed in the data area of each pixel (pixel) in the vertical first half in the TMDS channel # 2. And the data of bit 4 to bit 11 of the red color difference (Cr) data are alternately arranged for each pixel.

  In the YCbCr 4: 2: 2 method, luminance (Y) data of pixel data of the right eye (R) image data is formed in the data area of each pixel (pixel) in the vertical second half in TMDS channel # 0. Bit 0 to bit 3 data are arranged, and bit 0 to bit 3 of blue difference (Cb) data and bit 0 to bit 3 of red difference (Cr) data are alternated for each pixel. Is arranged.

  In the YCbCr 4: 2: 2 system, the luminance (Y) data bits 4 to 11 of the right eye (R) image data are stored in the data area of each pixel (pixel) in the vertical second half in the TMDS channel # 1. Data is arranged. In the YCbCr 4: 2: 2 system, bits 4 to 11 of the blue difference (Cb) data of the right eye (R) image data are placed in the data area of each pixel (pixel) in the vertical second half in TMDS channel # 2. And the data of bit 4 to bit 11 of the red color difference (Cr) data are alternately arranged for each pixel.

  In this method (5), the right eye image data may be arranged in the data area of each pixel in the first half of the vertical, and the left eye image data may be arranged in the data area of each pixel in the second half of the vertical.

  FIG. 25 shows an example of TMDS transmission data of method (6). In this case, 1920 pixel × 1080 line active video section, 1920 pixel × 1080 line effective pixel (active pixel) data (the synthesis of left eye (L) image data and right eye (R) image data). Data) is arranged.

  In the case of this method (6), as described above, in the left eye image data and the right eye image data, the pixel data in the horizontal direction is thinned out to 1/2. Here, the left eye image data to be transmitted is either an odd pixel or an even pixel, and similarly, the right eye image data to be transmitted is either an odd pixel or an even pixel. Therefore, in combination, both left eye image data and right eye image data are odd pixels, both left eye image data and right eye image data are even pixels, left eye image data is odd pixels, and right eye image data is There are four types of even-numbered pixels, left-eye image data, even-numbered pixels, and right-eye image data, odd-numbered pixels.

  FIG. 26 illustrates an example of a packing format when transmitting 3D image data of the method (6) using the three TMDS channels # 0, # 1, and # 2 of HDMI. Three image data transmission schemes are shown: RGB 4: 4: 4, YCbCr 4: 4: 4, and YCbCr 4: 2: 2. Here, the relationship between the TMDS clock and the pixel clock is a relationship of TMDS clock = pixel clock.

  In the RGB 4: 4: 4 system, the pixel data of the left eye (L) image data is configured in the data area of each pixel (pixel) in the first half of the horizontal in TMDS channels # 0, # 1, and # 2, 8-bit blue (B) data, 8-bit green (G) data, and 8-bit red (R) data are arranged. Also, in this RGB 4: 4: 4 system, pixel data of right eye (R) image data is respectively stored in the data area of each pixel (pixel) in the latter half of the horizontal in TMDS channels # 0, # 1, and # 2. The 8-bit blue (B) data, 8-bit green (G) data, and 8-bit red (R) data are arranged.

  In the YCbCr 4: 4: 4 system, pixel data of left-eye (L) image data is configured in the data area of each pixel (pixel) in the first half of the horizontal in TMDS channels # 0, # 1, and # 2, respectively. Bit blue difference (Cb) data, 8-bit luminance (Y) data, and 8-bit red difference (Cr) data are arranged. Further, in this YCbCr 4: 4: 4 system, pixel data of right eye (R) image data is configured in the data area of each pixel in the second half of the horizontal in TMDS channels # 0, # 1, and # 2, respectively. 8 bits of blue color difference (Cb) data, 8 bits of luminance (Y) data, and 8 bits of red color difference (Cr) data are arranged.

  In the YCbCr 4: 2: 2 method, bit 0 of luminance (Y) data constituting pixel data of left eye (L) image data in the data area of each pixel (pixel) in the first half of the horizontal direction in TMDS channel # 0. -Bit 3 data is arranged, and bits 0 to 3 of the blue difference (Cb) data and bits 0 to 3 of the red difference (Cr) data are alternately arranged for each pixel. Has been.

  Further, in the YCbCr 4: 2: 2 system, the luminance (Y) data bits 4 to 11 of the left eye (L) image data are set in the data area of each pixel (pixel) in the first half of the horizontal direction in the TMDS channel # 1. Data is arranged. In the YCbCr 4: 2: 2 system, bits 4 to 11 of the blue difference (Cb) data of the left eye (L) image data are placed in the data area of each pixel (pixel) in the first half of the horizontal in TMDS channel # 2. And the data of bit 4 to bit 11 of the red color difference (Cr) data are alternately arranged for each pixel.

  Further, in the YCbCr 4: 2: 2 system, luminance (Y) data that constitutes pixel data of right-eye (R) image data in the data area of each pixel (pixel) in the second half of the horizontal in TMDS channel # 0. Bit 0 to bit 3 data are arranged, and bit 0 to bit 3 of blue difference (Cb) data and bit 0 to bit 3 of red difference (Cr) data are alternated for each pixel. Is arranged.

  Also, in the YCbCr 4: 2: 2 system, in the data area of each pixel (pixel) in the second half of the horizontal in TMDS channel # 1, bits 4 to 11 of luminance (Y) data of right eye (R) image data are stored. Data is arranged. In the YCbCr 4: 2: 2 system, bits 4 to 11 of the blue difference (Cb) data of the right eye (R) image data are placed in the data area of each pixel (pixel) in the second half of the horizontal in TMDS channel # 2. And the data of bit 4 to bit 11 of the red color difference (Cr) data are alternately arranged for each pixel.

  In this method (6), the right eye image data may be arranged in the data area of each pixel in the first half of the horizontal, and the left eye image data may be arranged in the data area of each pixel in the second half of the horizontal.

  Next, the 3D image data of the original signal is composed of two-dimensional (2D) image data (see FIG. 27A) and depth data corresponding to each pixel (see FIG. 27B). The case of the C method will be described.

  In the case of this MPEG-C system, the 4: 4: 4 system two-dimensional image data is converted into the 4: 2: 2 system, the depth data is arranged in the vacant area, and the two-dimensional image data and the depth data are combined. Data is transmitted through the TMDS channel of HDMI. That is, in this case, pixel data constituting two-dimensional image data and depth data corresponding to the pixel data are arranged in the data area of each pixel (image).

  FIG. 28 shows an example of TMDS transmission data in the MPEG-C system. In this case, data of effective pixels (active pixel) corresponding to 1920 pixels × 1080 lines (combined data of two-dimensional image data and depth data) is arranged in an active video section of 1920 pixels × 1080 lines.

  FIG. 29 shows an example of packing format when MPEG-C 3D image data is transmitted using three TMDS channels # 0, # 1, and # 2 of HDMI. Here, the relationship between the TMDS clock and the pixel clock is a relationship of TMDS clock = pixel clock.

  FIG. 29A shows the packing format of YCbCr 4: 4: 4 type two-dimensional image data for comparison. 8-bit blue color difference (Cb) data and 8-bit luminance (Y) that constitute pixel data of two-dimensional image data in the data area of each pixel (pixel) in TMDS channels # 0, # 1, and # 2, respectively. Data and 8-bit red color difference (Cr) data are arranged.

  FIG. 29B shows a packing format of the combined data of the two-dimensional image data and the depth data. In the data area of each pixel (pixel) in the TMDS channel # 0, 8-bit blue difference (Cb) data and 8-bit red difference (Cr) data are alternately arranged for each pixel. Also, 8-bit luminance (Y) data is arranged in the data area of each pixel in the TMDS channel # 1. Further, 8-bit depth data (D) is arranged in the data area of each pixel (pixel) in TMDS channel # 2.

  Thus, in order to transmit an 8-bit luminance signal and 8-bit depth data with one pixel clock, the method shown in FIG. 29B is referred to as a “YCbCrD4: 2: 2: 4” method. In this method, the pixel data of the color difference signals Cb and Cr are thinned out to ½, whereas the depth data is not thinned out. This is because the depth data is 8-bit data related to the luminance (Y) data, and it is necessary to maintain the same quality as the luminance (Y) data without thinning out.

  When the MPEG-C method is selected, the 3D signal processing unit (encoding unit) 229 of the above-described disc player 210 uses the above-mentioned “YCbCrD4: 2” from the 3D image data (two-dimensional image data and depth data) of the original signal. : 2: 4 ”The synthetic data corresponding to the method is generated. In such a case, the 3D signal processing unit (decoding unit) 254 of the television receiver 250 described above generates two-dimensional image data from the synthesized data of the “YCbCrD4: 2: 2: 4” method illustrated in FIG. Separate and extract depth data. Then, as shown in FIG. 30B, the 3D signal processing unit 254 performs interpolation processing on the color difference data Cb and Cr as shown in FIG. 30B to obtain YCbCr4: 4: 4 two-dimensional image data. Convert. Further, the 3D signal processing unit 254 performs calculations using the two-dimensional image data and the depth data, and generates left eye (L) image data and right eye (R) image data.

  In the AV system 200 shown in FIG. 1, the CPU 214 of the disc player 210 performs a 3D image data transmission method that can be supported by the television receiver 250 based on the E-EDID read from the HDMI receiving unit 252 of the television receiver 250. Recognize

  FIG. 31 shows an example of the data structure of E-EDID. This E-EDID is composed of a basic block and an extended block. At the head of the basic block, data defined by the E-EDID 1.3 standard represented by “E-EDID 1.3 Basic Structure” is arranged, and then the conventional EDID represented by “Preferred timing” and Timing information for maintaining the compatibility of the EDID and timing information different from “Preferred timing” for maintaining the compatibility with the conventional EDID represented by “2nd timing” are arranged.

  The basic block includes information indicating the name of the display device represented by “Monitor NAME” following “2nd timing”, and aspect ratios represented by “Monitor Range Limits” of 4: 3 and 16 : Information indicating the number of displayable pixels in the case of 9 is arranged in order.

  At the beginning of the extended block, information such as displayable image size (resolution), frame rate, interlaced / progressive information, aspect ratio, and the like represented by “Short Video Description” are described. Data, data describing information such as reproducible audio codec system, sampling frequency, cutoff band, codec bit number, etc. represented by “Short Audio Description”, and left and right speakers represented by “Speaker Allocation” Information about is arranged in order.

  In addition, the extension block maintains compatibility with the conventional EDID represented by “3rd timing”, the data defined uniquely for each manufacturer represented by “Vender Specific” following “Speaker Allocation”. Timing information for maintaining compatibility with the conventional EDID represented by “4th timing” is arranged.

  In this embodiment, a data area to be expanded to store 3D (stereoscopic) image information is defined in this Vender Specific area. FIG. 32 shows an example of the data structure of the Vender Specific area. In the Vender Specific area, a 0th block to an Nth block, which are 1-byte blocks, are provided. Data area of 3D image / audio information to be stored by the sink device (in this embodiment, the television receiver 250) from the 8th byte to the 11th byte following the already defined 0th byte to the 7th byte Define

  First, the 0th to 7th bytes will be described. The 0th byte arranged at the head of the data represented by “Vender Specific” includes a header indicating a data area of data “Vender Specific” (“Vender-Specific tag code (= 3)”), and “Vendor Specific”. Information indicating the length of the data “Vender Specific” represented by “Length (= N)” is arranged.

  In the first to third bytes, information indicating the number “0x000C03” registered for HDMI (R) represented by “24-bit IEEE Registration Identifier (0x000C03) LSB first” is arranged. Further, in the fourth byte and the fifth byte, information indicating the physical address of the 24-bit sink device represented by “A”, “B”, “C”, and “D” is arranged.

  The sixth byte is represented by a flag indicating a function supported by the sink device represented by “Supports-AI”, “DC-48 bit”, “DC-36 bit”, and “DC-30 bit”. Each of the information designating the number of bits per pixel, which is indicated by “DC-Y444”, indicates whether the sink device supports YCbCr4: 4: 4 image transmission.

  In the seventh byte, information indicating the maximum frequency of the TMDS pixel clock represented by “Max-TMDS-Clock” is arranged.

  Next, the 8th to 11th bytes will be described. Information on the 3D image is stored in the 8th to 10th bytes. The eighth byte indicates the correspondence in RGB 4: 4: 4, the ninth byte indicates the correspondence in YCbCr 4: 4: 4, and the tenth byte indicates the correspondence in YCbCr 4: 2: 2. In the 7th to 1st bits of the 8th to 10th bytes, there are 7 types of 3D images (the above-mentioned methods (1) to (6) and the MPEG-C method) supported by the sink device. Data indicating the video format (RGB 4: 4: 4 format, YCbCr 4: 4: 4 format, YCbCr 4: 2: 2 format) is written.

  Whether or not the seventh bit corresponds to a method (method (1): “Pixel ALT”) in which pixel data of left-eye image data and pixel data of right-eye image data are sequentially switched for each TMDS clock. Indicates. The sixth bit indicates whether or not it is compatible with a method of transmitting one line of left eye image data and one line of right eye image data alternately (method (2): “Simul”).

  The fifth bit indicates whether or not the left-eye image data and the right-eye image data are compatible with a method (method (3): “Field Seq.”) For sequentially switching and transmitting each field. In the fourth bit, the left-eye image data and the right-eye image data are each thinned by half in the vertical direction, and one line of left-eye image data and one line of right-eye image data are alternately transmitted. (Method (4): “Line Seq.”).

  In the third bit, the left eye image data and the right eye image data are respectively thinned by half in the vertical direction, and the data of each line of the left eye image data is transmitted in the first half, and each line of the left eye image data is transmitted in the second half. It indicates whether or not it is compatible with the method of transmitting data (method (5): “Top & Bottom”). In the second bit, the left-eye image data and the right-eye image data are respectively thinned by half in the horizontal direction, and the pixel data of the left-eye image data is transmitted in the first half, and each pixel of the left-eye image data is transmitted in the second half. It indicates whether or not the data transmission method (method (6): “Side by Side”) is supported.

  The first bit indicates whether or not it corresponds to a transmission system (MPEG-C system) using a two-dimensional image (main image) and depth data defined by MPEG-C. Subsequent bits can be assigned when other methods are proposed.

  Information related to 3D sound is stored in the 11th byte. The 7th to 5th bits indicate the 3D audio transmission format supported by the sink device. As an example, the seventh bit indicates the correspondence to the method A, the sixth bit indicates the correspondence to the method B, and the fifth bit indicates the correspondence to the method C. Subsequent bits can be assigned when other methods are proposed. In addition, the description about system A-C is abbreviate | omitted.

  In the AV system 200 shown in FIG. 1, the CPU 214 of the disc player 210 confirms the connection of the television receiver (sink device) 250 via the HPD line, and then uses the DDC to send the E-EDID from the television receiver 250. The 3D image / audio information is read, and the television receiver (sink device) recognizes the corresponding 3D image / audio data transmission method.

  In the AV system 200 shown in FIG. 1, when the disc player (source device) 210 transmits 3D image / audio data (3D image data, 3D audio data) to the television receiver (sink device) 250, the above-mentioned is used. As described above, based on the 3D image / audio information read out from the television receiver 250, any one of the 3D image / audio data transmission methods that can be supported by the television receiver 250 is selected and transmitted.

  At that time, the disc player (source device) 210 transmits information regarding the currently transmitted image / audio format to the television receiver (sink device) 250. In this case, the disc player 210 transmits the information to the television receiver 250 by inserting the information in the blanking period of the 3D image data (video signal) to be transmitted to the television receiver 250. Here, the disc player 210 uses, for example, an HDMI AVI (Auxiliary Video Information) InfoFrame packet, an Audio InfoFrame packet, and the like to insert information on the currently transmitted image / audio format into the blanking period of the 3D image data. To do.

  The AVI InfoFrame packet is arranged in the data island section described above. FIG. 33 shows an example of the data structure of an AVI InfoFrame packet. In HDMI, the AVI InfoFrame packet can be used to transmit incidental information about an image from a source device to a sink device.

  “Packet Type” indicating the type of data packet is defined in the 0th byte. The “Packet Type” of the AVI InfoFrame packet is “0x82”. The version information of the packet data definition is described in the first byte. The AVI InfoFrame packet is currently “0x02”, but when the 3D image data transmission method is defined in the present invention, it becomes “0x03” as shown in the figure. In the second byte, information indicating the packet length is described. The AVI InfoFrame is currently “0x0D”, but when the 3D image output format information is defined in the 17th byte in the present invention, it becomes “0x0E” as shown in the figure. Each AVI InfoFrame is defined in CEA-861-D Section 6-4 and will be omitted.

  The 17th byte will be described. The 17th byte specifies any one of the 3D image data transmission methods selected by the source device (in this embodiment, the disc player 210). The seventh bit indicates a method (method (1): “Pixel ALT”) in which pixel data of left eye image data and pixel data of right eye image data are sequentially switched for each TMDS clock. The sixth bit indicates a method of transmitting one line of left eye image data and one line of right eye image data alternately (method (2): “Simul”).

  The fifth bit indicates a method (method (3): “Field Seq.”) In which left-eye image data and right-eye image data are sequentially switched for each field and transmitted. In the fourth bit, the left-eye image data and the right-eye image data are each thinned by half in the vertical direction, and one line of left-eye image data and one line of right-eye image data are alternately transmitted. (Method (4): “Line Seq.”). In the third bit, the left eye image data and the right eye image data are respectively thinned by half in the vertical direction, and the data of each line of the left eye image data is transmitted in the first half, and each line of the left eye image data is transmitted in the second half. The method of transmitting the data (method (5): “Top & Bottom”) is shown.

  In the second bit, the left-eye image data and the right-eye image data are respectively thinned by half in the horizontal direction, and the pixel data of the left-eye image data is transmitted in the first half, and each pixel of the left-eye image data is transmitted in the second half. A method of transmitting data (method (6): “Side by Side”) is shown. The first bit indicates selection of a transmission method (MPEG-C method) based on a two-dimensional image and depth data defined by MPEG-C.

  Therefore, the sink device (in this embodiment, the television receiver 250) can determine that 3D image data is being transmitted when any of the seventh to first bits is set. Further, in the method (1), a video format of 3840 × 1080 is used, and in the method (2), a video format of 1920 × 2160 is used. Therefore, the video format specified by the VIC6 to VIC0 bits of the seventh byte of the AVI InfoFrame is selected from the video formats as shown in FIG. Further, RGB 4: 4: 4, YCbCr 4: 4: 4, and YCbCr 4: 2: 2 are designated by the sixth and fifth bits of the fourth byte of the AVI InfoFrame.

  Also, Deep Color information must be transmitted in a packet different from AVI InfoFrame. Therefore, as shown in FIG. 35, 48 bits (0x7) are designated in the bits (CD3 to CD0) of the General Control Protocol packet in the case of methods (1) to (3).

  The Audio InfoFrame packet is arranged in the data island section described above. FIG. 36 shows the data structure of an Audio InfoFrame packet. In HDMI, the audio InfoFrame packet can be used to transmit audio-related information from the source device to the sink device.

  “Packet Type” indicating the type of data packet is defined in the 0th byte, and Audio InfoFrame used in the present invention is “0x84”. The version information of the packet data definition is described in the first byte. The Audio InfoFrame packet is currently “0x01”, but when the 3D audio data transmission method is defined in the present invention, it becomes “0x02” as shown. In the second byte, information indicating the packet length is described. Audio InfoFrame is currently “0x0A”.

  The 3D audio output format information in the present invention is defined in the ninth byte. From the 7th bit to the 5th bit, one of the selected transmission methods among the 3D audio data transmission methods supported by the sink device is designated. As an example, the seventh bit indicates transmission in the method A, the sixth bit indicates transmission in the method B, and the fifth bit indicates transmission in the method C.

  Next, in the AV system 200 shown in FIG. 1, processing when the television receiver (sink device) is connected in the disc player (source device) 210 (CPU 221) will be described with reference to the flowchart of FIG.

  The disc player 210 starts processing in step ST1, and then proceeds to processing in step ST2. In step ST2, the disc player 210 determines whether or not the HPD signal is at the high level “H”. When the HPD signal is not at the high level “H”, the television receiver (sink device) 250 is not connected to the disc player 210. At this time, the disc player 210 immediately proceeds to step ST8 and ends the process.

  When the HPD signal is at the high level “H”, the disc player 210 reads the E-EDID (see FIGS. 31 and 32) of the television receiver (sink device) 250 in step ST3. In step ST4, the disc player 210 determines whether there is 3D image / audio information.

  When there is no 3D image / audio information, the disc player 210 sets data indicating non-transmission of 3D image / audio in the AVI InfoFrame packet and the Audio InfoFrame packet in step ST9, and then proceeds to step ST8 to perform processing. finish. Here, the setting of data indicating non-transmission of 3D image / sound means that all 7th to 4th bits of the 17th byte of the AVI InfoFrame packet (see FIG. 33) are set to “0”. This means that all the seventh to fifth bits of the ninth byte of the Audio InfoFrame packet (see FIG. 36) are set to “0”.

  When there is 3D image / audio information in step ST4, the disc player 210 determines the transmission method of 3D image / audio data in step ST5. In step ST6, the disc player 210 determines whether or not transmission of 3D image / audio data is started. When the 3D image / audio transmission is not started, the disc player 210 sets data indicating non-transmission of the 3D image / audio in the AVI InfoFrame packet and the Audio InfoFrame packet in step ST9, and then proceeds to step ST8 for processing. Exit.

  When the transmission of 3D image / audio data is started in step ST6, the disc player 210 sets data indicating the 3D image / audio data transmission method in the AVI InfoFrame packet and the Audio InfoFrame packet in step ST7, and thereafter Then, the process proceeds to step ST8, and the process ends.

  Next, in the AV system 200 shown in FIG. 1, 3D image data transmission method determination processing (processing in step ST5 in FIG. 37) in the disc player (source device) 210 will be described with reference to the flowchart in FIG. 38. .

  The disc player 210 starts processing in step ST11, and then proceeds to processing in step ST12. In step ST12, the disc player 210 determines whether the seventh to fifth bits of the eighth to tenth bytes in the Vender Specific area are set. The transmission method according to these bit settings is a method for transmitting the data of the left eye image and the right eye image having the highest image quality without deterioration, and is the method that is most easily processed by the sink device. Therefore, when the 7th to 5th bits are set, the disc player 210 selects one of the transmission methods (1) to (3) set by these bits in step ST13. A transmission method is selected, and then the process ends in step ST14.

  When the 7th bit to the 5th bit are not set, the disc player 210 proceeds to the process of step ST15. In step ST15, the disc player 210 determines whether the fourth to third bits of the eighth to tenth bytes in the Vender Specific area are set. The transmission method related to these bit settings is a method in which independent left-eye image data and right-eye image data having the next highest image quality are sequentially transmitted for each line, and the processing of the sink device is in units of two frames, and a memory is required. It becomes. When the fourth bit to the third bit are set, the disc player 210 selects a transmission method for either the method (4) or (5) set by these bits in step ST16, and then In step ST14, the process is terminated.

  When the 4th to 3rd bits are not set, the disc player 210 proceeds to the process of step ST17. In step ST17, the disc player 210 determines whether or not the second bit of the eighth to tenth bytes in the Vender Specific area is set. The transmission method according to this bit setting transmits independent left-eye image data and right-eye image data having the next highest image quality in the same frame and transmits the data with half the horizontal resolution using a method called “Side By Side”. This is a method and requires processing for expanding the horizontal resolution by a factor of 2 in the processing of the sink device. When the second bit is set, the disc player 210 selects the transmission method of the method (6) set by this bit at step ST18, and thereafter ends the processing at step ST14.

  When the second bit is not set, the disc player 210 moves to the process of step ST19. In step ST19, the disc player 210 determines whether or not the first bit of the eighth to tenth bytes in the Vender Specific area is set. The transmission method according to this bit setting is an MPEG-C method that separately transmits two-dimensional image data, which is common image data for the left eye and right eye, and depth data for the left eye and right eye. In this method, it is necessary to generate left-eye image data and right-eye image data from these two-dimensional image data and depth data by processing of the sink device, and the processing becomes complicated. When the first bit is set, the disc player 210 selects the MPEG-C transmission method set in this bit in step ST20, and thereafter ends the process in step ST14.

  When the first bit is not set, the disc player 210 moves to the process of step ST21. In step ST21, the disc player 210 determines that there is no method capable of transmitting 3D image data, sets 3D non-selection, and then ends the processing in step ST14.

  As described above, in the AV system 200 shown in FIG. 1, when the 3D image / audio data is transmitted from the disc player 210 to the television receiver 250, the disc player 210 transmits the 3D image / audio data to be transmitted. As a transmission method, 3D image / audio data transmission method information that can be supported by the television receiver 250 is received and transmitted. At that time, the disc player 210 transmits the transmission method information of the 3D image / audio data to be transmitted to the television receiver 250 using the AVI InfoFrame packet and the Audio InfoFrame packet. Therefore, it is possible to satisfactorily transmit 3D image / audio data between the disc player 210 and the television receiver 250.

  In the above embodiment, the disc player (source device) 210 uses the AVI InfoFrame packet and the Audio InfoFrame packet to transmit the transmission method information of the 3D image / audio data to be transmitted to the television receiver 250 to the image data ( The video signal is transmitted to the television receiver 250 by being inserted in the blanking period.

  For example, the disc player (source device) 210 transmits 3D image / audio data transmission method information to be transmitted to the television receiver 250 to the television receiver 250 via the CEC line 84 that is a control data line of the HDMI cable 350. You may make it transmit. Also, for example, the disc player 210 receives 3D image / audio data transmission method information to be transmitted to the television receiver 250 via a bidirectional communication path composed of a reserved line of the HDMI cable 350 and an HPD line. You may make it transmit to the machine 250.

  In the above-described embodiment, the E-EDID of the television receiver 250 includes 3D image / audio data transmission method information corresponding to the television receiver 250, and the disc player 210 uses the HDMI cable. By reading the E-EDID through the 350 DDC 83, the television receiver 250 acquires the transmission method information of the corresponding 3D image / audio data.

  However, the disc player 210 transmits 3D image / audio data transmission method information supported by the television receiver 250 from the television receiver 250 via the CEC line 84 which is a control data line of the HDMI cable 350 or the HDMI cable. You may make it receive via the bidirectional | two-way communication path comprised by the 350 reserve line and HPD line.

  In the above-described embodiment, an HDMI transmission path is used. However, examples of the baseband digital interface include DVI (Digital Visual Interface), DP (Display Port) interface, and a wireless interface using 60 GHz millimeter wave in addition to HDMI. The present invention can be similarly applied to transmission of 3D image / audio data using these digital interfaces.

  In the case of DVI, similarly to the above-described HDMI, the 3D image / audio data transmission method supported by the receiving device is stored in an area called E-EDID held by the receiving device. Therefore, in the case of this DVI, as in the case of the above-described HDMI, the transmitting device uses the DDC (Display Data Channel) to transmit the 3D image / audio data to the receiving device. The above-mentioned 3D image / audio information is read from the EDID, and the transmission method can be determined.

  FIG. 39 shows a configuration example of a DP system using a DP interface. In this DP system, a display port transmitting device and a display port receiving device are connected by a DP interface. The display port transmitting device includes a display port transmitter, and the display port receiving device includes a display port receiver.

  The main link consists of one, two, or four double-terminated differential signal pairs (pair lanes), does not have a dedicated clock signal, but instead has a clock embedded in the 8B / 10B encoded data stream. Yes. In the DP interface, two transmission rates are defined. One has a bandwidth per pair lane of 2.16 Gbps. The other has a bandwidth per pair lane of 1.296 Gbps. Accordingly, the logical upper limit transmission bit rate in the transmission path of the DP interface is 2.16 Gbps per port, and 8.64 Gbps for a maximum of 4 ports.

  In this DP interface, unlike HDMI, the transmission speed and the pixel frequency are independent, and the depth and resolution of the pixel, the frame frequency, the presence / absence of additional data such as audio data and DRM information in the transfer stream, and the amount thereof, It can be adjusted freely.

  In addition to the main link, the DP interface has a half-duplex bi-directional external (auxiliary) channel with a bandwidth of 1 Mbit / sec and a maximum delay of 500 ms. Exchange information on the functions of In the present invention, information relating to 3D image / sound is transmitted using the external (auxiliary) channel. In the case of this DP interface, although not shown, 3D image / audio data transmission method information supported by the receiving device is recorded in EDID similar to HDMI. Hot plug detection is provided to detect that the connection destination has been changed.

  FIG. 40 shows a configuration example of a wireless system using a wireless interface. The transmission apparatus includes an image / audio data reproduction unit, a wireless transmission / reception unit, a storage unit, and a control unit that controls these units. The receiving device includes a video / audio output unit, a wireless transmission / reception unit, a storage unit, and a control unit that controls these units. The transmission device and the reception device are connected by a wireless transmission path.

  In this invention, the information on the transmission method of 3D image / audio data that can be handled by the receiving device is stored in the storage unit of the receiving device, and is transmitted to the transmitting device via the wireless transmission path. Also, 3D image / audio data transmission method information from the transmission device is multiplexed with video / audio / control signals and sent to the reception device via a wireless transmission path.

  In the case of connection by cable or wireless, the logical upper limit transmission rate on each transmission line (10.2 Gbps for HDMI, 3.96 Gbps for DVI, 2.16 Gbps per DP, 8.64 Gbps with a maximum of 4 ports) The Gigabit Ether optical fiber is defined as 1 Gbps or 10 Gbps).

  However, in these transmission paths, the upper limit transmission rate may not be reached due to the transmission path length, the electrical characteristics of the transmission path, etc., and the transmission rate required for transmission of 3D image data to be transmitted by the transmission apparatus May not be obtained. At that time, it is necessary to appropriately select a 3D image data transmission method.

  FIG. 41 shows a configuration example of a transmission system 600 that confirms the transmission rate of the transmission path and determines the 3D image data transmission method. The transmission system 600 has a configuration in which a transmission device 610 and a reception device 650 are connected via a transmission path 660.

  The transmission apparatus 610 includes a control unit 611, a storage unit 612, a reproduction unit 613, a 3D signal processing unit 614, and a transmission unit 615. The control unit 611 controls the operation of each unit of the transmission device 610. The reproduction unit 613 reproduces 3D image data to be transmitted from a recording medium such as an optical disc, an HDD, or a semiconductor memory. The 3D signal processing unit 614 matches the 3D image data (for example, left-eye image data and right-eye image data) reproduced by the reproduction unit 613 with a transmission method specified by the control unit 611 (FIG. 11, FIG. 12, see FIG. 28).

  The transmission unit 615 transmits the 3D image data obtained by the 3D signal processing unit 614 to the reception device 650. In addition, the transmission unit 615 transmits transmission method information of 3D image data to be transmitted to the reception device 650 using, for example, an AVI InfoFrame packet. In addition, the transmission unit 615 receives transmission method information and transmission rate information of 3D image data corresponding to the reception device 650 sent from the reception device 650, and supplies the received information to the control unit 611.

  The receiving device 650 includes a control unit 651, a storage unit 652, a transmission unit 653, a 3D signal processing unit 654, an output unit 655, and a detection unit 656. The control unit 611 controls the operation of each unit of the receiving device 650. The storage unit 652 stores 3D image data transmission method information supported by the receiving device 650.

  The transmission unit 653 receives 3D image data sent from the transmission device 653. In addition, the transmission unit 653 receives 3D image data transmission method information sent from the transmission device 653 and supplies it to the control unit 651. Further, the transmission unit 653 transmits the transmission method information of 3D image data stored in the storage unit 652 and corresponding to the reception device 650 to the transmission device 610.

  In addition, the transmission unit 653 transmits the transmission rate information obtained by the control unit 651 to the transmission device 610. That is, the detection unit 656 determines the state of the transmission path 660 based on, for example, bit error information supplied from the transmission unit 653. The control unit 651 determines the quality of the transmission path 660 based on the determination result of the detection unit 656, and the transmission rate of the transmission path 660 is required for the transmission method of the 3D image data notified from the transmission device 610. When the rate is lower than the rate, transmission rate information indicating that fact is sent to the transmission device 610 through the transmission unit 653.

  The 3D signal processing unit 654 processes the 3D image data received by the transmission unit 653 to generate left eye image data and right eye image data. The control unit 651 controls the operation of the 3D signal processing unit 654 based on 3D image data transmission method information sent from the transmission device 610. The display unit 656 displays a stereoscopic image based on the left eye image data and the right eye image data generated by the 3D signal processing unit 654.

  The operation of the transmission system 600 shown in FIG. 41 will be described. In the transmission device 610, 3D image data (left-eye image data and right-eye image data, or two-dimensional image data and depth data) reproduced by the reproduction unit 613 is supplied to the 3D signal processing unit 614. The control unit 611 selects a predetermined transmission method from among the transmission methods supported by the receiving device 650 based on the transmission method information of the 3D image data supported by the receiving device 650 received from the receiving device 650. .

  In the 3D signal processing unit 614, the 3D image data reproduced by the reproduction unit 613 is processed so as to be in a state that matches the transmission method selected by the control unit 611. The 3D image data processed by the 3D signal processing unit 614 is transmitted to the reception device 650 by the transmission unit 615 via the transmission path 660. In addition, information on the transmission method selected by the control unit 611 is transmitted from the transmission unit 615 to the reception device 650.

  In the reception device 650, the transmission unit 653 receives 3D image data transmitted from the transmission device 610, and the 3D image data is supplied to the 3D signal processing unit 654. In addition, the transmission unit 653 receives transmission method information of 3D image data transmitted from the transmission device 610, and the transmission method information is supplied to the control unit 651. In the 3D signal processing unit 654, under the control of the control unit 651, the 3D image data received by the transmission unit 653 is processed according to the transmission method, and the left eye image data and the right eye image Data is generated.

  The left eye image data and right eye image data are supplied to the display unit 655. The display unit 656 displays a stereoscopic image using the left eye image data and the right eye image data generated by the 3D signal processing unit 654 (see FIG. 2).

  In the receiving device 650, the detection unit 656 determines the state of the transmission path 660 based on, for example, bit error information supplied from the transmission unit 653, and the determination result is supplied to the control unit 651. The control unit 651 determines the quality of the transmission path 660 based on the determination result of the detection unit 656. When the transmission rate of the transmission path 660 is lower than the transmission rate required for the 3D image data transmission method notified from the transmission device 610, the control unit 651 generates transmission rate information indicating that fact, and this transmission The rate information is transmitted from the transmission unit 653 to the transmission device 610.

  In the transmission device 610, the transmission unit 650 receives the transmission rate information transmitted from the reception device 650, and this transmission rate information is supplied to the control unit 611. Based on the transmission rate information, the control unit 611 changes the selection of the 3D image data transmission method so as to be within the transmission rate of the transmission path 660. In the 3D signal processing unit 614, the 3D image data reproduced by the reproduction unit 613 is processed so as to match the changed transmission method. Then, the processed 3D image data is transmitted by the transmission unit 615 to the reception device 650 via the transmission path 660. In addition, information on the transmission method changed by the control unit 611 is transmitted from the transmission unit 615 to the reception device 650.

  In the transmission system 600 shown in FIG. 41, as described above, the transmission device 610 has a necessary transmission rate as a transmission method of 3D image data to be transmitted based on the transmission rate information sent from the reception device 650. A transmission method that falls within the transmission rate of the transmission line 660 can be selected. Therefore, stereoscopic image data can always be transmitted satisfactorily regardless of changes in the state of the transmission path.

  In the above description, the transmission rate information sent from the receiving device 650 to the transmitting device 610 indicates that the transmission rate of the transmission path 660 is lower than the transmission rate required for the 3D image data transmission method notified from the transmitting device 610. Although shown, this transmission rate information may indicate the transmission rate of the transmission path 660.

  In the above description, when the transmission rate of the transmission path 660 is lower than the transmission rate required for the 3D image data transmission method notified from the transmission device 610, the transmission rate information indicating that from the reception device 650 to the transmission device 610 Although what was transmitted was shown, you may make it as follows. In other words, in this case, only the transmission method within the transmission rate of the transmission path 660 is rewritten from the E-EDID stored in the storage unit 652 and the transmission method information of 3D image data that can be supported by the receiving device 650 is rewritten. Enabled.

  In this case, the receiving device 650 needs to notify the transmitting device 610 of the change of E-EDID. For example, when the transmission line 660 is an HDMI interface, the HPD signal is temporarily controlled to “L”, and the transmission device 610 is controlled to read E-EDID again.

  In the above-described embodiment, an example is shown in which the left-eye image data and right-eye image data, or two-dimensional image data and depth data constituting 3D image data are processed and transmitted through the HDMI TMDS channel. It was. However, it is also conceivable to transmit two types of data constituting 3D image data through different transmission paths.

  For example, when the 3D image data is composed of left-eye image data and right-eye image data, either one is transmitted through the TMDS channel, and the other is transmitted through a predetermined line of the HDMI cable 350 (in this embodiment, the reserved line). And an HPD line) may be transmitted via a bidirectional communication path. Further, for example, when the 3D image data is composed of 2D image data and depth data, the 2D image data is transmitted through the TMDS channel, and the depth data is transmitted to a predetermined line of the HDMI cable 350 (in this embodiment, You may transmit in the bidirectional | two-way communication path comprised by a reserve line and a HPD line), or the data island area of HDMI.

  In the above embodiment, the disc player 210 is used as the transmission device (source device) and the television receiver 250 is used as the reception device (sink device). However, other transmission devices and reception devices are used. The present invention can be similarly applied to what is used.

  The present invention favorably transmits 3D image data from a transmission device to a reception device using a transmission method selected based on correspondence information of the transmission method of 3D image data in the reception device. And 3D image data transmission system configured by a receiving device.

  200 ... AV system, 210 ... disc player, 211 ... HDMI terminal, 212 ... HDMI transmission unit, 213 ... high-speed data line interface, 214 ... CPU, 215 ... CPU bus 216: SDRAM, 217 ... Flash ROM, 218 ... Remote control receiver, 219 ... Remote control transmitter, 220 ... IED interface, 221 ... BD drive, 222 ... Internal bus 223 Ethernet interface 224 Network terminal 225 MPEG decoder 226 Graphic generation circuit 227 Video output terminal 228 Audio output terminal 229 3D signal processing unit, 230... DTCP circuit, 250... Television receiver, 251. HDMI terminal, 252... HDMI receiving unit, 253... High-speed data line interface, 254... 3D signal processing unit, 255... Antenna terminal, 256. 258 ... MPEG decoder, 259 ... video signal processing circuit, 260 ... graphic generation circuit, 261 ... panel drive circuit, 262 ... display panel, 263 ... audio signal processing circuit, 264 ..Audio amplifier circuit, 265... Speaker, 170... Internal bus, 271... CPU, 272... Flash ROM, 273... DRAM, 274. Terminal, 276 ... Remote control receiver, 277 ... Remote control transmitter, 278 ... DTCP Path 350... HDMI cable 600 600 transmission system 610 transmission device 611 control unit 612 storage unit 613 playback unit 614 3D signal Processing unit, 615... Transmission unit, 650... Receiving device, 651... Control unit, 652... Storage unit, 653 .. transmission unit, 654 .. 3D signal processing unit, 655. .Display unit, 656... Detection unit

Claims (2)

A receiving method in a receiving apparatus connected to an external device via a main link and an auxiliary channel,
The main link consists of one, two or four double terminated differential signal pairs,
The auxiliary channel is a channel for half duplex bidirectional communication,
A transmission method information transmission step of transmitting transmission method information of stereoscopic image data that can be supported to the external device through the auxiliary channel;
The transmission method information includes a field sequential method for transmitting at least left-eye image data and right-eye image data by sequentially switching each field,
A data receiving step of receiving stereoscopic image data as an 8B / 10B encoded data stream embedded with a clock from the external device via the main link;
A transmission method information receiving step for extracting transmission method information of the stereoscopic image data from a blanking period of the stereoscopic image data received in the data receiving step;
The data processing step further includes processing the stereoscopic image data received in the data receiving step based on the transmission method information extracted in the transmission method information receiving step to generate left eye image data and right eye image data. Method. A receiving device connected to an external device via a main link and an auxiliary channel,
The main link consists of one, two or four double terminated differential signal pairs,
The auxiliary channel is a channel for half duplex bidirectional communication,
A transmission method information transmitting unit that transmits transmission method information of stereoscopic image data that can be supported to the external device via the auxiliary channel,
The transmission method information includes a field sequential method for transmitting at least left-eye image data and right-eye image data by sequentially switching each field,
A data receiving unit that receives stereoscopic image data as an 8B / 10B encoded data stream embedded with a clock from the external device via the main link;
A transmission method information receiving unit that extracts transmission method information of the stereoscopic image data from a blanking period of the stereoscopic image data received by the data receiving unit;
The data processing unit further includes a data processing unit that processes the stereoscopic image data received by the data receiving unit based on the transmission mode information extracted by the transmission mode information receiving unit to generate left eye image data and right eye image data. apparatus.