JP2014039269A - Stereoscopic image data transmission method and stereoscopic image data transmitter - Google Patents

Abstract

PROBLEM TO BE SOLVED: To satisfactorily transmit stereoscopic image data including left-eye image data and right-eye image data.SOLUTION: Information on the screen size is acquired from an external apparatus via a transmission path. Stereoscopic image data is transmitted to the external apparatus via the transmission path. The stereoscopic image data includes left-eye image data and right-eye image data for displaying a stereoscopic image. In the stereoscopic image data, the left-eye image data and the right-eye image data are arranged in one video field section with a predetermined period interposed therebetween. For example, the stereoscopic image data includes no image data in the predetermined period.

Description

  The present invention relates to a stereoscopic image data transmission method and a stereoscopic image data transmission apparatus.

  In recent years, for example, digital video signals from a game machine, a DVD (Digital Versatile Disc) recorder, a set top box, and other AV sources (Audio Visual source) to a television receiver, a projector, and other displays, An interface such as HDMI (High Definition Multimedia Interface) is used as a communication interface for transmitting an uncompressed (baseband) video signal (image data) and a digital audio signal (audio data) accompanying the video signal at high speed. It is becoming popular. For example, Non-Patent Document 1 describes details of the HDMI standard.

High-Definition Multimedia Interface Specification Version 1.3a, November 10 2006

  For example, stereoscopic image data including left-eye image data and right-eye image data for displaying a stereoscopic image is transmitted from an AV source to the display, and stereoscopic image display using binocular parallax is performed on the display. It is possible.

  FIG. 30 shows the relationship between the display position of the left and right images of the object on the screen and the playback position of the stereoscopic image in stereoscopic image display using binocular parallax. For example, with respect to the object A in which the left image La is displayed on the right side and the right image Ra is shifted to the left side as shown in the figure on the screen, the right and left line of sight intersects in front of the screen surface. The position is in front of the screen surface.

  Further, for example, with respect to the object B in which the left image Lb and the right image Rb are displayed at the same position as shown in the figure on the screen, the right and left lines of sight intersect on the screen surface. It becomes on the surface. Further, for example, with respect to the object C displayed on the screen as shown in the figure, the left image Lc is shifted to the left side and the right image Rc is shifted to the right side, the right and left lines of sight intersect at the back of the screen surface. The playback position is behind the screen.

  In FIG. 30, an object D is an object at infinity. Regarding the object D, the display positions of the left image Ld and the right image Rd on the screen need to be shifted by a distance between both eyes (for example, about 6.5 cm for an adult). However, when the video signals for displaying the left eye image and the right eye image on the screen are the same, the shift width of the left image Ld and the right image Rd changes depending on the screen size, and the reproduction position of the stereoscopic image of the object D is It may not be at infinity.

  For example, an image generated by a small television receiver having a screen size of 20 inches or a PC (Personal Computer) monitor so that the shift width of the display position of the left image Ld and the right image Rd on the screen is the distance between both eyes. Consider a signal (left eye video signal, right eye video signal) V1. For example, when the left image Ld and the right image Rd are displayed on a small television receiver having a screen size of 20 inches or a PC monitor to display a stereoscopic image by the video signal V1, the left image Ld and the right image Rd are displayed on the screen. Since the shift width of the display position is the distance between both eyes, the reproduction position of the stereoscopic image of the object D is infinite. However, for example, when the left image Ld and the right image Rd are displayed by the projector having a screen size of 200 inches by the video signal V1, and the stereoscopic image display is performed, the display position shift of the left image Ld and the right image Rd on the screen is performed. The width becomes larger than the distance between both eyes, and stereoscopic image display breaks down.

  For example, consider a video signal (left-eye video signal, right-eye video signal) V2 generated such that the shift width of the display position on a projector having a screen size of 200 inches is the distance between both eyes. For example, when the left image Ld and the right image Rd are displayed by the video signal V2 to display a left image Ld and a right image Rd on a projector having a screen size of 200 inches, the shift width of the display positions of the left image Ld and the right image Rd on the screen is as follows. Since the distance is between the eyes, the reproduction position of the stereoscopic image of the object D is infinite. However, when the left image Ld and the right image Rd are displayed by the video signal V2 to display the left image Ld and the right image Rd on, for example, a small television receiver having a screen size of 20 inches or a PC monitor, the left image Ld and the right image Rd are displayed. The display position shift width on the screen is smaller than the distance between both eyes, and the reproduction position of the stereoscopic image of the object D is a position before infinity.

  It should be noted that when the video signal for displaying the left eye image and the right eye image on the screen is the same and the screen size is changed, the influence is not only on the object D at infinity but also on the objects A and C. It reaches. That is, since the shift width of the left and right image display positions on the screen changes depending on the screen size, the reproduction position of the stereoscopic images of the objects A and C with reference to the screen surface changes significantly, or the stereoscopic image display fails. To do.

  As described above, when the video signals for displaying the left-eye image and the right-eye image on the screen are the same, if the screen size changes, it becomes impossible to display an appropriate stereoscopic image.

  Conventionally, when a left-eye video signal and a right-eye video signal are dynamically generated at the time of image display, such as a game machine, even if the screen size changes by setting screen size information, it is appropriate 3D image display is possible. However, in this case, the user has to set screen size information in the game machine in accordance with a change in the screen size.

  Further, conventionally, object position shift in the left eye image and the right eye image is detected from the left eye image and the right eye image by extracting feature points, correlation between images, and the like, and a clue of depth information is obtained therefrom. There is also a technique of displaying depth information after correcting depth information. However, if there is screen size information at that time, correction can be performed more appropriately. Also at this time, if the screen size information can be acquired automatically, the user does not need to set the screen size information.

  An object of the present invention is to satisfactorily transmit stereoscopic image data including left eye image data and right eye image data.

The concept of this invention is
An information acquisition step of acquiring information about the screen size from an external device via a transmission path;
A data transmission step of transmitting stereoscopic image data including left-eye image data and right-eye image data for displaying a stereoscopic image to the external device via the transmission path;
In the stereoscopic image data, there is a stereoscopic image data transmission method in which the left eye image data and the right eye image data are arranged in a video field section with a predetermined period interposed.

  In the present invention, information regarding the screen size is acquired from an external device via a transmission path. In addition, stereoscopic image data is transmitted to an external device via a transmission path. This stereoscopic image data includes left-eye image data and right-eye image data for displaying a stereoscopic image. In this stereoscopic image data, left-eye image data and right-eye image data are arranged with a predetermined period interposed in one video field section. For example, in this stereoscopic image data, the image data may not be included in a predetermined period.

  According to the present invention, it is possible to satisfactorily transmit stereoscopic image data including left eye image data and right eye image data.

1 is a block diagram showing a configuration example of an AV system as an embodiment of the present invention. It is a figure which shows the "field sequence system" and the "phase difference plate system" which are the example of a display system of a stereoscopic vision image. It is a block diagram which shows the structural example of the game machine (source device) which comprises AV system. It is a block diagram which shows the structural example of the television receiver (sink apparatus) which comprises AV system. It is a block diagram which shows the structural example of an HDMI transmission part (HDMI source) and an HDMI receiving part (HDMI sink). It is a block diagram which shows the structural example of the HDMI transmitter which comprises an HDMI transmission part, and the HDMI receiver which comprises an HDMI receiving part. It is a figure which shows the example of a structure of TMDS transmission data (when the image data of horizontal x length is 1920 pixels x 1080 lines is transmitted). It is a figure which shows the pin arrangement (type A) of the HDMI terminal to which the HDMI cable of the source device and the sink device is connected. It is a figure which shows the image data (Image data of a 1920 * 1080p pixel format) of the left eye (L) and the right eye (R). 3D (stereoscopic) image data transmission method, (a) a method of sequentially switching left eye image data and right eye image data for each field, and (b) one line of left eye image data and the right eye A method of alternately transmitting one line of image data, (c) a method of transmitting pixel data of left-eye image data in the first half of the horizontal direction, and a method of transmitting pixel data of right-eye image data in the second half of the horizontal direction, It is a figure for demonstrating. It is a figure which shows the TMDS transmission data example in the system which switches and transmits left-eye image data and right-eye image data sequentially for every field. It is a figure which shows the example of TMDS transmission data in the system which transmits one line of left eye image data and one line of right eye image data alternately. It is a figure which shows the TMDS transmission data example in the system which transmits the pixel data of left eye image data in the first half of a horizontal direction, and transmits the pixel data of right eye image data in the second half of a horizontal direction. It is a figure for demonstrating that screen size is the horizontal width of the area | region where a left eye image and a right eye image are actually displayed, height, the length of a diagonal, etc. FIG. It is a figure which shows the structural example of E-EDID data. It is a figure which shows the example of video data of a Short Video Descriptor area | region. It is a figure which shows the example of a data structure of a Vendor Specific area | region. It is a figure for demonstrating the modeling process in the case of producing | generating stereo image data. It is a figure for demonstrating using screen size and a viewing distance as a parameter when producing | generating stereo image data. It is a flowchart which shows roughly the flow of the production | generation of stereo image data in a game machine, and an output process. It is a reference figure for demonstrating the 1st calculation method of the view angle and aspect of a camera. It is a reference figure for demonstrating the 2nd calculation method of the view angle and aspect of a camera. It is a figure for demonstrating calculating | requiring the correlation between the L and R images at the time of estimating depth information per line of a horizontal direction. It is a figure for demonstrating estimation of depth information. It is a figure which shows the depth information of the estimated image. It is a figure which shows roughly the sequence at the time of sending the stereo image data (left eye image data, right eye image data) for displaying a stereo image from a game machine to a television receiver. It is a block diagram which shows the structural example of AV system which connected AV amplifier between the disc player and the television receiver. It is a block diagram which shows the structural example of the disc player (source device) which comprises AV system. It is a block diagram which shows the structural example of AV amplifier (repeater apparatus) which comprises AV system. It is a figure for demonstrating the reproduction | regeneration position of the stereo image in the stereo image display using binocular parallax.

Hereinafter, modes for carrying out the invention (hereinafter referred to as “embodiments”) will be described. The description will be given in the following order.
1. Embodiment 2. FIG. Modified example

<1. Embodiment>
[Example of AV system configuration]
FIG. 1 shows a configuration example of an AV (Audio Visual) system 200 as an embodiment. The AV system 200 includes a game machine 210 as a source device and a television receiver 250 as a sink device. The source device may be a device other than a game machine, a device that generates 3D video, or a device that plays 3D video, such as Blu-ray Disc Player.

  The game machine 210 and the television receiver 250 are connected via an HDMI cable 350. The game machine 210 is provided with an HDMI terminal 211 to which an HDMI transmission unit (HDMI TX) 212 is connected. The television receiver 250 is provided with an HDMI terminal 251 to which an HDMI receiving unit (HDMI RX) 252 is connected. One end of the HDMI cable 300 is connected to the HDMI terminal 211 of the game machine 210, and the other end of the HDMI cable 300 is connected to the HDMI terminal 251 of the television receiver 250.

  In the AV system 200 shown in FIG. 1, uncompressed image data (video signal) from the game machine 210 is transmitted to the television receiver 250 via the HDMI cable 350, and the television receiver 250 uses the image from the game machine 210. An image based on the data is displayed. In addition, uncompressed audio data (audio signal) from the game machine 210 is transmitted to the television receiver 250 via the HDMI cable 350, and the audio based on the audio data from the game machine 210 is output from the television receiver 250. .

  When the image data sent from the game machine 210 to the television receiver 250 is stereoscopic image data (3D image data) for displaying a stereoscopic image, the television receiver 250 displays the stereoscopic image.

  An example of this stereoscopic image display method will be described. As a stereoscopic image display method, for example, as shown in FIG. 2A, a left-eye (L) image and a right-eye (R) image are alternately displayed for each field, a so-called “field sequence method”. There is. In this display method, the television receiver side needs to be driven at twice the normal frame rate. Further, in this display method, it is not necessary to attach an optical film to the display unit, but it is necessary to switch opening and closing of the shutters of the left and right lens units in synchronization with the field of the display unit on the side of the glasses worn by the user. .

  Further, as a stereoscopic image display method, for example, as shown in FIG. 2B, a method of switching and displaying a left eye (L) image and a right eye (R) image for each line, a so-called “phase difference” There is a “plate method”. In this display method, a polarizing plate having a polarization direction different by 90 degrees for each line is attached to the display unit on the television receiver side. Stereoscopic image display is realized by blocking the light of the image of the reverse eye with polarized glasses worn by the user.

[Game console configuration example]
FIG. 3 shows a configuration example of the game machine 210.
The game machine 210 includes an HDMI terminal 211, an HDMI transmission unit 212, an Ethernet interface (Ethernet I / F) 214, and a network terminal 215. The game machine 210 also has an input interface 216, a control pad 217, a drive interface 218, and a DVD / BD (Digital Versatile Disk / Blu-ray Disc) drive 219.

  The game machine 210 includes an internal bus 220, a CPU (Central Processing Unit) 221, a flash ROM (Read Only Memory) 222, and a DRAM (Dynamic Random Access Memory) 223. Further, the game machine 210 includes a drawing processing unit 224, a VRAM (Video Random Access Memory) 225, an audio processing unit 226, and an MPEG decoder 227. “Ethernet”, “Ethernet” and “Blu-ray Disc” are registered trademarks.

  The HDMI transmission unit (HDMI source) 212 transmits uncompressed (baseband) video (image) and audio data from the HDMI terminal 211 through communication conforming to HDMI. Details of the HDMI transmission unit 212 will be described later.

  The CPU 221, flash ROM 222, DRAM 223, Ethernet interface 214, input interface 216, and drive interface 218 are connected to the internal bus 220. The drawing processing unit 224, VRAM 225, audio processing unit 226, and MPEG decoder 227 are connected to the internal bus 220. The DVD / BD drive 219 is connected to the internal bus 220 via the drive interface 218. The DVD / BD drive 219 reproduces content such as a movie recorded on a recording medium such as a DVD, and reproduces game software information recorded on the recording medium.

  When the game machine 210 functions as a playback machine, the MPEG decoder 227 performs a decoding process on the compressed video data and audio data reproduced from a recording medium such as a DVD, and converts the uncompressed video data and audio data. obtain.

  The CPU 221 controls the operation of each part of the game machine 210. The flash ROM 222 stores control software and data. The DRAM 223 constitutes a work area for the CPU 221. The CPU 221 develops software and data read from the flash ROM 222 on the DRAM 223 to activate the software, and controls each unit of the game machine 210.

  The control pad 217 constitutes a user operation unit. The input interface 216 takes an operation input signal from the control pad 217 into the internal bus 220. The drawing processing unit 224 includes a drawing engine. When the game machine 210 functions as a game machine, the drawing processing unit 224 dynamically creates a game image in accordance with a user operation from the control pad 217 based on the game software information and develops the game image in the VRAM 225.

  The drawing processing unit 224 generates, as game image data, image data for displaying a two-dimensional image, as well as stereoscopic image data (left-eye image data and right-eye image data) for displaying a stereoscopic image. Generate. In this case, the rendering processing unit 224 generates stereoscopic image data using information on the screen size and viewing distance of the television receiver 250, as will be described later.

  In addition, when the image data of a content such as a movie reproduced from a recording medium such as a DVD is stereoscopic image data for displaying a stereoscopic image, the drawing processing unit 224 performs the stereoscopic processing according to a user instruction. Correct the image data. The correction of the stereoscopic image data is performed using information on the screen size and viewing distance of the television receiver 250, as in the generation of the stereoscopic image data described above. When stereoscopic image data for displaying a stereoscopic image is transmitted through the HDMI TMDS channel, the stereoscopic image data is processed into a state corresponding to the transmission method. Here, the stereoscopic image data is composed of left-eye image data and right-eye image data. The stereoscopic image data transmission method and the like will be described later.

  When the game machine 210 functions as a game machine, the sound processing unit 226 generates sound data for obtaining game sound corresponding to the game image, based on the game software information, in response to a user operation from the control pad 217. To do.

The operation of the game machine 210 shown in FIG. 3 will be briefly described.
An operation at the time of reproducing content such as a movie recorded on a recording medium such as a DVD will be described.

  Image data and audio data reproduced by the DVD / BD drive 219 are decoded by the MPEG decoder 227 to obtain uncompressed image and audio data. The image and audio data is supplied to the HDMI transmission unit 212, and is transmitted from the HDMI terminal 211 to the HDMI cable through the HDMI TMDS channel.

Also, the operation when functioning as a game machine will be described.
In the drawing processing unit 224, image data for displaying a game image is dynamically generated based on the game software information in accordance with a user operation from the control pad 217, and is developed in the VRAM 225. Here, when the image data to be generated is stereoscopic image data (left-eye image data, right-eye image data), the rendering processing unit 224 uses the information on the screen size and viewing distance of the television receiver 250 to generate a stereoscopic image. Image data is generated appropriately. Then, image data is read from the VRAM 225 and supplied to the HDMI transmission unit 212.

  In this case, the sound processing unit 226 generates sound data for obtaining game sound corresponding to the game image in accordance with the operation from the control pad 217 by the user based on the game software information. The audio data is supplied to the HDMI transmission unit 212. The game image and audio data supplied to the HDMI transmission unit 212 is transmitted from the HDMI terminal 211 to the HDMI cable via the HDMI TMDS channel.

  It should be noted that when the content such as a movie is reproduced, the image data obtained by the decoding process by the MPEG decoder 227 is stereoscopic image data, and the operation when the user instructs the correction process is as follows. .

  In this case, the stereoscopic image data (left-eye image data and right-eye image data) obtained by the MPEG decoder 227 is supplied to the drawing processing unit 224 via the internal bus 220. In the drawing processing unit 224, the stereoscopic image data (existing stereoscopic image data) is corrected using the screen size and viewing distance information of the television receiver 250. The stereoscopic image data corrected in this way is read out after being developed in the VRAM 225 and supplied to the HDMI transmission unit 212.

  The flow of processing for generating and correcting the above-described stereoscopic image data in the drawing processing unit 224 will be described later.

  Note that the image and audio data supplied from the rendering processing unit 224 and the audio processing unit 226 to the HDMI transmission unit 212 are packed by the HDMI transmission unit 212 and output to the HDMI terminal 211. When the image data is stereoscopic image data (left-eye image data, right-eye image data), the stereoscopic image data is processed by the drawing processing unit 224 into a state corresponding to the transmission method, and then transmitted by HDMI. Supplied to the unit 212.

[Configuration example of TV receiver]
FIG. 4 shows a configuration example of the television receiver 250. The television receiver 250 includes an HDMI terminal 251, an HDMI receiving unit 252, and a 3D signal processing unit 254. In addition, the television receiver 250 includes an antenna terminal 255, a digital tuner 256, a demultiplexer 257, an MPEG decoder 258, a video signal processing circuit 259, a graphic generation circuit 260, a panel drive circuit 261, and a display panel 262. have.

  The television receiver 250 includes an audio signal processing circuit 263, an audio amplification circuit 264, a speaker 265, an internal bus 270, a CPU 271, a flash ROM 272, and a DRAM 273. The television receiver 250 includes an Ethernet interface 274, a network terminal 275, a remote control receiving unit 276, a remote control transmitter 277, and a DTCP circuit 278.

  The antenna terminal 255 is a terminal for inputting a television broadcast signal received by a receiving antenna (not shown). The digital tuner 256 processes the television broadcast signal input to the antenna terminal 255 and outputs a predetermined transport stream corresponding to the user's selected channel. The demultiplexer 257 extracts a partial TS (Transport Stream) (a TS packet of video data and a TS packet of audio data) corresponding to the user's selected channel from the transport stream obtained by the digital tuner 256.

  Further, the demultiplexer 257 extracts PSI / SI (Program Specific Information / Service Information) from the transport stream obtained by the digital tuner 256 and outputs it to the CPU 271. A plurality of channels are multiplexed in the transport stream obtained by the digital tuner 256. The process of extracting the partial TS of an arbitrary channel from the transport stream by the demultiplexer 257 can be performed by obtaining the packet ID (PID) information of the arbitrary channel from the PSI / SI (PAT / PMT). .

  The MPEG decoder 258 obtains image data by performing decoding processing on a video PES (Packetized Elementary Stream) packet constituted by a TS packet of video data obtained by the demultiplexer 257. Also, the MPEG decoder 258 performs a decoding process on the audio PES packet configured by the TS packet of the audio data obtained by the demultiplexer 257 to obtain audio data.

  The video signal processing circuit 259 and the graphic generation circuit 260 perform scaling processing (resolution conversion processing) and graphic processing on the image data obtained by the MPEG decoder 258 or the image data received by the HDMI receiving unit 252 as necessary. Data superimposition processing is performed. Also, the video signal processing circuit 259 displays a stereoscopic image for the left eye image data and the right eye image data when the image data received by the HDMI receiving unit 252 is stereoscopic image data. Processing is performed (see FIG. 2). The panel drive circuit 261 drives the display panel 262 based on the video (image) data output from the graphic generation circuit 260.

  The display panel 262 includes, for example, an LCD (Liquid Crystal Display), a PDP (Plasma Display Panel), or the like. The audio signal processing circuit 263 performs necessary processing such as D / A conversion on the audio data obtained by the MPEG decoder 258. The audio amplifier circuit 264 amplifies the audio signal output from the audio signal processing circuit 263 and supplies the amplified audio signal to the speaker 265.

  The CPU 271 controls the operation of each unit of the television receiver 250. The flash ROM 272 stores control software and data. The DRAM 273 constitutes a work area for the CPU 271. The CPU 271 develops software and data read from the flash ROM 272 on the DRAM 273 to activate the software, and controls each unit of the television receiver 250. The DTCP circuit 278 decrypts the encrypted data supplied from the network terminal 275 to the Ethernet interface 274.

  The remote control receiving unit 276 receives the remote control signal (remote control code) transmitted from the remote control transmitter 277 and supplies it to the CPU 271. The CPU 271 controls each unit of the television receiver 250 based on the remote control code. The network terminal 275 is a terminal connected to the network, and is connected to the Ethernet interface 274. The CPU 271, flash ROM 272, DRAM 273, and Ethernet interface 274 are connected to the internal bus 270.

  The HDMI receiving unit (HDMI sink) 252 receives uncompressed image (video) and audio data supplied to the HDMI terminal 251 via the HDMI cable 350 by communication conforming to HDMI. Details of the HDMI receiving unit 252 will be described later.

  The 3D signal processing unit 254 performs processing (decoding processing) corresponding to the transmission method on the stereoscopic image data received by the HDMI receiving unit 252 to generate left eye image data and right eye image data. That is, the 3D signal processing unit 254 performs processing opposite to the drawing processing unit 224 of the game machine 210 described above, and acquires left-eye image data and right-eye image data constituting the stereoscopic image data.

The operation of the television receiver 250 shown in FIG. 4 will be briefly described.
The television broadcast signal input to the antenna terminal 255 is supplied to the digital tuner 256. The digital tuner 256 processes the television broadcast signal, outputs a predetermined transport stream corresponding to the user's selected channel, and supplies the predetermined transport stream to the demultiplexer 257. The demultiplexer 257 extracts a partial TS (video data TS packet, audio data TS packet) corresponding to the user's selected channel from the transport stream, and supplies the partial TS to the MPEG decoder 258.

  In the MPEG decoder 258, the video PES packet constituted by the TS packet of the video data is decoded to obtain video data. The video data is supplied to the panel drive circuit 261 after being subjected to scaling processing (resolution conversion processing), graphics data superimposition processing, and the like in the video signal processing circuit 259 and the graphic generation circuit 260 as necessary. The Therefore, the display panel 262 displays an image corresponding to the user's selected channel.

  Also, in the MPEG decoder 258, audio data is obtained by performing a decoding process on the audio PES packet configured by the TS packet of audio data. The audio data is subjected to necessary processing such as D / A conversion by the audio signal processing circuit 263, further amplified by the audio amplification circuit 264, and then supplied to the speaker 265. Therefore, sound corresponding to the user's selected channel is output from the speaker 265.

  The encrypted content data (image data and audio data) supplied from the network terminal 275 to the Ethernet interface 274 is decrypted by the DTCP circuit 278 and then supplied to the MPEG decoder 258. Thereafter, the operation is the same as when the above-described television broadcast signal is received, an image is displayed on the display panel 262, and sound is output from the speaker 265.

  Further, the HDMI receiving unit 252 acquires image data and audio data transmitted from the game machine 210 connected to the HDMI terminal 251 via the HDMI cable 350. The image data is supplied to the video signal processing circuit 259 via the 3D signal processing unit 254. The audio data is directly supplied to the audio signal processing circuit 263. Thereafter, the operation is the same as when the above-described television broadcast signal is received, an image is displayed on the display panel 262, and sound is output from the speaker 265.

  If the image data received by the HDMI receiving unit 252 is a stereoscopic image (3D image data), the 3D signal processing unit 254 performs processing corresponding to the transmission method (decoding processing) on the stereoscopic image data. The left eye image data and the right eye image data are generated. Then, the left eye image data and the right eye image data are supplied from the 3D signal processing unit 254 to the video signal processing unit 259. In addition, in the video signal processing circuit 259, when left-eye image data and right-eye image data constituting stereoscopic image data are supplied, a stereoscopic image (FIG. 2) is based on the left-eye image data and right-eye image data. Image data for displaying (see) is generated. Therefore, a stereoscopic image is displayed on the display panel 262.

[Configuration Example of HDMI Transmitter and HDMI Receiver]
FIG. 5 shows a configuration example of the HDMI transmission unit (HDMI source) 212 of the game machine 210 and the HDMI reception unit (HDMI sink) 252 of the television receiver 250 in the AV system 200 of FIG.

  The HDMI transmission unit 212 transmits, in a plurality of channels, a differential signal corresponding to pixel data of an uncompressed image for one screen in an effective image section (hereinafter also referred to as an active video section as appropriate) using a plurality of channels. Send in one direction. Here, the effective image section is a section obtained by removing the horizontal blanking section and the vertical blanking section from the section from one vertical synchronization signal to the next vertical synchronization signal. In addition, the HDMI transmission unit 212 receives, at a plurality of channels, a differential signal corresponding to at least audio data, control data, and other auxiliary data associated with an image in a horizontal blanking interval or a vertical blanking interval. Transmit to the unit 252 in one direction.

  The transmission channels of the HDMI system including the HDMI transmission unit 212 and the HDMI reception unit 252 include the following transmission channels. That is, three TMDS channels # 0 to ## as transmission channels for serially transmitting pixel data and audio data in one direction in synchronization with the pixel clock from the HDMI transmission unit 212 to the HDMI reception unit 252. There are two. There is also a TMDS clock channel as a transmission channel for transmitting a pixel clock.

  The HDMI transmission unit 212 includes an HDMI transmitter 81. The transmitter 81 converts, for example, pixel data of an uncompressed image into a corresponding differential signal, and is connected via the HDMI cable 350 with three TMDS channels # 0, # 1, and # 2 that are a plurality of channels. Serial transmission in one direction to the HDMI receiving unit 252.

  The transmitter 81 converts audio data accompanying uncompressed images, further necessary control data and other auxiliary data, etc. into corresponding differential signals, and converts them into three TMDS channels # 0, # 1, #. 2 is serially transmitted to the HDMI sink 252 in one direction.

  Further, the transmitter 81 transmits the pixel clock synchronized with the pixel data transmitted through the three TMDS channels # 0, # 1, and # 2 to the HDMI receiving unit 252 connected via the HDMI cable 350 using the TMDS clock channel. Send. Here, in one TMDS channel #i (i = 0, 1, 2), 10-bit pixel data is transmitted during one pixel clock.

  The HDMI receiving unit 252 receives a differential signal corresponding to the pixel data transmitted from the HDMI transmitting unit 212 in one direction through a plurality of channels in the active video section. Further, the HDMI receiving unit 252 transmits differential signals corresponding to audio data and control data transmitted in one direction from the HDMI transmitting unit 212 through a plurality of channels in a horizontal blanking interval or a vertical blanking interval. Receive.

  That is, the HDMI receiving unit 252 includes an HDMI receiver 82. This HDMI receiver 82 uses TMDS channels # 0, # 1, and # 2 to transmit a differential signal corresponding to pixel data and a difference corresponding to audio data and control data transmitted in one direction from the HDMI transmission unit 212. Receive a motion signal. In this case, reception is performed in synchronization with the pixel clock transmitted from the HDMI transmission unit 212 via the TMDS clock channel.

  In addition to the TMDS channels # 0 to # 2 and the TMDS clock channel described above, the transmission channel of the HDMI system including the HDMI transmission unit 212 and the HDMI reception unit 252 is called a DDC (Display Data Channel) 83 or a CEC line 84. There is a transmission channel. The DDC 83 includes two signal lines (not shown) included in the HDMI cable 350, and the HDMI transmission unit 212 is connected to the HDMI reception unit 252 connected via the HDMI cable 350 from the E-EDID (Enhanced Extended Display Identification Data). Used to read

  That is, the HDMI receiving unit 252 has an EDID ROM (Read Only Memory) 85 that stores E-EDID, which is performance information related to its own performance (configuration / capability), in addition to the HDMI receiver 81. . For example, in response to a request from the CPU 221 (see FIG. 3), the HDMI transmission unit 212 sends the E-EDID of the HDMI reception unit 252 from the HDMI reception unit 252 connected via the HDMI cable 350 to the DDC 83. Read through. The HDMI transmission unit 212 sends the read E-EDID to the CPU 221. The CPU 221 uses this E-EDID. The data is stored in the flash ROM 222 or the DRAM 223.

  The CPU 221 can recognize the performance setting of the HDMI receiving unit 252 based on the E-EDID. For example, the CPU 221 recognizes the format (resolution, frame rate, aspect, etc.) of image data that can be supported by the television receiver 250 having the HDMI receiving unit 252. In this embodiment, the CPU 221 recognizes the size (screen size) of the actual image display area of the television receiver 250 having the HDMI receiving unit 252 based on information on the screen size described later included in the E-EDID. To do.

  The CEC line 84 includes one signal line (not shown) included in the HDMI cable 350, and is used to perform bidirectional communication of control data between the HDMI transmission unit 212 and the HDMI reception unit 252. The CEC line 84 constitutes a control data line.

  The HDMI cable 350 includes a line (HPD line) 86 connected to a pin called HPD (Hot Plug Detect). The source device can detect the connection of the sink device using the line 86. Also, the HDMI cable 350 includes a line 87 used for supplying power from the source device to the sink device. Further, the HDMI cable 350 includes a reserved line 88.

  FIG. 6 shows a configuration example of the HDMI transmitter 81 and the HDMI receiver 82 of FIG.

  The HDMI transmitter 81 has three encoder / serializers 81A, 81B, and 81C corresponding to the three TMDS channels # 0, # 1, and # 2, respectively. Each of the encoders / serializers 81A, 81B, and 81C encodes the image data, auxiliary data, and control data supplied thereto, converts the parallel data into serial data, and transmits the data by a differential signal. Here, when the image data has, for example, three components R, G, and B, the B component is supplied to the encoder / serializer 81A, the G component is supplied to the encoder / serializer 81B, and the R component is supplied to the encoder / serializer 81C. Supplied.

  The auxiliary data includes, for example, audio data and control packets. The control packets are supplied to, for example, the encoder / serializer 81A, and the audio data is supplied to the encoder / serializers 81B and 81C. Further, the control data includes a 1-bit vertical synchronization signal (VSYNC), a 1-bit horizontal synchronization signal (HSYNC), and 1-bit control bits CTL0, CTL1, CTL2, and CTL3. The vertical synchronization signal and the horizontal synchronization signal are supplied to the encoder / serializer 81A. The control bits CTL0 and CTL1 are supplied to the encoder / serializer 81B, and the control bits CTL2 and CTL3 are supplied to the encoder / serializer 81C.

  The encoder / serializer 81A transmits the B component of the image data, the vertical synchronization signal and the horizontal synchronization signal, and auxiliary data supplied thereto in a time division manner. That is, the encoder / serializer 81A converts the B component of the image data supplied thereto into 8-bit parallel data that is a fixed number of bits. Further, the encoder / serializer 81A encodes the parallel data, converts it into serial data, and transmits it through the TMDS channel # 0.

  The encoder / serializer 81A encodes the 2-bit parallel data of the vertical synchronization signal and horizontal synchronization signal supplied thereto, converts the data into serial data, and transmits the serial data through the TMDS channel # 0. Furthermore, the encoder / serializer 81A converts the auxiliary data supplied thereto into parallel data in units of 4 bits. Then, the encoder / serializer 81A encodes the parallel data, converts it into serial data, and transmits it through the TMDS channel # 0.

  The encoder / serializer 81B transmits the G component of the image data, control bits CTL0 and CTL1, and auxiliary data supplied thereto in a time division manner. That is, the encoder / serializer 81B sets the G component of the image data supplied thereto as parallel data in units of 8 bits, which is a fixed number of bits. Further, the encoder / serializer 81B encodes the parallel data, converts it into serial data, and transmits it through the TMDS channel # 1.

  The encoder / serializer 81B encodes the 2-bit parallel data of the control bits CTL0 and CTL1 supplied thereto, converts the data into serial data, and transmits the serial data through the TMDS channel # 1. Furthermore, the encoder / serializer 81B converts the auxiliary data supplied thereto into parallel data in units of 4 bits. Then, the encoder / serializer 81B encodes the parallel data, converts it into serial data, and transmits it through the TMDS channel # 1.

  The encoder / serializer 81C transmits the R component of the image data, control bits CTL2 and CTL3, and auxiliary data supplied thereto in a time division manner. That is, the encoder / serializer 81C sets the R component of the image data supplied thereto as parallel data in units of 8 bits, which is a fixed number of bits. Further, the encoder / serializer 81C encodes the parallel data, converts it into serial data, and transmits it through the TMDS channel # 2.

  The encoder / serializer 81C encodes 2-bit parallel data of the control bits CTL2 and CTL3 supplied thereto, converts the data into serial data, and transmits the serial data through the TMDS channel # 2. Furthermore, the encoder / serializer 81C converts the auxiliary data supplied thereto into parallel data in units of 4 bits. Then, the encoder / serializer 81C encodes the parallel data, converts it into serial data, and transmits it through the TMDS channel # 2.

  The HDMI receiver 82 has three recovery / decoders 82A, 82B, and 82C corresponding to the three TMDS channels # 0, # 1, and # 2, respectively. Then, each of the recovery / decoders 82A, 82B, and 82C receives image data, auxiliary data, and control data transmitted as differential signals through the TMDS channels # 0, # 1, and # 2. Further, each of the recovery / decoders 82A, 82B, and 82C converts the image data, auxiliary data, and control data from serial data to parallel data, and further decodes and outputs them.

  That is, the recovery / decoder 82A receives the B component of the image data, the vertical synchronization signal, the horizontal synchronization signal, and the auxiliary data that are transmitted as differential signals through the TMDS channel # 0. Then, the recovery / decoder 82A converts the B component of the image data, the vertical synchronization signal, the horizontal synchronization signal, and the auxiliary data from serial data to parallel data, and decodes and outputs them.

  The recovery / decoder 82B receives the G component of the image data, the control bits CTL0 and CTL1, and the auxiliary data transmitted by the differential signal through the TMDS channel # 1. Then, the recovery / decoder 82B converts the G component of the image data, the control bits CTL0 and CTL1, and the auxiliary data from serial data to parallel data, and decodes and outputs them.

  The recovery / decoder 82C receives the R component of the image data, the control bits CTL2 and CTL3, and the auxiliary data transmitted by the differential signal through the TMDS channel # 2. Then, the recovery / decoder 82C converts the R component of the image data, the control bits CTL2 and CTL3, and the auxiliary data from serial data to parallel data, and decodes and outputs them.

  FIG. 7 shows an example of the structure of TMDS transmission data. FIG. 7 shows sections of various transmission data when image data of horizontal × vertical 1920 pixels × 1080 lines is transmitted in TMDS channels # 0, # 1, and # 2.

  A video field (Video Field) in which transmission data is transmitted through the three TMDS channels # 0, # 1, and # 2 of HDMI has three types of sections according to the type of transmission data. These three types of sections are a video data period, a data island period, and a control period.

  Here, the video field period is a period from the rising edge (active edge) of a certain vertical synchronizing signal to the rising edge of the next vertical synchronizing signal. The video field period is divided into a horizontal blanking period (horizontal blanking), a vertical blanking period (vertical blanking), and an active video period (Active Video). This active video section is a section obtained by removing the horizontal blanking period and the vertical blanking period from the video field section.

  The video data section is assigned to the active video section. In this video data section, 1920 pixel (pixel) × 1080 line effective pixel (Active pixel) data constituting uncompressed image data for one screen is transmitted.

  The data island period and the control period are assigned to the horizontal blanking period and the vertical blanking period. In the data island section and the control section, auxiliary data (Auxiliary data) is transmitted. That is, the data island period is assigned to a part of the horizontal blanking period and the vertical blanking period. In this data island period, for example, audio data packets, which are data not related to control, of auxiliary data are transmitted.

  The control period is allocated to other parts of the horizontal blanking period and the vertical blanking period. In this control period, for example, vertical synchronization signals, horizontal synchronization signals, control packets, and the like, which are data related to control, of auxiliary data are transmitted.

  FIG. 8 shows an example of the pin arrangement of the HDMI terminals 211 and 251. The pin arrangement shown in FIG. 8 is called type A (type-A).

  Two lines, which are differential lines through which TMDS Data # i + and TMDS Data # i−, which are differential signals of TMDS channel #i, are transmitted are pins to which TMDS Data # i + is assigned (the pin number is 1). , 4, 7) and pins assigned with TMDS Data # i− (pin numbers 3, 6, 9).

  A CEC line 84 through which a CEC signal as control data is transmitted is connected to a pin having a pin number of 13, and a pin having a pin number of 14 is a reserved pin. A line through which an SDA (Serial Data) signal such as E-EDID is transmitted is connected to a pin having a pin number of 16 and is an SCL (Serial Clock) which is a clock signal used for synchronization when transmitting and receiving the SDA signal. A line through which a signal is transmitted is connected to a pin having a pin number of 15. The above-described DDC 83 includes a line for transmitting the SDA signal and a line for transmitting the SCL signal.

  Further, as described above, the HPD line 86 for detecting the connection of the sink device by the source device is connected to the pin having the pin number 19. Further, as described above, the line 87 for supplying power is connected to a pin having a pin number of 18.

[Example of transmission method of stereoscopic image data]
As transmission methods for stereoscopic image data (3D image data), the following first to third transmission methods are listed, but other transmission methods may be used. Here, as shown in FIG. 9, an example will be described in which the image data of the left eye (L) and the right eye (R) is image data of a pixel format of 1920 × 1080p, respectively.

  As shown in FIG. 10A, the first transmission method is a method in which left-eye image data and right-eye image data are sequentially switched and transmitted for each field. In this case, a field memory is required for the switching process, but signal processing at the source device is the simplest. FIG. 11 shows an example of TMDS transmission data in the first transmission method. In this case, left-eye (L) image data of effective pixels (active pixels) corresponding to 1920 pixels × 1080 lines is arranged in an active video section of 1920 pixels × 1080 lines in an odd field. Also, right-eye (R) image data of effective pixels (active pixels) for 1920 pixels × 1080 lines is arranged in an active video section of 1920 pixels × 1080 lines in the even field.

  As shown in FIG. 10B, the second transmission method is a method of alternately transmitting one line of left eye image data and one line of right eye image data. In this case, the left eye image data and the right eye image data are each thinned by half. This method is a video signal itself of a stereoscopic image display method called the “phase difference plate method” described above, and is the simplest method for signal processing on the display unit of the sink device, but is perpendicular to the original signal. The resolution is halved.

  FIG. 12 shows an example of TMDS transmission data of the second transmission method. In this case, 1920 pixel × 1080 line active video section, 1920 pixel × 1080 line effective pixel (active pixel) data (the synthesis of left eye (L) image data and right eye (R) image data). Data) is arranged. In the case of the second transmission method, as described above, the left-eye image data and the right-eye image data are each thinned by 1/2 in the vertical direction. Here, the left eye image data to be transmitted is either an odd line or an even line, and similarly, the right eye image data to be transmitted is either an odd line or an even line.

  The third transmission method is a “Side By Side” method that is currently used in experimental broadcasting. As shown in FIG. 10C, pixel data of left-eye image data is transmitted in the first half of the horizontal direction, and horizontal In the latter half of the direction, the pixel data of the right eye image data is transmitted. In this case, in the left eye image data and the right eye image data, the pixel data in the horizontal direction is thinned out to 1/2. This third transmission method is compatible even with a source device that does not support stereoscopic image data if it is output as existing 2D image data, and is highly compatible with conventional source devices.

  FIG. 13 shows an example of TMDS transmission data of the third transmission method. In this case, 1920 pixel × 1080 line active video section, 1920 pixel × 1080 line effective pixel (active pixel) data (the synthesis of left eye (L) image data and right eye (R) image data). Data) is arranged. In the case of the third transmission method, as described above, the left-eye image data and the right-eye image data are each decimated by half of the horizontal pixel data.

[Screen size information]
In the game machine 210 of the AV system 200 shown in FIG. 1, when generating stereoscopic image data for displaying a game image or correcting existing stereoscopic image data of content such as a movie, the television receiver 250 Use screen size information.

  In this embodiment, the game machine 210 acquires information on the screen size from the television receiver 250 and obtains screen size information from this information. The game machine 210 acquires E-EDID (Enhanced Extended Display Identification Data) from the television receiver 250 to obtain information regarding the screen size. In other words, the television receiver 250 supplies the information to the game machine 210 by including information about the screen size in the E-EDID.

  The E-EDID includes information on the format (resolution, frame rate, aspect, etc.) of image data handled by the television receiver 250. The game machine 210 acquires information on the format (resolution, frame rate, aspect, etc.) of image data that can be supported by the television receiver 250 from the E-EDID. Then, the game machine 210 sets the format of the image data sent to the television receiver 250 to a format that can be supported by the television receiver 250.

[Information on screen size]
Here, as shown in FIG. 14, the screen size is the width, height, diagonal length, etc. of the area (display area) where the left eye image and the right eye image are actually displayed. As information on the screen size, for example, the following (1) to (3) are conceivable.

  (1) In the case of a television receiver using a display panel such as an LCD (Liquid Crystal Display) or a PDP (Plasma Display Panel), information on the effective display size of the panel is used. This information is a fixed value for each television receiver. In this case, the Source device generates a 3D video on the assumption that the video to be output is displayed on the entire display panel.

(2) 16: 9 Full HD (1920x1080) When a dot image is displayed in full, the size information of the area where the image is actually displayed is used. This information is a fixed value for each television receiver.
Also in this case, as in (1), the Source device generates a 3D video on the assumption that the video to be output is displayed on the entire display panel.

  (3) When each display resolution and aspect (1920x1080 / 16: 9, NTSC: 720x480 / 4: 3, etc.) is displayed, it is used as size information of the area where the actual video is displayed. This information is a variable value for each resolution and aspect.

  In these cases (1) to (3), the values representing the width, height, and diagonal length of the area in centimeter (cm) units, inch (inch) units, etc. It becomes. In this case, the information regarding the screen size directly represents the screen size.

  In addition, for example, a value such as the number of dots corresponding to 10 cm such that the size of the above-described areas (1) to (3) can be obtained indirectly may be used as information regarding the screen size.

  Further, as in the case of (3) above, when the information about the screen size depends on the resolution and aspect, the screen size of each resolution and aspect that can be handled by the television receiver 250 from the television receiver 250 to the game machine 210. A list of information about may be provided. Also, as in the case of (3) above, when the information about the screen size depends on the resolution and aspect, the resolution and aspect information to be displayed on the television receiver 250 from the game machine 210 is obtained using the CEC control data line. The information regarding the screen size corresponding to the resolution and aspect may be sent from the television receiver 250 to the game machine 210.

  For example, in the television receiver 250, when an image of 16: 9 Full HD (1920x1080 dots) is displayed in full on the above-mentioned E-EDID as information on the screen size, the area where the image is actually displayed (actual size) ) Diagonal length may be set. In this case, for example, it is set in inch units as follows. The reason why the size is set in inches is that the screen size of the television receiver (TV) is often designed to the inch size.

For 32 ”TV: 32inch
For 40 ”TV: 40inch
For 52 ”TV: 52inch
For a 200 ”projector: 200inch

  Further, for example, in the television receiver 250, an area where an image is actually displayed when a 16: 9 Full HD (1920x1080 dots) image is fully displayed as information on the screen size in the above-described E-EDID. A width of (actual size) may be set. In this case, for example, it is set in units of cm (or units of 0.25 cm or mm) as follows.

For 32 ”TV: 71cm
For 40 ”TV: 88cm
For 52 ”TV: 115cm
For a 200 ”projector: 442cm

  If the size of the display area is larger than a certain level, a value that means “sufficiently large” may be set in the above-mentioned E-EDID as information on the screen size. Therefore, for example, when the actual display area size is not known by the projector, a value (for example, 255) that means “sufficiently large” may be set.

[Configuration of E-EDID]
FIG. 15 shows an example of the data structure of E-EDID. This E-EDID is composed of a basic block and an extended block. At the head of the basic block, data defined by the E-EDID 1.3 standard represented by “E-EDID 1.3 Basic Structure” is arranged, and then the conventional EDID represented by “Preferred timing” and Timing information for maintaining the compatibility of the EDID and timing information different from “Preferred timing” for maintaining the compatibility with the conventional EDID represented by “2nd timing” are arranged.

  The basic block includes information indicating the name of the display device represented by “Monitor NAME” following “2nd timing”, and aspect ratios represented by “Monitor Range Limits” of 4: 3 and 16 : Information indicating the number of displayable pixels in the case of 9 is arranged in order.

  At the beginning of the extended block, information such as displayable image size (resolution), frame rate, interlaced or progressive information, aspect ratio, etc., represented by “Short Video Descriptor” are described. Data, data describing information such as reproducible audio codec system, sampling frequency, cutoff band, codec bit number, etc., represented by “Short Audio Descriptor”, and left and right speakers represented by “Speaker Allocation” Information about is arranged in order.

  In addition, the extension block maintains compatibility with the conventional EDID represented by “3rd timing”, the data defined uniquely for each manufacturer represented by “Vender Specific” following “Speaker Allocation”. Timing information for maintaining compatibility with the conventional EDID represented by “4th timing” is arranged.

  FIG. 16 shows an example of video data in the Short Video Descriptor area. Among the video signal formats defined by CEA-861-D, there are formats that can be displayed by the receiving apparatus (in this embodiment, the television receiver 250) from Byte # 1 to Byte # L in the Short Video Descriptor area. , Resolution, frame rate, and aspect (aspect ratio).

  FIG. 17 shows an example of the data structure of the Vender Specific area (HDMI Vendor Specific Data Block). In the Vender Specific area, a 0th block to an Nth block which are 1-byte blocks are provided.

  In the 0th block arranged at the head of the data represented by “Vender Specific”, a header indicating a data area of data “Vender Specific” (“Vender-Specific tag code (= 3)”) and “Vendor Specific” Information indicating the length of the data “Vender Specific” represented by “Length (= N)” is arranged.

  In the first to third blocks, information indicating the number “0x000C03” registered for HDMI (R) represented by “24-bit IEEE Registration Identifier (0x000C03) LSB first” is arranged. Further, in the fourth block and the fifth block, information indicating the physical address of the 24-bit sink device represented by “A”, “B”, “C”, and “D” is arranged.

  The sixth block is represented by a flag indicating a function supported by the sink device represented by “Supports-AI”, “DC-48 bit”, “DC-36 bit”, and “DC-30 bit”. Each of the information specifying the number of bits per pixel, a flag indicating whether the sink device supports transmission of a YCbCr4: 4: 4 image, represented by “DC-Y444”, and “DVI-Dual A flag indicating whether the sink device corresponds to dual DVI (Digital Visual Interface) is arranged.

  In the seventh block, information indicating the maximum frequency of the TMDS pixel clock represented by “Max-TMDS-Clock” is arranged. Furthermore, a flag indicating the presence or absence of video and audio delay information represented by “Latency” is arranged in the sixth and seventh bits of the eighth block.

  In addition, in the ninth block, the delay time data of the progressive video represented by “Video Latency” is arranged, and in the tenth block, the audio accompanying the progressive video represented by “Audio Latency”. The delay time data is arranged. Furthermore, in the eleventh block, delay time data of an interlaced video represented by “Interlaced Video Latency” is arranged, and in the twelfth block, an interlaced video represented by “Interlaced Audio Latency” is attached. Audio delay time data is arranged.

  In this embodiment, a flag indicating the presence / absence of information relating to the screen size is arranged in the fifth bit of the eighth block. This flag is set to “1”, and the information regarding the screen size described above is arranged in the thirteenth block.

[Output of stereoscopic image data]
When sending the stereoscopic image data to the television receiver 250, the game machine 210 outputs the stereoscopic image data that matches the screen size obtained from the information about the screen size acquired from the television receiver 250 as described above. Send.

  As described above, the game machine 210 dynamically generates and outputs stereoscopic image data based on screen size information when a game image is displayed. As the stereoscopic image data, stereoscopic image data (left-eye image data, right-eye image data) can be generated with completely correct parallax by using viewing distance information in addition to screen size information. The viewing distance is the distance from the viewer to the screen.

  As described above, the game machine 210 can obtain the screen size information from the information about the screen size obtained from the television receiver 250, and can automatically obtain the information without any user setting. In addition, when the information regarding the screen size acquired from the television receiver 250 is a value that means “sufficiently large” as described above, the screen size (horizontal width, height) is set in advance. Use a large value.

  The game machine 210 cannot automatically acquire the viewing distance information and needs to be manually set by the user. In this embodiment, the game machine 210 is obtained based on the screen size of the television receiver 250. A viewing distance adjustment unit having the recommended viewing distance as a default value. The recommended viewing distance of the television receiver is, for example, 2 to 3 times the vertical size. For example, the user operates the control pad 217 to adjust the viewing distance as the viewing distance adjustment mode. In this case, for example, a GUI screen for viewing distance adjustment is displayed on the display panel 262 of the television receiver 250, and the user adjusts (sets) the viewing distance using this GUI screen.

  The game machine 210 uses the default value as it is when the user does not adjust the viewing distance. As described above, the default value may be used as it is, or only the user who wants to adjust the value to the optimum value manually performs the setting so that the burden of the user setting can be reduced. Further, since the default value is an appropriate value as such, the viewing distance can be easily adjusted to a better value than when the user newly sets the viewing distance from scratch.

A flow of generating and outputting stereoscopic image data (3D CG) of a game image will be briefly described.
When generating stereoscopic image data, as shown in FIG. 18, a 2D image (left eye image, right eye image) is modeled in 3D (3D) space and projected onto a 2D (2D) screen. Is generated. In the modeling example of FIG. 18, a rectangular parallelepiped object Oa and a cylindrical object Ob are arranged at the back of the screen surface. In this case, as shown in FIG. 19, by using the screen size and the viewing distance as parameters, it is possible to generate a 2D image (left eye image, right eye image) having an accurate parallax.

  The flowchart in FIG. 20 schematically shows the flow of processing for generating and outputting stereoscopic image data in the game machine 210. First, the game machine 210 performs an initialization process in step ST1. In this case, the game machine 210 performs various initialization processes including initialization of various libraries and memories, setting of a VRAM (frame buffer) 225, output setting, and the like.

  Next, the game machine 210 performs a modeling process in step ST2. In this modeling process, the drawing processing unit 224 calculates each vertex data to be drawn in each drawing frame. In this case, a model of each object is constructed. Then, data of each vertex to be drawn is calculated on the “model coordinate system” (“local coordinate system”) for each object. Then, each object to be drawn is arranged in the space of the “world coordinate system”. That is, the vertex data of each object to be drawn calculated on the “model coordinate system” is arranged on the “world coordinate system”.

  Next, in step ST3, the game machine 210 performs viewpoint / light source setting processing, and in step ST4, rendering is performed to generate left and right image data. When generating stereoscopic image data, the setting of this viewpoint is important. In this case, the drawing processing unit 224 performs viewpoint / light source setting and rendering for the left eye image to generate left eye image data, and then performs viewpoint / light source setting and rendering for the right eye image. Right eye image data is generated.

  In the viewpoint / light source setting process, the viewpoint position / direction is set. In the “world coordinate system” where each object to be drawn is placed, the viewpoint, gazing point, upward vector (specify which direction is the upward direction of the camera to determine the orientation of the viewpoint), the angle of view of the camera, Set the camera aspect. In this case, the coordinates of the viewpoints for the left eye and the right eye are determined by separating only the senses of both eyes. Specify the same point for the left eye and the right eye. The upward direction vector specifies the same direction for the left eye and for the right eye so that the left eye and the right eye are aligned horizontally.

  As for the angle of view (viewing angle) of the camera, the angle of view obtained from the screen size and viewing distance of the television receiver 250 is designated. In this case, the height and width as the screen size are obtained based on the information regarding the screen size acquired from the television receiver 250. As the viewing distance, a value set by the user or a recommended viewing distance based on the screen size (for example, 2 to 3 times the height of the screen) is used.

  When a vertical field angle is specified as the camera field angle, the field angle in the actual viewing environment can be obtained from the screen size height and viewing distance. When a horizontal angle of view is designated as the angle of view of the camera, the angle of view in the actual viewing environment can be obtained from the horizontal width of the screen size and the viewing distance. The camera aspect specifies the aspect of the image to be output. For example, to output in Full HD (1920x1080 16: 9), specify 16: 9.

FIG. 21 is a reference diagram of the first calculation method of the angle of view and the aspect of the camera. This first calculation method can be applied when the screen size is sufficiently larger than the distance between both eyes. The calculated value in this case is an approximate value. In this case, the angle of view is obtained by equation (1), and the aspect is obtained by equation (2).
[Angle of view] = atan (([Screen size] / 2) / [Viewing distance]) x 2 (1)
[Aspect] = [Aspect of output video] (2)

  FIG. 22 is a reference diagram of the second calculation method of the angle of view and aspect of the camera. In the second calculation method, the angle of view and the aspect can be obtained with more accurate values. In this case, the angle of view 1 is obtained by the equation (3), and the angle of view 2 is obtained by the equation (4). Then, the angle of view is obtained by the expression (5) as an added value of the angle of view 1 and the angle of view 2.

[Angle of view 1] = atan (([screen size] / 2-[distance between both eyes] / 2) / [viewing distance])
... (3)
[Angle of view 2] = atan (([screen size] / 2 + [distance between both eyes] / 2) / [viewing distance])
... (4) [Field angle] = [Field angle 1] + [Field angle 2]
= Atan (([Screen size] / 2-[B between eyes] / 2) / [View distance])
+ Atan (([screen size] / 2 + [distance between both eyes] / 2) / [viewing distance])
... (5)

When the aspect of the camera to be designated is [horizontal] / [vertical], the aspect (horizontal / vertical) can be obtained by equation (6).
[Aspect (Horizontal / Vertical)]
= Cos ([angle of view] / 2? [Angle of view 1]) * [Aspect of output video (horizontal / vertical)]
= Cos (atan (([screen size] / 2 + [distance between both eyes] / 2) / [viewing distance])
− Atan (([Screen size] / 2-[Binocular distance] / 2) / [View distance]))
* [Aspect of output video (horizontal / vertical)]
... (6)

  When the aspect of the camera to be specified is [vertical] / [horizontal], the aspect (vertical / horizontal) is the reciprocal of equation (6).

  In the rendering process, texture mapping, depth test, alpha test, stencil test, blending, various effect processes, etc. are performed, and left eye image data and right eye image data corresponding to the final image to be displayed are generated and expanded in the VRAM 225. (draw.

  Next, in step ST5, the game machine 210 reads the left eye image data and right eye image data developed (drawn) in the VRAM 225 (frame buffer), and transmits them from the HDMI transmission unit 212 to the television receiver 250. At this time, the arrangement and size of the left eye image data and the right eye image data are converted in accordance with the standard of the image data for output as necessary, and then supplied to the HDMI transmission unit 212 and transmitted.

  Further, as described above, when the game machine 210 reproduces content such as a movie and the reproduced image data is stereoscopic image data, and the user instructs correction processing, the stereoscopic image data is generated based on the screen size information. The image data is corrected and output. As described above, when video content is corrected and played back, a video playback device such as a Blu-ray Disc Player may be used in addition to the game machine.

  The drawing processing unit 224 of the game machine 210 detects depth information from the reproduced stereoscopic image data (left-eye image data, right-eye image data) and performs correction processing. In this case, the drawing processing unit 224 analyzes the left eye image data and the right eye image data constituting the reproduced stereoscopic image data, extracts feature points, and detects a correlation between the left eye image and the right eye image. In depth information can be estimated. Then, after inferring the depth information, the drawing processing unit 224 corrects the left eye image data and the right eye image data based on the screen size and viewing distance of the television receiver 250.

  The flow of correction and output processing of stereoscopic image data in the game machine 210 will be described. The drawing processing unit 224 first estimates depth information. The left eye (L) image data and right eye (R) image data constituting the reproduced stereoscopic image data are analyzed, and a correlation between the L and R images is obtained. It may be assumed that the L and R images taken for displaying the stereoscopic image have the same upward vector in the camera.

  Therefore, as shown in FIG. 23, for the L and R images, the correlation between the L and R images may be obtained in units of horizontal lines. In this case, the correlation can be obtained using brightness / color information, image information after applying a filter (edge detection) such as differentiation to the brightness / color, and the like for each region / point of the image. It is possible to obtain a left-right shift. Furthermore, if information such as the distance between the two lenses and the lens angle can be used as the shooting conditions for the camera, the accuracy can be determined from the camera position / angle information and the left / right deviation information of each area / point The depth information of each region and each point can be estimated high.

  In the case shown in FIG. 24, for the cylindrical object (object), the left and right lines of sight intersect before the screen surface. Therefore, it turns out that this cylinder exists in front of the reference plane (screen surface). In this case, the depth can be calculated by calculation. In addition, for a rectangular parallelepiped object (object), the left and right line of sight intersect on the screen surface. Therefore, it can be seen that the rectangular parallelepiped exists at the position of the reference plane (screen plane).

  The depth information of this image can be expressed as shown in FIG. That is, the cylinder exists in front of the reference plane, and the rectangular parallelepiped exists at the position of the reference plane. Further, it can be assumed that the position of the object is between the left and right regions.

  Next, the drawing processing unit 224 corrects the L and R image data in the same manner as the processing flow described in the above-described example of generating a game image. In this case, the drawing processing unit 224 sets the position and depth information of the object obtained by estimation in the modeling process, and thereafter performs the processing of viewpoint / light source setting, rendering, and video output of the above-described game image. The same as in the generation example. Thus, the L and R image data of the reproduced stereoscopic image data, which is the existing stereoscopic image data, is corrected according to the screen size and viewing distance of the television receiver 250 and transmitted from the HDMI transmission unit 212 to the television receiver 250. it can.

  FIG. 26 schematically shows a sequence for transmitting stereoscopic image data (left-eye image data and right-eye image data) for displaying a stereoscopic image from the game machine 210 to the television receiver 250. Prior to transmission of the stereoscopic image data, the game device 210 reads and acquires E-EDID (see FIGS. 15 to 17) from the television receiver 250.

  The game machine 210 obtains the format information of the image data that can be supported by the television receiver 250 included in the E-EDID, the screen size information of the television receiver 250, etc., sets the output resolution, and the stereoscopic image data The image generation parameters such as the screen size and the viewing distance for generating or correcting the image are set.

  Thereafter, the game machine 210 generates or corrects stereoscopic image data with the set parameters and transmits the stereoscopic image data to the television receiver 250. The television receiver 250 receives stereoscopic image data sent from the game machine 210 and displays a stereoscopic image.

  As described above, in the AV system 200 shown in FIG. 1, the game machine 210 acquires information related to the screen size from the television receiver 250. In the game machine 210, stereoscopic image data matching the screen size is generated, or existing stereoscopic image data is corrected according to the screen size. Then, the generated or corrected stereoscopic image data is transmitted from the game machine 210 to the television receiver 250. Further, the television receiver 250 displays a left eye image and a right eye image that present a stereoscopic image, based on the stereoscopic image data that matches the screen size sent from the game machine 210. Therefore, it is possible to display a stereoscopic image that matches the screen size without increasing the user's effort.

  In the AV system 200 shown in FIG. 1, the game machine 210 uses information on the screen size and viewing distance when generating or correcting stereoscopic image data. In the game machine 210, when the viewing distance of the user is not set (adjusted), the recommended viewing distance obtained based on the screen size is used as the viewing distance. Accordingly, stereoscopic image data can be generated or corrected without user setting, and the user's effort is reduced.

  In the AV system 200 shown in FIG. 1, in the game machine 210, the recommended viewing distance obtained based on the screen size is set as a default value for user setting (adjustment). Therefore, the user can start the adjustment of the viewing distance from a value close to the optimum value, so that the viewing distance can be adjusted efficiently.

<2. Modification>
In the above embodiment, the AV system 200 in which the game machine 210 and the television receiver 250 are directly connected by the HDMI cable 350 is shown. However, a configuration in which an AV amplifier, an image conversion device, or the like, which is a repeater device, is connected between a 3D video playback device such as a game machine 210 or a Blu-ray Disc Player and a television receiver 250 is also conceivable.

  FIG. 27 shows a configuration example of an AV system 200A in which an AV amplifier 300 is connected between a disc player 400 and a television receiver 250. The television receiver 250 is the same as the television receiver 250 in the AV system 200 of FIG. The AV system 200A includes a disc player 400 as a source device, an AV amplifier 300 as a repeater device, and a television receiver 250 as a sink device.

  The disc player 400 and the AV amplifier 300 are connected via an HDMI cable 351. The disc player 400 is provided with an HDMI terminal 401 to which an HDMI transmission unit (HDMI TX) 402 is connected. The AV amplifier 300 is provided with an HDMI terminal 301a to which an HDMI receiving unit (HDMITX) 302a is connected. One end of the HDMI cable 351 is connected to the HDMI terminal 401 of the disc player 400, and the other end of the HDMI cable 351 is connected to the HDMI terminal 301 a of the AV amplifier 300.

  The AV amplifier 300 and the television receiver 250 are connected via an HDMI cable 352. The AV amplifier 300 is provided with an HDMI terminal 301b to which an HDMI transmission unit (HDMI TX) 302b is connected. One end of the HDMI cable 352 is connected to the HDMI terminal 301 b of the AV amplifier 300, and the other end of the HDMI cable 352 is connected to the HDMI terminal 251 of the television receiver 250.

[Configuration example of disc player]
FIG. 28 shows a configuration example of the disc player 400. The disc player 400 includes an HDMI terminal 401, an HDMI transmission unit 402, a drive interface 403, and a BD / DVD drive 404. The disc player 400 includes a demultiplexer 405, an MPEG decoder 406, a video signal processing circuit 407, an audio decoder 408, and an audio signal processing circuit 409.

  The disc player 400 includes an internal bus 410, a CPU 411, a flash ROM 412, and a DRAM 413. The disc player 400 includes an Ethernet interface (Ethernet I / F) 414, a network terminal 415, a remote control receiver 416, and a remote control transmitter 417. “Ethernet” and “Ethernet” are registered trademarks. The CPU 411, flash ROM 412, DRAM 413, Ethernet interface 414, and drive interface 403 are connected to the internal bus 410.

  The CPU 411 controls the operation of each unit of the disc player 400. The flash ROM 412 stores control software and data. The DRAM 413 constitutes a work area for the CPU 411. The CPU 411 develops software and data read from the flash ROM 412 on the DRAM 413 to activate the software, and controls each unit of the disc player 400. The remote control receiving unit 416 receives a remote control signal (remote control code) transmitted from the remote control transmitter 417 and supplies it to the CPU 411. The CPU 411 controls each part of the disc player 400 according to the remote control code.

  The BD / DVD drive 404 records content data on a BD or DVD (not shown) as a disc-shaped recording medium, or reproduces content data from the BD or DVD. The BD / DVD drive 404 is connected to the internal bus 410 via the drive interface 403.

  The demultiplexer 405 separates elementary streams such as video and audio from the reproduction data of the BD / DVD drive 404. The MPEG decoder 406 decodes the video elementary stream separated by the demultiplexer 405 to obtain uncompressed image data.

  The video signal processing circuit 407 performs scaling processing (resolution conversion processing), graphics data superimposition processing, and the like on the image data obtained by the MPEG decoder 406 as necessary, and supplies the result to the HDMI transmission unit 402. . Further, the video signal processing circuit 407, when the image data obtained by the MPEG decoder 406 is stereoscopic image data (left-eye image data, right-eye image data) for displaying a stereoscopic image, the above-described game machine 210. Similarly to the drawing processing unit 224, the stereoscopic image data is processed into a state corresponding to the transmission method.

  Further, when the image data obtained by the MPEG decoder 406 is stereoscopic image data (left-eye image data, right-eye image data) for displaying a stereoscopic image, the video signal processing circuit 407 responds to a user instruction. The stereo image data is corrected. This stereoscopic image data correction is performed using information about the screen size and viewing distance of the television receiver 250, as in the drawing processing unit 224 of the game machine 210 described above.

  The audio decoder 408 decodes the audio elementary stream separated by the demultiplexer 405 to obtain uncompressed audio data. The audio signal processing circuit 409 performs sound quality adjustment processing on the audio data obtained by the audio decoder 408 as necessary, and supplies the result to the HDMI transmission unit 402.

  The HDMI transmission unit 402 transmits baseband image (video) and audio data from the HDMI terminal 401 by communication conforming to HDMI. The HDMI transmission unit 402 is configured in the same manner as the HDMI transmission unit 212 of the game machine 210 described above.

An operation at the time of reproducing contents such as a movie in the disc player 400 shown in FIG. 28 will be described.
The reproduction data of the DVD / BD drive 219 is supplied to the demultiplexer 405 and separated into elementary streams such as video and audio. The elementary stream of video separated by the demultiplexer 405 is supplied to the MPEG decoder 406 and decoded to obtain uncompressed image data. The audio elementary stream separated by the demultiplexer 405 is supplied to the audio decoder 408 and decoded to obtain uncompressed audio data.

  Image data obtained by the MPEG decoder 406 is supplied to the HDMI transmission unit 402 via the video signal processing circuit 407. The audio data obtained by the audio decoder 408 is supplied to the HDMI transmission unit 402 via the audio signal processing circuit 409. These image and audio data are transmitted from the HDMI terminal 401 to the HDMI cable via the HDMI TMDS channel.

  Note that image and audio data supplied from the video signal processing circuit 407 and the audio signal processing circuit 409 to the HDMI transmission unit 402 are packed by the HDMI transmission unit 4022 and output to the HDMI terminal 401. When the image data is stereoscopic image data (left-eye image data, right-eye image data), the stereoscopic image data is processed by the video signal processing circuit 407 into a state corresponding to the transmission method, and then HDMI. It is supplied to the transmission unit 402.

[Configuration example of AV amplifier]
FIG. 29 shows a configuration example of the AV amplifier 300. The AV amplifier 300 includes HDMI terminals 301a and 301b, an HDMI receiving unit 302a, and an HDMI transmitting unit 302b. The AV amplifier 300 includes a video / graphic processing circuit 305, an audio processing circuit 307, an audio amplification circuit 308, and audio output terminals 309a to 309f. The AV amplifier 300 includes an internal bus 312, a CPU 313, a flash ROM 314, and a DRAM 315.

  The HDMI receiving unit 302a receives uncompressed video (image) and audio data supplied to the HDMI terminal 301a via the HDMI cable 351 by communication conforming to HDMI. Although detailed description is omitted, the HDMI receiving unit 302a has the same configuration as the HDMI receiving unit 252 in the television receiver 250 of the AV system 200 of FIG.

  The HDMI transmission unit 302b sends uncompressed video (image) and audio data from the HDMI terminal 301b to the HDMI cable 352 by communication conforming to HDMI. Although detailed description is omitted, the HDMI transmission unit 302b has the same configuration as the HDMI transmission unit 212 in the game machine 210 of the AV system 200 of FIG.

  The audio processing circuit 307 generates, for example, audio data of each channel for realizing 5.1ch surround for audio data obtained by the HDMI receiving unit 202a, a process of giving predetermined sound field characteristics, Performs processing to convert digital signals to analog signals. The audio amplifier circuit 308 amplifies the audio signal of each channel output from the audio processing circuit 307 and outputs the amplified audio signal to the audio output terminals 309a to 319f.

  Further, the audio processing circuit 307 further supplies the audio data obtained by the HDMI receiving unit 302a to the HDMI transmitting unit 302b after performing necessary processing. The video / graphic processing circuit 305 subjects the video (image) data obtained by the HDMI receiving unit 302a to image conversion processing, graphics data superimposition processing, and the like as necessary, and supplies the processed data to the HDMI transmitting unit 302b. To do.

  The CPU 313 controls the operation of each unit of the AV amplifier 300. The flash ROM 314 stores control software and data. The DRAM 315 constitutes a work area for the CPU 313. The CPU 313 develops software and data read from the flash ROM 314 on the DRAM 315 to activate the software, and controls each unit of the AV amplifier 300. The CPU 313, flash ROM 314, and DRAM 315 are connected to the internal bus 312.

The operation of the AV amplifier 300 shown in FIG. 29 will be briefly described.
The HDMI receiving unit 302a acquires video (image) data and audio data transmitted from the disc player 400 connected to the HDMI terminal 301a via the HDMI cable 351. The video data and audio data are supplied to the HDMI transmission unit 302b via the video / graphic processing circuit 305 and the audio processing circuit 307, respectively, and transmitted from the HDMI terminal 301b to the television receiver 250 via the HDMI cable 352. The As a result, the AV amplifier 300 exhibits a repeater function.

  When audio is output through the AV amplifier 300, the audio processing circuit 307 generates audio data of each channel for realizing 5.1ch surround with respect to the audio data obtained by the HDMI receiving unit 302a. Necessary processing such as processing, processing for imparting predetermined sound field characteristics, processing for converting a digital signal into an analog signal, and the like are performed. The audio signal of each channel is amplified by the audio amplifier circuit 308 and then output to the audio output terminals 319a to 319f.

  In the AV system 200 </ b> A shown in FIG. 27, the disc player 400 acquires the content of the E-EDID of the television receiver 250 through the AV amplifier 300. Then, the disc player 400 obtains image data format (resolution, frame rate, aspect, etc.) information and screen size information that can be supported by the television receiver 250.

  Therefore, in the AV system 200A shown in FIG. 27, the disc player 400 can correct the reproduced stereoscopic image data according to the screen size by the video signal processing circuit 407. Then, the disc player 400 can transmit the corrected stereoscopic image data to the television receiver 250 through the AV amplifier 300.

  Therefore, the AV system 200A shown in FIG. 27 can obtain the same operational effects as those of the AV system 200 shown in FIG. That is, the television receiver 250 can display a stereoscopic image that matches the screen size without increasing the user's effort.

  In the AV system 200A shown in FIG. 27, for example, the video / graphic processing circuit 305 of the AV amplifier 300 may have the same function as the drawing processing unit 224 of the game machine 210 described above. In this case, for example, the playback stereoscopic image data (before correction) transmitted from the disc player 400 is corrected by this video / graphic processing circuit 305 into stereoscopic image data corresponding to the screen size of the television receiver 250, and the television Transmission to the receiver 250 is possible.

  Further, the above-described embodiment has been described using an HDMI transmission path. However, the present invention provides a transmission path for uncompressed video signals other than HDMI, for example, a DVI (Digital Visual Interface), DP (Display Port) interface, wireless transmission, and a Gigabit Ethernet / optical fiber transmission path that is expected to become more popular in the future. The same applies to what is used.

  For example, in the case of DVI, a standard for storing a corresponding image format (resolution, frame rate, etc.) of a video signal in an area called E-EDID possessed by the receiving apparatus is defined, as in the above-described HDMI.

  Therefore, in the case of this DVI, as in the case of the above-described HDMI, the transmitting device uses the DDC (Display Data Channel) to obtain the above-mentioned corresponding image format information, information on the screen size, etc. from the E-EDID of the receiving device. You can get it. Therefore, the transmission device can generate stereoscopic image data that matches the screen size on the reception device side, or can correct existing stereoscopic image data to match the screen size on the reception device side.

  Further, in the above-described embodiment, information regarding the screen size is described in the E-EDID in the television receiver 250, and the game machine 210 and the like (including the disc player 400 and the AV amplifier 300 in addition to the game machine 210). Shows that the information about the screen size of the television receiver 250 is obtained by reading the E-EDID.

  However, the means by which the game machine 210 or the like acquires information related to the screen size of the television receiver 250 is not limited to this. For example, by using a CEC line that is a control data line of an HDMI cable to perform communication between the game machine 210 and the television receiver 250, the game machine 210 and the like can obtain information on the screen size of the television receiver 250. You may get it.

  Further, for example, the game machine 210 and the disc player 400 are connected to the television receiver 250 by communication using a bidirectional communication path configured using a predetermined line (for example, a reserved line or an HPD line) of the HDMI cable. Information regarding the screen size may be acquired.

  Further, in the above-described embodiment, an example in which the transmission device is the game machine 210 and the disc player 400 and the reception device is the television receiver 250 is shown. However, the transmission device and the reception device are not limited to these. For example, in addition to the game machine 210, the transmission device may be a DVD recorder, a set top box, or other AV source. In addition to the television receiver 250, the receiving device may be a projector, a PC monitor, or other display.

  The present invention makes it possible to display an appropriate stereoscopic image suitable for the screen size without increasing the user's effort, transmit stereoscopic image data from the transmission device, and display the left eye image and the right eye image on the screen on the reception device side. The present invention can be applied to AV systems that display and provide stereoscopic images to viewers.

  200, 200A ... AV system, 210 ... game machine, 211 ... HDMI terminal, 212 ... HDMI transmission unit, 217 ... control pad, 221 ... CPU, 224 ... drawing process 225 ... VRAM, 250 ... TV receiver, 251 ... HDMI terminal, 252 ... HDMI receiver, 254 ... 3D signal processor, 271 ... CPU, 300 ... AV amplifier, 301a, 301b ... HDMI terminal, 302a ... HDMI receiver, 302b ... HDMI transmitter, 350, 351, 352 ... HDMI cable, 400 ... disc player, 401 ... HDMI terminal, 402... HDMI transmission unit

Claims (4)

An information acquisition step of acquiring information about the screen size from an external device via a transmission path;
A data transmission step of transmitting stereoscopic image data including left-eye image data and right-eye image data for displaying a stereoscopic image to the external device via the transmission path;
In the stereoscopic image data, the left-eye image data and the right-eye image data are arranged in a video field section with a predetermined period interposed therebetween. The stereoscopic image data transmission method according to claim 1, wherein the stereoscopic image data does not include image data in the predetermined period. An information acquisition unit that acquires information about a screen size from an external device via a transmission path; and three-dimensional image data including left-eye image data and right-eye image data for displaying a stereoscopic image via the transmission path. A data transmission unit for transmitting to the device,
In the stereoscopic image data, the left-eye image data and the right-eye image data are arranged in a video field section with a predetermined period interposed therebetween. The stereoscopic image data transmission device according to claim 3, wherein the stereoscopic image data does not include image data in the predetermined period.

Images