JP2013042275A - Integrated circuit and information processing apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To suppress an increase of signal lines related to transmission inside an apparatus of a plurality of systems of streams.SOLUTION: An integrated circuit comprises: a stream generation section; and a transmission section. On the basis of a video stream containing a video period and a blanking period per frame data structure according to a predetermined data structure for transmission/reception of video data between apparatuses, and a related data stream containing related data related to the video data, the stream generation section generates a multiplex stream having a data structure in which a predetermined size of additional blanking period for storing the related data is added per frame of the video stream. The transmission section transmits the generated multiplex stream to another integrated circuit.

Description

  The present technology relates to an integrated circuit, and more particularly, to an integrated circuit and an information processing apparatus for transmitting or receiving a plurality of streams.

  In recent years, devices that input and output high-quality video data (video data) and high-quality audio data (audio data) have become widespread. In general, high-quality video data and high-quality audio data have a large amount of data, so that the amount of data transmitted and received between electronic devices is also increasing. As the amount of data increases, it is assumed that the number of wirings connecting electronic devices increases. However, it is desirable that the number of wires connecting the electronic devices is small, and various transmission methods are standardized and used.

  For example, an apparatus for transmitting and receiving data using the SDI (Serial Digital Interface) standard has been proposed (for example, see Patent Document 1). The SDI standard is, for example, a standard in which video data and audio data are multiplexed to generate one stream, and the generated stream is serialized and transmitted / received.

Japanese Patent Laid-Open No. 2001-29412

  In the above prior art, video data and audio data can be transmitted and received via one coaxial cable. However, as described above, since the amount of data transmitted and received between electronic devices is increasing, the data transmission speed is becoming insufficient.

  Therefore, in order to make up for the shortage of data transmission speed while using the SDI standard, transmission / reception of data has been performed by applying various measures to the transmission method. For example, the video data size (frame size) is a size that can be transmitted according to the SDI standard. However, if the size of the audio data is too large, the video data and the audio data cannot be transmitted together. Therefore, in such a case, two cables are wired to transmit and receive video data and audio data as separate streams. If the frame size of the video data is too large, one frame is divided into a plurality of frames and transmitted as a plurality of streams.

  In these cases, since a plurality of streams are received, the number of signal lines for transmitting and receiving video data and audio data within the device also increases. As the number of signal lines increases in this way, it is assumed that the SI (Signal Integrity) decreases and the phase management between signals becomes difficult. For this reason, there is a possibility that an increase in design cost when designing a circuit for each device and an increase in quality cost due to a decrease in yield may occur. Therefore, it is important to transmit a plurality of data received by a plurality of systems in the apparatus so as not to increase the number of signal lines.

  The present technology has been created in view of such a situation, and an object thereof is to suppress an increase in signal lines related to transmission of a plurality of streams in a device.

  The present technology has been made to solve the above-described problems. The first aspect of the present technology is that a moving image period and a blanking period are set according to a predetermined data structure for transmitting and receiving moving image data between devices. Based on the video stream included in each data structure of one frame and the related data stream including related data related to the moving image data, an additional blanking period of a predetermined size for storing the related data is set in the video stream. This is an integrated circuit including a stream generation unit that generates a multiplexed stream having a data structure added for each frame, and a transmission unit that transmits the generated multiplexed stream to another integrated circuit. As a result, in order to transmit moving image data and related data transmitted from other devices to other integrated circuits, an additional blanking period of a predetermined size for storing the related data is added for each frame of the video stream. The multiplexed stream having the data structure is transmitted to another integrated circuit.

  In the first aspect, the additional blanking period stores identification information for identifying a position of the additional blanking period, the related data, and padding, and the stream generation unit The additional blanking period may be generated by increasing or decreasing the amount of padding according to the data size. As a result, the blanking period is generated based on the identification information, the related data, and the padding.

  In the first aspect, the related data stream may include audio data associated with the moving image data as the related data. This brings about the effect that audio data associated with moving image data is included as related data.

  Further, in this first aspect, a restoration unit that restores the frame before the division based on the plurality of video streams generated by dividing one frame into a plurality of subframes for transmission and reception; The stream generation unit further includes a division unit that re-divides the restored frame based on a division method different from the division method performed in the division, and generates a plurality of new video streams. The plurality of multiplexed streams may be generated for each of the plurality of new video streams, and the transmission unit may transmit the generated plurality of multiplexed streams to the other integrated circuit. Accordingly, a plurality of multiplexed streams are generated based on a plurality of new video streams generated by dividing a plurality of video streams generated by dividing one frame into a plurality of frames into different division methods. Bring about an effect.

  Further, in this first aspect, the video stream to be restored by the restoration unit is a stream generated by dividing one frame into four, and the division unit includes data of each pixel in the restored frame. Are alternately and sequentially classified in units of four pixels continuous in a predetermined direction of the restored frame, so that four new video streams may be generated as the new plurality of video streams. . As a result, the division method that divides one frame into four can be converted into a division method that sequentially and sequentially classifies the restored frame in units of four pixels that are continuous in a predetermined direction.

  Further, in this first aspect, the video stream to be restored by the restoration unit is a stream generated by dividing one frame into four, and the division unit includes data of each pixel in the restored frame. Are alternately and sequentially classified in units of two pixels that are continuous in a predetermined direction of the restored frame, and are sequentially classified in units of two lines that are continuous in a direction orthogonal to the predetermined direction, Four new video streams may be generated as the new video streams. As a result, the division method that divides one frame into four is classified sequentially and alternately in units of two pixels that are continuous in a predetermined direction of the restored frame, and is adjacent to a direction that is orthogonal to the predetermined direction. It is possible to convert to a division system that sequentially classifies alternately.

  In addition, according to the second aspect of the present technology, an additional blanking period of a predetermined size for storing related data of moving image data is added to a predetermined data structure for transmission / reception of moving image data between devices. A stream receiving unit that receives the multiplexed stream; a separating unit that separates the moving image data and the related data included in the received multiplexed stream; and the video stream having the predetermined data structure. A video stream transmission unit for storing and transmitting moving image data; and a related data stream transmission unit for storing and transmitting the separated related data in a related data stream having a data structure for transmitting and receiving the related data between devices. Is an integrated circuit. Accordingly, there is an effect that the moving image data and the related data separated from the multiplexed stream are transmitted to another apparatus as a video stream and a related data stream.

  In addition, according to a third aspect of the present technology, a video stream including a moving picture period and a blanking period for each data structure of one frame according to a predetermined data structure for transmitting and receiving moving picture data between devices and the moving picture data are provided. Based on the related data stream including the related data, a multiplexed stream having a data structure in which an additional blanking period of a predetermined size for storing the related data is added for each frame of the video stream is generated. A first integrated circuit including a stream generation unit and a transmission unit that transmits the generated multiplexed stream to another integrated circuit; and separation that separates the moving image data and the related data from the transmitted multiplexed stream , An image processing unit that performs image processing on the separated moving image data, and the separated association An information processing apparatus having a second integrated circuit and a related data processing unit for performing signal processing over data. Accordingly, the second integrated circuit that has received the multiplexed stream generated by the first integrated circuit separates each data included in the multiplexed stream, and each stream including each data separated by the second integrated circuit. Is caused to cause the processing unit of each data to perform signal processing.

  According to the present technology, it is possible to achieve an excellent effect that an increase in signal lines related to transmission of a plurality of streams in a device can be suppressed.

It is a block diagram showing an example of composition of information processor 100 in a 1st embodiment of this art. 3 is a block diagram illustrating a configuration example of an in-device transmission stream generation unit 300 and a stream transmission unit 270 of the interface board 200 according to the first embodiment of the present technology. FIG. 3 is a block diagram illustrating a configuration example of a stream reception unit 410 and an in-device transmission stream separation unit 420 of the signal processing circuit board 400 according to the first embodiment of the present technology. FIG. 3 is a schematic diagram illustrating an example of a bit width and a clock of a video stream in the information processing apparatus 100 according to the first embodiment of the present technology. FIG. It is a mimetic diagram showing an example of a data structure of an in-device transmission stream in information processor 100 of a 1st embodiment of this art. It is a mimetic diagram showing an example of the data structure in additional blanking 540 of the in-device transmission stream generated by stream generation part 390 of a 1st embodiment of this art. It is a schematic diagram which shows an example of the effect by transmitting in the apparatus using the in-apparatus transmission stream produced | generated by the stream generation part 390 of 1st Embodiment of this technique. It is a block diagram showing an example of composition of information processor 110 in a 2nd embodiment of this art. Fig. 25 is a block diagram illustrating a configuration example of a video data writing unit 630, a video data acquisition unit 640, and a frame restoration unit 680 in the second embodiment of the present technology. It is a mimetic diagram showing an example of four kinds of video streams supplied from an external device to information processor 110 in a 2nd embodiment of this art. It is a mimetic diagram showing an example of a memory map of an image (frame) held by DRAM 684 in a 2nd embodiment of this art. 22 is a schematic diagram illustrating an example of division method conversion when the video data acquisition unit 640 reads out an image held in a DRAM 684 according to the second embodiment of the present technology. FIG. 22 is a schematic diagram illustrating an example of division method conversion when the video data acquisition unit 640 reads out an image held in a DRAM 684 according to the second embodiment of the present technology. FIG. It is a block diagram showing an example of composition of information processor 120 in a 3rd embodiment of this art. It is a block diagram showing an example of composition of interface board 209 in a 3rd embodiment of this art.

Hereinafter, modes for carrying out the present technology (hereinafter referred to as embodiments) will be described. The description will be made in the following order.
1. First embodiment (intra-device transmission control: an example in which three streams transmitted by other devices are transmitted to a signal processing circuit)
2. Second embodiment (intra-device transmission control: an example of transmitting a plurality of video streams in a device)
3. Third embodiment (intra-device transmission control: an example in which three streams to be transmitted to another device are transmitted in the device)

<1. First Embodiment>
[Configuration example of information processing device]
FIG. 1 is a block diagram illustrating a configuration example of the information processing apparatus 100 according to the first embodiment of the present technology. The information processing apparatus 100 includes an interface board 200 and a signal processing circuit board 400.

  In the embodiment of the present technology, three streams (a video stream, an audio stream, and an accompanying data stream) are transmitted from an external device (external device) of the information processing device 100 to the information processing device 100. Assume that. Since the accompanying data will be described in the description of the accompanying data stream input terminal 293 of the interface board 200, the description thereof is omitted here.

  The interface board 200 is a board for interposing data transmission / reception between the information processing apparatus 100 and an external apparatus. The interface board 200 includes a video stream input terminal 291, an audio stream input terminal 292, and an accompanying data stream input terminal 293. The interface board 200 includes a video stream conversion unit 210, an audio stream conversion unit 220, an accompanying data stream conversion unit 230, and a baseband clock generation unit 240. The interface board 200 includes a stream clock generation unit 250, an in-device transmission stream generation unit 300, an in-device transmission clock generation unit 260, and a stream transmission unit 270. The interface substrate 200 is an example of an integrated circuit and a first integrated circuit described in the claims.

  The video stream input terminal 291 is a terminal for the information processing apparatus 100 to receive a video (moving image) stream output from the external device. For example, the video stream input terminal 291 receives a video stream (bit width is 1 bit) transmitted based on the SDI (Serial Digital Interface) standard. The video stream input terminal 291 supplies the received video stream to the video stream conversion unit 210. The video stream is an example of a stream having a predetermined data structure for transmitting and receiving a moving image between the devices described in the claims.

  The audio stream input terminal 292 is a terminal for the information processing apparatus 100 to receive an audio stream output from the external device. The audio stream received by the audio stream input terminal 292 is a stream of the audio portion of the video input to the video stream input terminal 291 and is data related to the video stream. The audio stream input terminal 292 receives an audio stream transmitted via a signal (another cable) different from the video stream. In the first embodiment of the present technology, it is assumed that digital audio having a bit width of 1 bit is input to the audio stream input terminal 292. The audio stream input terminal 292 supplies the received audio stream to the audio stream conversion unit 220.

  The associated data stream input terminal 293 is a terminal for the information processing apparatus 100 to receive associated data stream information output from the external device. Here, the accompanying data will be described. The accompanying data is data other than video and audio, and is data related to the video stream. For example, character data in teletext and data such as a frame rate in a video stream are transmitted as accompanying data. The accompanying data stream input terminal 293 receives the accompanying data stream transmitted via a signal line different from the video stream and the audio stream. The accompanying data stream input terminal 293 supplies the received accompanying data stream to the accompanying data stream conversion unit 230. The audio stream and the accompanying data stream are an example of a stream including related data related to the moving image data described in the claims. That is, the audio data and the accompanying data are examples of related data described in the claims.

  The video stream converter 210 converts the video stream supplied from the video stream input terminal 291 into bit-width data processed by the in-device transmission stream generator 300. That is, the video stream conversion unit 210 converts serial data into parallel data. The in-device transmission stream generation unit 300 processes each data using the baseband bit width and clock of the video stream, so the video stream conversion unit 210 converts the bit width of the video stream to this bit width. . The video stream conversion unit 210 places the video stream whose bit width has been converted on the baseband clock restored by the baseband clock generation unit 240 and supplies the video stream to the in-device transmission stream generation unit 300 via the signal line 211.

  The baseband clock generation unit 240 generates a baseband clock for the video stream. The baseband clock generation unit 240 supplies the generated baseband clock to the video stream conversion unit 210 and the stream clock generation unit 250. The video stream conversion unit 210 and the baseband clock generation unit 240 are realized by, for example, a deserializer (DeSer: Deserializers) compatible with 3G-SDI.

  The audio stream converter 220 converts the audio stream supplied from the audio stream input terminal 292 into bit-width data (converted from serial data to parallel data) processed by the in-device transmission stream generator 300. That is, the audio stream conversion unit 220 converts the audio stream to the same bit width as the video stream converted by the video stream conversion unit 210. The audio stream conversion unit 220 supplies the audio stream whose bit width is converted to the in-device transmission stream generation unit 300 via the signal line 221.

  The accompanying data stream conversion unit 230 converts the accompanying data stream supplied from the accompanying data stream input terminal 293 into bit-width data processed by the in-device transmission stream generation unit 300. That is, the accompanying data stream conversion unit 230 converts the accompanying data stream to the same bit width as that converted by the video stream conversion unit 210 and the audio stream conversion unit 220. The accompanying data stream conversion unit 230 supplies the accompanying data stream whose bit width is converted to the in-device transmission stream generation unit 300 via the signal line 231.

  The stream clock generation unit 250 generates a baseband clock of the stream (intra-device transmission stream) generated by the intra-device transmission stream generation unit 300. The stream clock generation unit 250 is realized by, for example, a PLL (Phase Locked Loop) circuit, and is m / n times the clock supplied from the baseband clock generation unit 240 (for example, 6/5 (1.2 times) )). The stream clock generation unit 250 supplies the generated clock (stream clock) to the in-device transmission stream generation unit 300 and the in-device transmission clock generation unit 260 via the signal line 251.

  The in-device transmission stream generation unit 300 transmits (transmits) these three streams to other circuits inside (inside the device) of the information processing device 100 based on the three streams received by the interface board 200 from the external device. To generate a stream for. The in-device transmission stream generation unit 300 will be described with reference to FIG. The in-device transmission stream generation unit 300 supplies the generated stream (in-device transmission stream) to the stream transmission unit 270. The in-device transmission stream generation unit 300 supplies information related to the in-device transmission stream (in-device transmission stream information) to the in-device transmission stream separation unit 420 of the signal processing circuit board 400 via the signal line 201. The in-device transmission stream generation unit 300 is an example of the stream generation unit described in the claims. The intra-device transmission stream is an example of a multiplexed stream generated by the stream generation unit described in the claims.

  The intra-apparatus transmission clock generator 260 generates a clock (intra-apparatus transmission clock) for transmitting (transmitting) the intra-apparatus transmission stream to another circuit. For example, the in-device transmission clock generation unit 260 generates an in-device transmission clock based on the stream clock supplied from the stream clock generation unit 250. The in-device transmission clock generation unit 260 supplies the generated in-device transmission clock to the stream transmission unit 270.

  The stream transmission unit 270 puts the intra-device transmission stream from the intra-device transmission stream generation unit 300 on the speed (frequency) indicated by the intra-device transmission clock from the intra-device transmission clock generation unit 260, and other circuits (FIG. Then, the signal is transmitted to the signal processing circuit board 400). Note that the stream transmission unit 270 will be described with reference to FIG. 2, and description thereof is omitted here. The stream transmission unit 270 supplies the in-device transmission stream to the stream reception unit 410 of the signal processing circuit board 400 via the signal line 202. The in-device transmission clock generation unit 260 and the stream transmission unit 270 are realized by, for example, a serializer that transmits data using an LVDS (Low Voltage Differential Signaling) transmission method. The stream transmission unit 270 is an example of the transmission unit described in the claims.

  The signal processing circuit board 400 is a board on which circuits for performing signal processing in the information processing apparatus 100 are integrated. The signal processing circuit board 400 includes a stream reception unit 410, an in-device transmission stream separation unit 420, a video processor 440, an audio processor 450, and a system controller 460. The signal processing circuit board 400 is an example of a second integrated circuit described in the claims.

  The stream reception unit 410 receives the in-device transmission stream supplied from the stream transmission unit 270 of the interface board 200. The stream receiving unit 410 will be described with reference to FIG. The stream receiving unit 410 puts the received in-device transmission stream on the processing speed (clock) in the in-device transmission stream separation unit 420 and supplies it to the in-device transmission stream separation unit 420. The stream receiving unit 410 is realized by, for example, a deserializer that receives data transmitted by the LVDS transmission method. The stream receiving unit 410 is an example of a stream receiving unit described in the claims.

  The intra-device transmission stream separation unit 420 separates three streams (video stream, audio stream, and accompanying data stream) included in the intra-device transmission stream. Note that the in-device transmission stream separation unit 420 will be described with reference to FIG. The in-device transmission stream separation unit 420 supplies a video stream separated from the in-device transmission stream to the video processor 440 via the signal line 449. The in-device transmission stream separation unit 420 supplies the separated audio stream to the audio processor 450 via the signal line 459, and supplies the separated accompanying data stream to the system controller 460 via the signal line 469. The in-device transmission stream separation unit 420 is an example of a separation unit described in the claims.

  The video processor 440 performs signal processing on the video stream. For example, the video processor 440 displays a moving image (video) generated based on the video stream on a display unit (not shown).

  The audio processor 450 performs signal processing on the audio stream. For example, the audio processor 450 generates sound (audio) generated based on the audio stream from a speaker (not shown).

  The system controller 460 controls the operation of the information processing apparatus 100. For example, the character information included in the accompanying data stream is signal-processed and displayed on a display unit (not shown).

[Configuration example of in-device transmission stream generator and stream transmitter]
FIG. 2 is a block diagram illustrating a configuration example of the in-device transmission stream generation unit 300 and the stream transmission unit 270 of the interface board 200 according to the first embodiment of the present technology.

  In the first embodiment of the present technology, the SDI standard video stream input from the video stream input terminal 291 does not include anything other than video data (there is no accompanying data such as embedded audio). An explanation will be given.

  The in-device transmission stream generation unit 300 includes a video data separation unit 310, a TRS (Timing Reference Signal) analysis unit 320, a video data buffer 330, an audio data buffer 340, and an audio data packet generation unit 345. Further, the in-device transmission stream generation unit 300 includes an accompanying data buffer 350, an accompanying data packet generation unit 355, a control unit 360, a control packet generation unit 370, a TRS generation unit 380, a blank generation unit 385, a stream A generation unit 390.

  The video data separation unit 310 analyzes the video stream supplied from the video stream conversion unit 210 via the signal line 211, and separates the video data so that only the video data is stored in the video data buffer 330. The video data separator 310 supplies video data to the video data buffer 330 for each line in one frame. In addition, the video data separation unit 310 supplies TRS, which is a data timing reference signal of the video stream, to the TRS analysis unit 320.

  The TRS analysis unit 320 analyzes the TRS included in the video stream and generates information regarding the video stream. For example, the TRS analysis unit 320 determines the horizontal length of one frame (horizontal resolution), the vertical length of one frame (vertical resolution), the length of a blanking period of video data, and the like based on TRS. To detect. The TRS analysis unit 320 supplies information regarding the detected video stream to the control unit 360.

  The video data buffer 330 holds the video data supplied from the video data separation unit 310. For example, the video data buffer 330 holds video data for each line in one frame. The video data buffer 330 supplies the held video data to the stream generation unit 390 based on a command from the control unit 360. The video data buffer 330 is, for example, a first-in first-out (FIFO) type queue that holds video data for each line, and data input and output are asynchronous (clocks are different). Realized by queues. In FIG. 2, for convenience of explanation, only the signal line of the clock for operating the video data buffer 330 is the signal line of the output side clock (stream clock supplied via the signal line 251). The side clock signal lines are omitted. Similarly, the audio data buffer 340 and the accompanying data buffer 350 are shown only for the output clock signal line (signal line 251), and the input clock signal line is omitted.

  The audio data buffer 340 holds audio stream data (audio data) supplied from the audio stream conversion unit 220 via the signal line 221. The audio data buffer 340 supplies the held audio data to the audio data packet generation unit 345 based on a command from the control unit 360. The audio data buffer 340 is, for example, a FIFO type, and is realized by a queue in which data input and output are asynchronous.

  The audio data packet generation unit 345 generates a storage unit (packet) of audio data in the stream generated by the stream generation unit 390 based on the audio data supplied from the audio data buffer 340. That is, the audio data packet generation unit 345 converts the audio data file format supplied from the audio data buffer 340 into an audio file format in the stream (intra-device transmission stream) generated by the stream generation unit 390. The audio data packet generation unit 345 supplies the generated audio data packet (audio packet) to the stream generation unit 390.

  The accompanying data buffer 350 holds the data (associated data) of the accompanying data stream supplied from the accompanying data stream conversion unit 230 via the signal line 231. The accompanying data buffer 350 supplies the accompanying accompanying data to the accompanying data packet generation unit 355 based on a command from the control unit 360. The accompanying data buffer 350 is realized by, for example, a FIFO type queue.

  The accompanying data packet generation unit 355 generates a storage unit (packet) of accompanying data in the in-device transmission stream based on the accompanying data supplied from the accompanying data buffer 350. That is, the accompanying data packet generation unit 355 converts the file format of the accompanying data supplied from the accompanying data buffer 350 into the file format of the accompanying data in the in-device transmission stream generated by the accompanying data buffer 350. The accompanying data packet generation unit 355 supplies the generated packet of accompanying data (accompanying data packet) to the stream generation unit 390.

  The control packet generator 370 generates a control packet included in the in-device transmission stream based on a command from the controller 360. Here, the control packet is a packet in which information for identifying blanking for storing the audio packet and the accompanying data packet in the in-device transmission stream is stored. The blanking for storing the audio packet and the accompanying data packet is generated by adding a blanking period to a predetermined position in the data structure of the video stream input from the video stream input terminal 291. Note that blanking identified by the control packet is hereinafter referred to as additional blanking, and other blanking in the intra-device transmission stream (same blanking included in the video stream) is simply blanking. I will call it. The data structure in the additional blanking will be described with reference to FIG. The control packet generation unit 370 supplies the generated control packet to the stream generation unit 390.

  The TRS generation unit 380 generates a data timing reference signal (TRS) of the in-device transmission stream based on a command from the control unit 360. Note that blanking and video data in the in-device transmission stream are the same as SDI standard blanking and video data (see FIGS. 5 and 6 for details). That is, the TRS generator 380 generates the same SAV and EAV as the SAV (Start of Active Video) and EAV (End of Active Video) of the SDI standard data timing reference signal. The TRS generation unit 380 supplies the generated TRS (SAV and EAV) to the stream generation unit 390.

  The blank generation unit 385 generates data other than the TSR in the blanking of the in-device transmission stream based on a command from the control unit 360. The blank generation unit 385 also generates invalid data (padding) in the additional blanking identified by the control packet (see FIG. 6). The blank generation unit 385 supplies the generated data to the stream generation unit 390.

  The control unit 360 controls the generation of the intra-device transmission stream by the intra-device transmission stream generation unit 300. The control unit 360 controls the supply timing of data supplied from the video data buffer 330, the audio data buffer 340, and the associated data buffer 350 to the stream generation unit 390. Similarly, the control unit 360 controls the supply timing of each data generated by the control packet generation unit 370, the TRS generation unit 380, and the blank generation unit 385 and supplied to the stream generation unit 390. Thus, the control unit 360 supplies each data for each line in one frame to the stream generation unit 390 so that the time axis between the data does not shift.

  In addition, the control unit 360 supplies a selection control signal to the stream generation unit 390, and controls the stream generation unit 390 to output a plurality of data supplied to the stream generation unit 390 while aligning them with the data structure of the in-device transmission stream. To do. The data structure of the in-device transmission stream will be described with reference to FIGS.

  The stream generation unit 390 generates an intra-device transmission stream by aligning a plurality of data supplied as data of the intra-device transmission stream. The stream generation unit 390 is realized by, for example, a multiplexer (MUX: MUltipleXer). The stream generation unit 390 supplies the generated in-device transmission stream to the bit width conversion unit 271 of the stream transmission unit 270.

  The stream transmission unit 270 includes a bit width conversion unit 271, a stream output unit 272, and a clock output unit 273.

  The bit width conversion unit 271 converts the bit width of the in-device transmission stream supplied from the stream generation unit 390 into the bit width in the route (transmission cable or backplane) of the in-device transmission stream in the device. The bit width conversion unit 271 is supplied with the intra-device transmission clock from the intra-device transmission clock generation unit 260, and converts the bit width of the intra-device transmission stream on this clock. For example, when a 20-bit in-device transmission stream generated by the stream generation unit 390 is sent via a 5-bit route, the bit width conversion unit 271 serializes the bit width from 20 bits to 5 bits. The bit width conversion unit 271 supplies the in-device transmission stream with the bit width converted to the stream output unit 272.

  The stream output unit 272 outputs (transmits) the in-device transmission stream supplied from the bit width conversion unit 271 toward other circuits in the information processing apparatus 100. For example, the stream output unit 272 transmits the in-device transmission stream by the LVDS transmission method. The stream output unit 272 supplies the in-device transmission stream to the signal processing circuit board 400 via the signal line 204 in the signal line 202.

  The clock output unit 273 outputs a clock (restored clock) when the bit width of the signal output from the stream output unit 272 is restored. For example, when the in-device transmission clock generation unit 260 generates a 600 MHz in-device transmission clock from a 150 MHz stream clock, the clock output unit 273 outputs a 150 MHz clock. The clock output unit 273 supplies a restored clock to the signal processing circuit board 400 via the signal line 203 in the signal line 202.

[Configuration example of stream receiver and in-device transmission stream separator]
FIG. 3 is a block diagram illustrating a configuration example of the stream reception unit 410 and the in-device transmission stream separation unit 420 of the signal processing circuit board 400 according to the first embodiment of the present technology.

  The stream receiving unit 410 includes a stream input unit 411, a bit width conversion unit 412, and a clock input unit 413.

  The stream input unit 411 receives the in-device transmission stream transmitted from the interface board 200 via the signal line 204. The stream input unit 411 supplies the received in-device transmission stream to the bit width conversion unit 412.

  The clock input unit 413 receives a recovered clock of the in-device transmission stream transmitted from the interface board 200 via the signal line 203. The clock input unit 413 supplies the received recovered clock to the bit width conversion unit 412 and the video clock generation unit 426 of the in-device transmission stream separation unit 420.

  The bit width conversion unit 412 converts the bit width of the in-device transmission stream in accordance with the recovered clock supplied from the clock input unit 413. That is, the bit width conversion unit 412 performs in-device transmission of the conversion (converting 20 bits to 5 bits) reverse to the conversion performed by the bit width conversion unit 271 (see FIG. 2) of the stream transmission unit 270 (converting 5 bits to 20 bits). To the stream. The bit width conversion unit 412 supplies the in-device transmission stream with the bit width converted to the stream separation unit 422 of the in-device transmission stream separation unit 420.

  The in-device transmission stream separator 420 includes a stream information analyzer 421, a stream separator 422, a video stream generator 423, an audio stream generator 424, an accompanying data stream generator 425, and a video clock generator 426. Is provided.

  The stream information analysis unit 421 analyzes in-device transmission stream information supplied from the interface board 200 via the signal line 201. The stream information analysis unit 421 detects the data structure of the in-device transmission stream by analyzing the in-device transmission stream information. The stream information analysis unit 421 supplies the stream separation unit 422 with a selection control signal for causing the stream separation unit 422 to separate data based on the detected data structure of the in-device transmission stream.

  The stream separation unit 422 separates the in-device transmission stream supplied from the bit width conversion unit 412 into each data (video, audio, associated data) based on the selection control signal supplied from the stream information analysis unit 421. It is. The stream separation unit 422 is realized by, for example, a demultiplexer (DMX: DeMultipleXer). The stream separation unit 422 supplies the video data separated from the in-device transmission stream to the video stream generation unit 423. Further, the stream separation unit 422 supplies the separated audio data to the audio stream generation unit 424 and supplies the separated accompanying data to the accompanying data stream generation unit 425.

  The video clock generation unit 426 generates a video clock based on the recovered clock supplied from the clock input unit 413 of the stream reception unit 410. The video clock generation unit 426 supplies the generated video clock to the video stream generation unit 423.

  The video stream generation unit 423 generates a video stream in a data format calculated by the video processor 440 based on the video data supplied from the stream separation unit 422. For example, the video stream generation unit 423 sequentially outputs the video data supplied from the stream separation unit 422 on the video clock supplied from the video clock generation unit 426 in chronological order. The video stream generation unit 423 supplies the sequentially output video data (video stream) to the video processor 440 via the signal line 449.

  The audio stream generation unit 424 generates audio data in a data format calculated by the audio processor 450 based on the audio data supplied from the stream separation unit 422. For example, the audio stream generation unit 424 sequentially outputs the audio data supplied from the stream separation unit 422 on the audio clock restored by the in-device transmission stream information in time series order. The audio stream generation unit 424 supplies the generated audio data to the audio processor 450 via the signal line 459.

  The accompanying data stream generation unit 425 generates an accompanying data stream in a data format calculated by the system controller 460 based on the accompanying data supplied from the stream separation unit 422. For example, the accompanying data stream generation unit 425 sequentially outputs the accompanying data supplied from the stream separation unit 422 on the accompanying data clock restored by the in-device transmission stream information in time series order. The accompanying data stream generation unit 425 supplies the generated accompanying data stream to the system controller 460 via the signal line 469.

[Example of bit width and clock of video stream in information processing apparatus]
FIG. 4 is a schematic diagram illustrating an example of the bit width and the clock of the video stream in the information processing apparatus 100 according to the first embodiment of the present technology.

  In the figure, among the configurations shown in FIGS. 1 to 3, the configuration in which video data, audio data, and accompanying data are processed is shown together with signal lines connecting the configurations. The audio data packet generation unit 345 and the accompanying data packet generation unit 355 are not shown for convenience of explanation. Further, the bit width of the signal line for transmitting and receiving the video data is shown (1 bit, 20 bit, and 5 bit in the figure) on the signal line that connects the components in which the video data is processed. Further, in the same figure, a clock of a stream including video data is shown together with an arrow and a broken line indicating a section to be processed on the clock.

  Here, the bit width and clock of the video stream will be described in order from the input of the stream to the interface board 200.

  First, video data input from a device external to the information processing device 100 is supplied to the video stream conversion unit 210. For example, in the case of 3G-SDI, a signal (video stream) having a bit width of 1 bit and a clock of 2.97 GHz is supplied to the video stream conversion unit 210. As for audio and associated data, signals transmitted from an external device with a bit width and a clock according to the transmission standard of each data are supplied to the audio stream conversion unit 220 and the associated data stream conversion unit 230.

  Subsequently, the video stream conversion unit 210 performs parallel conversion on the supplied video stream, and converts the video stream into a signal having a baseband bit width (20 bits) and a clock (148.5 MHz). Then, the video stream conversion unit 210 transmits the video stream toward the video data buffer 330. Also, audio data and accompanying data are also converted into signals having a bit width of 20 bits by the audio stream converting unit 220 and the accompanying data stream converting unit 230, respectively. Then, the audio data and the accompanying data whose bit width is converted are transmitted to the audio data buffer 340 and the accompanying data buffer 350.

  When each data is transmitted from the video data buffer 330, the audio data buffer 340, and the associated data buffer 350 to the stream generation unit 390, the clock (stream in the apparatus) of the stream in which the three data are multiplexed (in-device transmission stream) Data is output at 150 MHz). That is, in these three buffers, the clock of each data is switched to the clock of the in-device transmission stream.

  Thereafter, in the stream generation unit 390, each data is collected according to the data structure of the in-device transmission stream, and an in-device transmission stream having a bit width of 20 bits and a clock of 150 MHz is generated.

  Subsequently, the bit width conversion unit 271 converts the bit width 20 bits and the clock (150 MHz) of the in-device transmission stream into a bit width (5 bits) and a clock (600 MHz) for transmission within the device. The converted in-device transmission stream is output from the stream output unit 272 and transmitted to the stream input unit 411 of the signal processing circuit board 400. Note that the number of signal lines in the case of transmission by the LVDS transmission method is 10 (2 (differential) × 5 (bit)) for the in-device transmission stream and 2 (differential) for the clock. ) And a signal line for transmitting the in-device transmission stream information. That is, the number of signal lines can be reduced as compared with the case of transmitting with 20 bits.

  In the signal processing circuit board 400, the bit width conversion unit 412 converts the in-device transmission stream (5 bits, 600 MHz) supplied from the stream input unit 411 into an in-device transmission stream having a bit width of 20 bits and a clock of 150 MHz. To do. As a result, the in-device transmission stream serialized to 5 bits for transmission / reception within the device is restored to the in-device transmission stream of the original bit width (20 bits).

  Subsequently, the in-device transmission stream (20 bits, 150 MHz) is separated into video data, audio data, and accompanying data by the stream separation unit 422. Then, each stream is generated in the video stream generation unit 423, the audio stream generation unit 424, and the accompanying data stream generation unit 425 (for example, the video stream is a 20-bit, 148.5-MHz stream). Thereafter, each generated stream is supplied to the processing circuit of each stream.

  In this way, by transmitting the intra-device transmission stream inside the device, the number of streams to be transmitted can be reduced. Thereby, the number of wiring required for transmission can be reduced.

  Next, the data structure of the in-device transmission stream will be described with reference to FIG.

[Example of data structure of intra-device transmission stream]
FIG. 5 is a schematic diagram illustrating an example of the data structure of the intra-device transmission stream in the information processing apparatus 100 according to the first embodiment of the present technology.

  FIG. 6A schematically shows the data structure of one frame of a video stream transmitted from an external device to the information processing apparatus 100 and input from the video stream input terminal 291. This video stream is a video stream transmitted with a data structure defined as 3G-SDI. The size of one frame in this video stream is 2048 × 1080 pixels. As shown in FIG. 6A, a blank period (horizontal blanking 521 and vertical blanking 522) having a prescribed size is provided for each frame of video data (effective video area 523).

  In the data area corresponding to the last four pixels of the horizontal blanking 521, an SAV for identifying that the effective video area 523 starts after the blanking (blanking period) ends is provided. In the data area corresponding to the first four pixels of the horizontal blanking 521, an EAV for identifying that blanking starts after the period of the video data of one line before (effective video area 523) is provided. . Video data having a data structure as shown in FIG. 5A is transmitted for each line of one frame to form a video stream.

  FIG. 5B schematically shows the data structure of one frame of the in-device transmission stream generated by the stream generation unit 390 and transmitted / received in the device. Of the data structure shown in FIG. 6B, the horizontal blanking 521, the vertical blanking 522, and the effective video area 523 are the same as those shown in FIG. The description here is omitted.

  The data structure shown in FIG. 7B includes additional blanking (additional blanking 540) in addition to the data structure shown in FIG. Except for the additional blanking 540, the data structure is the same as that shown in FIG. As described above, the stream generation unit 390 generates a stream having a data structure in which the additional blanking 540 is added to the data structure defined as 3G-SDI as an in-device transmission stream. That is, the stream generation unit 390 adds an additional blanking period to a predetermined position in the data structure for each line of one frame of a video stream of the SDI standard that is a standard for transmitting video data to other devices. A data structure stream is generated as an in-device transmission stream.

  Next, data in the additional blanking 540 will be described with reference to FIG.

[Example of data structure of additional blanking]
FIG. 6 is a schematic diagram illustrating an example of a data structure in the additional blanking 540 of the intra-device transmission stream generated by the stream generation unit 390 according to the first embodiment of the present technology.

  In the figure, the data structure in the additional blanking 540 for one line is shown. In the figure, for the convenience of explanation, it is assumed that there is no accompanying data.

  In the figure, as a data structure in the additional blanking 540 for one line, a control header 541, audio packets 542 to 544, and padding 545 are shown.

  The control header 541 is a data period constituted by the control packet generated by the control packet generator 370 and is arranged at the start position of the additional blanking 540. That is, the start of the additional blanking 540 is detected by detecting the control header 541 when separating each stream from the in-device transmission stream.

  Audio packets 542 to 544 indicate audio packets generated by the audio data packet generation unit 345. For example, the audio packets 542 to 544 are audio data structure packets of AES (Audio Engineering Society) standard, similar to 3G-SDI embedded audio. The audio packet generated by the audio data packet generation unit 345 is arranged by the stream generation unit 390 after the control header 541 in the additional blanking 540 (side to be transmitted later in the stream).

  Padding 545 is a data area (period) composed of meaningless data in additional blanking. Since the additional blanking 540 is a period of a specific size, the extra blanking 540 period remaining after the control header 541 and the audio packets 542 to 544 are arranged is filled with meaningless data to become padding 545. .

  Although the accompanying data is not shown in the drawing, when the accompanying data is included in the additional blanking 540, the accompanying data packetized like the audio packets 542 to 544 is like the audio packets 542 to 544. Placed in.

  Here, the generation of the in-device transmission stream by the stream generation unit 390 will be described with reference to FIGS. 5 and 6 assuming one line of data including pixel data of the effective video area 523. First, when the generation of the in-device transmission stream of the previous line is completed, the control unit 360 transfers each data of the next line from the video data buffer 330, the audio data buffer 340, and the associated data buffer 350 to the stream generation unit 390. To output. Note that the audio data output from the audio data buffer 340 is packetized by the audio data packet generator 345, and the accompanying data output from the accompanying data buffer 350 is packetized by the accompanying data packet generator 355.

  Further, the control unit 360 causes the TRS generation unit 380 to generate EAV and SAV in the horizontal blanking 521 of this line, and causes the stream generation unit 390 to output them. Similarly, the control unit 360 causes the blank generation unit 385 to generate the data of the area other than EAV and SAV of blanking of this line and the data of the padding 545 in the additional blanking 540, and causes the stream generation unit 390 to output the data. .

  Then, the control unit 360 controls the stream generation unit 390 to collect data so that the data structure in one line becomes the data structure as shown in FIGS. As a result, EAV, blanking, SAV, effective video area, control header, audio packet, accompanying data packet (if there is accompanying data), and padding are sequentially performed from the left side of the line (the side ahead of the stream). The data is stitched together. As described above, by adding additional blanking to the SDI standard video stream, one stream (intra-device transmission stream) including an audio stream that could not be included in the SDI standard stream is generated.

[Effects of intra-device transmission stream]
FIG. 7 is a schematic diagram illustrating an example of an effect obtained by transmitting the inside of a device using the in-device transmission stream generated by the stream generation unit 390 according to the first embodiment of the present technology.

  FIG. 5A shows the data structure of the in-device transmission stream when the size of one frame is 2048 × 1080 pixels and the amount of audio data is large. Note that, except for the audio region 551 that schematically shows the arrangement period of the audio buckets in the additional blanking 540, it is the same as that shown in FIG. 5B, and a description thereof will be omitted here.

  As shown in the audio area 551, when the amount of audio data is large, the audio area 551 increases while the padding area of the additional blanking 540 decreases.

  FIG. 7B shows the data structure of the in-device transmission stream when the size of one frame is 2048 × 1080 pixels and the amount of audio data is small. FIG. 7B shows an audio area 561 that schematically shows an audio bucket area when the amount of audio data is small.

  As shown in the audio area 561, when the amount of audio data is small (for example, when the number of surround channels is small), the audio area 561 decreases while the padding area of the additional blanking 540 increases. That is, as shown in FIGS. 9A and 9B, by generating an in-device transmission stream, a data amount per frame including blanking is predetermined regardless of an increase or decrease in the data amount of audio data. Can be set to the size of

  FIG. 7 (c) shows the data structure of the in-device transmission stream when the size of one frame is 1920 × 1080 pixels and the amount of audio data is the same as that in FIG. 7 (a). In the SDI format, the difference between the data structure in which the size of one frame is 2048 × 1080 pixels and the data structure in which the size of one frame is 1920 × 1080 pixels is only the difference in the blanking length in horizontal blanking. . That is, the horizontal blanking 571 in FIG. 10C has a longer period than the horizontal blanking 521 in FIGS. However, depending on the size of the audio data, the horizontal blanking 571 may not be fully accommodated. Even in such a case, it is possible to generate one stream (intra-device transmission stream) including an audio stream that could not be inserted by adding an additional blanking period.

  As described above, according to the first embodiment of the present technology, an intra-device transmission stream is generated based on a plurality of streams supplied from an external device, and the generated intra-device transmission stream is transmitted to other devices in the device. It can be transmitted to a substrate (circuit). That is, the number of streams transmitted in the device can be reduced, and the number of wirings required to transmit the stream in the device can be reduced.

<2. Second Embodiment>
In the first embodiment of the present technology, the description has been made assuming that the video stream, the audio stream, and the accompanying data stream are each one system. The video stream can be transmitted / received in one system up to the upper limit of the frame size defined by the SDI standard. When the frame size is higher (for example, Super Hi-Vision), the video stream is transmitted / received in one system. I can't.

  In such a case, when it is desired to transmit / receive a stream using the SDI standard, the original video stream is divided into a plurality of systems (video streams) and transmitted / received.

  Therefore, in the second embodiment of the present technology, an example in which video streams are transmitted in four systems will be described with reference to FIGS. 8 to 13.

[Configuration example of information processing device]
FIG. 8 is a block diagram illustrating a configuration example of the information processing apparatus 110 according to the second embodiment of the present technology. The information processing apparatus 100 includes an interface board 600 and a signal processing circuit board 700.

  In the figure, it is assumed that there are four video streams and audio streams, respectively, and one accompanying data stream.

  The interface board 600 includes four video stream input terminals (first V terminal 691 to fourth V terminal 694) and four audio stream input terminals (first A terminal 695 to fourth A terminal 698). Further, the interface board 600 includes four video stream converters (first VS converter 611 to fourth VS converter 614) and four audio stream converters (first AS converter 621 to fourth AS converter 624). Is provided.

  Further, the interface board 600 includes four systems of in-device transmission stream generation units (first S generation unit 651 to fourth S generation unit 654) and four systems of stream transmission units (first S transmission unit 655 to fourth S transmission unit 658). With. Note that the first V terminal 691 to the fourth V terminal 694 correspond to the video stream input terminal 291 in FIG. 1, and the first A terminal 695 to the fourth A terminal 698 correspond to the audio stream input terminal 292 in FIG. Also, the first VS conversion unit 611 to the fourth VS conversion unit 614 correspond to the video stream conversion unit 210 in FIG. 1, and the first AS conversion unit 621 to the fourth AS conversion unit 624 correspond to the audio stream conversion unit 220 in FIG. The first S generation unit 651 to the fourth S generation unit 654 correspond to the in-device transmission stream generation unit 300 in FIG. 1, and the first S transmission unit 655 to the fourth S transmission unit 658 correspond to the stream transmission unit 270 in FIG. .

  Similarly to the interface board 200 of FIG. 1, the interface board 600 includes an accompanying data stream input terminal 293, an accompanying data stream conversion unit 230, and a baseband clock generation unit 240. Further, the interface board 600 includes a stream clock (SCLK) generation unit 250 and an in-device transmission clock (CLK) generation unit 260, as with the interface board 200 of FIG.

  The interface board 600 includes a video data writing unit 630, a video data acquisition unit 640, and a frame restoration unit 680. Each configuration other than the video data writing unit 630, the video data obtaining unit 640, and the frame restoration unit 680 corresponds to each configuration shown in FIG. For this reason, in FIG. 8, the video data writing unit 630, the video data acquisition unit 640, and the frame restoration unit 680 will be described.

  The video data writing unit 630 writes the four video streams input via the first V terminal 691 to the fourth V terminal 694 to the frame restoration unit 680 frame by frame. The video data writing unit 630 restores a frame before being divided into four systems by writing video data to a DRAM (Dynamic Random Access Memory) in the frame restoration unit 680. Since the video data writing unit 630 will be described with reference to FIG. 9, the description thereof is omitted here. The video data writing unit 630 writes video data to the DRAM, which will be described with reference to FIG. The video data writing unit 630 is an example of a restoration unit described in the claims.

  The video data acquisition unit 640 acquires video data for each frame from the frame restoration unit 680, divides the acquired video data into four, and generates four stream generation units (first S generation unit 651 to fourth S generation). Part 654). That is, the video data acquisition unit 640 subdivides the video stream into a frame division method different from the frame division method in the four video streams input to the first V terminal 691 to the fourth V terminal 694, and generates a new 4 Generate one video stream. Note that frame re-division by the video data acquisition unit 640 will be described with reference to FIGS. The video data acquisition unit 640 is an example of a dividing unit described in the claims.

  The frame restoration unit 680 temporarily holds the video data supplied from the video data acquisition unit 640 and restores a frame before being divided into four video streams in the external device. The frame restoration unit 680 supplies the video data to be held to the video data acquisition unit 640 after restoring the frame. The frame restoration unit 680 will be described with reference to FIG.

  The signal processing circuit board 700 includes four stream receiving units (first S receiving unit 711 to fourth S receiving unit 714). In addition, the signal processing circuit board 700 includes four in-device transmission stream separators (first S separator 721 to fourth S separator 724). The first S receiving unit 711 to the fourth S receiving unit 714 correspond to the stream receiving unit 410 in FIG. 1, and the first S separating unit 721 to the fourth S separating unit 724 correspond to the in-device transmission stream separating unit 420 in FIG. .

  The signal processing circuit board 700 includes a video processor 440, an audio processor 450, and a system controller 460, similar to the signal processing circuit board 400 of FIG. 1. Note that each configuration of the signal processing circuit board 700 corresponds to that shown in FIG. 1, and thus the description thereof is omitted here.

  Next, the video data writing unit 630, the video data acquisition unit 640, and the frame restoration unit 680 will be described with reference to FIG.

[Configuration example of video data writing unit and video data acquiring unit]
FIG. 9 is a block diagram illustrating a configuration example of the video data writing unit 630, the video data acquisition unit 640, and the frame restoration unit 680 according to the second embodiment of the present technology.

  In the figure, description will be given focusing on data transmission / reception among the video data writing unit 630, the video data acquisition unit 640, and the frame restoration unit 680 shown in FIG. In FIG. 8, only signal lines related to video data are shown between the video data writing unit 630, the video data acquisition unit 640, and the frame restoration unit 680, but FIG. 9 also shows signal lines related to control. .

  In the figure, a video data writing unit 630, a video data acquisition unit 640, and a frame restoration unit 680 are shown.

  The video data writing unit 630 includes a first time axis correction unit 631 to a fourth time axis correction unit 634. The frame restoration unit 680 includes an arbiter 681, a memory controller 682, a division control unit 683, and a DRAM 684.

  The first time axis correction unit 631 to the fourth time axis correction unit 634 adjust the time axis between the four video streams supplied from the first VS conversion unit 611 to the fourth VS conversion unit 614. Further, when the first time axis correction unit 631 to the fourth time axis correction unit 634 receive a command from the arbiter 681 after adjusting the time axis, the video data to be written in the DRAM 684 is supplied to the memory controller 682. The first time axis correction unit 631 to the fourth time axis correction unit 634 are realized by, for example, TBC (Time Base Corrector).

  The arbiter 681 arbitrates access (data writing or reading (acquisition)) to the DRAM 684. When the client (the first time axis correction unit 631 to the fourth time axis correction unit 634 and the video data acquisition unit 640) wants to access the DRAM 684, the arbiter 681 issues an access request (request) to the DRAM 684 issued by the client. Signal) is received via the signal line 689. The arbiter 681 determines (arbitration) a request that permits access to the DRAM 684 from the received requests, and sends an access permission signal (grant signal) to the client that issued the request via the signal line 688. Supply. Further, the arbiter 681 supplies a request permitting access to the DRAM 684 to the memory controller 682, and executes access to the DRAM 684 by the request.

  That is, the arbiter 681 supplies a grant signal to any one of the first time axis correction unit 631 to the fourth time axis correction unit 634 and holds it in the DRAM 684 when the video data for one frame is held in the DRAM 684. Output video data. Further, when the arbiter 681 acquires video data for one frame held in the DRAM 684, the arbiter 681 supplies a grant signal to the video data acquisition unit 640 to acquire the video data.

  The memory controller 682 controls access to the DRAM 684. For example, when access by a request issued by the first time axis correction unit 631 is permitted by the arbiter 681, the memory controller 682 writes the video data output by the first time axis correction unit 631 to the DRAM 684.

  The division control unit 683 controls the division of the video data read from the DRM 684 into four systems. For example, the division control unit 683 holds a plurality of control patterns according to the video data division method. Then, the division control unit 683 controls the arbiter 681, the memory controller 682, and the video data acquisition unit 640 based on the control pattern of the designated division method. This causes the video data acquisition unit 640 to generate four new video streams that are subdivided. As described above, the division control unit 683 holds a plurality of division scheme control patterns, whereby the division scheme of the video data divided in the external device can be changed in the interface board 600.

  The DRAM 684 is a storage device into which data supplied from the video data writing unit 630 is written and data is read out by the video data acquisition unit 640.

[Example of four video streams supplied to information processing apparatus]
FIG. 10 is a schematic diagram illustrating an example of four video streams supplied from an external apparatus to the information processing apparatus 110 according to the second embodiment of the present technology.

  FIG. 5A shows one frame (image 810) of a video stream before the external apparatus divides the system into four systems. The size of the image 810 is 3840 pixels in the horizontal direction and 2160 pixels in the vertical direction. A video stream composed of images of this size (3840 × 2160 pixels) cannot be transmitted as a single SDI video stream. Therefore, the external device divides an image having a size of 3840 × 2160 pixels into four (for example, divided into four subframes of upper right, lower right, upper left, and lower left) to generate four video streams of the SDI standard, These four video streams are supplied to the information processing apparatus 110.

  FIG. 4B schematically shows one frame in each of the four video streams.

  The first video stream image 820 indicates one frame of the video stream (first video stream) input to the first V terminal 691. The first video stream image 820 is an upper left image among the images obtained by dividing the image 810 shown in FIG. That is, the first video stream is data in which images in an area of 1920 × 1080 pixels in the upper left of the image 810 are continuous in time series.

  Similar to the first video stream image 820, the second video stream image 830 indicates the second video stream input to the second V terminal 692, and the third video stream image 840 indicates the third video stream at the third V terminal 693. . The fourth video stream image 850 indicates the fourth video stream input to the fourth V terminal 694. The second video stream corresponds to the upper right of the image 810, the third video stream corresponds to the lower left of the image 810, and the fourth video stream corresponds to the lower right of the image 810.

  In FIG. 5B, the first video stream image 820 is indicated by a dark gray rectangle, and the second video stream image 830 is indicated by a fine dot rectangle. Further, the third video stream image 840 is indicated by a rectangle with few dots, and the fourth video stream image 850 is indicated by a rectangle with a mesh. In these images, rectangles (pixels 821, 831, 841, and 851) schematically showing pixels are shown together with pixel numbers. Note that the rectangles with these patterns shown in the following drawings indicate the origin of the pixel (which of the four video streams transmitted from the external device is derived).

[One-frame memory map example held in DRAM]
FIG. 11 is a schematic diagram illustrating an example of a memory map of images (frames) held in the DRAM 684 according to the second embodiment of the present technology.

  FIG. 10A shows a memory map (memory map image 861) of one frame held in the DRAM 684 based on the four video streams (one frame is 1920 × 1080 pixels) shown in FIG. An example is shown. FIG. 11B shows an example of a one-frame memory map (memory map image 862) held in the DRAM 684 based on four video streams of 2048 × 1080 pixels per frame.

  In FIGS. 7A and 7B, memory addresses (addresses 0x0, 0x20, 0x200, 0x3ff, and 0x3e0) in the column direction (the horizontal direction in the figure) in the DRAM 684 are based on the left end of the memory map image 862. It is shown as (0x0 address).

  Here, writing of video data to the DRAM 684 by the video data writing unit 630 will be described. The video data writing unit 630 restores, on the memory map of the DRAM 684, a frame before being divided into four for transmission in four video streams. At the time of this writing, data is written so that data is not interrupted in the middle of the line (in the horizontal direction in the figure). As shown in FIG. 4B, it is assumed in advance that a plurality of sizes of frames are supplied to the interface board 600, and data is written so that data is not interrupted even when the number of pixels in the frame is different.

  For example, as shown in (a) and (b) of the figure, writing is performed so that the left end of the upper right and lower right images of the four divided images is at address 0x200. Further, along with this writing, writing is performed so that the right end of the upper left and lower left images of the four-divided image is the address immediately before 0x200. That is, by setting an address (for example, address 0x200) as a joint of the four-divided image in advance and writing to the DRAM 684 with reference to this address, the data can be written to the DRAM 684 so that the data is not interrupted in the middle of the line.

  Thus, by writing to the DRAM 684 so that the data is not interrupted in the middle of the line, when the video data acquisition unit 640 reads, the data can be read by using burst transfer, thereby enabling high-speed reading. .

[Example of division method conversion when reading from DRAM]
12 and 13 are schematic diagrams illustrating an example of division method conversion when the video data acquisition unit 640 reads out an image held in the DRAM 684 according to the second embodiment of the present technology.

  Note that the division format conversion performed by the video data acquisition unit 640 described in FIGS. 12 and 13 is performed in an advantageous manner for image processing of the video processor 440 in the signal processing circuit board 700. For this reason, various examples of conversion methods can be considered according to the type of the video processor 440. Here, as an example, a method of classifying vertical lines into four in order is shown in FIG. A method of dividing two pixels into four is shown in FIG.

  In FIG. 12, an example in which vertical lines are classified into four in order is shown in FIG. 12A, and an image showing the data structure of four video streams (in-device transmission video streams) generated by this method. Is shown in FIG.

  In FIG. 9A, a data string (read data string 911) indicating a series of data read from the DRAM 684 in pixel units, and four data strings (first data columns) obtained by dividing the data string by the video data acquisition unit 640. 1 data string 912 to fourth data string 915) are shown. Note that the read data string 911 shows a data string of 12 (numbered 1 to 12) pixels as an example. An example of dividing these 12 pixels into four systems is shown in a first data string 912 to a fourth data string 915.

  Here, the division format conversion by the video data acquisition unit 640 will be described. When the video data writing unit 630 writes video data for one frame into the DRAM 684, the video data acquisition unit 640 starts acquiring video data for the frame. For example, data is read in order from the data (No. 1) of the upper left pixel in FIG. 11A to the right (2, 3, 4,...). Then, the read data (read data string 911) is divided into four data strings (first data string 912 to fourth data string 915) by the video data acquisition unit 640 according to the division method designated by the division control unit 683. ).

  In FIG. 12, since the vertical line is divided into four in order (column-based division method), the first, fifth, and ninth pixel data are defined as the first data column 912, and the second, sixth, and tenth. The second pixel data is the second data string 913. The pixel data of Nos. 3, 7, and 11 are the third data string 914, and the pixel data of Nos. 4, 8, and 12 are the fourth data string 915. The four data strings are supplied to the first S generation unit 651 to the fourth S generation unit 654 as four video streams for in-device transmission.

  In FIG. 4B, four images (first video stream image 921 to fourth video stream image 924) each representing one frame in the four video streams for in-device transmission are shown.

  As shown in the first video stream image 921 to the fourth video stream image 924, when divided into four systems in units of columns, the size of one frame is 960 pixels in the horizontal direction and 2160 pixels in the vertical direction. The video processor can generate a frame by receiving pixel streams alternately from the first video stream to the fourth video stream by receiving the stream thus divided, so that the processing delay in the video processor is small. Become.

  In FIG. 13, an example in which 2 × 2 pixels are divided into four is shown in FIG. 13A, and an image showing a data structure in four video streams generated by this method is shown in FIG. Has been.

  In FIG. 2A, two rows of data strings (read data string 931) read from the DRAM 684 are shown to explain a method of dividing 2 × 2 pixels into four (two-pixel interleave method). ing. Also, in FIG. 9A, four data strings (first data string 932 to fourth data string 936) obtained by dividing the data string by the video data acquisition unit 640 are shown.

  Here, the conversion of the two-pixel interleave method by the video data acquisition unit 640 will be described. In the two-pixel interleave method, the four pixels in 2 rows × 2 columns are divided so as to be in different systems. For example, the pixels (Nos. 1, 2, 1921, and 1922) in the left two columns of the read data column 931 are in different systems. In this way, by dividing the 4 pixels in 2 rows × 2 columns into a separate system, the first, third, and fifth pixel data become the first data column 932, and the second, fourth, and sixth pixels. The data is the second data string 933. In addition, the pixel data Nos. 1921, 1923, and 1925 are the third data string 934, and the pixel data Nos. 1922, 1924, and 1926 are the fourth data string 935.

  In FIG. 4B, four images (first video stream image 941 to fourth video stream image 944) each representing one frame in the four video streams for in-device transmission are shown.

  As shown in the first video stream image 941 to the fourth video stream image 944, when divided into four systems in units of 2 rows × 2 columns, the size of one frame is 1920 pixels in the horizontal direction and 1080 pixels in the vertical direction. Moreover, by dividing into 4 systems in units of 2 rows × 2 columns, an image in each system becomes an image in which the original image is reduced to ¼. In other words, the video processor can generate an image close to the original image by performing the complementary process even when a problem occurs in one stream by receiving the stream thus divided. it can.

  As shown in FIGS. 12 and 13, the video data is held in the DRAM 684 in units of one frame, so that the division method can be converted when the video data acquisition unit 640 acquires the video data.

  Thus, according to the second embodiment of the present technology, even when a plurality of video streams are supplied from an external device, an in-device transmission stream is generated, and the generated in-device transmission stream is It can be transmitted to other boards (circuits) in the device. That is, similarly to the first embodiment of the present technology, it is possible to suppress an increase in signal lines related to transmission of a plurality of streams within a device.

  Further, according to the second embodiment of the present technology, it is possible to easily convert the video data division method when generating the in-device transmission stream. Thereby, when designing interface boards of a plurality of devices having different specifications, it is possible to improve the possibility of being configured in the same circuit design.

<3. Third Embodiment>
In the first and second embodiments of the present technology, the example in which the interface board generates the in-device transmission stream in order to transmit the three streams transmitted by the external device to the signal processing circuit board 400 has been described. However, the present invention is not limited to this, and it is also conceivable that the signal processing circuit board generates an in-device transmission stream and the interface board receives it in order to transmit the three streams to the external device. Even in such a case, as in the first and second embodiments of the present technology, by transmitting and receiving the intra-device transmission stream, an increase in signal lines related to the transmission of a plurality of streams within the device is increased. Can be suppressed.

  Thus, an example in which the signal processing circuit board generates an in-device transmission stream and the interface board receives the signal will be described as a third embodiment of the present technology with reference to FIGS. 14 and 15.

[Configuration example of information processing device]
FIG. 14 is a block diagram illustrating a configuration example of the information processing device 120 according to the third embodiment of the present technology. The information processing apparatus 100 includes a signal processing circuit board 409 and an interface board 209.

  The signal processing circuit board 409 includes a video processor 445, an audio processor 455, a system controller 465, an in-device transmission stream generation unit 301, and a stream transmission unit 401. The signal processing circuit board 409 also includes a baseband clock generation unit 249, a stream clock generation unit 259, and an in-device transmission clock generation unit 269.

  The baseband clock generation unit 249, the stream clock generation unit 259, and the in-device transmission clock generation unit 269 correspond to the baseband clock generation unit 240, the stream clock generation unit 250, and the in-device transmission clock generation unit 260 illustrated in FIG. . For this reason, explanation here is omitted.

  The video processor 445 is the same as the video processor 440 shown in FIG. 1 except that a video stream for transmission to an external device is transmitted to the in-device transmission stream generation unit 301. Similarly, the audio processor 455 is the same as the audio processor 450 shown in FIG. 1 except that an audio stream for transmission to an external device is transmitted to the in-device transmission stream generation unit 301. The system controller 465 is the same as the system controller 460 shown in FIG. 1 except that the accompanying data stream for transmission to the external device is transmitted to the in-device transmission stream generation unit 301.

  The intra-device transmission stream generation unit 301 generates an intra-device transmission stream, similar to the intra-device transmission stream generation unit 300 of the interface board 200 shown in FIG. That is, the intra-device transmission stream generation unit 301 generates an intra-device transmission stream based on the streams supplied from the video processor 445, the audio processor 455, and the system controller 465. The in-device transmission stream generation unit 301 supplies the generated in-device transmission stream to the stream transmission unit 401 and transmits the stream to the interface board 209 via the signal line 205. Further, the in-device transmission stream generation unit 301 supplies the in-device transmission stream information to the interface board 209 via the signal line 208. The configuration of the in-device transmission stream generation unit 301 and the stream transmission unit 401 is the same as that of the in-device transmission stream generation unit 300 and the stream transmission unit 270 shown in FIG.

  The interface board 209 is a board for intervening data transmission / reception between the information processing apparatus 100 and the external apparatus, and outputs three streams to the external apparatus in the third embodiment of the present technology. Note that each configuration of the interface board 209 will be described with reference to FIG.

[Configuration example of interface board]
FIG. 15 is a block diagram illustrating a configuration example of the interface board 209 according to the third embodiment of the present technology.

  The interface board 209 includes a stream reception unit 275, a baseband clock generation unit 245, an external output stream generation unit 280, a video stream transmission clock generation unit 246, and a video stream conversion unit 215. The interface board 200 includes an audio stream conversion unit 225, an accompanying data stream conversion unit 235, a video stream output terminal 294, an audio stream output terminal 295, and an accompanying data stream output terminal 296.

  The stream receiving unit 275 includes a stream data input unit 276, a bit width conversion unit 277, and a clock input unit 278. Each configuration of the stream receiving unit 275 is the same as that of the stream receiving unit 410 shown in FIG. That is, the stream receiving unit 275 converts the bit width of the in-device transmission stream supplied via the signal line 207, and converts the bit width-converted in-device transmission stream to the stream separation unit 281 of the external output stream generation unit 280. Supply. In addition, the stream reception unit 275 supplies a clock (stream clock) of the in-device transmission stream to the baseband clock generation unit 245.

  The baseband clock generation unit 245 generates a baseband clock of the video stream, similarly to the baseband clock generation unit 240 shown in FIG. The baseband clock generation unit 245 generates a baseband clock based on the stream clock. The baseband clock generation unit 245 supplies the generated baseband clock to the external output stream generation unit 280 and the video stream transmission clock generation unit 246.

  The external output stream generation unit 280 includes a stream separation unit 281, a control unit 282, a video data buffer 283, an audio data buffer 284, and an accompanying data buffer 285. The external output stream generation unit 280 includes a TRS generation unit 286, a blank generation unit 287, a video stream synthesis unit 288, and a stream information analysis unit 289.

  The stream information analysis unit 289 analyzes the in-device transmission stream information in the same manner as the stream information analysis unit 421 shown in FIG. 3, and supplies a selection control signal for separating data to the stream separation unit 281. .

  The stream separation unit 281 separates the in-device transmission stream into each data (video, audio, and accompanying data), similarly to the stream separation unit 422 shown in FIG. The stream separation unit 281 supplies the separated video data to the video data buffer 283, supplies the separated audio data to the audio data buffer 284, and supplies the separated accompanying data to the accompanying data buffer 285.

  The control unit 282 controls generation of an SDI standard video stream (output video stream) transmitted (output) from the information processing apparatus 100 to an external apparatus. The control unit 282 controls the supply timing of data supplied from the TRS generation unit 286, the blank generation unit 287, and the video data buffer 283 to the video stream synthesis unit 288. Also, the control unit 282 supplies a selection control signal to the video stream synthesis unit 288, and controls the video stream synthesis unit to align and output the plurality of data supplied to the video stream synthesis unit 288 into the data structure of the video stream. To 288.

  The video data buffer 283 holds the video data supplied from the stream separation unit 281 and supplies the held video data to the video stream synthesis unit 288 based on a command from the control unit 282.

  The audio data buffer 284 holds the audio data supplied from the stream separation unit 281 and supplies the held audio data to the audio stream conversion unit 225.

  The accompanying data buffer 285 holds the accompanying data supplied from the stream separation unit 281 and supplies the accompanying accompanying data to the accompanying data stream conversion unit 235.

  The TRS generation unit 286 generates a TRS of a video stream to be transmitted from the information processing apparatus 100 to an external device based on an instruction from the control unit 282. The TRS generation unit 286 supplies the generated TRS to the video stream synthesis unit 288.

  The blank generation unit 287 generates data other than the TSR in the blanking of the video stream transmitted from the information processing apparatus 100 to the external apparatus based on an instruction from the control unit 282. The blank generation unit 287 supplies the generated data to the video stream synthesis unit 288.

  The video stream synthesis unit 288 generates a SDI standard video stream by aligning a plurality of supplied data, and supplies the generated video stream (output video stream) to the video stream conversion unit 215.

  The video stream transmission clock generation unit 246 generates a clock for transmitting the output video stream to an external device, and supplies the generated clock to the video stream conversion unit 215.

  The video stream conversion unit 215 converts the output video stream synthesized by the video stream synthesis unit 288 into bit-width data to be output to an external device. The video stream conversion unit 215 puts the converted output video stream on the clock generated by the video stream transmission clock generation unit 246 and outputs it to an external device via a cable connected to the video stream output terminal 294. Note that the video stream converter 215 is an example of a video stream transmitter described in the claims.

  The audio stream conversion unit 225 generates an audio stream to be output to an external device based on the audio data acquired from the audio data buffer 284. The audio stream conversion unit 225 outputs the generated audio stream to an external device via a cable connected to the audio stream output terminal 295.

  The accompanying data stream conversion unit 235 generates an accompanying data stream to be output to an external device based on the accompanying data acquired from the accompanying data buffer 285. The accompanying data stream conversion unit 235 outputs the generated accompanying data stream to an external device via a cable connected to the accompanying data stream output terminal 296. The audio stream conversion unit 225 and the accompanying data stream conversion unit 235 are examples of the related data stream transmission unit described in the claims.

  The video stream output terminal 294 is a terminal for connecting a cable for outputting the output video stream to an external device. Similarly, the audio stream output terminal 295 is a terminal for connecting a cable for outputting an audio stream, and the accompanying data stream output terminal 296 is a terminal for connecting a cable for outputting the accompanying data stream. .

  Thus, according to the third embodiment of the present technology, three streams for external output can be generated from the in-device transmission stream.

  14 and 15, an example in which one video stream is provided as in the first embodiment of the present technology has been described. However, a plurality of video streams are included in the second embodiment of the present technology. The same applies to the system. In the second embodiment of the present technology, the number of necessary circuits (DRAM, arbiter, memory controller, etc.) is reduced by sharing the DRAM used on the input side and the DRAM used on the output side. be able to.

  As described above, according to the embodiment of the present technology, it is possible to suppress an increase in signal lines related to transmission of a plurality of streams in a device by transmitting and receiving the transmission stream in the device. In particular, by reducing the number of streams transmitted inside the device, the number of signal pins, the number of connectors, and the like related to stream transmission can be reduced, thereby reducing costs and improving yield.

  In addition, according to the embodiment of the present technology, it is not necessary to change the circuit design according to the change in the size of the audio data as long as the size fits in the additional blanking. That is, an electronic circuit (interface board) having the same design can be used in a plurality of devices. This reduces the need to design and evaluate for each device specification and can improve design productivity.

  In addition, according to the second embodiment of the present technology, by providing the DRAM on the interface substrate, the division method can be converted in the interface substrate. This eliminates the need to change the circuit design according to the division method required by the signal processing circuit board. That is, the same design interface board can be used in a plurality of devices, and cost reduction, yield improvement, design productivity improvement, and the like can be performed.

  In other words, compared with the conventional technology in which an external input board (interface board) and a processing circuit board (signal processing circuit board) are designed for each device according to the size of data to be processed, According to the embodiment of the technology, the design for each device can be reduced.

  In the embodiment of the present technology, it is assumed that the audio data and accompanying data are not included in the video stream, but the present invention is not limited to this. Even if it is included, it can be applied in the same manner as in the embodiment of the present technology by generating an in-device transmission stream including them.

  In the embodiment of the present technology, it is assumed that no data processing is performed on the video data of the video stream transmitted from the external device, but the present invention is not limited to this. For example, there may be a case where it is necessary to convert the RGB format to the YUV format. In this case, before the video stream conversion unit 210 shown in FIG. 2 holds the video stream in the video data buffer 330, it is converted into the YUV format using a color space conversion (CSC) arithmetic circuit. Can be similarly implemented.

  In the embodiment of the present technology, the data structure of the in-device transmission stream is transmitted by transmitting and receiving the in-device transmission stream information. However, the present invention is not limited to this. For example, it may be considered that information included in the in-device transmission stream information is included in the blanking of the in-device transmission stream.

  The above-described embodiment shows an example for embodying the present technology, and the matters in the embodiment and the invention-specific matters in the claims have a corresponding relationship. Similarly, the invention specific matter in the claims and the matter in the embodiment of the present technology having the same name as this have a corresponding relationship. However, the present technology is not limited to the embodiment, and can be embodied by making various modifications to the embodiment without departing from the gist thereof.

  Further, the processing procedure described in the above embodiment may be regarded as a method having a series of these procedures, and a program for causing a computer to execute these series of procedures or a recording medium storing the program. You may catch it. As this recording medium, for example, a hard disk, a CD (Compact Disc), an MD (MiniDisc), a DVD (Digital Versatile Disk), a memory card, a Blu-ray Disc (registered trademark), or the like can be used.

In addition, this technique can also take the following structures.
(1) Related data including a video stream including a moving picture period and a blanking period for each data structure of one frame in accordance with a predetermined data structure for transmitting / receiving moving picture data between apparatuses and related data related to the moving picture data A stream generation unit that generates a multiplexed stream having a data structure in which an additional blanking period of a predetermined size for storing the related data is added for each frame of the video stream, based on the stream;
An integrated circuit comprising: a transmission unit that transmits the generated multiplexed stream to another integrated circuit.
(2) In the additional blanking period, identification information for identifying a position of the additional blanking period, the related data, and padding are stored.
The integrated circuit according to (1), wherein the stream generation unit generates the additional blanking period by increasing or decreasing the amount of padding according to the size of the related data.
(3) The integrated circuit according to (1), wherein the related data stream includes audio data associated with the moving image data as the related data.
(4) a restoration unit that restores the frame before the division based on the plurality of video streams generated by dividing one frame into a plurality of subframes for transmission and reception;
A division unit that re-divides the restored frame based on a division method different from the division method performed in the division and generates a plurality of new video streams;
The stream generation unit generates a plurality of the multiplexed streams for each of the new plurality of video streams,
The integrated circuit according to any one of (1) to (3), wherein the transmission unit transmits the generated multiplexed streams to the other integrated circuit.
(5) The video stream to be restored by the restoration unit is a stream generated by dividing one frame into four,
The dividing unit sequentially classifies the data of each pixel in the restored frame in units of four pixels continuous in a predetermined direction of the restored frame, thereby generating four new video streams. The integrated circuit according to (4), which is generated as the plurality of new video streams.
(6) The video stream to be restored by the restoration unit is a stream generated by dividing one frame into four,
The dividing unit sequentially and sequentially classifies the data of each pixel in the restored frame in units of two pixels continuous in a predetermined direction of the restored frame and continues in a direction orthogonal to the predetermined direction. The integrated circuit according to (4), wherein four new video streams are generated as the new plurality of video streams by alternately and sequentially classifying in units of two lines.
(7) Stream reception for receiving a multiplexed stream in which an additional blanking period of a predetermined size for storing related data of moving image data is added to a predetermined data structure for transmission / reception of moving image data between devices And
A separation unit that separates moving image data and related data included in the received multiplexed stream;
A video stream transmission unit for storing and transmitting the separated moving image data in the video stream having the predetermined data structure;
An integrated circuit comprising: a related data stream transmission unit that stores and transmits the separated related data in a related data stream having a data structure for transmitting and receiving the related data between devices.
(8) Related data including a video stream including a moving image period and a blanking period for each data structure of one frame in accordance with a predetermined data structure for transmitting / receiving moving image data between apparatuses and related data related to the moving image data A stream generation unit that generates a multiplexed stream having a data structure in which an additional blanking period of a predetermined size for storing the related data is added for each frame of the video stream based on the stream; A first integrated circuit comprising a transmitter for transmitting the multiplexed stream to another integrated circuit;
A separation unit that separates the moving image data and the related data from the transmitted multiplexed stream, an image processing unit that performs image processing on the separated moving image data, and related data processing that performs signal processing on the separated related data An information processing apparatus comprising: a second integrated circuit including a unit.

DESCRIPTION OF SYMBOLS 100 Information processing apparatus 200 Interface board 210 Video stream conversion part 220 Audio stream conversion part 230 Attached data stream conversion part 240 Baseband clock generation part 250 Stream clock generation part 260 In-device transmission clock generation part 270 Stream transmission part 271 Bit width conversion part 272 Stream output unit 273 Clock output unit 300 In-device transmission stream generation unit 310 Video data separation unit 320 TRS analysis unit 330 Video data buffer 340 Audio data buffer 345 Audio data packet generation unit 350 Attached data buffer 355 Attached data packet generation unit 360 Control Unit 370 control packet generation unit 380 TRS generation unit 385 blank generation unit 390 stream generation unit 40 Signal processing circuit board 410 Stream receiving unit 411 Stream input unit 412 Bit width conversion unit 413 Clock input unit 420 In-device transmission stream separation unit 421 Stream information analysis unit 422 Stream separation unit 423 Video stream generation unit 424 Audio stream generation unit 425 Accompanying data Stream generation unit 426 Video clock generation unit 440 Video processor 450 Audio processor 460 System controller

Claims (8)

A video stream including a moving picture period and a blanking period for each data structure of one frame in accordance with a predetermined data structure for transmitting / receiving moving picture data between devices, and a related data stream including related data related to the moving picture data A stream generation unit for generating a multiplexed stream having a data structure in which an additional blanking period of a predetermined size for storing the related data is added for each frame of the video stream;
An integrated circuit comprising: a transmission unit that transmits the generated multiplexed stream to another integrated circuit. In the additional blanking period, identification information for identifying a position of the additional blanking period, the related data, and padding are stored.
The integrated circuit according to claim 1, wherein the stream generation unit generates the additional blanking period by increasing or decreasing the amount of padding according to a size of the related data.   The integrated circuit according to claim 1, wherein the related data stream includes audio data associated with the moving image data as the related data. A restoration unit that restores the frame before the division based on the plurality of video streams generated by dividing one frame into a plurality of subframes for transmission and reception;
A division unit that re-divides the restored frame based on a division method different from the division method performed in the division and generates a plurality of new video streams;
The stream generation unit generates a plurality of the multiplexed streams for each of the new plurality of video streams,
The integrated circuit according to claim 1, wherein the transmission unit transmits the generated multiplexed streams to the other integrated circuit. The video stream to be restored by the restoration unit is a stream generated by dividing one frame into four,
The dividing unit sequentially classifies the data of each pixel in the restored frame in units of four pixels continuous in a predetermined direction of the restored frame, thereby generating four new video streams. 5. The integrated circuit according to claim 4, wherein the integrated circuit is generated as the plurality of new video streams. The video stream to be restored by the restoration unit is a stream generated by dividing one frame into four,
The dividing unit sequentially and sequentially classifies the data of each pixel in the restored frame in units of two pixels continuous in a predetermined direction of the restored frame and continues in a direction orthogonal to the predetermined direction. The integrated circuit according to claim 4, wherein four new video streams are generated as the plurality of new video streams by alternately and sequentially classifying in units of two lines. A stream receiving unit that receives a multiplexed stream in which an additional blanking period of a predetermined size for storing related data of moving image data is added to a predetermined data structure for transmission and reception of the moving image data between devices;
A separation unit that separates moving image data and related data included in the received multiplexed stream;
A video stream transmission unit for storing and transmitting the separated moving image data in the video stream having the predetermined data structure;
An integrated circuit comprising: a related data stream transmission unit that stores and transmits the separated related data in a related data stream having a data structure for transmitting and receiving the related data between devices. A video stream including a moving picture period and a blanking period for each data structure of one frame in accordance with a predetermined data structure for transmitting / receiving moving picture data between devices, and a related data stream including related data related to the moving picture data A stream generation unit for generating a multiplexed stream having a data structure in which an additional blanking period of a predetermined size for storing the related data is added for each frame of the video stream, and the generated multiplexing A first integrated circuit comprising a transmitter for transmitting the stream to another integrated circuit;
A separation unit that separates the moving image data and the related data from the transmitted multiplexed stream, an image processing unit that performs image processing on the separated moving image data, and related data processing that performs signal processing on the separated related data An information processing apparatus comprising: a second integrated circuit including a unit.

Images