JP2007311929A - Device and method for sending and receiving video image - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To transmit a plurality of video image data with a cable having an HDMI standard, or the like satisfactorily. <P>SOLUTION: When the video image data and data following them are sent to other devices in a format for transmission in synchronization with a pixel clock in one-pixel unit of the video image data; the plurality of video image data are obtained, the data of each pixel of the plurality of video image data are assigned to the transmission period of each pixel of one frame that can be transmitted in the format each, and the video image data that are synthesized by the assignment and have the format are output in synchronization with the pixel clock. Or, the pixel data of first video image data in the plurality of video image data are arranged at a pixel data transmission position prescribed in the format, an assignment is made for arranging the other video image data except the first ones at a data transmission position in a blanking period prescribed by the format, and the video image data in the format composited by the assignment are output in synchronization with the pixel clock. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention is a video transmission apparatus, a video transmission method, a video reception apparatus, and a video transmission apparatus suitable for application to a system for transmitting video data in accordance with a digital video / audio input / output interface standard called HDMI (High-Definition Multimedia Interface) standard. The present invention relates to a video receiving method.

  In recent years, what is called an HDMI standard has been developed as an interface standard for transmitting uncompressed digital video data and the like between a plurality of video devices. The HDMI standard is a standard for individually transmitting video data as primary color data of each color in units of pixels (hereinafter, pixels are referred to as pixels). Audio data (audio data) is also transmitted using a video data transmission line during the blanking period of the video data. The primary color data to be transmitted may be the case of transmitting three-channel primary color data (R data, G data, B data) of additive color mixture of red, green, and blue, or the case of luminance and color difference signals such as Y, Cb, and Cr. is there.

  One pixel data of each color is basically transmitted in units of 8 bits. Synchronization signals such as a horizontal synchronization signal and a vertical synchronization signal are also transmitted at the timing at which each synchronization signal is arranged. Also, a pixel clock transmission line for video data and a control data transmission line are provided. As described above, since the transmission configuration is such that non-compressed digital video data is transmitted in units of pixels, it is possible to transmit high definition video while protecting the copyright.

  FIG. 24 is a diagram showing an outline of an example in which primary color data (R data, G data, B data) is transmitted through an HDMI standard interface. As for video data, B data, G data, and R data are individually transmitted through three channels of channel 0, channel 1, and channel 2. In the example of FIG. 24, a period for transmitting data of five pixels, pixel 0, pixel 1, pixel 2, pixel 3, and pixel 4, is shown, and data of one pixel of each channel is composed of 8 bits.

  That is, for B data (blue data), 8-bit B0 data is sent during the period of pixel 0 using channel 0. Hereinafter, 8-bit B1 data, B2 data, B3 data, and B4 data are transmitted. The signals are sent in order in synchronization with a pixel clock (not shown). For G data (green data), 8-bit G0 data is sent during the period of pixel 0 using channel 1, and hereinafter, 8-bit G1 data, G1 data, G2 data, G3 data, G4 data Are sent sequentially in synchronization with the pixel clock. For R data (red data), 8-bit R0 data is sent during the period of pixel 0 using channel 2, and hereinafter, 8-bit R1 data, R2 data, R3 data, and R4 data are pixel clocks. Sent sequentially in sync with. Each of phase 0, phase 1,... Shown in FIG. 24 represents one period of the pixel clock.

  Although not shown in FIG. 24, the HDMI standard interface uses another channel to transmit control data and a pixel clock. For control data, not only transmission of video data from the sending device (source device) to the receiving device (sink device), but also from the receiving device (sink device) to the sending device (source device) Can be transmitted. The source device encrypts data in 8-bit units, and the sink-side device decrypts data from the encryption in 8-bit units.

  FIG. 25 is a diagram illustrating an outline of an example in which luminance data (Y data) and chroma data (C data) are transmitted through an HDMI standard interface. In this case, 4 bits out of 8 bits per pixel clock that can be transmitted on channel 0 are assigned to luminance data, 4 bits are assigned to chroma data, 8 bits of channel 1 are assigned to luminance data, and 8 bits of channel 2 are assigned. Is assigned to chroma data. With such a configuration, 12-bit luminance data and 12-bit chroma data (6-bit Cb data and 6-bit Cr data) can be transmitted per pixel clock.

  FIG. 26 is a diagram showing an outline of another example in the case of transmitting luminance data (Y data) and chroma data (C data) with an HDMI standard interface. In this case, channel 0 is assigned to 8-bit chroma data (Cb data) per pixel clock, channel 1 is assigned to 8-bit luminance data per pixel clock, and channel 2 is 8-bit chroma per pixel clock. The data is assigned to data (Cr data). With such a configuration, 8-bit luminance data and 16-bit chroma data can be transmitted per pixel clock.

  The connection of a plurality of video devices via the HDMI standard transmission line (HDMI cable) transmitted in the transmission configuration of FIGS. 24 to 26 includes a video signal source such as a disk playback device, a hard disk recording / playback device, and a tuner device. In general, a display device (a monitor receiver, a television receiver, or the like) is connected to the device. A device that outputs video data or the like to an HDMI standard transmission line is called a source device (output device), and a device that inputs video data or the like via an HDMI standard transmission line is called a sink device (receiving device). Is done.

Patent Document 1 describes details of the HDMI standard.
WO2002 / 078336

  By the way, when video data is digitally transmitted according to the HDMI standard or the like, only one video can be transmitted with one cable. Therefore, in order to realize a multi-screen on a television, for example, to display video from a connected video playback device or tuner, and to make it very easy for a user to select content, a single video playback device must have multiple When video can be provided, it is necessary to connect the television receiver and the video playback device with a plurality of cables, which places a burden on the user in terms of cost and makes the installation status of the device very unsightly. Conversely, if a single cable is used, the video provided from the video playback device is limited to one. In recent years, video playback devices, such as hard disk recorders, that can store and play back a large amount of video content have become commonplace, but due to the problems described above, when connected with an HDMI standard cable, It was not easy to use, and the operability when selecting content was not good.

  SUMMARY An advantage of some aspects of the invention is that a plurality of pieces of video data can be transmitted satisfactorily using an HDMI standard cable or the like.

  The first invention is a format in which video data and data accompanying the video data are transmitted in synchronization with a pixel clock in units of one pixel of the video data, and when a plurality of video data is sent to another device, The data of each pixel of the plurality of video data is allocated to the transmission period of each pixel of one frame that can be transmitted in the format, and the video data of the format synthesized by the allocation is synchronized with the pixel clock. Output.

  In a second aspect of the present invention, when video data and data accompanying the video data are transmitted to another device in a format in which the video data is transmitted in units of one pixel in synchronization with a pixel clock, a plurality of video data is transmitted. The pixel data of the first video data among the plurality of video data is arranged at the pixel data transmission position defined by the format, and other video data other than the first video data is The allocation to be arranged at the data transmission position within the blanking period defined by the format is performed, and the video data of the format synthesized by the allocation is output in synchronization with the pixel clock.

  According to a third aspect of the present invention, when video data transmitted from another device and data accompanying the video data are received in a format in which the video data is received in synchronization with a pixel clock in units of one pixel, The received video data is received in synchronization with the pixel clock, and the received one-frame video data defined in the format is divided into a plurality of video data in synchronization with the pixel clock. Is displayed.

  According to a fourth aspect of the present invention, when video data sent from another device and data accompanying the video data are received in a format in which the video data is received in synchronization with the pixel clock in units of one pixel, the data is input. The video data is received in synchronization with the pixel clock, and the received one-frame video data defined in the format and the video data arranged in the data transmission period within the blanking period defined in the format The separated video data is subjected to display processing.

  By performing the processes of these inventions, a plurality of video data can be transmitted simultaneously in a prescribed format.

  According to the present invention, a plurality of types of video data can be transmitted at the same time using a cable of a standard that originally transmits types of video data, such as the HDMI standard. For this reason, for example, it is possible to perform a process of simultaneously transmitting various types of videos such as index videos of video content stored by the transmission source and simultaneously displaying them on the receiving side.

  Hereinafter, a first embodiment of the present invention will be described with reference to FIGS.

  In this example, a video program viewing system is configured by a display device and a plurality of recording / playback devices capable of transmitting video data to the display device. FIG. 1 shows an example of the system configuration. A display device 10 configured as a television receiver is connected to a first recording / playback device 30 via an HDMI standard transmission line 1. Further, the display device 10 is connected to the second recording / playback device 50 via another HDMI standard transmission line 1.

  FIG. 2 is a diagram illustrating a configuration example of the display device 10 of the present example. The display device 10 configured as a television receiver includes an HDMI terminal 11 for connecting the HDMI cable 1 (FIG. 1). The HDMI terminal 11 is a terminal for inputting video data and the like, and performs input processing of video data and audio data input by the HDMI transmission processing unit 12. The input processing in the HDMI transmission processing unit 12 is executed under the control of the HDMI transmission control unit 13. Some data such as control data can be sent from the HDMI transmission processing unit 12 to the cable 1 connected to the HDMI terminal 11 under the control of the HDMI transmission control unit 13.

  Transmission using the HDMI terminal 11 is controlled by the control unit 17 that controls the operation of the entire display device. As a configuration for displaying video on the display device 10, the video display processing unit 18 is provided. The video data received by the HDMI terminal 11 or the video data received by the tuner 27 is processed for display and displayed on the display panel 19. Display. As the display panel, various video display means such as a liquid crystal display panel can be applied.

  In addition, the display device 10 includes an audio processing unit 20. The audio processing unit 20 performs audio processing on the audio data received by the HDMI terminal 11 or the audio data received by the tuner 27 to obtain an analog-converted audio signal. The converted audio signal is subjected to output processing such as amplification by the output processing unit 21 and is output from the connected speakers 22L and 22R.

  A list of video contents that can be received via the HDMI terminal 11 of the display device 10 is stored in the HDMI content list storage unit 25 under the control of the control unit 17. This list of contents is obtained at the stage of exchanging control data with a device connected to the HDMI terminal 11, performs processing to be acquired from the counterpart device, and receives data received by the transmission processing unit 12 as an HDMI content list storage unit 25. Remember me. Furthermore, the HDMI status storage unit 26 stores the data transmission state via the HDMI terminal 11. As specific statuses stored in the HDMI status storage unit 26, for example, when receiving video content, data necessary for specifying the content being received and video content are received (reproduced). ) Data of the section.

  The playback position of the video content received and played back (viewed) via the HDMI terminal 11 of the display device 10 is stored in the content playback position storage unit 28, and the playback position stored in the storage unit 28 is stored in the control unit 17. Can be determined.

  FIG. 3 is a diagram showing a configuration example of the first recording / reproducing apparatus 30 of this example. The first recording / playback apparatus 30 configured as a video recorder that receives and records video content (video program) and plays back the recorded video content is an HDMI for connecting the HDMI cable 1 (FIG. 1). A terminal 31 is provided. The HDMI terminal 31 is a terminal that outputs video data and the like, and the HDMI transmission processing unit 32 performs output processing of video data and audio data. The input processing in the HDMI transmission processing unit 32 is executed under the control of the HDMI transmission control unit 33. Some data such as control data can be transmitted to a counterpart device (input device) connected by a cable under the control of the HDMI transmission control unit 33, and data such as control data transmitted from the counterpart device can be transmitted. The HDMI transmission control unit 33 can discriminate.

  Transmission using the HDMI terminal 31 is controlled by a control unit 34 that controls the operation of the entire recording / playback apparatus. The recording / playback apparatus includes a content storage unit 42 that stores video content (video programs such as broadcast programs and movies). The content storage unit 42 is composed of a large-capacity hard disk, for example. Storage (recording) of video content in the content storage unit 42 and playback processing of the stored content are executed by the content recording / playback unit 43. The video content reproduced by the content recording / reproducing unit 43 is output from the HDMI terminal 31.

The content list stored in the content storage unit 42 is stored in the content list storage unit 41. The content list storage unit 41 and the content storage unit 42 may use the same storage unit (such as a hard disk). As a list of content stored in the content storage unit 42, when the video content is a broadcast program, the program title, the broadcast date and time, and the long time are used by using electronic program information (EPG) related to the broadcast program. Let's say that this is a list that stores (recording time), performers, program contents, and the like. When the video content is video content shot by a video camera device, a list storing shooting date / time, title, length, and the like is used. In the case of this example, an index video is prepared in each video content list, and the index video can be transmitted to the display device 10 side. The index video is video data for displaying a so-called thumbnail video, and is moving image data generated from video such as a main part of video content. An example of this index video transmission process will be described later.
The internal configuration of the second recording / reproducing apparatus 50 is not shown, but is the same as that of the first recording / reproducing apparatus 30.

  Next, a data configuration example of each channel transmitted through the HDMI cable 1 between the HDMI terminal 31 of the first recording / playback device 30 and the HDMI terminal 11 of the display device 10 will be described. In the HDMI standard, as shown in FIG. 4, three channels of channel 0, channel 1, and channel 2 are prepared as channels for transmitting video data, and a clock channel for transmitting a pixel clock is prepared. It is. In addition, a power transmission line, a DDC (Display Data Channel) line and a CEC (Consumer Electronics Control) line are prepared as control data transmission channels. A request for a content list, an instruction of a reproduction position, and a return to those instructions, which will be described later, are performed using, for example, a CEC channel as the control data transmission channel.

  On the transmitting side (first recording / reproducing device 30), data compositing units 32A, 32B, and 32C are prepared in the transmission processing unit 32 for each channel for transmitting video data, and also on the receiving side (display device 10). Data separation units 12A, 12B, and 12C are provided in the transmission processing unit 12 for each channel for transmitting video data.

  Explaining the configuration of each channel, channel 0 transmits pixel data of B data (blue data), vertical synchronization data, horizontal synchronization data, and auxiliary data. In channel 1, pixel data of G data (green data), two types of control data (CTL0, CTL1), and auxiliary data are transmitted. In channel 2, pixel data of R data (red data), two types of control data (CTL2, CTL3), and auxiliary data are transmitted.

  FIG. 5 is a diagram showing a line configuration and a pixel configuration of one frame transmitted by the transmission configuration of this example. The video data (main video data) transmitted in the case of this example is uncompressed data, and a vertical blanking period and a horizontal blanking period are added. Specifically, in the example of FIG. 5, the video area to be displayed (area shown as an active video area) is pixel data of 480 lines × 720 pixels, and 525 as the number of lines and the number of pixels including the blanking period. There are as lines and 858 pixels. An area indicated by double hatching during the blanking period is called a data island and is a period during which auxiliary data can be added.

  Next, a configuration and processing for transmitting video data using the HDMI cable 1 from the first recording / reproducing apparatus 30 of this example to the display apparatus 10 will be described. Here, a plurality of pieces of video data are transmitted from the first recording / playback apparatus 30 to the display apparatus 10 by using a pair of HDMI cables 1. In the following description, transmission of a plurality of pieces of video data is performed. The processing configuration will be mainly described.

First, a video data transmission configuration in the first recording / reproducing apparatus 30 will be described with reference to FIG. The processing configuration shown in FIG. 6 is executed under the control of the control unit 34 shown in FIG.
In the first recording / reproducing apparatus 30, the broadcast signal is received in advance by the tuner unit 44 through the antenna input terminal 44a and stored in the content storage unit 42 which is a large-capacity storage device. At this time, with respect to the video to be used in a reduced size or the video to be stored with a compression method different from the broadcast signal, the size / compression method conversion unit 43a in the recording / playback unit 43 (FIG. 3) performs a desired conversion to perform a large conversion. Store in the capacity storage device. The compressed video placed on the mass storage device is individually converted into uncompressed video by the decoding units 111a, 111b,... 111n for each individual video data, and then the size conversion units 112a, 112b,. The data is converted into a size necessary for transmission by 112n and supplied to the switch unit 32a in the HDMI transmission processing unit 32 (FIG. 3). The switch unit 32a selects a video to be transmitted. For the video to be sent, the pixel discriminating unit 32d selects the video for each pixel, selects one pixel at a time in the plurality of videos to be sent, and selects all the selected videos to repeat from the original video.

  As the selection process in the switch unit 32a, as shown in a transmission example in FIG. 12 to be described later, for example, when transmitting three video data such as screen J, screen K, and screen L, pixel 0 is displayed on screen J, screen After sending K and screen L three times in succession, the same processing is performed for pixel 1 to continuously transmit video data of a plurality of screens. For this purpose, the pixel clock generated by the clock generation unit 32c is supplied to the interface unit 32b and the pixel determination unit 32d in the HDMI transmission processing unit 32 to synchronize the transmission timing and the switch selection timing. The three screens J, K, and L received at the same time are reduced and displayed side by side on one screen, for example. For example, in the case of a thumbnail image of a moving image, when the content list is displayed on the display device 10, the moving images are displayed side by side, and the content to be reproduced is displayed from the displayed moving images to the user. Let them choose.

FIG. 7 is a diagram showing a processing configuration in which the display device 10 receives the video data sent to the HDMI cable 1 in this way. The processing configuration shown in FIG. 7 is executed under the control of the control unit 17 shown in FIG.
In the display device 10, data is received by the interface unit 12a in synchronization with the pixel clock received by the clock unit 12c, and is supplied to the switch unit 12b. The pixel discriminating unit 12d discriminates to which video data the received pixel belongs, and supplies the result to the switch unit 12b to store the video data in the image memories 121a, 121b,. On the other hand, it is classified and supplied in units of pixels, and divided into a plurality of images. Thereafter, if necessary, the image from the additional image generating unit 123 that generates an additional image such as text is combined with the image combining unit 122 and displayed on the display panel 19.

  Next, the operation of the video transmission processing configuration shown in FIG. 6 will be described with reference to the flowchart of FIG. First, a plurality of images to be transmitted are converted into appropriate sizes (step S11), and a synchronization signal for synchronizing transmission and reception with the image receiving device is transmitted (step S12). Then, it is confirmed whether or not the transmission timing is a blanking period (step S13). If it is a blanking period, control data transmitted in the blanking period is transmitted (step S14), and the process is repeated from step S12.

  If it is not the blanking period in step S13, the video data is transmitted. Therefore, first, the position in the screen to be transmitted and the screen number of the image to be transmitted are initialized (steps S15 and S16), and the pixel of the designated screen coordinates is transmitted (step S17). Next, the video screen to be transmitted is changed by the pixel discrimination unit without changing the coordinates (step S18), and it is confirmed whether all the video screens have been transmitted (step S19). If there is, the process returns to step S17, and the pixels having the same coordinates on the video screen are transmitted. On the other hand, when all the video screens are transmitted at the coordinates, the coordinates are moved in the horizontal direction (step S20), and it is confirmed whether the line has reached the end (step S21). If not, the process returns to step S16, the screen to be sent is selected again, and the process is repeated. If the line is moved to the end of the line and one line of pixels has been sent, the coordinates are moved in the vertical direction (step S22), and it is confirmed whether all lines have been sent (step S23). If not completed, the process is repeated from step S12.

  Next, the operation of the video reception processing configuration shown in FIG. 7 will be described with reference to the flowchart of FIG. First, it waits for the arrival of a synchronizing signal (pixel clock) and synchronizes (step S31), confirms whether it is a blanking period (step S32), and if it is a blanking period, receives a signal of the blanking period. (Step S33). If it is not the blanking period, the coordinates in the screen and the screen number are initialized (steps S34 and S35), the pixel of the coordinates of the screen number is determined by the pixel determining unit, and the received data is classified and classified by the switch unit. (Step S36). Then, the screen number is changed (step S37), and it is confirmed whether all screens have been received (step S38). If there is an unreceived screen, the processing is repeated from step S36. In step S38, if the coordinates are received on all the screens, the coordinates are moved in the horizontal direction (step S39), and it is confirmed whether the coordinates have been moved to the end of the line (step S40). If one line is completed, the coordinates are moved in the vertical direction (step S41), it is confirmed whether all lines have been received (step S42), and if not, the process is repeated from step S31.

  When a plurality of video data is transmitted in units of one pixel as in this example, control data transmission in the HDMI cable 1 is transmitted from the video transmission device (recording / playback device 30) to the video reception device (display device 10). For this, the transmission data structure is notified using a channel (for example, the DDC channel shown in FIG. 4). That is, for example, a packet header of the AVI info frame, which is one of the packets sent as control data shown in FIG. 10, and a packet following the header shown in FIG. . As shown in FIG. 11, the detailed data of the arrangement position of each video data is transmitted, and this data is discriminated and correctly separated on the receiving side.

  12 to 14 are diagrams showing transmission examples using the HDMI cable 1 in this example. The example of FIG. 12 is an example in the case of transmitting screen J, screen K, and screen L and three video data. FIG. 12 shows an example of transmitting primary color data (R data, G data, and B data). B data, G data, and R data are transmitted through three channels of channel 0, channel 1, and channel 2. They are transmitted separately. One pixel data of each channel is composed of 8 bits, and this 8 bit data (a total of 24 channels of 3 channels) is transmitted in 1 pixel clock cycle.

  In the case of this example, the period of pixel 0 is continuous for 3 pixel clock periods, 24-bit data of screen J is transmitted in the first cycle of the 3-pixel clock period, and 24 bits of screen K is transmitted in the next cycle. Data is transmitted, and 24-bit data of the screen L is transmitted in the last one cycle. In the following, each pixel clock period is set for 3 clock cycles and transmitted.

  In addition, when the number of pixels when only the pixel data of one screen shown in FIG. 24 is transmitted and the number of pixels of the screen composed of each video data in the example of FIG. 12 are the same, The pixel clock needs to be about three times the frequency. When the pixel clock period is the same, the number of pixels of one screen that can be transmitted is reduced to 1/3.

  FIGS. 13 and 14 are diagrams illustrating an example in which the processing of this example is applied when transmitting luminance data (Y data) and chroma data (C data). FIGS. 13 and 14 are examples in the case of transmitting two pieces of video data of an image a and an image b, respectively. As shown in FIG. 13 and FIG. 14, the transmission processing shown in FIG. 25 and FIG. 26 described in the background art section is transmitted twice for each pixel, and two video data of an image a and an image b Are transmitted simultaneously. Also in this case, when the number of pixels of each video data is the same, it is necessary to increase the frequency corresponding to the pixel clock.

  In the case of this example, the pixels of all screens are sent out with each pixel, so it is possible to unify the number of pixels, that is, the screen size, on all screens. The size may be different. In this case, the number of pixels is determined according to the largest size screen, and even if the large size screen data remains, transmission of the small size screen data is completed first. It is not necessary to send data during the transmission period.

  As described above, with the transmission configuration of this example, it is possible to simultaneously transmit a plurality of videos using one (one set) cable. Therefore, it is not necessary to provide a plurality of cables, and the connection configuration of the devices is simplified. In addition, index image display such as thumbnail display using moving images can be performed, and a plurality of contents on the source device can be easily selected on the sink device side. Further, if the sink device side does not support the processing of this example, it is sufficient to select and display only one video data among a plurality of transmitted video data. This is the same as the pixel doubling process in which data is duplicated and transmitted for each data. In the case of a sink device that complies with the HDMI standard, it can be easily dealt with and the video is not disturbed. Furthermore, since there is a degree of freedom in setting the number of overlapping pixels, a plurality of contents can be transmitted without waste.

  Next, a second embodiment of the present invention will be described with reference to FIGS. The basic transmission system configuration in the present embodiment is the same as the configuration in FIGS. 1 to 5 described in the first embodiment, and the recording / reproducing device 30 and the display device 10 are connected by the HDMI cable 1. The basic configuration is the same. In the present embodiment, the details of the process for simultaneously transmitting a plurality of video data are different from those in the first embodiment. The following description will focus on the differences.

FIG. 15 is a diagram showing a video data transmission configuration in the first recording / reproducing apparatus 30. The processing configuration shown in FIG. 15 is executed under the control of the control unit 34 shown in FIG.
In the first recording / reproducing apparatus 30, the broadcast signal is received in advance by the tuner unit 44 through the antenna input terminal 44a and stored in the content storage unit 42 which is a large-capacity storage device. At this time, with respect to the video to be used in a reduced size or the video to be stored with a compression method different from the broadcast signal, the size / compression method conversion unit 43a in the recording / playback unit 43 (FIG. 3) performs a desired conversion to perform a large conversion. Store in the capacity storage device. The compressed video placed on the mass storage device is individually converted into uncompressed video by the decoding units 111a, 111b,... 111n for each individual video data, and then the size conversion units 112a, 112b,. The data is converted into a size necessary for transmission by 112n and supplied to the switch unit 32a in the HDMI transmission processing unit 32 (FIG. 3). The switch unit 32a selects a video to be transmitted. The image to be sent is selected by the in-screen area determination unit 32e for each in-screen area.

  Here, a video selection example of each area in one screen will be described with reference to FIG. FIG. 19 is a diagram showing a transmission configuration in this example. FIG. 19 is a diagram showing a transmission configuration of one frame in the HDMI standard. In the case of this example, nine types of video data of images J, K, L, M, O, P, Q, and R are transmitted simultaneously. As the transmission areas for the nine video data of the images J to R, the active video area where the pixel data of the video data of one frame is originally arranged is divided into nine equal parts to set each area. In the example of FIG. 19, the entire active video area is composed of 480 lines × 720 pixels, and is composed of 160 lines × 240 pixels as one divided area.

  Returning to the description of FIG. 15, in order to divide the transmission area in this way, the pixel clock supplied from the clock generation unit 32c to the interface unit 32b for sending video data is also supplied to the in-screen region determination unit 32e. The in-screen area determination unit 32e determines in which area the current transmission timing is, that is, which video is to be transmitted. Based on the determination, switching of the switch unit 32a is controlled, and the switch unit 32a selects a video to be transmitted.

FIG. 16 is a diagram showing a processing configuration in which the display device 10 receives the video data sent to the HDMI cable 1 in this way. The processing configuration shown in FIG. 16 is executed under the control of the control unit 17 shown in FIG.
In the display device 10, data is received by the interface unit 12a in synchronization with the pixel clock received by the clock unit 12c, and is supplied to the switch unit 12b. The in-screen area discriminating unit 12j discriminates which divided area the received video data belongs to, and supplies the result to the switch unit 12b, thereby individually storing the video data 121a, 121b,. ... classified and supplied to 121n and divided into a plurality of videos. Thereafter, if necessary, the image from the additional image generating unit 123 that generates an additional image such as text is combined with the image combining unit 122 and displayed on the display panel 19. As the display, for example, a plurality of received videos are displayed side by side at the same time. When each video data is configured as a moving image thumbnail image, when displaying a list such as a content list, a moving image may be displayed alongside the list.

  Next, the operation of the video transmission processing configuration shown in FIG. 15 will be described with reference to the flowchart of FIG. First, a plurality of videos to be sent are each converted to an appropriate size (step S51), and a synchronization signal for synchronizing transmission and reception with the video receiving device is sent (step S52). Then, it is confirmed whether or not the transmission timing is a blanking period (step S53). If it is a blanking period, control data transmitted in the blanking period is transmitted (step S54), and the process is repeated from step S52.

  If it is not the blanking period in step S53, the video data is transmitted. In the video data transmission processing, first, the position in the screen to be transmitted and the screen number of the video to be transmitted are initialized (steps S55 and S56), and the pixel of the designated screen coordinates is transmitted (step S57). Next, the coordinates are moved in the horizontal direction (step S58), and it is confirmed by the in-screen region discriminating unit whether the region has moved to the boundary of the region (step S59). If the boundary is not reached, the processing is repeated from step S57. On the contrary, if the boundary has been reached, it is confirmed whether transmission of one line has been completed (step S60). If it has not been completed, the screen number to be transmitted is changed to the corresponding area number (step S61), and the process is repeated from step S57. On the other hand, when the transmission of one line is completed, the coordinates are moved in the vertical direction (step S62), and it is confirmed whether or not the boundary is the allocation area (step S63). If not, the process is repeated from step S52. . If it is the boundary of the allocation area, it is confirmed whether all lines have been transmitted (step S64). If not yet, the transmission screen is changed to another video data (step S65), and the process is repeated from step S52.

  Next, the operation of the video reception processing configuration shown in FIG. 16 will be described with reference to the flowchart of FIG. First, synchronization is made after the arrival of a synchronizing signal (pixel clock) (step S71), and it is confirmed whether it is a blanking period (step S72). If it is a blanking period, a signal of the blanking period is received (step S72). Step S73). If it is not the blanking period, the coordinates in the screen and the screen number are initialized (steps S74 and S75), and the received data is stored as pixels of the coordinates of the screen number (step S76). Then, the coordinates are moved in the horizontal direction (step S77), and the in-screen area discriminating unit 12e confirms whether the coordinates have reached the boundary of the area (step S78). If not, the process is repeated from step S76. On the contrary, it is confirmed whether or not one line has been received (step S79). If it has not been completed, the screen number to be received is changed (step S80), and the processing is repeated from step S76. If the reception of one line has been completed, the coordinates are moved in the vertical direction (step S81), and it is confirmed whether or not the boundary is an allocation area (step S82). repeat. If it is the boundary of the allocation area, it is confirmed whether all lines have been received (step S83), and if not completed, the screen is changed (step S84) and the process is repeated from step S71.

Note that the method of dividing the entire screen illustrated in FIG. 19 is an example, and the screen may be divided into equal areas or may be divided into areas of different sizes. In this case, it is possible to send out images of different sizes.
Further, after assigning various areas to the entire screen, there may be areas where video data is not assigned. In this case, the transmission efficiency is lowered, but the screen size can be set freely.
Further, a continuous frame of one video may be transmitted in a plurality of areas. In this case, it is possible to change the playback speed such as fast-forwarding a specific video.

  As described above, the area for transmitting the pixel data of one frame is divided into a plurality of parts, and a plurality of video data is transmitted in units of pixels, so that one cable is provided in the same manner as in the first embodiment. Thus, it becomes possible to transmit a plurality of videos, and there is no need to provide a plurality of cables. Also in the case of this embodiment, it is possible to display a moving image thumbnail or the like, and it is possible to easily select a plurality of contents on the source device. Further, even when the sink device does not support the reception processing of this example, as shown in FIG. 19, since the frame structure of the HDMI standard is maintained, a display in which a plurality of videos are arranged side by side is maintained. The image is displayed and the display image is not disturbed. FIG. 19 shows an example. If the screen area is subdivided, a large amount of video can be transmitted.

  Next, a third embodiment of the present invention will be described with reference to FIGS. The basic transmission system configuration in the present embodiment is the same as the configuration in FIGS. 1 to 5 described in the first embodiment, and the recording / reproducing device 30 and the display device 10 are connected by the HDMI cable 1. The basic configuration is the same. In the present embodiment, the details of the process of simultaneously transmitting a plurality of video data are different from those in the first and second embodiments. In the present embodiment, main video data (first video data) is transmitted in a video section (active video area in FIG. 5) defined by the HDMI standard, and other video data is compressed. Video data is transmitted in a data island section within a blanking period. The following description will focus on the differences.

FIG. 20 is a diagram showing a video data transmission configuration in the first recording / reproducing apparatus 30. The processing configuration shown in FIG. 20 is executed under the control of the control unit 34 shown in FIG.
The first recording / reproducing apparatus 30 receives the broadcast signal by the tuner unit 44 through the antenna input terminal 44a in advance and stores it in the content storage unit 42 which is a large-capacity storage device. At this time, the video to be used in a reduced size or the video to be stored in a compression method different from the broadcast signal is subjected to desired conversion in the size / compression method conversion unit 43a and stored in the mass storage device. A compressed video placed on the mass storage device and transmitted as an uncompressed video signal is decoded by the decoding unit 113 and output by the interface unit 32b via the superimposing unit 32f. The blanking period in the video data is determined by the blanking period determination unit 32e based on the clock supplied from the clock generation unit 32c together with the interface unit 32b, and is supplied to the superposition unit 32f. The signal from is superimposed. The switch unit 32a selects a compressed video signal on the large-capacity storage device based on an instruction from the intra-blanking period allocating unit 32g and outputs it to the superimposing unit 32f.

FIG. 21 is a diagram showing a processing configuration in which the display device 10 receives the video data sent to the HDMI cable 1 in this way. The processing configuration shown in FIG. 21 is executed under the control of the control unit 17 shown in FIG.
In the display device 10, data is received by the interface unit 12a in synchronization with the pixel clock received by the clock unit 12c, and is supplied to the separation unit 12e. The blanking period determination unit 12f is also supplied with a synchronization signal of received data. The separation unit 12e separates the signal in the blanking period into the switch unit 12h and the video data into the image memory 126 based on an instruction from the blanking period determination unit 12f. The blanking period data input to the switch unit 12h is classified as a compressed video signal of which screen based on the determination of the screen number from the intra-period allocation unit 12i, and each of the decoding units 124a, 124b. Is decoded into video uncompressed video data. The decoded video uncompressed video data is input to separate image memories 125a, 125b... 125n, respectively. Thereafter, if necessary, the image from the additional image generating unit 123 that generates an additional image such as text is combined with the image combining unit 122 and displayed on the display panel 19.

  Next, the operation of the video transmission processing configuration shown in FIG. 20 will be described with reference to the flowchart of FIG. First, a synchronization signal for synchronizing transmission / reception with the video reception device is transmitted (step S91). Then, the screen number to be sent during the blanking period is initialized (step S92), and it is confirmed whether it is in the blanking period (step S93). If it is a blanking period, the process of step S101-S106 will be performed, and if that is not right, the process of step S94-S100 will be performed.

  To explain from the processing when not in the blanking period, it is confirmed whether or not there is an uncompressed video to be transmitted in the period of the video signal that is not the blanking period (step S94). If there is no uncompressed video, the process repeats from step S93, and if there is, the coordinates to be sent are initialized (step S95). Then, the coordinate pixel is transmitted (step S96), the coordinate is moved in the horizontal direction (step S97), and it is confirmed whether transmission of one line is completed (step S98). If not completed, the process is repeated from step S96. When one line is completed, the coordinates are moved in the vertical direction (step S99), it is confirmed whether all lines are completed (step S100), and the process is repeated from step S91 until completion.

  On the other hand, if it is in the blanking period in step S93, a certain amount of screen number data instructed to the intra-period allocation unit is transmitted (step S101). Then, it is confirmed whether transmission of one frame of data on the screen has been completed (step S102), and if not completed, it is confirmed whether the blanking period has ended (step S103). If the blanking period has not ended yet, the screen data is repeatedly transmitted from step S101, and if the blanking period ends, the process returns to step S91. When the transmission of the screen data is completed, it is confirmed whether the transmission of all the screens is completed (step S104). When the transmission is completed, another signal to be transmitted during the blanking period is transmitted (step S105). ), The process returns to step S91. Conversely, if transmission of all screens has not been completed, the screen number is switched (step S106), and the screen data is transmitted (step S101).

  Next, the operation of the video reception processing configuration shown in FIG. 21 will be described with reference to the flowchart of FIG. First, synchronization is waited for the arrival of a synchronization signal (step S111), and the screen number received from the blanking period is initialized (step S112). Next, the blanking period discriminating unit checks whether it is in the blanking period (step S113). If it is in the blanking period, the process of steps S121 to S126 is performed. If not, the process of steps S114 to S120 is performed. Do.

  First, if it is not the blanking period in step S113, it is confirmed whether an uncompressed video is received (step S114), and if not received, the process is repeated from step S111. If received, the coordinates to be recorded are initialized (step S115), the received data is recorded as pixels of the coordinates (step S116), and the coordinates are moved in the horizontal direction (step S117). It is confirmed whether or not the minute reception has been completed (step S118). While the reception of one line is not completed, the process is repeated from step S116. When the reception is completed, the coordinates are moved in the vertical direction (step S119), and it is confirmed whether the reception of all lines is completed (step S120). . If reception of all lines has not been completed, the process is repeated from step S111.

  On the other hand, if it is in the blanking period in step S113, the data received in the blanking period is recorded as screen data of the screen number (step S121), and it is confirmed whether one frame of the screen has been received (step S121). S122). If reception of one frame has not been completed, it is confirmed whether or not the blanking period has ended (step S123). If the blanking period has not yet ended, the process returns to step S121 to further receive data, and the blanking period has ended. Repeat from step S111. When reception of one frame of data has been completed, it is confirmed whether reception of all screens has been completed (step S124). If reception has been completed, other signals to be transmitted during the blanking period. Is received (step S125), and the process is repeated from step S111. On the other hand, when reception of all the screens is not completed, the screen is changed to a screen designated by the intra-period allocation unit (step S126), and the process is repeated from step S121.

Note that the compressed video data transmitted in the blanking period may have different bit rates. In this case, video of various sizes can be transmitted.
Further, while the description has been given of sending one frame of compressed video while sending one frame of uncompressed video, the amount of data to be sent may be changed for each video. In this case, the number of display frames of a specific video can be changed, and fast-forwarding can be performed.

  As described above, by transmitting a plurality of video data using a blanking period, a plurality of videos can be transmitted with a single cable as in the first and second embodiments. It becomes possible and it is necessary to provide a plurality of cables. Then, it is possible to display a moving image thumbnail, and it is possible to easily select a plurality of contents on the source device. Also, if the sink-side device is an incompatible device, it is only necessary to sense the video data of the data island within the blanking period, so that the video is not disturbed even when connected. In addition, since uncompressed video data is also transmitted, it is possible to switch at a very high speed with respect to the maximum video defined by the transmission path.

  In each of the embodiments described so far, the example described using the HDMI standard transmission path for transmitting uncompressed video data in one direction has been described. Similarly, the baseband uncompressed video is synchronized with the pixel clock. The present invention can also be applied to a case where the transmission side and the reception side are connected with other transmission lines for transmitting data.

It is a block diagram which shows the system configuration example by the 1st Embodiment of this invention. It is a block diagram which shows the structural example of the display apparatus by the 1st Embodiment of this invention. It is a block diagram which shows the structural example of the video recording / reproducing apparatus by the 1st Embodiment of this invention. It is explanatory drawing which shows the example of a transmission channel structure with the cable by the 1st Embodiment of this invention. It is explanatory drawing which shows the data structural example of 1 frame at the time of transmission with the cable by the 1st Embodiment of this invention. It is a block diagram which shows the structural example by the image | video transmission side by the 1st Embodiment of this invention. It is a block diagram which shows the structural example by the image | video receiving side by the 1st Embodiment of this invention. It is a flowchart which shows the example of a process by the video transmission side by the 1st Embodiment of this invention. It is a flowchart which shows the process example by the image | video receiving side by the 1st Embodiment of this invention. It is explanatory drawing which shows the packet structural example by the 1st Embodiment of this invention. It is explanatory drawing which shows the packet structural example by the 1st Embodiment of this invention. It is explanatory drawing which shows the example of transmission (Example 1) by the 1st Embodiment of this invention. It is explanatory drawing which shows the example of transmission (example 2) by the 1st Embodiment of this invention. It is explanatory drawing which shows the example of transmission (example 3) by the 1st Embodiment of this invention. It is a block diagram which shows the structural example by the video transmission side by the 2nd Embodiment of this invention. It is a block diagram which shows the structural example by the image | video receiving side by the 2nd Embodiment of this invention. It is a flowchart which shows the process example by the video transmission side by the 2nd Embodiment of this invention. It is a flowchart which shows the example of a process by the video reception side by the 2nd Embodiment of this invention. It is explanatory drawing which shows the transmission structural example of 1 frame by the 2nd Embodiment of this invention. It is a block diagram which shows the structural example by the image | video transmission side by the 3rd Embodiment of this invention. It is a block diagram which shows the structural example by the image | video receiving side by the 3rd Embodiment of this invention. It is a flowchart which shows the example of a process by the video transmission side by the 3rd Embodiment of this invention. It is a flowchart which shows the example of a process by the video reception side by the 3rd Embodiment of this invention. It is explanatory drawing which shows the example of video data transmission by HDMI specification. It is explanatory drawing which shows the example of video data transmission by HDMI specification. It is explanatory drawing which shows the example of video data transmission by HDMI specification.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... HDMI cable, 10 ... Display apparatus (television receiver), 11 ... HDMI terminal, 12 ... HDMI transmission processing part, 13 ... HDMI transmission control part, 16 ... Network transmission control part, 17 ... Control part, 18 ... Video | video Display processing unit, 19 ... display panel, 20 ... audio processing unit, 21 ... output processing unit, 22L, 22R ... speaker, 25 ... HDMI content list storage unit, 26 ... HDMI status storage unit, 27 ... tuner, 30 ... first 31 ... HDMI terminal, 32 ... HDMI transmission processing unit, 33 ... HDMI transmission control unit, 37 ... control unit, 39 ... HDMI status storage unit, 40 ... device status storage unit, 41 ... device content list Storage unit 42 ... Content storage unit 43 ... Content recording / playback unit 44 ... Tuner 50 ... Second recording / playback apparatus

Claims (19)

In a video transmission device that transmits video data and data accompanying the video data to another device in a format in which the video data is transmitted in units of one pixel in synchronization with a pixel clock.
A video output unit for outputting a plurality of video data;
An assigning unit that assigns data of each pixel of a plurality of video data output from the video output unit to a transmission period of each pixel of one frame that can be transmitted in the format;
An image transmission device comprising: an output terminal unit that outputs the image data of the format synthesized by the allocation in the allocation unit in synchronization with the pixel clock. The video transmission device according to claim 1,
The assigning unit continuously arranges pixel data at the same pixel position of a plurality of video data, and outputs video data in which pixel data at the same pixel position is continuously arranged from the output terminal unit. Characteristic video transmission device. The video transmission device according to claim 1,
The video transmission device according to claim 1, wherein the pixel clock has a higher frequency corresponding to the number of video data output from the video output unit, and the number of pixels that can be transmitted in one frame is increased. The video transmission device according to claim 1,
The allocating unit performs size conversion processing for reducing the number of pixels of each of the plurality of video data corresponding to the number of pixels of one screen of the format, and the plurality of size-converted video data is converted into one frame. A video transmission device characterized in that a video transmission area is divided and arranged in a set area. The video transmission device according to claim 1,
The video output unit is an output unit that outputs a plurality of video data accumulated by the device,
The video transmission device, wherein the plurality of video data are index videos of the stored video data. In a video transmission method for transmitting video data and data accompanying the video data to another device in a format for transmitting the video data in units of one pixel in synchronization with a pixel clock,
Obtaining a plurality of video data, and assigning the data of each pixel of the plurality of video data to the transmission period of each pixel of one frame that can be transmitted in the format,
A video transmission method comprising: outputting the video data of the format synthesized by the allocation in synchronization with the pixel clock. In a video transmission device for transmitting video data and data accompanying the video data to another device in a format for transmitting the video data in units of one pixel in synchronization with a pixel clock,
A video output unit for outputting a plurality of video data;
Among the plurality of video data output from the video output unit, the pixel data of the first video data is arranged at a pixel data transmission position defined by the format, and other than the first video data An allocation unit that arranges video data at a data transmission position within a blanking period defined in the format;
An image transmission apparatus comprising: an output terminal unit that outputs the image data of the format synthesized by the allocation in the allocation unit in synchronization with the pixel clock. The video transmission device according to claim 7, wherein
The allocating unit arranges video data other than the first video data with a data amount compressed so as to be arranged in a blanking period. The video transmission device according to claim 8, wherein
The video output unit is an output unit that outputs a plurality of video data accumulated by the device,
The other video data of the plurality of video data is an index video of the stored video data. In a video transmission method for transmitting video data and data accompanying the video data to another device in a format for transmitting the video data in units of one pixel in synchronization with a pixel clock,
A plurality of video data is obtained, and pixel data of the first video data among the plurality of video data is arranged at a pixel data transmission position defined by the format, and other than the first video data. The video data is assigned to the data transmission position within the blanking period defined in the format,
A video transmission method comprising: outputting the video data of the format synthesized by the allocation in synchronization with the pixel clock. In a video receiving device that receives video data sent from another device and data accompanying the video data in a format for receiving the video data in units of one pixel in synchronization with a pixel clock,
An input unit for receiving input video data in synchronization with a pixel clock; and
A dividing unit for dividing one frame of video data defined by the format received by the input unit into a plurality of video data in synchronization with the pixel clock;
A video processing apparatus comprising: a display processing unit configured to display and process a plurality of video data divided by the dividing unit. The video receiver according to claim 11, wherein
The division unit separates a plurality of pieces of video data from a state in which pixel data at the same pixel position is continuously arranged. The video receiver according to claim 11, wherein
The video receiving apparatus, wherein the dividing unit extracts each video data constituting the plurality of video data from each area set by dividing an area for transmitting one frame of video. The video receiver according to claim 1,
The plurality of video data is an index video of video data stored in the other device, and the received plurality of index videos are displayed side by side on the same screen. In a video receiving method for receiving video data transmitted from another device and data accompanying the video data in a format in which the video data is received in synchronization with a pixel clock in units of one pixel,
Receives the input video data in synchronization with the pixel clock,
One frame of video data defined in the received format is divided into a plurality of video data in synchronization with the pixel clock,
A video receiving method, wherein display processing is performed on the plurality of divided video data. In a video receiving device that receives video data sent from another device and data accompanying the video data in a format for receiving the video data in units of one pixel in synchronization with a pixel clock,
An input unit for receiving input video data in synchronization with a pixel clock; and
A dividing unit that separates video data of one frame specified by the format received by the input unit and video data arranged in a data transmission period within a blanking period specified by the format;
A video receiving apparatus comprising: a display processing unit configured to display a plurality of video data separated by the dividing unit. The video receiver according to claim 16, wherein
The video receiving apparatus, wherein the separation unit decodes video data arranged in a data transmission period within the blanking period from a data-compressed state. The video receiver according to claim 1,
The video data arranged in the data transmission period within the blanking period is an index video of the video data stored in the other device, and the received multiple index videos are displayed side by side on the same screen. Yes Video receiver. In a video receiving method for receiving video data transmitted from another device and data accompanying the video data in a format in which the video data is received in synchronization with a pixel clock in units of one pixel,
Receives the input video data in synchronization with the pixel clock,
Separating one frame of video data defined by the received format from video data arranged in a data transmission period within a blanking period defined by the format;
A video receiving method comprising: displaying a plurality of separated video data.

Images