JP6211929B2 - Transmission device, video display device, transmission method, video processing method, video processing program, and integrated circuit - Google Patents

Description

  The present invention relates to 3D video processing technology, and more particularly, to a technology for superimposing and displaying a display object such as characters and graphics on a 3D video.

  In a 3D digital video content (hereinafter referred to as “3D video”) that can be viewed as a stereoscopic video by a viewer, when subtitles are displayed together with 3D video, if they are superimposed in the same manner as normal 2D video, Since the 3D video has a spread in front of or behind the screen, it is difficult for the viewer to see the subtitles displayed in the back of the 3D video or in the foreground.

  Therefore, in order to improve this, as a technique for appropriately displaying a plane image on which a plane subtitle to be displayed together with the 3D video is arranged in the 3D space, the image of the display object arranged on the plane is horizontal. There has been proposed a processing technique for making a stereoscopic view by generating a left-eye image and a right-eye image by shifting in the direction (Non-Patent Document 1). This processing technique is referred to as a 1 plane + offset method. In addition to subtitles, display data distributed for display together with 3D video in digital broadcasting includes operation menus, telops, display data for data broadcasting, etc. (hereinafter referred to as “subtitle display data”). The above processing technique can be used when displaying the display objects arranged on these display planes together with the 3D video.

Blu-ray Disc Association, "White Paper Blu-ray Disc Read-Only Format 2.B Audio Visual Application Format Specifications for BD-ROM Version 2.5 July 2011", P.36-P.37, "6.3 3D graphics with 3D video ", [Online], July 2011, Blu-ray Disc Association, [December 6, 2012 search], Internet <URL: http://www.blu-raydisc.com/assets/Downloadablefile/BD-ROM -AV-WhitePaper_110712.pdf>

  However, in the above technique, even if a plurality of display objects having different display positions, particularly display positions in the depth direction, are arranged on the display plane of display data such as subtitles, the display plane of subtitles and other display data is uniform over the entire display plane. It can only be displayed in depth. That is, it is impossible to display the display objects having different display positions so that they can be seen at different depths. For this reason, even if the depth is appropriately set for one display object among the plurality of display objects, the depth of the displayed object varies depending on the position of the display area in the 3D image, and therefore, the other display objects are appropriate. It is not always possible to set the depth, and it may be difficult for the viewer to see.

  Therefore, the present invention has been made in view of such a problem, and in a video display device, when a display object arranged at a different display position of a display plane such as captions is superimposed on a 3D video and displayed, It is an object of the present invention to provide a transmission device that transmits stream data (transmission stream) that can be displayed with reduced visibility and a video display device that can receive and display such a transmission stream.

In order to solve the above-described problem, a transmission apparatus according to the present invention transmits a data for displaying a video including a 3D video and a display object to be displayed on the display area in the video display device. A division information generating means for generating division information indicating a range of each of the partial areas obtained by dividing the display area into two or more areas by a horizontal boundary line; and a display object for each of the partial areas. Offset information setting means for setting offset information indicating the depth for 3D display according to the depth of the video part of the 3D video in the partial area where the display object exists, the division information, the offset information, Stream generation for generating a transmission stream including 3D video data for displaying 3D video Comprising a stage, and a stream transmission unit for transmitting the transport stream, said offset information setting means, depending on the depth of the 3D image to be displayed at a time of displaying a display object, temporal in the 3D image One offset information is set for each of the partial areas for each section unit, the 3D video data is data encoded in MPEG2 format or MPEG4 format, and the division information generating means The relative position in which the vertical position of the boundary line is represented by N times the number of pixels in the vertical direction of the macroblock when encoding the 3D video data from the upper end of the display area (N is a natural number of 1 or more) The division information divided so as to be generated is generated .

The video display device according to the present invention is a video display device that receives a transmission stream and superimposes and displays a display object on video of video data included in the transmission stream. Division information for specifying a partial area formed by dividing a display area for displaying a display object, and offset information indicating a depth for displaying the display object in 3D for each of the partial areas. Generation means for generating a display object image for the right eye and a display object image for the left eye by shifting the display objects displayed in each of the partial areas specified based on the information in the horizontal direction based on the offset information; When outputting the 3D video, the right eye display object image is superimposed on the right eye video, and the left eye And output means for outputting the superimposing the left-eye display object image on the image, the generation unit, the transmission stream, display of the display object to the predetermined range of the boundary line near the partial region When the prohibited area information indicating the prohibited area for prohibiting is included, only the display objects displayed outside the prohibited area are shifted in the horizontal direction .

  With the above-described configuration, the transmission device according to the present invention displays different display objects at different display positions when the display object arranged on the display plane of the display data such as captions is superimposed on the 3D video in the video display apparatus. It is possible to transmit a transmission stream that can be displayed so that it can be seen at a certain depth.

  In addition, the video display device according to the present invention receives the above-described transmission stream, and displays the display objects having different display positions when the display objects arranged on the display plane of the display data such as captions are superimposed on the 3D video. Can be displayed at different depths.

The figure which shows the concept of 1 plane + offset system. The figure which shows the concept of 1 plane + offset by the area | region division which concerns on this Embodiment. A data structure of offset metadata indicating an offset for each partial area. The functional block diagram of the transmitter 10 which concerns on embodiment of this invention. 10 is a flowchart of processing in the transmission apparatus 10; The functional block diagram of the video display apparatus 20. FIG. 4 is a flowchart of superimposition processing in the video display device 20. The figure which shows an example of the usage condition of the video display apparatus. The figure which shows notionally how the display thing displayed on the display 50 looks. The conceptual diagram which shows the prohibition area | region which does not display the display thing in a partial area | region. Data structure of offset metadata including prohibited area information. The functional block diagram of the transmitter 10a. The flowchart of the process at the time of the caption stream production | generation which considered the prohibition area | region in the transmitter 10a. The flowchart of the superimposition process which considered the prohibition area | region in the video display apparatus 20. FIG. The modification of the data structure of offset metadata. A data structure of offset metadata when using a division pattern of a predetermined division area. The modification of the data structure of the data which shows the prohibition area | region in offset metadata.

<1. Embodiment>
<1.1 Overview>
In 3D broadcasting, display data such as captions such as captions and menus may be superimposed on 3D video and displayed. FIG. 1 is a diagram conceptually illustrating a conventional 1 plane + offset process. In the conventional 1 plane + offset method, as shown in FIG. 6A, this plane is shifted by horizontally shifting an image of one plane displaying display data such as subtitles based on offset information indicating an offset amount. The depth of the display object arranged on the screen is adjusted and displayed so that it can be seen in front of the 3D image. Specifically, when the image of the display data plane such as caption is superimposed on the image of the left-eye video plane 1001, the entire plane image is shifted to the right by the offset amount (value indicated by OffsetA), and the protruding portion Is cropped and superimposed. Similarly, when superimposing on the image of the right-eye video plane 1002, it is shifted to the left by the value indicated by OffsetA, and the protruding portion is cropped and superimposed for display.

  However, with such a method, as shown in FIG. 1B, object A and object B, which are display objects arranged in this plane, can only be displayed so that they can be seen at the same depth. In other words, the depth of the display object can only be set uniformly over the entire plane, and when a plurality of display objects are arranged on the plane, each display object cannot be displayed at a different depth.

  Therefore, in the transmission apparatus according to the present invention, as shown in FIG. 2, a plane for displaying display data such as captions is divided into a plurality of partial areas along a horizontal boundary line, and an offset amount different for each partial area. Generate and send offset information set with.

  In the video display device that has received the offset information, when the image of the plane of the display object such as subtitles is superimposed on the image of the left-eye video plane 1001, the image of the area A is shifted to the right by the value indicated by OffsetA. The image is shifted to the right by the value indicated by OffsetB, and the protruding portion is cropped and superimposed. Similarly, when superimposing on the image of the right-eye video plane 1002, the image of region A is shifted to the left by the value indicated by OffsetA, and the image of region B is shifted to the left by the value indicated by OffsetB, The protruding part is cropped and superimposed.

  In these processes in the conventional 1 plane + offset method, for example, when the process of shifting the image for each line of the image is performed, the process of shifting all the lines with the same offset amount is performed. This can be realized by processing with a different offset amount for each partial area. Therefore, it can be realized without increasing the number of image planes used for the offset processing.

  As a result, each partial area can be shifted by a different shift amount. For example, as shown in FIG. 2B, the object A displayed in the area A1 shown in FIG. The object B displayed in the area A2 can be displayed so that the viewer can see it at different depths.

<1.2 Data>
Hereinafter, it corresponds to the division information about each display object plane (for example, the subtitle plane and the graphics plane) for arranging the display object of the display data such as caption used in the present embodiment, and each divided partial area. The data structure of the offset metadata describing the offset information will be described.

  FIG. 3 shows a data structure of offset metadata 300 used in the present embodiment.

  The offset metadata 300 is a descriptor describing information indicating the range of divided partial areas and offset values of the partial areas for each OSG (Offset Sequence Group).

  The offset sequence is data in which one offset value is associated with each partial area in one division pattern obtained by dividing the display area into a plurality of partial areas. The summary is OSG. The OSG can be specified by the ID assigned to each OSG. For example, by generating offset information in which the OSG_ID of the OSG applied to the subtitle plane is “0” and the OSG_ID of the OSG applied to the graphics plane is “1”, the information is transmitted from the transmission apparatus. In the received video display device, different planes can be shifted using different offset information.

  The number_of_OSG in offset_metadata () in FIG. 3 indicates how many OSGs exist. The OSG_ID is for specifying the OSG and is indicated by a value of 0, 1,..., (Number_of_OSG-1). For example, when number_of_OSG is “2”, it indicates that there are two OSGs, and the value of OSG_ID indicating each OSG is “0” or “1”.

  number_of_offset_sequence_in_OSG indicates the number of Offset Sequences included in one OSG, that is, the number of divided partial areas.

  The offset_priority is a flag for specifying an offset sequence used when the process of shifting by an offset value different for each partial area is not performed and the same 1 plane + offset process is performed as in the prior art. Of the Offset Sequences included in one OSG, only one offset_priority value is set to “1”, and the offset_priority values of the other Offset Sequences are set to “0”. When the entire display area is processed uniformly instead of processing for each partial area, an Offset Sequence in which the value of offset_priority is “1” is used. For example, in a video display device having a low processing capability, when processing for superimposing a display object on 3D video is performed, there may be a case where processing for shifting with a different offset value for each partial region is not in time for display in real time. In such a case, it is avoided that the processing in real time is not in time by performing the conventional 1 Plane + Offset process instead of for each partial area. At this time, the offset value to be used for the entire display area is determined by offset_priority. can do.

  The offset_value indicates an offset value for shifting the partial area when overlapping with the 3D video.

  dividing_point_start indicates the start Y coordinate of the partial area for each Offset Sequence, and dividing_point_end similarly indicates the end Y coordinate. 2A, the horizontal direction is the X axis, the vertical direction is the Y axis, the upper left corner coordinate value of the subtitle plane 1000 is (0, 0), and the lower right corner coordinate value is (1920, 1080). ).

 As shown in FIG. 2, when the display area is divided into two partial areas, information about area A is stored when i = 0 in offset_sequence_group (), and information about area B is stored when i = 1. , I = 0, the value indicated by OffsetA is described, the value of dividing_point_start is “0”, and the value of dividing_point_end is “359”. When i = 1, the value of offset_priority is “0”, the value of offset_value is the value indicated by OffsetB, the value of dividing_point_start is “360”, and the value of dividing_point_end is “1920”. The Further, the offset_priority value when i = 0 is described as “1”, and the offset_priority value when i = 0 is described as “0”.

  In such a video display device that has received the offset metadata, as a partial area in the subtitle plane 1000, the partial area A is a rectangular range having (0, 0)-(1920, 359) as the vertices of diagonal lines. It can be obtained that the offset value in the range is a value indicated by OffsetA. The partial area B is a rectangular range having (0, 360)-(1920, 1080) as the vertices of the diagonal, and the offset value can be acquired as a value indicated by OffsetB. Based on this, each partial area can be shifted by a designated offset value and superimposed on the 3D video. Further, in the case of performing a process of uniformly shifting the entire display area rather than for each partial area, the process is performed using an offset value in the case of i = 0.

<1.3 Configuration of transmitter>
Hereinafter, a transmission device 10 according to an embodiment of the present invention will be described with reference to the drawings.

  FIG. 4 is a functional block diagram of transmitting apparatus 10 according to the embodiment of the present invention.

  As shown in the figure, the transmission apparatus 10 includes a video encoding unit 101, a division information generation unit 102, an offset information setting unit 103, a stream management information generation unit 104, a multiplexing processing unit 105, and a transmission unit 106. . In addition, a storage device that stores the 3D video original image 110, the video stream 111, the subtitle stream 112, the graphics stream 113, the audio stream 114, the stream management information 115, and the transport stream is included. This storage device is, for example, a hard disk.

  The transmission device 10 includes a processor, a RAM (Random Access Memory), a ROM (Read Only Memory), and a hard disk not shown. Each functional block of the transmission device 10 is configured as hardware, or the function of each functional block is realized by a processor executing a computer program stored in a memory.

  The video encoding unit 101 has a function of reading an original 3D video image from a storage device, performing encoding, and outputting the video stream as a video stream. The encoding method is, for example, the MPEG4 MVC method.

  Based on the information on the display position of the display object obtained from the subtitle stream 112 and the graphics stream 113, the division information generating unit 102 displays each display object so that the display range of each display object does not extend over a plurality of partial areas. A function of generating division information for dividing a partial area by a horizontal boundary set between vertical ranges of an object display range and information indicating each range of the partial area are output to the offset information setting unit 103. With functionality.

  The offset information setting unit 103 is a depth when the subtitle stream or the like is superimposed on the 3D video based on the information obtained from the 3D video original image 110 in the range specified from the partial area information output by the division information generation unit 102. Is generated for each 3D video frame image, and offset information adjusted to have a depth equivalent to that of the 3D video displayed at the same time within the range in which captions are displayed, and the generated offset information is stream management information A function of outputting to the generation unit 104 is provided.

  The stream management information generation unit 104 generates offset management information output from the offset information setting unit 103, a function for generating stream management information necessary for reproducing a stream from the audio stream 114 and the video stream 111, and the generated stream management. It has a function to output information. Specifically, the stream management information includes a PAT (Program Association Table), a PMT (Program Map Table), an event information table EIT (Event Information Table), a service information table SIT (Service Information Table), and the like. The stream management information is stored in SI (Service Information) / PSI (Program Specific Information) of the transport stream (TS) at the time of multiplexing in the multiplexing processing unit 105.

  The multiplexing processing unit 105 has a function of generating and outputting a transport stream 116 in which the video stream 111, the subtitle stream 112, the graphics stream 113, the audio stream 114, and the stream management information 115 are multiplexed.

  The transmission unit 106 has a function of transmitting the transport stream 116 multiplexed by the multiplexing processing unit 105 on a digital broadcast wave.

<1.4 Operation of Transmission Device 10>
Hereinafter, the processing operation of the transmission apparatus 10 having the above function will be described.

  The subtitle stream 112, the graphics stream 113, the audio stream 114, and the 3D video stream 111 to be multiplexed by the multiplexing processing unit are generated as a stream used in TV broadcasting, for example, an MPEG4 MVC format stream. To do.

  FIG. 5 is a flowchart showing processing of the transmission device 10.

  First, the division information generation unit 102 reads the subtitle stream 112 (step S10), and divides the subtitle plane into partial areas based on the subtitle display position (step S11). Specifically, when the value of OSG_ID is set to “0” as the ID of the OSG used for the caption plane, and there are objectA and objectB as display objects to be displayed on the caption plane 1000 as shown in FIG. The subtitle plane 1000 is divided into a region A in which objectA is completely included and a region B in which objectB is completely included by a horizontal boundary line. In the case of FIG. 2, a line segment connecting coordinates (0, 360)-(1920, 360) is divided into partial areas as boundary lines. In this example, since it is divided into two areas, “2” is described in number_of_offset_sequence_in_OSG in offset_metadata () of the offset metadata 300. In order to indicate that the offset_sequence indicating the default depth is described when i = 0, the offset_priority value is set to “1”, and the offset_priority value of i = 1 is set to “0”.

  Further, the value of dividing_point_start of offset_sequence of i = 0 is set to “0”, the value of dividing_point_end is set to “359”, the value of dividing_point_start of offset_sequence when i = 1 is set to “360”, and the value of dividing_point_end is “1080”. To. As a result, the offset_sequence applied to the region A is the offset_sequence when i = 0, and the offset_sequence applied to the region B is the offset_sequence when i = 1.

Next, the division information generation unit 102 reads the graphic stream (step S12),
The graphic plane is divided into partial areas based on the graphic display position (step S13). The value of OSG_ID is set to “1” as the ID of the OSG used for this graphic plane, and the division method is the same as the subtitle plane, and is divided into a plurality of partial areas according to the display position of the graphic object to be displayed. .

  Next, the offset information setting unit 103 reads the offset metadata 300 and the 3D video original image 110 generated by the region dividing unit (step S14), and sets offset values for determining the depths of the region A and the region B of the caption plane 1000, respectively. Set (step S15). Specifically, offset_sequence_group in the case of OSG_ID = 0 is the same as the depth of the object of the 3D video to be displayed in the range of each partial area in the PTS 3D video at the same time as the PTS (Presentation Time Stamp) of the caption. An offset value corresponding to a certain depth is set in offset_value.

  In the example of FIG. 2, the value indicated by offsetA is set in the offset_value of the region A (when i = 0), and the value indicated by offsetB is set as the offset_value of the region B (when i = 1).

  Furthermore, the offset information setting unit 103 generates offset metadata 300 in which an offset value is set for the graphic plane (step S16). Specifically, for the offset_sequence_group when OSG_ID = 1, the value of offset_value is set by the same method as in step S15.

  Next, the stream management information generation unit 104 reads the offset metadata 300, the video stream 111, and the audio stream 114, generates stream management information, and outputs the generated stream management information (step S17). Specifically, the stream management information generation unit 104 generates PMT including information such as PTS and DTS (Decoding Time Stamp) necessary for reproducing a video stream and the like, and offset metadata 300, and performs SI / Store in PSI. The video display device that has received such SI / PSI displays a 3D video image and a subtitle image, etc., in which the PTS indicates the same time based on the information of the PTS, when displaying a caption or the like superimposed on the 3D video. Can be superimposed.

  The multiplexing processing unit 105 reads the video stream 111, the subtitle stream 112, the graphics stream 113, the audio stream 114, and the stream management information 115, and outputs the multiplexed transport stream 116 (step S18).

  Next, the transmission unit 106 transmits the transport stream 116 output from the multiplexing processing unit 105 on a broadcast wave (step S19).

<1.5 Configuration of video display device>
Next, the video display device 20 that receives the transport stream 116 transmitted by the transmission device 10 and displays the video will be described.

  FIG. 6 is a functional block diagram of the video display device 20.

  As shown in the figure, the video display device 20 includes a user interface unit 201, a tuner 202, a demultiplexing unit 203, a stream management information analysis unit 204, a video decoding unit 205, a left-eye video plane 206, a right-eye video plane 207, and a division. Information analysis unit 208, subtitle decoding unit 209, subtitle plane 210, subtitle offset processing unit 211, graphics decoding unit 212, graphics plane 213, graphics offset processing unit 214, selector 215, plane addition unit 216, display unit 217, An audio decoding unit 218 and a speaker 219 are included.

The video display device 20 includes a processor, a RAM, a ROM, and a hard disk not shown. Each functional block of the video processing apparatus is configured as hardware, or the function of each functional block is realized by the processor executing a computer program stored in the memory.
(User interface unit 201)
The user interface unit 201 receives from the remote controller 21 instructions for channel selection, display of subtitles, menus, and the like, instructions for switching non-display, power-on / off instructions, and the like, and receives control signals corresponding to the received instructions. It has a function of outputting to the tuner 202 or the plane adder 216 in response to an instruction.

  As an example of this function, when the user performs an operation to change to a certain channel using the remote controller 21, the remote controller 21 transmits a signal indicating an instruction to change to the designated channel to the user interface unit 201. Upon receiving this signal, the user interface unit 201 outputs a control signal for changing to a channel designated by the user to the tuner 202. The tuner 202 changes the channel based on this control signal, and changes the channel. A broadcast wave corresponding to is received.

Further, for example, when the user performs an operation of displaying a caption with the remote controller 21, the remote controller 21 transmits a signal indicating a caption display instruction to the user interface unit 201. Upon receiving this signal, the user inner face unit 201 outputs a control signal indicating that the subtitles are superimposed on the plane adder 216 and output, and the plane adder 216 receives the control signal when receiving the control signal. The image of the subtitle plane 210 is superimposed and output on the images of the video plane 206 for video and the video plane 207 for right eye, and otherwise, the image of the subtitle plane 210 is output without being superimposed.
(Tuner 202)
The tuner 202 is a tuner for receiving digital broadcast waves. The tuner 202 has a function of receiving a control signal for changing to the channel designated by the user from the user interface 201 and changing to the channel selected by the user. The digital broadcast wave transmitted from the transmission apparatus 10 corresponding to the channel is received and demodulated to extract a transport stream and output it to the demultiplexing unit 203.
(Demultiplexer 203)
The demultiplexing unit 203 is configured by a demultiplexer LSI, acquires a transport stream, and separates the transport stream into packets such as SI / PSI, video stream packets, audio stream packets, subtitle stream packets, and graphics streams. Has the function of

Specifically, the demultiplexing unit 203 demultiplexes the transport stream packets received and demodulated by the tuner 202 into SI / PSI, video stream, audio stream, subtitle stream, and graphics stream packets. / PSI packet to the stream management information analysis unit 204, video stream packet to the video decoding unit 205, subtitle stream packet to the subtitle decoding unit 209, graphics stream packet to the graphics decoding unit 212, audio stream Are output to the audio decoding unit 218, respectively.
(Stream management information analysis unit 204)
The stream management information analysis unit 204 has a function of receiving SI / PSI from the demultiplexing unit 203 and analyzing SI / PSI contents such as PAT, PMT, NIT (Network Information Table), EIT, and BIT (Broadcaster Information Table). Prepare. In addition, the stream management information analysis unit 204 has a function of extracting the division information offset metadata 300 included in the PMT and outputting it to the division information analysis unit 208.
(Division information analysis unit 208)
The division information analysis unit 208 analyzes the offset metadata 300 output from the stream management information analysis unit 204, and displays the partial region information indicating the range of the partial region and the images of the subtitle plane 210 and the graphics plane 213 for each partial region. A function of extracting offset information for shifting with different offset values and a function of outputting the extracted information to the caption offset processing unit 211 and the graphics offset processing unit 214 are provided.
(Video decoding unit 205)
The video decoding unit 205 extracts and decodes the encoded 3D video data from the packet including the 3D video data distributed and input by the demultiplexing unit 203, and converts the left-eye video frame into the left-eye video plane 206. And a function of outputting the right-eye video frame to the right-eye video plane 207, respectively. For example, 3D video in the MPEG4 MVC format is decoded, and the left-eye video picture is output to the left-eye video plane 206 and the right-eye video picture is output to the right-eye video plane 207, respectively.
(Subtitle decoding unit 209, graphics decoding unit 212)
The caption decoding unit 209 has a function of decoding a packet including the caption data distributed by the demultiplexing unit 203 to generate a caption image and outputting it to the caption plane 210.

  At this time, the caption decoding unit 209 outputs a PTS caption image indicating the same time as the 3D video PTS output by the video decoding unit to the caption plane 210.

  The graphics decoding unit 212 has a function of decoding a packet including graphics data distributed by the demultiplexing unit 203 to generate a graphics image and outputting the graphics image to the graphics plane 213.

At this time, the graphics decoding unit 209 outputs, to the graphics plane 210, a PTS graphics image indicating the same time as the 3D video PTS output by the video decoding unit in the same manner as the caption decoding unit 209.
(Left-eye video plane 206, right-eye video plane 207, subtitle plane 210, graphics plane 213)
The left-eye video plane 206 is a plane memory that holds a picture of the left-eye video output by the video decoding unit 205 according to the PTS value after decoding the video stream packet.

  The right-eye video plane 207 is a plane memory that holds a picture of the right-eye video that the video decoding unit 205 decodes a video stream packet and outputs according to the value of the PTS.

  The subtitle plane 210 is a plane memory that has a display area of the same size as the left-eye video plane 206 and the right-eye video plane and holds a subtitle image decoded and generated by the subtitle decoder 209.

The graphics plane 213 is a plane memory that has a display area as wide as the subtitle plane and holds the graphics image generated by the graphics decoding unit 212 according to the value of the PTS.
(Selector 215)
The selector 215 has a function of alternately switching the image of the left-eye video plane 206 and the image of the right-eye video plane based on the 3D video PTS and outputting the image to the plane adder 216. In addition, when outputting the image of the left-eye video plane, the selector 215 instructs the subtitle offset processing unit 211 and the graphics offset processing unit 214 to shift for the left eye, and the right-eye video plane is output. When outputting an image, it has a function of giving an instruction to shift to the right eye.
(Subtitle offset processing unit 211, Graphics offset processing unit 214)
The subtitle offset processing unit 211 converts the image of the subtitle plane 210 into one line of the display region image based on the partial region information obtained from the division information analysis unit 208 and the offset value for each partial region indicated by the offset information. A function of sequentially shifting the offset value every time, and a function of outputting the shifted image to the plane adding unit 216 every time the shift is performed.

  The processing of sequentially shifting the offset value for each display line of the caption offset processing unit 211 is the same as the processing by the conventional 1 plane + offset method. In the conventional 1 plane + offset method, the image of all lines is shifted with the same offset value, but the caption offset processing unit 211 shifts the image using different offset values indicated by the offset information for each partial area. For this reason, as compared with the conventional 1 plane + offset method, it is not necessary to separately prepare a plane for storing an image shifted with a different offset value for each partial region.

  When the subtitle offset processing unit 211 receives an instruction to shift to the left eye from the selector 215, the subtitle offset processing unit 211 offsets the image of the subtitle plane 210 for each partial area specified by the partial area information. If an instruction to shift to the left eye based on the value and to shift to the right eye is received, the shift is made to the right eye and output to the plane adder 216.

The graphics offset processing unit 214 has a function of shifting the image of the graphics plane 213 in the same way as the subtitle offset processing unit 211 and outputting it to the plane addition unit 216. Similar to the caption plane, it is not necessary to separately prepare a plane for storing an image shifted with an offset value different for each partial area when shifting the image of the graphics plane.
(Plane adder 216)
The plane adder 216 superimposes the caption image sequentially output for each line from the caption offset processor 211 on the image of the video plane output from the selector 215, and the graphics offset processor 214 for each line. A function of superimposing sequentially output graphics images and a function of outputting an image of the superimposed video plane to the display unit are provided. Note that the plane addition unit 216 first superimposes the caption image output from the caption offset processing unit 211 and then superimposes the graphics image output from the graphics offset processing unit 214.

The plane adder 216 first writes the image of the video plane output from the selector 215 to the display plane, and the subtitle image for each line that has been shifted and output from the subtitle offset processor 211 corresponds to the display plane. Write on the line you want. Further, the shifted graphics image output from the graphics offset processing unit 214 is written into the corresponding display line. In this way, you can process and write for each line,
The plane adder 216 determines whether or not a control signal indicating that subtitles and the like are to be superimposed on 3D video and output from the user interface unit 201 and the above-described superimposing process is superimposed on the 3D video. And a function of performing control when it receives a control signal indicating that it is output.
(Display unit 217)
The display unit 217 is, for example, a display, and has a function of displaying a video plane image received from the plane addition unit 216.
(Audio decoding unit 218, speaker 219)
The audio decoding unit 218 has a function of sequentially decoding the audio stream packets received from the demultiplexing unit 203 to generate audio data, and outputting the generated audio data as audio via the speaker 219.

  The speaker 219 is composed of a speaker and outputs the audio data decoded by the audio decoding unit 218 as audio.

<1.6 Operation of Video Display Device 20>
Next, the operation of the video display device 20 having the above configuration will be described.

  FIG. 7 is a flowchart showing processing of the video display device 20.

  An example will be described in which the user operates the remote controller 21 to change the TV broadcast channel to be received.

  First, when the user interface unit 201 receives a signal indicating a channel change instruction for a designated channel from the remote controller 21, the user interface unit 201 outputs to the tuner 202 a control signal for changing to a channel designated by the user. The tuner 202 changes the channel based on this control signal, and receives a broadcast wave corresponding to the changed channel. The tuner 202 demodulates the broadcast wave, extracts the transport stream packet, and outputs the packet to the demultiplexing unit 203 (step S20).

  The demultiplexing unit 203 receives the transport stream packet, separates the transport stream packet into each packet of the video stream, the stream management information SI / PSI, the caption stream, the graphics stream, and the audio stream, The separated packets are output to the video decoding unit 205, the stream management information analysis unit 204, the video decoding unit 205, the caption decoding unit 209, the graphics decoding unit 212, and the audio decoding unit 218, respectively (step S21).

  Next, the stream management information analysis unit 204 receives the SI / PSI packet separated by the demultiplexing unit 203, extracts the PAT, PMT, NIT, EIT, BIT, etc. included in the SI / PSI, and the video decoding unit 205. The extracted information is output to the division information analysis unit 208, the caption decoding unit 209, the graphics decoding unit 212, and the audio decoding unit 218 (step S22).

  The video decoding unit 205 decodes the packet of the 3D video stream received from the demultiplexing unit 203 (for example, the packet of the MPEG4 MVC TS) based on the information received from the stream management information analysis unit (step S23). The left-eye video decoded to the video plane 206 for the right and the right-eye video decoded to the video plane 207 for the right eye are output (step S24).

  The caption decoding unit 209 decodes the packet of the caption stream received from the demultiplexing unit 203 based on the information received from the stream management information analysis unit (step S25), and the same time as the PTS of the image obtained by decoding the 3D video stream The subtitle image having the PTS is output to the subtitle plane 210 (step S29).

  The graphics decoding unit 212 decodes the graphics stream packet received from the demultiplexing unit 203 based on the information received from the stream management information analysis unit (step S26), and the PTS of the image obtained by decoding the 3D video stream. A graphics image having the PTS at the same time is output to the graphics plane 213 (step S30).

  The audio decoding unit 218 decodes the audio stream packet received from the demultiplexing unit 203 based on the information received from the stream management information analysis unit (step S27), and outputs the decoded audio data to the speaker 219 (step S27). S28).

  The division information analysis unit 208 receives the offset metadata 300 corresponding to the caption image or graphics image having the PTS value at the same time as the PTS of the image obtained by decoding the 3D video stream from the stream management information analysis unit 204. The data 300 is analyzed, partial area information of each plane and an offset value for each partial area are extracted, and output to the caption offset processing unit 211 and the graphics offset processing unit 214 (steps S31 and S32).

  Next, the selector 215 selects either the left-eye video plane 206 or the right-eye video plane 207 as a video plane to be output to the plane addition unit 216 according to the PTS value extracted from the stream management information by the stream management information analysis unit 204. It is selected whether to output a video plane (step S33).

  When the selector 215 selects the left-eye video plane 206 as the video plane to be output to the plane adding unit 216 (step S33: YES), the selector 215 sends the respective planes to the subtitle offset processing unit 211 and the graphics offset processing unit 214 for the left eye. To shift to.

  Receiving the instruction to shift to the left eye from the selector 215, the subtitle offset processing unit 211 shifts the subtitle plane image for each partial region to the left eye and outputs the result to the plane adding unit 216 (step S34). Specifically, an image for one line is sequentially extracted from the top of the display area of the caption plane, and is shifted to the right by the offset value indicated by the offset information for each partial area received from the division information analysis unit 208. The offset subtitle image for the line is output to the plane adder 216. The subtitle offset processing unit 211 repeats this process until it reaches the bottom of the display area. In the example of FIG. 2A, the caption offset processing unit 211 shifts the line image included in the area A to the right by the value indicated by OffsetA, and the line image included in the area B area is OffsetB. Is shifted to the right by the value indicated by, and output to the plane adder 216.

  The graphics offset processing unit 214 extracts the graphics plane image for one line in the same way as the caption offset processing unit 211 generates the left eye image, shifts it to the left eye, and sends it to the plane addition unit 216. Output (step S35).

  The plane adding unit 216 superimposes the offset subtitle image sequentially output line by line from the subtitle offset processing unit 211 on the image of the left-eye video plane output from the selector 215. Next, the offset graphics image sequentially output line by line from the graphics offset processing unit 214 is superimposed (step S36).

  On the other hand, when the selector 215 selects the right-eye video plane 207 as the video plane to be output to the plane adder 216 (step S33: NO), the selector 215 sends the subtitle offset processor 211 and the graphics offset processor 214 respectively. Instructs the plane to shift to the right eye.

  The subtitle offset processing unit 211 that has received an instruction to shift to the right eye from the selector 215 shifts the image of the subtitle plane for the right eye for each partial area in the same manner as when generating an image shifted for the left eye. It outputs to the plane addition part 216 (step S37). The process of step S37 corresponds to the process of step S34, except that the shifting direction is shifted to the left instead of the right.

  The graphics offset processing unit 214 generates a right-eye offset graphics image in which the graphics plane image is shifted for the right eye for each partial region in the same manner as when the subtitle offset processing unit 211 generates the right-eye image. Is output to the plane adder 216 (step S38).

  The plane addition unit 216 superimposes the offset caption image sequentially output line by line from the caption offset processing unit 211 on the image of the right-eye video plane output from the selector 215. Next, the offset graphics image sequentially output line by line from the graphics offset processing unit 214 is superimposed (step S39).

  The display unit 217 displays the image superimposed by the plane addition unit 216 (step S40).

  As described above, the video display device 10 can sequentially shift and superimpose a caption image and a graphics image one line at a time on the image of the left-eye video plane or the image of the right-eye video plane. The image can be superimposed without using an extra image plane.

(Example of usage of video display device 20)
Hereinafter, a 3D digital television 30 that reproduces 3D video, which is an aspect of the video display device 20, will be described as an example with reference to FIG.

  As shown in FIG. 8A, the user views 3D video using the 3D digital television 30 and the 3D glasses 40.

  The 3D digital television 30 can display 2D video and 3D video, and displays video by reproducing a stream included in the received broadcast wave. Specifically, a 2D video stream compressed and encoded in the MPEG-2 format and a 3D video stream compressed and encoded in the MPEG-4 MVC format are reproduced.

  When receiving the 3D video stream, the 3D digital television 30 alternately displays the left-eye image and the right-eye image.

  The user can view the video reproduced in this way as a stereoscopic video by wearing the 3D glasses 40 and viewing the video.

  FIG. 8B shows the time when the left-eye image of the 3D glasses 40 is displayed.

  At the moment when the image for the left eye is displayed on the screen, the 3D glasses 40 transmit light to the liquid crystal shutter corresponding to the left eye and shield the liquid crystal shutter corresponding to the right eye.

  FIG. 3C shows the display time of the right eye image.

  At the moment when the image for the right eye is displayed on the screen, the liquid crystal shutter corresponding to the right eye is made transparent, and the liquid crystal shutter corresponding to the left eye is shielded from light.

  FIG. 9 is a diagram conceptually showing how each display object looks when an image viewed on the display 50 of the 3D digital TV 30 is viewed through the 3D glasses 40.

  When the image for the left eye is displayed, the right eye of the 3D glasses 40 is hidden by the liquid crystal shutter, and the user views the image for the left eye only with the left eye. When the right-eye image is displayed on the display 50, the left eye of the 3D glasses 40 is hidden by the liquid crystal shutter, and the user views the left-eye image only with the right eye. By performing such display control, an object 60 included in the 3D video data appears to jump out from the display 50 to the user. Further, the display object 70 and the display object 80 of the subtitle plane appear to jump out before that. Since the display object 70 is a display object displayed in the area A, which is a partial area of FIG. 2A, and the display object 80 is a display object displayed in the area B, as described above. In addition, the display object 80 appears to protrude forward from the display object 70 by shifting the image by different offset amounts for each partial region. Furthermore, it appears that a display object 90 on the graphics plane is popping out in front of it.

The user can view the video displayed on the 3D digital television 30 as a stereoscopic video by viewing through the 3D glasses in this way.
<2. Second Embodiment>
<2.1 Overview>
As in the first embodiment, when the offset value to be shifted for each partial area is set and the display object displayed in each partial area is displayed with a different offset value, When a display object is displayed, display objects with different depths are displayed close to each other. For this reason, when viewing such a video, it may be difficult for the user to view.

  Therefore, in the second embodiment, a certain range in the vicinity of the boundary of the partial area can prevent display objects with different depths from being displayed in proximity by providing a prohibited area in which display objects are not displayed. A transmission apparatus will be described. This transmitting apparatus generates information indicating the prohibited area for each partial area, and transmits the information by adding it to the transmission stream.

  In addition, when a transmission stream to which information indicating a prohibited area is added is received, when the image is shifted in the horizontal direction by an offset value indicated by the offset information for each partial area, the image included in the prohibited area A video display device that shifts only images outside the range of the prohibited area without shifting will be described.

  Hereinafter, the description of the data structure, the transmission apparatus, and the structure and operation common to the video display apparatus used in Embodiment 1 will be omitted, and different points will be mainly described.

<2.1 Data>
FIG. 10 is a conceptual diagram showing a prohibited area where display objects are not displayed in the partial area of the caption plane 1000.

  The subtitle plane 1000 is divided into partial areas of area A and area B on a horizontal boundary line. In the area A, a prohibited area 1210 is set on the upper side of the horizontal boundary line, and in the area B, a prohibited area 1211 is set on the lower side of the horizontal boundary line. The display object 1203 is displayed outside the prohibited area 1211 and the display object 1203 is displayed outside the prohibited area 1211 of the area B.

  Hereinafter, the data structure of offset metadata describing information indicating the prohibited area corresponding to each of the partial areas thus divided will be described.

  FIG. 11 shows the data structure of the offset metadata 310 used in the second embodiment. The offset metadata 310 has a data structure in which a descriptor 311 for indicating a prohibited area is added to the offset metadata 300 used in the first embodiment.

  The upper_length of forbidden_area () that is the descriptor 311 indicates the range of the prohibited area on the boundary line at the upper end of the corresponding partial area. Similarly, lower_length indicates the range of the prohibited area on the lower boundary line. Specifically, in the example of FIG. 10, since the upper end of the area A is the same as the upper end of the display area of the caption plane 1000 and no prohibited area is set, “0” is described in upper_length. On the other hand, in lower_length, a value indicating the height of the prohibited area 1210 is described.

  For the region B, the upper end of the region B is a boundary with the region A, and upper_length describes a value indicating the height of the prohibited region 1211. On the other hand, the lower end of the area B is the same as the lower end of the display area of the caption plane, and no prohibited area is set, so “0” is described in lower_length.

<2.2 Configuration of transmitter>
FIG. 12 is a functional block diagram of transmitting apparatus 10a according to the second embodiment.

  Most of the functions of the transmission device 10a are the same as those of the transmission device 10 of the first embodiment. The transmission device 10a is different from the transmission device 10 in that a prohibited area setting unit 107 and a stream generation unit 108 are added, and the function of the division information generation unit 102a is different from that of the division information generation unit 102 of the transmission device 10.

  The division information generation unit 102 of the transmission device 10 generates partial area information based on the display position of the display object of the subtitle stream 112 or the graphics stream 113. It is different in that division information for dividing a display area for subtitles and graphics into partial areas is generated based on the input of predetermined area information.

  Similarly, the prohibited area setting unit 107 has a function of receiving the input of the prohibited area information for each partial area predetermined by the content producer and adding information indicating the prohibited area for each partial area.

  The stream generation unit 108 has a function of generating a subtitle stream and a graphics stream from subtitle and graphics data input by the content creator.

<2.3 Operation of transmitter>
Hereinafter, a processing operation for generating a subtitle stream and a graphics stream in consideration of the prohibited area in the transmission device 10a will be described. It should be noted that when a graphics stream is generated, it can be generated in the same procedure because the caption data in the case of generating a caption stream described below is simply replaced with graphics data. For this reason, a case where a subtitle stream is generated will be described as an example.

  FIG. 13 is a flowchart of processing for generating a caption stream in consideration of the prohibited area of the transmission device 10a.

  The division information generation unit 102a reads information indicating a partial area in which the display position of the subtitle is set in advance by the content creator by the content creator, and sets the values of dividing_point_start and dividing_point_end of the offset metadata 310 for each partial area. . Similarly, the prohibited area setting unit 107 reads information indicating a prohibited area preset in advance by the content creator, and sets the values of upper_length and lower_length of forbidden_area of the offset metadata 310 for each partial area (step) S50). The information indicating the partial area and the information indicating the prohibited area set in advance by the content creator is, for example, the content provider using a keyboard for data input from the outside while looking at the monitor provided in the transmission device 10a. Input by operating. Specifically, the content provider inputs the value of the start Y coordinate and the value of the end Y coordinate of the partial area. Also, an external storage device (for example, a hard disk drive or a memory card) that stores a list indicating the value of the start Y coordinate, the value of the end Y coordinate, and the height of the prohibited area for each partial area created by the content creator is transmitted. You may make it read by connecting to 10a.

  Next, the stream generation unit 108 reads the caption data input by the content creator in the same manner as the information indicating the partial area created by the content creator (step S51). This caption data is caption data whose display position is determined in advance by the content provider so that captions are not displayed in the range of the prohibited area.

  Next, the stream generation unit 108 generates a subtitle stream for the subtitles input by the content creator (step S52).

  Through the above processing, the transmission device 10a can generate offset metadata including offset information to which information indicating a prohibited area that does not display captions is added for each partial area, and the caption stream that does not display captions in the prohibited area Can be generated.

<2.4 Configuration of video display device>
Next, a video display device that receives the transport stream 116 transmitted by the transmission device 10a according to the second embodiment and displays a video will be described. The video display device according to the second embodiment has substantially the same configuration as the video display device 20 according to the first embodiment, and therefore, the same reference numerals as those of the video display device 20 are used for convenience of explanation.

  In the video display device 20 of the second embodiment, the functions of the subtitle offset processing unit 211 and the graphics offset processing unit 214 are added to the functions of the subtitle offset processing unit 211 and the graphics offset processing unit 214 of the first embodiment. The information indicating the prohibited area for each partial area of the offset metadata 310 is extracted, and the image included in the extracted prohibited area range is not shifted, and only the image included in the partial area range other than the prohibited area is displayed. Has the function of shifting.

<2.5 Operation of video display device>
The processing operation of the video display device 20 having the above function will be described below.

  FIG. 14 is a flowchart showing the processing of the video display device 20 of the present embodiment.

  Since the processing from step S20 to step S33 is the same as that from step S20 to step S33 in FIG. 7, here, the processing after step S33 will be mainly described.

  When the image of the left-eye video plane 206 is selected as the image of the video plane to be output to the plane adder 216 (step S33: YES), the selector 215 sends the subtitle offset processor 211 and the graphics offset processor 214 respectively. An instruction to shift the plane image for the left eye is issued.

  The subtitle offset processing unit 211 checks whether a prohibited area is set in the partial area (step S61). Specifically, the value of upper_length and lower_length of forbidden_area for each partial area of offset metadata 310 is checked to determine whether each value is “0”. Judge that it is set. If the area to be shifted is within this prohibited area (step S61: YES), an image that is not shifted in this area is output to the plane adder 216. On the other hand, if it is not within the prohibited area (step S61: NO), the image of this area is added to the left by the same method as in step S34 in FIG. 7 described above for the left eye with the value indicated by offset_value. It outputs to the part 216 (step S62).

  The graphics offset processing unit 214 checks whether or not the graphics plane image is a prohibited area by the same method as in step S61 (step S63).

  If YES in step S63, the graphics offset processing unit 214 outputs an image that is not shifted to the plane addition unit 216. If NO in step S63, the graphics offset processing unit 214 converts the image into the graphics plane in the same manner as in step S62. An image shifted to the right with the value indicated by offset_value for each partial region to be applied is output to the plane adder 216 (step S64).

  Next, the plane addition unit 216 adds the left-eye video plane image output from the selector 215 to the left-eye shifted subtitle image output from the subtitle offset processing unit 211 and the left-eye output from the graphics offset processing unit 214. The shifted graphics image is superimposed by the same method as in step S36 of FIG. 7 described above, and is output to the display unit 217 (step S65). The display unit 217 displays the left-eye image output from the plane addition unit 216 (step S71).

  On the other hand, if NO in step S33, an image obtained by shifting the subtitle plane and the graphics plane for the right eye is generated by the processing in steps S66 to S70. Steps S66 to S70 correspond to the processes of Steps S61 to S65, which are processes for generating an image shifted for the left eye, and differ only in that the image is shifted not in the right direction but in the left direction. .

The display unit 217 displays the right-eye image output from the plane addition unit 216 (step S71).
<3. Modification>
The transmission apparatus and the video display apparatus according to the present invention have been described above based on the embodiments. However, the transmission apparatus and the video display apparatus according to the present invention can be modified as follows. Of course, the present invention is not limited to the device and the video display device.

  (1) In the above-described embodiment, the information indicating the range of the partial area and the information indicating the offset value for each partial area are described in an example described in one data structure. The information to be shown and the offset value for each partial area need not be described in the same data structure. Any data structure may be used as long as the correspondence between the range indicating the partial area and the offset value applied to the partial area is known.

  For example, as shown in FIG. 15, offset_metadata describing offset value information and offset_sequence_id_refs describing partial region information may be used.

  The offset_metadata in FIG. 15 is disclosed as the specification of Blu-ray Disc (registered trademark) and has a data structure equivalent to offset_metadata. The details are described in A.3.6.1 of Non-Patent Document 1.

  The offset metadata 400 of the present modification describes information indicating an offset for each partial area, with the data structure indicated by offset_metadata and the data structure indicated by offset_sequence_id_refs.

  member_of_offset_sequence_id_refs of offset_sequence_id_refs indicates the number of offset_sequences, that is, the number of partial areas.

  offset_sequence_id_ref in the for loop is an ID for specifying the Offset Sequence referred to by offset_sequence_id of offset_metadata.

  dividing_point_start is the start Y coordinate of the partial region indicated by offset_sequence_id_ref, and dividing_point_end similarly indicates the end Y coordinate of the region.

  Thus, by describing the information indicating the partial area and the information indicating the offset value with different data structures, the offset values for each partial area can be associated more flexibly.

  Further, in order to describe the range of the partial area, the start Y coordinate and the end Y coordinate of the partial area are used, but the description method of the partial area range is not limited to this. Any description may be used as long as the information can identify the range of the partial area. For example, you may describe by the start Y coordinate of a partial area, and height.

  In addition, when the difference in depth between adjacent partial areas, that is, the difference in the value of offset_value is larger than a predetermined value, the height of the prohibited area is set to be larger than that in the case where the difference in the value of offset_value is within a predetermined value. May be. By changing the height of the forbidden area according to the difference in depth between the adjacent partial areas, it is possible to reduce the difficulty in viewing due to the difference in depth near the boundary.

  (2) In the embodiment and the above-described modification example, the coordinates for specifying the range of the partial area are described directly in the offset metadata. However, the coordinates for specifying the range of the partial area are directly included in the offset metadata. It is not necessary to describe. The information described in the offset metadata may be information that can specify the range of the partial area. Specifically, for example, several types of patterns to be divided may be prepared in advance, and an ID that can identify the divided pattern may be described. In the video display device, the coordinates of the range of the partial area for each division pattern are stored in advance in association with the ID for specifying the division pattern at the time of manufacture. Then, the video display device extracts an ID indicating the division pattern of the offset metadata included in the received stream, and refers to the area information stored in advance for the partial area of the division pattern corresponding to the ID. Process.

  FIG. 16 shows an example of a division pattern and an example of the data structure of offset metadata.

  As the division patterns, two types of division patterns shown in FIGS. 16A and 16B are defined in advance. FIG. 4A shows an example in which the display area is divided into two, and this region_ID is “3”. FIG. 4B shows an example in which the display area is divided into three, and region_ID is “4”. Thus, a value obtained by adding 1 to the number of divisions is defined as region_ID.

  FIG. 3C shows an example of the data structure of the offset metadata 500.

  The region_ID is an ID for specifying the division pattern, and in the example of FIG. 16, the value is “3” or “4”.

  number_of_region indicates the number of partial regions, and can be obtained by region_ID-1.

  max_disparity_in_picture indicates the maximum offset value when the display area is shifted, and when the offset value is not changed for each partial area for output, that is, the partial area in which “1” is set in offset_priority described in the first embodiment Equivalent to the offset_value.

  min_disparity_in_region_i in the for loop indicates an offset value for each partial region. The image of the partial region is shifted using this min_disparity_in_region_i for each partial region.

  FIG. 4D shows an example of the data structure of the division pattern information 600 describing the range of the partial area for each division pattern stored in advance in the video display device.

  The division pattern information 600 is a table describing the range of the partial area for each division pattern. As shown in FIG. 4D, the division pattern information 600 includes items of region_ID 601, region NO 602, start 603, and end 604.

  The region_ID 601 is an item for specifying the region_ID described in the offset metadata 500, and the region NO602 is an item for specifying the partial region of the division pattern specified by the region_ID. start 603 and end 604 are items for describing a start Y coordinate and an end Y coordinate for each partial region.

  The case where the region_ID in FIG. 4D is “3” corresponds to the division pattern in the case of FIG. 3A, and there are two partial regions where the region NO is “0” and “1”, and the region NO is “0”. It is stored that the start Y coordinate of the area is “0” and the end Y coordinate is “539”. Similarly, when regionNO is “1”, it is stored that the start Y coordinate is “540” and the end Y coordinate is “1080”. Similarly, the region_ID of “4” in FIG. 6D corresponds to the division pattern in the case of FIG. As described above, the video display device can extract the region_ID included in the offset metadata 500 and specify the range of the partial region corresponding to the region_ID by referring to the division pattern information 600 stored in advance. it can.

  (3) In the second embodiment, the example of describing the range of the prohibited area at a constant height from the boundary line has been described. However, the description method of the range of the prohibited area is described at a constant height from the boundary line. Not limited to. Any description may be used as long as the range of the prohibited area can be specified. For example, you may describe with the ratio with respect to the height of each partial area.

  FIG. 17 shows an example of the data structure of offset metadata described as a ratio to the height of the partial area. As indicated by forbidden_area_ratio (), which is the descriptor 321 in FIG. 5, the offset metadata 320 describes the range of the prohibited area as a ratio with respect to the height of the partial area at each of the upper and lower boundaries of the partial area. upper_side_ratio indicates the ratio of the prohibited area range at the upper end to the height of the partial area. For example, if this value is 0.2 and the height of the partial area is 540, the height of the prohibited area is 108 (= 540 × 0.2), and a range obtained by adding 108 to the Y coordinate of the upper boundary. Indicates that the above is a prohibited area. Similarly, lower_side_ratio indicates the range of the prohibited area at the lower end of the partial area as a ratio to the height of the partial area.

  By describing in this way, it is possible to set a certain percentage range according to the height of the partial area as the prohibited area.

  (4) In the video display device according to the second embodiment, in the offset processing in the caption offset processing unit 211 and the graphics offset processing unit 214 when the offset metadata 310 in which the prohibited region is set is received, Although the included image is not shifted, the offset process is not limited to this process. It is only necessary to perform offset processing so that the difference in depth near the boundary between adjacent partial regions does not increase. For example, an image included in the prohibited area may be shifted by an offset value intermediate between the offset values of adjacent partial areas. In addition, when the difference between the offset values of adjacent areas is smaller than a predetermined value, the prohibited area may be shifted by the offset value for each partial area.

  Further, the offset_value value of the partial area where the display object is not displayed may be set to “0”. Since it is not necessary to shift the image of the partial area where the display object is not displayed, the offset processing value is always set to “0” for the partial area where it is known in advance that the display object is not displayed. Can be reduced.

  (5) In the embodiment, the display area is divided into partial areas and described in offset metadata. At this time, the height of the partial area may be an even number. This is for the following reason. A digital component that is a color difference method that reduces the information of color components by utilizing the characteristics of the human eye that the resolution for color is lower than the brightness in order to effectively use the broadcast band in video in TV broadcasting Video signal systems are widely used, and 4: 2: 2 video formats are mainly used. In this format, color signals in the horizontal and vertical directions are sampled every other scanning line. Therefore, if the subtitles and graphics are divided so that the height of the partial area is an odd number, one line is displayed when superimposed with 3D video. This is because there is a possibility of shifting.

  (6) In the embodiment, the subtitle stream and the graphics stream are included in the transmission stream multiplexed with the video stream and transmitted as a broadcast wave. However, the transmission of the subtitle stream and the graphics stream is multiplexed with the video stream. It is not limited to the method of transmitting the data. Any method may be used as long as the video can be received by the video display device so that the video and the subtitles and graphics can be superimposed and output. For example, it may be transmitted by a different broadcast wave instead of a multiplexed broadcast wave, or may be distributed via a network such as the Internet. Furthermore, it may be distributed by a recording medium such as an SD (registered trademark) card, a DVD, or a Blu-ray Disc.

  Note that the subtitle stream and graphics stream are superimposed on video and subtitles, and can be used to generate data in any format as long as it is a stream that can generate additional information and graphics that can be interactively operated by the user. It may be a stream generated by using. For example, it may be a stream generated using data configured in a programming language such as Java (registered trademark), or data described in HTML (Hyper Text Markup Language) or HDML (Handheld Device Markup Language). The stream may be a stream generated by using data described in BML (Broadcast Markup Language) or the like.

  (7) In the embodiment, the offset metadata is described as being described in the PMT and transmitted. However, the offset metadata is not limited to being described in the PMT. As long as the video display device can extract the offset metadata and acquire the offset information for each partial area, it may be described anywhere in the data acquired by the video display device. For example, when the offset information of the offset metadata does not change for each program, it may be described in the EIT. When it does not change in units of channels, it may be described in a descriptor indicating a channel in the PSI. Further, it may be a single stream describing offset metadata. Furthermore, when graphics rendering is described by a Java (registered trademark) program, and the image display device generates a graphics plane image by executing the Java program, the offset metadata is Java. It may be described in the program. Further, when data for drawing graphics is described in HTML, offset metadata may be described in HTML.

  (8) In the above-described embodiment, it has been described that both the left-eye video and the right-eye video of 3D video are transmitted and received by broadcast waves, but transmission / reception of 3D video is not limited to this. Any video transmission device may be used as long as it can transmit the left-eye video and the right-eye video for display so that the viewer can view the 3D video. For example, the video for the left eye may be transmitted / received by a conventional broadcast wave, and the video for the right eye may be distributed / received via a network or the like. In this case, the offset metadata may be distributed from a transmission method other than broadcast waves (in this example, via a network). By doing so, existing broadcasting facilities can be used as they are.

  (9) In the embodiment, the example in which the display area is divided into two partial areas has been described, but the number of divisions of the partial areas is not limited to two. What is necessary is just to divide | segment into the partial area | region which can set appropriately the depth of a different display object when it superimposes with 3D video. For example, it may be divided into two or more partial areas. When divided into three regions, the value of number_of_offset_sequence_in_OSG in the offset metadata 300 of FIG. 3 is “3”, and three offset_value, dividing_point_start, and dividing_point_end values are set in the for loop.

  Further, an upper limit value of the number of divisions may be set. In this case, the upper limit of the number of divisions may be determined based on the maximum value of the height of the displayed caption or the like. For example, if the height of the display screen is W and the maximum value of the subtitles is N, the maximum integer value that does not exceed the value of W / N may be set as the maximum value of the number of divisions. Further, the maximum number of divisions may be limited according to the resolution of the display screen. For example, when the size of the display area is Full HD (full high definition) (the number of pixels in the height direction is 1080 or more), up to 4 divisions, HD (high definition) (pixels in the height direction) below Full HD If the number is less than 1080 and 720 or more), it may be limited to 3 divisions, and if it is SD (standard definition) (the number of pixels in the height direction is less than 720), it may be limited to 2 divisions.

  Further, the boundary lines of the partial areas do not need to be in contact with each other. For example, a partial region in the range of ¼ of the total height from the top of the display region and a partial region in the range of ½ of the total height from the bottom of the display region may be set. When divided in this way, the boundary lines of the partial areas are not in contact.

  Further, the ratio of the area shifted by the offset value may be limited with respect to the display area. For example, the total height of the partial areas where the offset value is set may be limited to a height corresponding to ½ of the display area. In this case, the boundary of each partial area may not touch.

  Thus, since it is not necessary to perform offset processing in the subtitle offset processing unit 211 and the graphics offset processing unit 214 in regions other than the partial region to be offset, the processing load can be reduced.

  (10) In the embodiment, subtitles and graphics may not be displayed for a certain time before switching when the value of offset_value in the same partial region is switched over time. If the depth of the display object varies greatly within a short period of time, it may be difficult for the viewer who is viewing the 3D video to view the video. By not displaying the display object for a certain period of time before the depth is switched, it is possible to reduce the difficulty of viewing for the viewer.

Further, if the division range and depth of the partial area frequently change, the processing load increases in the offset processing in the caption offset processing unit 211 and the graphics offset processing unit 214. For this reason, you may make it switch a partial area | region and depth by a fixed time unit.
For example, in one program, the range of the partial area and its offset_value may not be changed. Thereby, if the partial area and its offset_value are extracted at the start of the program, the same value can be used until the end of the program, so that the processing load can be reduced.

  Also, the offset_value value may be changed only at the timing when the video encoded in the MPEG2 format or MPEG4 MVC format should be displayed together with the GOP unit or Ipicture.

  Further, when switching the value of the partial area or offset_value, information indicating that the switching occurs from a certain time before the time of the switching timing may be added to the SI / PSI and transmitted.

  The video display device may output a subtitle plane or a graphics plane image without shifting while receiving a packet of a stream to which information indicating that this switching occurs is added.

  (11) In Embodiment 2, the example has been described in which the transmission device 10a generates a subtitle stream in consideration of the prohibited area, but the generation of the subtitle stream may not be performed by the transmission device 10a. The transmission device 10a only needs to be able to transmit a multiplexed transmission stream including a subtitle stream, and the subtitle stream may be generated by another device and output to the transmission device.

  (12) The video decode 205 of the first embodiment decodes 3D video in the MPEG4 MVC format, but the 3D video encoding method is not limited to this method. Any encoding method may be used as long as the right-eye video and the left-eye video can be generated so that 3D video can be viewed. For example, a data stream obtained by encoding videos for the right eye and left eye in MPEG2 format or MPEG4 AVC may be received and decoded. Also, either the right-eye video or the left-eye video is encoded in the MPEG2 format, and only the difference between the right-eye video and the left-eye video is encoded in MPEG2 or MPEG4 AVC, and the multiplexed data stream is received and decoded. May be. Alternatively, side-by-side 3D video may be received and decoded.

  (13) When the plane addition unit 216 of the video display device 20 of Embodiment 1 superimposes the subtitle plane image and the graphics plane image on the video plane, it first superimposes the subtitle plane image, and then However, the method of superimposing is not limited to this. As long as the subtitle plane image and the graphics plane image can be superimposed on the video plane image, they may be superimposed in any manner. For example, the depth of the subtitle plane image to be superimposed may be compared with the depth of the graphics plane image, and the plane image with the smaller depth may be superimposed first.

  (14) The present invention may be a method for realizing the above processing. Further, the present invention may be a computer program that realizes these methods by a computer, or may be a digital signal composed of the computer program.

  The present invention also provides a computer-readable recording medium such as a flexible disk, hard disk, CD-ROM, MO, DVD, DVD-ROM, DVD-RAM, BD (Blu-ray Disc). (Registered trademark)) or a semiconductor memory. Further, the present invention may be the computer program or the digital signal recorded on these recording media.

  The computer program or digital signal according to the present invention may be transmitted via an electric communication line, a wireless or wired communication line, a network represented by the Internet, data broadcasting, or the like.

(15) The above embodiment and the above modifications may be combined as appropriate.
<4. Supplement>
Hereinafter, the configuration of the transmission apparatus and the video display apparatus as one embodiment of the present invention, and its modifications and effects will be described.

  (1) A transmission apparatus according to an embodiment of the present invention is a transmission apparatus that transmits data for displaying a video including a 3D video and a display object to be displayed on the display area in the video display device. And a division information generating means for generating division information indicating respective ranges of the partial areas obtained by dividing the display area into two or more areas by a horizontal boundary line, and display objects for each of the partial areas are displayed in 3D. Offset information setting means for setting offset information indicating the depth for display according to the depth of the video portion of the 3D video in the partial area where the display object exists, the division information, the offset information, and the 3D Stream generation means for generating a transmission stream including 3D video data for displaying video; and And a stream transmission unit for transmitting the serial transmission stream.

  The transmission apparatus having this configuration does not divide the display area of the display object to be displayed superimposed on the 3D video by the vertical boundary line, but divides the display object into a plurality of partial areas by the horizontal boundary line. The offset information for displaying on the video display device at the depth is transmitted.

  Therefore, when a display plane of display data such as captions is superimposed on 3D video on a video display device, display objects included in different partial areas in the display data such as captions can be displayed so as to be seen at different depths. Stream data can be transmitted.

  (2) Here, the offset information setting means sets the offset information for each time interval unit in the 3D video according to the depth of the 3D video to be displayed at the time when the display object is displayed. One may be set for each of the partial areas.

  Therefore, the transmission device having this configuration can transmit offset information for causing the video display device to display the partial regions at appropriate depths for each unit of time.

(3) Here, the 3D video data is data encoded in the MPEG2 format or the MPEG4 format, and the division information generating means determines that the vertical position of the boundary line of the partial region is the upper end of the display region. To generate division information that is divided so as to be a relative position represented by N times the number of pixels in the vertical direction of the macroblock at the time of encoding the 3D video data (N is a natural number of 1 or more).
It is good.

  The transmission apparatus having this configuration can divide the partial area so that the height of the partial area is an integral multiple of the size of the macroblock when 3D video is encoded in MPEG2 format or MPEG4 format.

  Therefore, the processing when decoding and superimposing the 3D video encoded in the MPEG2 format or the MPEG4 format is facilitated.

  (4) Here, further, prohibited area generating means for generating prohibited area information indicating that a predetermined fixed range near the boundary line in the partial area is set as a prohibited area for prohibiting display of the display object. The stream generation means may further include the prohibited area information in the transmission stream.

  Therefore, the transmission apparatus having this configuration can transmit prohibited area information indicating that a display object is not displayed in an area within a certain range near the boundary of the partial area.

  (5) Here, the forbidden area may be an area having a predetermined ratio with respect to the height of the partial area for each of the partial areas.

  Therefore, the transmission apparatus having this configuration can set an area where display objects are not displayed in a range having a certain ratio with respect to the height of the partial area.

  (6) Here, the display object data stream generation further generates a data stream for the display object in which the display range of the display object does not overlap with the range of the prohibited area specified based on the prohibited area information. The means and the stream generation means may further generate a transmission stream including the display object data stream.

  The transmission apparatus having this configuration generates a display object data stream in which display objects such as captions are not displayed in the range set as the prohibited area, and transmits a multiplexed transmission stream including the data stream. Send.

  Therefore, in the video display device that has received such a data stream, it is possible to generate and transmit a display object data stream that can display a video in which display objects having different depths are not displayed near the boundary.

  (7) Here, the display object data stream generation further generates a display object data stream in which the display range of the display object does not overlap with the prohibited area range specified based on the prohibited area information. Means and a display object data stream transmitting means for transmitting the display object data stream.

  The transmission apparatus having this configuration generates and transmits a display object data stream in which display objects such as captions are not displayed in the range set as the prohibited area.

  Therefore, the display object data stream for superimposing and displaying on the 3D video can be transmitted separately from the transmission stream.

  (8) A video display device according to an embodiment of the present invention is a video display device that receives a transmission stream and displays a display object superimposed on a video of video data included in the transmission stream. The stream includes division information for specifying a partial area obtained by dividing a display area for displaying the display object, and offset information indicating a depth for displaying the display object in 3D for each partial area. The display object displayed in each of the partial areas specified based on the division information is shifted in the horizontal direction based on the offset information to generate a right-eye display object image and a left-eye display object image. And generating means for outputting the 3D video, the right-eye display object image is added to the right-eye video. And tatami, and output means for outputting the superimposing the left-eye display object image on the left-eye video.

  When displaying the left-eye image of the 3D video based on the offset information for each partial area included in the received transmission stream, the video display device having this configuration has different offset values for each partial area. When an image shifted for the left eye is generated and a right eye image is displayed, an image shifted for the right eye is generated, superimposed, and output.

  Therefore, when a display plane of display data such as caption is superimposed on a 3D video, display objects having different display positions in the display data such as caption can be displayed so as to be seen at different depths.

  (9) Here, the generation means includes prohibited area information indicating a prohibited area for prohibiting display of the display object in a predetermined range in the vicinity of a boundary line of the partial area in the transmission stream. If it is, the display object may be shifted in the horizontal direction only for display objects displayed outside the prohibited area.

  When the transmission stream includes prohibited area information, the video display device with this configuration does not shift the display object in the prohibited area indicated by the prohibited area information, and shifts the other ranges for each partial area. Shift based on the offset information.

  Accordingly, since the image in the prohibited area is not shifted, it can be suppressed that the image is displayed at different depths in the vicinity of the boundary of the partial area.

  INDUSTRIAL APPLICABILITY The present invention can be used as a technique for displaying a display object such as a character or graphic superimposed on a 3D image.

10, 10a Transmission device 20 Video display device 101 Video encoding unit 102, 102a Division information generation unit 103 Offset information setting unit 104 Stream management information generation unit 105 Multiplexing processing unit 106 Transmission unit 107 Prohibited area setting unit 108 Stream generation unit 201 User interface unit 202 Tuner 203 Demultiplexing unit 204 Stream management information analysis unit 205 Video decoding unit 206 Left-eye video plane 207 Right-eye video plane 208 Division information analysis unit 209 Subtitle decoding unit 210 Subtitle plane 211 Subtitle offset processing unit 212 Graphics decoding Unit 213 graphics plane 214 graphics offset processing unit 215 selector 216 plane addition unit 217 display unit 218 audio decoding unit 219 speaker 300 310,320,400,500 offset metadata 600 divided pattern data

Claims (12)

A transmission device that transmits data for displaying a video composed of a 3D video and a display object to be displayed on the 3D video in a display area of the video display device,
Division information generating means for generating division information indicating respective ranges of partial areas obtained by dividing the display area into two or more areas by a horizontal boundary line;
Offset information setting means for setting offset information indicating the depth for displaying the display object in 3D for each of the partial areas according to the depth of the video part of the 3D video in the partial area in which the display object exists;
Stream generation means for generating a transmission stream configured to include the division information, the offset information, and 3D video data for displaying the 3D video;
Stream transmitting means for transmitting the transmission stream ,
The offset information setting means sets the offset information for each of the partial areas for each temporal section in the 3D video according to the depth of the 3D video to be displayed at the time when the display object is displayed. Set
The 3D video data is data encoded in MPEG2 format or MPEG4 format,
The division information generating means is configured such that the vertical position of the boundary line of the partial area is N times the number of pixels in the vertical direction of the macroblock when encoding the 3D video data from the upper end of the display area (N is A transmission apparatus that generates division information divided so as to be a relative position represented by a natural number of 1 or more . Furthermore, a prohibited area generating means for generating prohibited area information indicating that a predetermined fixed range in the vicinity of the boundary line in the partial area is set as a prohibited area for prohibiting display of the display object,
The transmission apparatus according to claim 1 , wherein the stream generation unit further includes the prohibited area information in the transmission stream. The transmission device according to claim 2 , wherein the prohibited area is an area having a predetermined ratio with respect to the height of the partial area for each of the partial areas. Furthermore, a display object data stream generating means for generating a data stream for a display object in which a display range of the display object does not overlap a range of the prohibited area specified based on the prohibited area information;
The transmission apparatus according to claim 2 , wherein the stream generation unit further generates a transmission stream including the display object data stream. Furthermore, a display object data stream generating means for generating a data stream for a display object in which a display range of the display object does not overlap a range of the prohibited area specified based on the prohibited area information;
The transmission device according to claim 2, further comprising display object data stream transmission means for transmitting the display object data stream. A video display device that receives a transmission stream and superimposes a display object on a video of video data included in the transmission stream.
The transmission stream includes division information for specifying a partial area obtained by dividing a display area for displaying the display object, and offset information indicating a depth for displaying the display object in 3D for each partial area. Included,
Generation means for generating a display object image for the right eye and a display object image for the left eye by shifting the display objects displayed in each of the partial areas specified based on the division information in the horizontal direction based on the offset information. When,
When outputting 3D video, output means for superimposing the right-eye display object image on the right-eye video and superimposing and outputting the left-eye display object image on the left-eye video ,
When the transmission means includes prohibited area information indicating a prohibited area for prohibiting display of the display object in a predetermined range near a boundary line of the partial area. The video display device is characterized by shifting in the horizontal direction only for display objects displayed outside the prohibited area . A transmission method executed by a transmission apparatus that transmits data for displaying a video including a 3D video and a display object to be displayed on the display area in a display area by the video display apparatus,
A division information generation step for generating division information indicating respective ranges of the partial areas obtained by dividing the display area into two or more areas by a horizontal boundary line;
Offset information setting step for setting offset information indicating the depth for displaying the display object in 3D for each of the partial areas in accordance with the depth of the video part of the 3D video in the partial area where the display object exists;
A stream generation step of generating a transmission stream configured to include the division information, the offset information, and 3D video data for displaying the 3D video;
A stream transmission step of transmitting the transmission stream ,
In the offset information setting step, the offset information is set to 1 for each of the partial areas for each temporal section in the 3D video according to the depth of the 3D video to be displayed at the time when the display object is displayed. Set
The 3D video data is data encoded in MPEG2 format or MPEG4 format,
In the division information generating step, the vertical position of the boundary line of the partial area is N times the number of pixels in the vertical direction of the macroblock when encoding the 3D video data from the upper end of the display area (N is A transmission method characterized by generating division information divided so as to be a relative position represented by a natural number of 1 or more . A transmission program of a transmission device for transmitting data for displaying a video including a 3D video and a display object to be displayed on the 3D video in a display area by the video display device,
In the transmitter,
A division information generation step for generating division information indicating respective ranges of the partial areas obtained by dividing the display area into two or more areas by a horizontal boundary line;
Offset information setting step for setting offset information indicating the depth for displaying the display object in 3D for each of the partial areas in accordance with the depth of the video part of the 3D video in the partial area where the display object exists;
A stream generation step of generating a transmission stream configured to include the division information, the offset information, and 3D video data for displaying the 3D video;
A stream transmission step of transmitting the transmission stream;
Let it run
In the offset information setting step, the offset information is set to 1 for each of the partial areas for each temporal section in the 3D video according to the depth of the 3D video to be displayed at the time when the display object is displayed. Set
The 3D video data is data encoded in MPEG2 format or MPEG4 format,
In the division information generating step, the vertical position of the boundary line of the partial area is N times the number of pixels in the vertical direction of the macroblock when encoding the 3D video data from the upper end of the display area (N is A transmission program that generates division information divided so as to be a relative position represented by a natural number of 1 or more . An integrated circuit constituting a transmission device for transmitting data for displaying a video composed of a 3D video and a display object to be displayed on the display area in a display area by the video display device,
Division information generating means for generating division information indicating respective ranges of partial areas obtained by dividing the display area into two or more areas by a horizontal boundary line;
Offset information setting means for setting offset information indicating the depth for displaying the display object in 3D for each of the partial areas according to the depth of the video part of the 3D video in the partial area in which the display object exists;
Stream generation means for generating a transmission stream configured to include the division information, the offset information, and 3D video data for displaying the 3D video;
Stream transmitting means for transmitting the transmission stream ,
The offset information setting means sets the offset information for each of the partial areas for each temporal section in the 3D video according to the depth of the 3D video to be displayed at the time when the display object is displayed. Set
The 3D video data is data encoded in MPEG2 format or MPEG4 format,
The division information generating means is configured such that the vertical position of the boundary line of the partial area is N times the number of pixels in the vertical direction of the macroblock when encoding the 3D video data from the upper end of the display area (N is An integrated circuit characterized by generating division information divided so as to be a relative position represented by a natural number of 1 or more . A video display method executed by a video display device that receives a transmission stream and superimposes a display object on a video of video data included in the transmission stream.
The transmission stream includes division information for specifying a partial area obtained by dividing a display area for displaying the display object, and offset information indicating a depth for displaying the display object in 3D for each partial area. Included,
Generation step of generating a display object image for the right eye and a display object image for the left eye by shifting the display objects displayed in each of the partial areas specified based on the division information in the horizontal direction based on the offset information. When,
When outputting the 3 D images, and an output step of superimposing the right-eye display object image on the right-eye video in a superposing the left eye display object image on the left-eye video,
When the generation step includes prohibited area information indicating a prohibited area for prohibiting display of the display object in a predetermined range near a boundary line of the partial area in the transmission stream. A video display method characterized by shifting in the horizontal direction only for display objects displayed outside the range of the prohibited area . A video display program for a video display device that receives a transmission stream and superimposes a display object on a video of video data included in the transmission stream.
In the video display device,
The transmission stream includes division information for specifying a partial area obtained by dividing a display area for displaying the display object, and offset information indicating a depth for displaying the display object in 3D for each partial area. Included,
Generation step of generating a display object image for the right eye and a display object image for the left eye by shifting the display objects displayed in each of the partial areas specified based on the division information in the horizontal direction based on the offset information. When,
When outputting the 3D video, an output step of superimposing the right-eye display object image on the right-eye video and superimposing and outputting the left-eye display object image on the left-eye video,
Let it run
When the generation step includes prohibited area information indicating a prohibited area for prohibiting display of the display object in a predetermined range near a boundary line of the partial area in the transmission stream. A video display program that shifts in the horizontal direction only for display objects that are displayed outside the prohibited area . An integrated circuit constituting a video display device that receives a transmission stream and superimposes a display object on a video of video data included in the transmission stream, and displays the display object.
The transmission stream includes division information for specifying a partial area obtained by dividing a display area for displaying the display object, and offset information indicating a depth for displaying the display object in 3D for each partial area. Included,
Generation means for generating a display object image for the right eye and a display object image for the left eye by shifting the display objects displayed in each of the partial areas specified based on the division information in the horizontal direction based on the offset information. When,
When outputting 3D video, output means for superimposing the right-eye display object image on the right-eye video and superimposing and outputting the left-eye display object image on the left-eye video,
When the transmission means includes prohibited area information indicating a prohibited area for prohibiting display of the display object in a predetermined range near a boundary line of the partial area. An integrated circuit characterized by shifting in the horizontal direction only for display objects displayed outside the range of the prohibited area .

Images