JP2005229384A - Multimedia information distribution and receiving system, multimedia information distribution device, and multimedia information receiving device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a multimedia information distribution and receiving system, etc. which can display multimedia information as a three-dimensional image. <P>SOLUTION: The system comprises a mono-media information creator 11 which creates a plurality of mono-media information, a solid multimedia information creator 12 which creates a solid multimedia information adding arrangement information of Z axis direction between mono-media information and arrangement information of X and/or Y axis direction between a plurality of mono-media information to a plurality of mono-media information, a multimedia information distribution device 1 including a distribution part 13 which distributes the solid multimedia information, a receiving part 21 which receives the distributed solid multimedia information, a solid multimedia screen drawing part 22 which draws the solid multimedia screen based on the received multimedia information, and a multimedia information receiving device 2 including a solid screen display unit 23 which displays the solid multimedia screen in three-dimensional display. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to a multimedia information distribution / reception system, a multimedia information distribution apparatus, and a multimedia information reception apparatus, and in particular, a multimedia information distribution / reception system capable of displaying all multimedia information including television information as a stereoscopic screen, The present invention relates to a multimedia information distribution apparatus and a multimedia information reception apparatus.

  BS digital broadcasting started in 2000 can receive services of high-definition broadcasting and multimedia data broadcasting, both of which are flat (two-dimensional) screen broadcasting.

  On the other hand, in recent years, research and development of stereoscopic (three-dimensional) television broadcasting systems have been promoted in various places including the laboratory to which the inventors of the present invention belong.

  In 3D television broadcasting, it is naturally desired to continue the data broadcasting service.

In order to satisfy this requirement, a “data broadcasting system and method” for synthesizing a data broadcasting screen and a three-dimensional television broadcasting screen that have been displayed in a plane has already been proposed (for example, see Patent Document 1).
JP 2002-135734 A ([0005], FIG. 3)

  However, in the conventional data broadcasting system according to the above proposal, only the television broadcast screen is stereoscopically displayed, and the data broadcast screen is not stereoscopically displayed.

  That is, in the conventional data broadcasting system, the received data broadcast wave is separated into a text data part and a stereoscopic video data part, and is controlled in display by the display control part to explain the product (text data) as a flat image. Are displayed on the same screen of the display unit as a product image which is a stereoscopic image.

  Therefore, even if the viewer is using a 3D screen display device, the text data portion cannot be displayed in 3D.

  The present invention has been made in view of the above problems, and is a multimedia information distribution / reception system, multimedia information distribution apparatus, and multimedia information reception capable of displaying all multimedia information including television information as a stereoscopic screen. An object is to provide an apparatus.

A first embodiment of a multimedia information distribution / reception system according to the present invention is a multimedia information distribution means for distributing stereoscopic multimedia information including a plurality of mono-media information, and a stereoscopic information distributed from the multimedia information distribution means. A multimedia information distribution / reception system comprising multimedia information receiving means for receiving multimedia information,
The multimedia information distribution means is a monomedia information generation unit that generates a plurality of monomedia information, and arrangement information in the Z-axis direction when the plurality of monomedia information is drawn on the plurality of monomedia information. A stereoscopic multimedia information generating unit for generating stereoscopic multimedia information by adding multimedia Z-axis arrangement information and multimedia X / Y-axis arrangement information which is arrangement information in the X / Y-axis directions, and the stereoscopic multimedia information Including a distribution unit for distribution,
A multimedia information receiving means for receiving the stereoscopic multimedia information distributed from the distribution unit; and a stereoscopic multimedia for rendering a stereoscopic multimedia screen based on the stereoscopic multimedia information received by the receiving unit. A media screen rendering unit; and a stereoscopic screen display unit that stereoscopically displays the stereoscopic multimedia screen rendered by the stereoscopic multimedia screen rendering unit.

  With this configuration, a stereoscopic multimedia screen can be distributed as multimedia information and displayed as a stereoscopic multimedia screen.

A second embodiment of the multimedia information distribution / reception system according to the present invention is a multimedia information distribution means for distributing stereoscopic multimedia information including a plurality of mono-media information, and a stereoscopic information distributed from the multimedia information distribution means. A multimedia information distribution / reception system comprising multimedia information receiving means for receiving multimedia information,
The multimedia information distribution means is a monomedia information generation unit that generates a plurality of monomedia information, and a multi-axis that is arrangement information in the Z-axis direction when the plurality of monomedia information is drawn on the plurality of monomedia information. A stereoscopic multimedia information generating unit for generating stereoscopic multimedia information by adding multimedia Z-axis arrangement information and multimedia arrangement X / Y-axis information that is arrangement information in the X and Y axis directions, and generating stereoscopic television information A stereoscopic television information generation unit; a stereoscopic television information multiplexing unit that multiplexes the stereoscopic television information on the stereoscopic multimedia information; and a distribution unit that distributes the stereoscopic multimedia information on which the stereoscopic television information is multiplexed; Including
A multimedia information receiving means for receiving the stereoscopic multimedia information distributed from the distributing unit; and a stereoscopic television for separating the stereoscopic television information from the stereoscopic multimedia information received by the receiving unit. An information separation unit, a stereoscopic multimedia screen rendering unit that renders a stereoscopic multimedia screen based on the stereoscopic multimedia information from which the stereoscopic television information is separated, and a stereoscopic television separated by the stereoscopic television information separation unit The stereoscopic television screen rendering unit that renders the stereoscopic television screen based on the television information, the stereoscopic television screen composition unit that synthesizes the stereoscopic television screen with the stereoscopic multimedia screen, and the stereoscopic television screen are combined. A stereoscopic screen display unit for stereoscopically displaying the stereoscopic multimedia screen Including the.

  With this configuration, a stereoscopic television screen and a stereoscopic multimedia screen can be combined and stereoscopically displayed.

A multimedia information distribution apparatus according to a first embodiment of the present invention is a multimedia information distribution apparatus that distributes stereoscopic multimedia information including a plurality of monomedia information,
A mono-media information generating unit that generates a plurality of mono-media information, multimedia Z-axis arrangement information that is arrangement information in the Z-axis direction when drawing the plurality of mono-media information on the plurality of mono-media information, and X. 3D multimedia information generating unit for generating 3D multimedia information by adding multimedia X / Y axis arrangement information which is arrangement information in the Y-axis direction, and 3D multimedia information generated by the 3D multimedia information generating unit And a distribution unit that distributes.

  With this configuration, a stereoscopic multimedia screen can be distributed as multimedia information.

  In a second embodiment of the multimedia information distribution apparatus according to the present invention, the mono-media information generation unit includes an image information generation unit that generates image information and a character information generation unit that generates character information.

  With this configuration, it is possible to include image information and character information in the multimedia information.

  In a third embodiment of the multimedia information distribution apparatus according to the present invention, the image information generation unit includes a stereoscopic image information generation unit that generates stereoscopic image information.

  With this configuration, a stereoscopic image can be included in the image information.

  In a fourth embodiment of the multimedia information distribution apparatus according to the present invention, the character information generation unit includes a three-dimensional character information generation unit that generates three-dimensional character information.

  With this configuration, it is possible to include a three-dimensional character in the character information.

  The fifth embodiment of the multimedia information distribution apparatus according to the present invention is a multimedia information distribution apparatus that distributes stereoscopic multimedia information including a plurality of pieces of monomedia information, and is a monomedia that generates a plurality of pieces of monomedia information. An information generation unit, multimedia Z-axis information that is arrangement information in the Z-axis direction and multimedia X that is arrangement information in the X and Y axes when the plurality of mono-media information is drawn on the plurality of mono-media information A stereoscopic multimedia information generating unit that generates stereoscopic multimedia information by adding Y-axis arrangement information; a stereoscopic television information generating unit that generates stereoscopic television information; and the stereoscopic television information in the stereoscopic multimedia information A 3D television information multiplexing unit for multiplexing the 3D television information and the 3D multimedia information on which the 3D television information is multiplexed. And a distribution unit that distributes and breakfasts information.

  With this configuration, a stereoscopic television screen and a stereoscopic multimedia screen can be combined and distributed.

  A first embodiment of a multimedia information receiving apparatus according to the present invention is a multimedia information receiving apparatus that receives stereoscopic multimedia information including a plurality of mono-media information, and a receiving unit that receives the stereoscopic multimedia information A stereoscopic multimedia screen rendering unit that renders a stereoscopic multimedia screen based on the stereoscopic multimedia information received by the receiving unit; and the stereoscopic multimedia screen rendered by the stereoscopic multimedia screen rendering unit And a stereoscopic screen display unit to be displayed.

  With this configuration, a stereoscopic multimedia screen can be received as multimedia information.

  In a second embodiment of the multimedia information receiving apparatus according to the present invention, the stereoscopic multimedia screen drawing unit converts the stereoscopic multimedia information received by the receiving unit into monomedia information and the plurality of monomedia information. A stereoscopic multimedia information separation unit that separates multimedia Z-axis arrangement information that is arrangement information in the Z-axis direction and multi-media X and Y-axis arrangement information that is arrangement information in the X and Y axes when drawing, A mono-media screen drawing unit for drawing a mono-media screen from media information, and the mono-media screen are arranged in a plane based on the multimedia X / Y-axis arrangement information, and based on the multimedia X / Y-axis arrangement information A stereoscopic multimedia screen generating unit that stereoscopically arranges the monomedia screen to generate a stereoscopic multimedia screen.

  With this configuration, it is possible to stereoscopically display a multimedia screen on which a plurality of monomedia images are three-dimensionally arranged.

  In a third embodiment of the multimedia information receiving apparatus according to the present invention, the monomedia screen drawing unit draws a stereoscopic monomedia screen.

  With this configuration, a stereoscopic multimedia image can be displayed even when the monomedia image itself is a stereoscopic image.

A multimedia information receiving apparatus according to a fourth embodiment of the present invention is a multimedia information receiving apparatus that receives stereoscopic multimedia information including a plurality of mono-media information,
The receiving unit that receives the stereoscopic multimedia information, the stereoscopic television information separating unit that separates the stereoscopic television information from the stereoscopic multimedia information received by the receiving unit, and the stereoscopic television information are separated. A stereoscopic multimedia screen rendering unit that renders a stereoscopic multimedia screen based on the stereoscopic multimedia information, and a stereoscopic television that renders a stereoscopic television screen based on the stereoscopic television information separated by the stereoscopic television information separation unit A three-dimensional television screen composition unit that synthesizes the three-dimensional television screen on the three-dimensional multimedia screen, and a three-dimensional screen display unit that three-dimensionally displays the three-dimensional multimedia screen obtained by synthesizing the three-dimensional television screen. Including.

  With this configuration, a stereoscopic television screen and a stereoscopic multimedia screen can be combined and stereoscopically displayed.

  The present invention distributes multimedia information by adding multimedia Z-axis arrangement information to multimedia information, and separates the multimedia Z-axis arrangement information from the multimedia information, thereby providing a multi-dimensionally arranged multi-media based on the multimedia Z-axis arrangement information. A media image can be displayed.

  Embodiments of the present invention will be described below.

  As shown in FIG. 1, the first embodiment of the multimedia information distribution / reception system according to the present invention is a multimedia functioning as multimedia information distribution means for distributing stereoscopic multimedia information including a plurality of monomedia information. This is a multimedia information distribution / reception system including an information distribution device 1 and a multimedia information reception device 2 that functions as multimedia information reception means for receiving stereoscopic multimedia information distributed from the multimedia information distribution device 1.

  The multimedia information distribution apparatus 1 includes a monomedia information generation unit 11 that generates a plurality of pieces of monomedia information, and a multimedia that is arrangement information in the Z-axis direction when drawing a plurality of pieces of monomedia information on the plurality of pieces of monomedia information. The stereoscopic multimedia information is generated by adding the Z-axis arrangement information and the multimedia X / Y-axis arrangement information, which is the arrangement information in the X / Y-axis directions, to generate the stereoscopic multimedia information, and the stereoscopic multimedia information is distributed. And a distribution unit 13.

  The multimedia information receiving apparatus 2 includes a receiving unit 21 that receives distributed stereoscopic multimedia information, and a stereoscopic multimedia screen drawing unit that draws a stereoscopic multimedia screen based on the stereoscopic multimedia information received by the receiving unit 21. 22 and a stereoscopic screen display unit 23 that stereoscopically displays the stereoscopic multimedia screen drawn by the stereoscopic multimedia screen drawing unit 22.

  As illustrated in FIG. 2, the monomedia information generation unit 11 includes an image information generation unit 15 that generates image information and a character information generation unit 16 that generates character information.

  The image information generation unit 15 includes a stereoscopic image information generation unit 17 that generates stereoscopic image information, and the character information generation unit 16 includes a stereoscopic character information generation unit 18 that generates stereoscopic character information.

  Accordingly, the monomedia information generation unit 11 outputs monomedia information including planar image information, stereoscopic image information, planar character information, and stereoscopic character information.

  The stereoscopic multimedia information generation unit 12 displays arrangement information in the Z-axis direction when a monomedia screen is drawn in order to stereoscopically display a plurality of monomedia information generated by the monomedia information generation unit 11 on one screen. The multimedia Z-axis arrangement information and the multimedia X / Y-axis arrangement information that is arrangement information in the X and Y axis directions are added to the mono-media information.

  The mono-media information generation unit 11 and the stereoscopic multimedia information generation unit 12 are configured by a digital computer, and use a BML (Broadcast Markup Language), which is a kind of multimedia description language, to extend mono-media using an extended BML. Generate information and stereoscopic multimedia information. Hereinafter, a document described in the extended BML is referred to as an extended BML document.

  Hereinafter, the configuration of stereoscopic multimedia information when the character string “ABCDE” and the image “Picture” are displayed on one screen will be described with reference to FIG.

  This stereoscopic multimedia information is sandwiched between the start tag <body> and end tag </ body> of the Body element, and the start tag <div> on the second line and the end tag </ div> on the fourth line. And a second DIV element sandwiched between a start tag <div> on the fifth line and an end tag </ div> on the seventh line.

  The three-dimensional character information for displaying the character string “ABCDE” generated by the three-dimensional character information generation unit 18 includes the character string “ABCDE” on the third line as the P element start tag <P> and end tag </ P>. It should be noted that the display area of the character string “ABCDE” has the character string width determined by the attribute value “width” 5 having a value “200 pixels (px)” and the attribute value “height” 6 having a value “50 pixels”. Height is defined.

  The drawing position of the character string “ABCDE” is also defined by the attribute value of the style attribute. That is, the X / Y-axis arrangement information, which is the position of the upper left corner of the character string from the origin of the first DIV element, is the value “0 pixel” of the attribute value “left” 7 and the value “0” of the attribute value “top” 8. Defined by "0 pixels".

  Also, the Z-axis arrangement information of the character string “ABCDE” is defined by the value “100 pixels” of the attribute value “depth” 18.

  The stereoscopic image information for displaying the image “Picture” generated by the stereoscopic image information generation unit 17 is defined by an Object element as shown in the sixth line of FIG. The display area of the image “Picture” is defined by the attribute value of the style attribute. That is, the width of the image is defined by the value “300 pixels” of the attribute value “width” 13 and the height of the image is defined by the value “200 pixels” of the attribute value “height” 14.

  Furthermore, the X / Y-axis arrangement information, which is the position of the upper left corner of the image “Picture” from the origin of the second DIV element, includes the attribute value “left” 15 value “30 pixels” and the attribute value “top” 16. Is defined by the value “30 pixels”. Also, the Z-axis arrangement information of the image “Picture” is defined by the value “100 pixels” of the attribute value “depth” 18.

  Similarly, the width and height of the first DIV element are defined by the value “200 pixels” of the attribute value “width” 1 of the style attribute and the value “50 pixels” of the attribute value “height” 2, respectively. The X / Y axis arrangement information that is the upper left position of the first DIV element from the screen origin is the value “150 pixels” of the attribute value “left” 3 of the style attribute and the value “50 pixels” of the attribute value “top” 4. ”.

  Further, the Z-axis arrangement information of the first DIV element is defined by the value “0 pixel” of the attribute value “depth” 17. In this case, since the attribute value “depth” is zero pixels, the first DIV element is arranged on the same plane as the screen origin. If “depth” is set to a positive value, the element is arranged in front of the screen origin, and if it is set to a negative value, the element is arranged behind the screen origin.

  The width and height of the second DIV element are defined by the value “360 pixels” of the attribute value “width” 9 of the style attribute and the value “260 pixels” of the attribute value “height” 10, respectively. The X / Y axis arrangement information which is the upper left position of the second DIV element from the screen origin is the style attribute attribute value “left” 11 value “120 pixels” and the attribute value “top” 12 value “170 pixels”. ”.

  Furthermore, the Z-axis arrangement information of the second DIV element is defined by the value “50 pixels” of the attribute value “depth” 19. In this case, since the attribute value “depth” is 50 pixels, the second DIV element is arranged at a position of 50 pixels ahead of the screen origin.

  Note that the Z-axis arrangement information can be defined as an attribute value of the Z-axis arrangement attribute “three-dimension” different from the style attribute, as shown in FIG.

  Then, the stereoscopic multimedia information in which the stereoscopic multimedia Z-axis arrangement information and the stereoscopic multimedia X / Y-axis arrangement information are added to the monomedia information is distributed to the multimedia information receiving apparatus 2 via the distribution unit 13. The distribution method is not particularly limited, and is distributed by wire or wireless.

  When using the multimedia information distribution apparatus 1 according to the present invention to distribute planar monomedia information, an attribute value defining multimedia Z-axis arrangement information may be set to zero, and the attribute value itself may be It may be omitted.

  As shown in FIG. 5, the multimedia information receiving apparatus 2 that receives stereoscopic multimedia information distributed via the distributing unit 13 includes a receiving unit 21, a stereoscopic multimedia screen drawing unit 22, and a stereoscopic screen display unit 23. Including.

  The stereoscopic multimedia screen drawing unit 22 includes a stereoscopic multimedia information separating unit 24 that separates stereoscopic multimedia information into mono-media information, multimedia Z-axis arrangement information, and multimedia X / Y-axis arrangement information; A mono-media screen rendering unit 25 that generates a mono-media screen based on the plane, and a mono-media screen based on the multimedia X / Y-axis arrangement information, A three-dimensionally arranged stereoscopic multimedia screen generating unit 26.

  The stereoscopic multimedia screen drawing unit 22 is configured by a digital computer in which an extended BML browser for drawing a stereoscopic multimedia image from an extended BML document is installed.

  When the multimedia information receiving apparatus 2 receives the stereoscopic multimedia information shown in FIG. 3, the stereoscopic multimedia information separating unit 24 converts the multimedia information into mono-media information, multimedia Z-axis arrangement information, and multimedia. Separated into X / Y axis arrangement information.

  That is, the mono-media screen drawing unit 25 uses the “depth” attribute value of the style attribute of each element as multimedia Z-axis arrangement information, and sets the “left” attribute value and “top” attribute value of the style attribute to multimedia XY. As axis arrangement information, other information is separated as mono-media information.

  Based on the separated monomedia information, the monomedia screen drawing unit 25 converts the character string “ABCDE” into an area having a width of 200 pixels and a height of 50 pixels, and an image “Picture” encoded in jpeg with a width of 300 pixels. Draw in an area with a height of 200 pixels.

  As shown in FIG. 6, the stereoscopic multimedia screen generation unit 26 uses the upper left corner of the screen of the character string “ABCDE” generated by the monomedia screen rendering unit 25 as XY based on the upper left corner of the first DIV. -It is arranged at a point of (0 pixel, 0 pixel, 100 pixel) of the Z coordinate axis system, and the upper left corner of the first DIV element is (150 of the XYZ coordinate axis system with reference to the origin of the Z axis direction reference plane Pixel, 50 pixel, 0 pixel).

  Furthermore, the stereoscopic multimedia screen generation unit 26 sets the upper left corner of the image “Picture” drawn by the mono-media screen drawing unit 25 to the (30 pixels, X, Y, Z coordinate axis system based on the origin of the second DIV. (30 pixels, 100 pixels), and the upper left corner of the second DIV element is set to (120 pixels, 170 pixels, 50 pixels) of the XYZ coordinate system with reference to the origin of the Z-axis reference plane Deploy.

  The stereoscopic screen display unit 23 displays the stereoscopic multimedia screen generated by the stereoscopic multimedia screen generation unit 26 in a stereoscopic manner. FIG. 7 is a detailed explanatory diagram of the relationship between each attribute value and the display position. (A) is a front view, (B) is a side view, and (C) is an enlarged view of a character string.

  The format of the stereoscopic screen display unit 23 is not particularly limited, but when the parallax correction method is applied, the left screen and the right screen shown in FIG. 8 are displayed on the stereoscopic screen display unit 23.

  Although the case where the monomedia information is a planar (two-dimensional) monomedia screen has been described above, the monomedia information itself may include three-dimensional information.

  FIG. 9 shows a case where the monomedia information includes background information as three-dimensional information, and may be defined as one attribute value “background_depth” of the style attribute as shown in (A). Thus, it may be defined as one attribute value “background_depth” of the three-dimensional attribute “three-dimension”.

  Further, as shown in FIG. 10, monomedia information may include three-dimensional information and character thickness information as a “front-thickness” attribute value of a style attribute.

  When the monomedia information includes an image, the image itself may be a three-dimensional screen.

  FIG. 11 is an extended BML document in a case where Z-axis arrangement information for each pixel is stored in a file designated by the attribute value of the “depth-data” attribute. The mono-media screen drawing unit 25 separates the file “Picture-depth.jpg” indicated by the attribute value of the “depth-data” attribute as the mono-media Z-axis position information, and each pixel of the plane screen of the image “Picture” Are arranged in the Z-axis direction according to the mono-media Z-axis position information to generate a stereoscopic mono-media screen.

  FIG. 11 shows a case where an image is encoded with jpeg, but this description format can also be applied when encoded with BMP, mpeg, PNG, GIF, or the like.

  FIG. 12 shows an extended BML document in which the monomedia Z-axis position information is encoded in a chunk different from the chunk in which the plane information of the image is encoded in PNG and stored in the same file. The mono media screen drawing unit 25 separates the depth chunk of the attribute value file “Picture.png” of the “data” attribute as the mono media Z-axis position information, and stores each pixel of the flat screen of the image “Picture” in the depth chunk. A stereoscopic monomedia screen is generated by arranging in the Z-axis direction according to the monomedia Z-axis position information file.

  Further, the mono-media screen drawing unit 25 can also use an object whose image data itself includes Z-axis arrangement information, such as an image obtained by photographing nature with a stereoscopic camera.

  FIG. 13 is an extended BML document in which a central view image for a conventional flat screen display device and left and right screens for a stereoscopic display device are stored in a file designated by the attribute value of an independent data attribute.

  When this extended BML document is received by the multimedia information receiving apparatus 2 according to the present invention, the mono-media screen drawing unit 25 is a file having “3D-type” attribute, “left-data” attribute, and “right-data” attribute. Draw a stereoscopic monomedia image using.

  The above assumes that the central view image and the left and right images are stored in separate files, but the three images are very similar, so the “left-data” attribute and the “right-data” attribute are If the difference from the visual image is used, the file size can be reduced.

  Furthermore, the file size can be further reduced by substituting the right-and-left image with the central view image.

  In addition, as monomedia Z-axis information, it is possible to define a thickness at the boundary of a character or to define a shadow of a character or an image. When a shadow is defined as mono-media Z-axis information, the shadow can be freely manipulated using DOM (Document Object Model).

  When the extended BML document of FIG. 13 is received by a receiving device having a conventional flat display device, files with the “3D-type” attribute, the “left-data” attribute, and the “right-data” attribute are ignored. A plane image is displayed based on the central vision image.

  The stereoscopic multimedia screen generation unit 26 draws the left eye screen and the right eye screen based on the multimedia Z-axis arrangement information from the mono media screen generated by the mono media screen drawing unit 25. For an object at a distance of (the front of the plane is positive and the back of the reference plane is negative), the left eye screen needs to be shifted to the right and the right eye screen must be shifted to the left.

FIG. 14 is an explanatory diagram of a correction method, and the correction amount ΔX can be expressed by the following equation.
ΔX = (a / d) D = αD
Where a = distance between face center and eyes
d = distance between eye and reference plane
α = a / d
However, d >> D.

  Therefore, when the extended BML document of FIG. 3 is rendered, as shown in FIG. 15, the character string “ABCDE” is arranged at 100 pixels ahead of the reference plane in the Z-axis direction. 26, the left eye screen is moved to the right side of 100α for drawing, and the right eye screen is moved to the left side of 100α for drawing.

  Similarly, as shown in FIG. 15, the stereoscopic multimedia screen generation unit 26 corrects and draws the image “Picture” and the second DIV element by 150α and 50α, respectively.

  FIG. 15 shows the left eye screen (A) and the right eye screen (B) when the parallax correction method is applied, and the stereoscopic multimedia screen generation unit 26 corrects the drawing position in the direction of the arrow.

  An example of a screen actually displayed on the stereoscopic screen display unit 23 is shown in FIG.

  When the multimedia information receiving apparatus 2 receives multimedia information that does not include multimedia Z-axis arrangement information, the stereoscopic multimedia information separation unit 24 sets the multimedia Z-axis information to zero and sets the stereoscopic multi-media information to zero. The data is output to the media screen generation unit 26. As a result, the stereoscopic multimedia screen generation unit 26 generates a planar multimedia screen.

  When the stereoscopic multimedia information distributed by the multimedia information distribution apparatus 1 according to the present invention is received by the conventional planar multimedia information reception apparatus, the extended BML browser displays the multimedia Z-axis arrangement information and the monomedia Z Ignore the axis information and generate a flat multimedia screen.

  As is clear from the above description, the multimedia information delivery / reception system according to the present invention is compatible with the two-dimensional multimedia information delivery / reception system used conventionally.

  FIG. 17 is an explanatory view of the compatibility between the multimedia information delivery / reception system according to the present invention and the conventional planar multimedia information delivery / reception system, and the stereoscopic multimedia information generated by the multimedia information delivery apparatus 1 is The information is distributed to the multimedia information receiving device 2 via the path a, and displayed on the multimedia information receiving device 2 as a stereoscopic multimedia screen.

  The planar multimedia information generated by the planar multimedia information distribution device 3 is distributed to the planar multimedia information reception device 4 via the path b, and is displayed as a planar multimedia screen by the planar multimedia information reception device 4.

  The stereoscopic multimedia information generated by the multimedia information distribution apparatus 1 is distributed to the planar multimedia information receiving apparatus 4 via the path c, and displayed on the planar multimedia information receiving apparatus 4 as a planar multimedia screen. In this case, the planar multimedia information receiving device 4 ignores the multimedia Z-axis arrangement information included in the stereoscopic multimedia information.

  The planar multimedia information generated by the planar multimedia information distribution device 3 is distributed to the multimedia information reception device 2 via the path d, and is displayed on the multimedia information reception device 2 as a planar multimedia screen. In this case, the multimedia information receiving apparatus 2 sets the multimedia Z-axis arrangement information to zero.

  Although the case where a plurality of image data and character data are displayed three-dimensionally on one screen has been described above, it is also possible to multiplex and distribute stereoscopic multimedia information with stereoscopic television broadcasting.

  That is, the second embodiment of the multimedia information distribution / reception system according to the present invention functions as multimedia information distribution means for distributing stereoscopic multimedia information in which a plurality of pieces of monomedia information is multiplexed, as shown in FIG. 1 is a multimedia information distribution / reception system comprising: a multimedia information distribution device 5 that performs the above operation; and a multimedia information reception device 6 that functions as a multimedia information reception unit that receives stereoscopic multimedia information distributed from the multimedia information distribution device 5. .

  As shown in FIG. 19, the multimedia information distribution apparatus 5 includes a monomedia information generation unit 11 that generates a plurality of pieces of monomedia information, and arrangement information in the Z-axis direction between the plurality of pieces of monomedia information. 3D multimedia information generation for generating 3D multimedia information by adding multimedia X axis and Y axis arrangement information which is arrangement information in X and Y axis directions between a plurality of pieces of multimedia Z information and multimedia Z axis arrangement information Unit 12, a stereoscopic television information generating unit 51 that generates stereoscopic television information, a stereoscopic television information multiplexing unit 52 that multiplexes stereoscopic television information on stereoscopic multimedia information, and a stereoscopic in which the stereoscopic television information is multiplexed. A distribution unit 53 for distributing multimedia information. Note that components having the same functions as those of the multimedia information distribution apparatus 1 of the first embodiment are denoted by reference numerals, and detailed description thereof is omitted.

  Further, as shown in FIG. 20, the multimedia information receiving apparatus 6 receives a stereoscopic multimedia information distributed from the distributing unit 53, and a stereoscopic television from the stereoscopic multimedia information received by the receiving unit 61. 3D television information separating unit 62 for separating John information, 3D multimedia screen drawing unit 22 for rendering 3D multimedia screen based on 3D multimedia information from which 3D television information is separated, and 3D television information separating A stereoscopic television screen rendering unit 63 that renders a stereoscopic television screen based on the stereoscopic television information separated by the unit 62; and a stereoscopic television screen composition unit 64 that synthesizes the stereoscopic multimedia screen and the stereoscopic television screen; 3D display of 3D multimedia screen combined with 3D TV screen And a body screen display unit 65. Note that components having the same functions as those of the multimedia information receiving apparatus 2 of the first embodiment are denoted by reference numerals, and detailed description thereof is omitted.

  The stereoscopic television information generation unit 51 generates stereoscopic television information by imaging a subject with a stereoscopic television camera.

  The stereoscopic television information multiplexing unit 52 multiplexes the stereoscopic television information on the stereoscopic multimedia information generated by the stereoscopic multimedia information generation unit 12 and transmits the multiplexed information to the distribution unit 53.

  The stereoscopic television information separating unit 62 separates the stereoscopic television information from the stereoscopic multimedia information received by the receiving unit 61.

  The stereoscopic television screen drawing unit 63 generates a stereoscopic television screen based on the stereoscopic television information.

  The stereoscopic television screen combining unit 64 combines the stereoscopic multimedia screen and the stereoscopic television screen.

  Then, the stereoscopic screen display unit 65 displays the stereoscopic multimedia screen and the stereoscopic television screen as one stereoscopic screen.

  As described above, there is an effect that a multimedia image in which multimedia information is three-dimensionally arranged based on multimedia Z-axis arrangement information can be displayed, and a multimedia information distribution / reception system, multimedia information distribution apparatus, and multi It is useful as a media information receiving device.

1 is a block diagram of a first embodiment of a multimedia information distribution / reception system according to the present invention. The block diagram of 1st Embodiment of the multimedia information delivery system which concerns on this invention Encoded document of stereoscopic multimedia information (part 1) Encoded document of stereoscopic multimedia information (Part 2) 1 is a configuration diagram of a first embodiment of a multimedia information receiving system according to the present invention. Perspective view of stereoscopic multimedia screen Explanatory diagram of the relationship between attribute value and display position Left eye screen and right eye screen when the parallax correction method is applied (part 1) 3D multimedia information encoded document (Part 3) Encoded document of stereoscopic multimedia information (Part 4) Encoded document of stereoscopic multimedia information (Part 5) Encoded document of stereoscopic multimedia information (Part 6) Encoded document of stereoscopic multimedia information (part 7) Explanation of display position correction method Left eye screen and right eye screen after display position correction Left eye screen and right eye screen when the parallax correction method is applied (part 2) Illustration of compatibility between 3D multimedia information receiving and delivering system and flat multimedia information receiving and delivering system The block diagram of 2nd Embodiment of the multimedia information delivery / reception system which concerns on this invention The block diagram of 2nd Embodiment of the multimedia information delivery system which concerns on this invention The block diagram of 2nd Embodiment of the multimedia information receiving system which concerns on this invention

Explanation of symbols

DESCRIPTION OF SYMBOLS 1, 5 Multimedia information delivery apparatus 11 Monomedia information generation part 15 Image information generation part 16 Character information generation part 17 Three-dimensional image information generation part 18 Three-dimensional character information generation part 12 Three-dimensional multimedia information generation part 13, 53 Delivery part 51 Three-dimensional Television information generating unit 52 Stereoscopic television information multiplexing unit 2, 6 Multimedia information receiving apparatus 21, 61 Receiving unit 62 Stereoscopic television information separating unit 22 Stereoscopic multimedia screen drawing unit 24 Stereoscopic multimedia information separating unit 25 Monomedia screen Drawing unit 26 3D multimedia screen generation unit 63 3D television screen drawing unit 64 3D television screen composition unit 23, 65 3D screen display unit

Claims (11)

Multimedia information distribution / reception system comprising multimedia information distribution means for distributing multimedia information including a plurality of mono-media information, and multimedia information reception means for receiving multimedia information distributed from the multimedia information distribution means Because
The multimedia information distribution means includes:
A monomedia information generation unit for generating a plurality of monomedia information;
Multimedia Z-axis information which is arrangement information in the Z-axis direction when rendering the plurality of mono-media information on the plurality of mono-media information, and multimedia XY axes which are arrangement information in the X / Y-axis directions A stereoscopic multimedia information generating unit for adding information to generate stereoscopic multimedia information;
A delivery unit for delivering the stereoscopic multimedia information,
Multimedia information receiving means
A receiver that receives the stereoscopic multimedia information distributed from the distributor;
A stereoscopic multimedia screen rendering unit that renders a stereoscopic multimedia screen based on the stereoscopic multimedia information received by the receiving unit;
A multimedia information distribution / reception system including a stereoscopic screen display unit that stereoscopically displays the stereoscopic multimedia screen drawn by the stereoscopic multimedia screen drawing unit. Multimedia information distribution means comprising: multimedia information distribution means for distributing stereoscopic multimedia information including a plurality of mono-media information; and multimedia information receiving means for receiving stereoscopic multimedia information distributed from the multimedia information distribution means. A receiving system,
The multimedia information distribution means includes:
A monomedia information generation unit for generating a plurality of monomedia information;
Multimedia Z-axis information which is arrangement information in the Z-axis direction when rendering the plurality of mono-media information on the plurality of mono-media information, and multimedia XY axes which are arrangement information in the X / Y-axis directions A stereoscopic multimedia information generating unit for adding information to generate stereoscopic multimedia information;
A 3D television information generating unit for generating 3D television information;
A stereoscopic television information multiplexing unit that multiplexes the stereoscopic television information with the stereoscopic multimedia information;
A delivery unit that delivers the stereoscopic multimedia information on which the stereoscopic television information is multiplexed;
Multimedia information receiving means
A receiver that receives the stereoscopic multimedia information distributed from the distributor;
A stereoscopic television information separating unit that separates the stereoscopic television information from the stereoscopic multimedia information received by the receiving unit;
A stereoscopic multimedia screen rendering unit for rendering a stereoscopic multimedia screen based on the stereoscopic multimedia information from which the stereoscopic television information is separated;
A stereoscopic television screen drawing unit for drawing a stereoscopic television screen based on the stereoscopic television information separated by the stereoscopic television information separation unit;
A stereoscopic television screen composition unit that synthesizes the stereoscopic multimedia screen and the stereoscopic television screen;
A multimedia information distribution / reception system including a stereoscopic screen display unit configured to stereoscopically display the stereoscopic multimedia screen combined with the stereoscopic television screen. A multimedia information distribution apparatus for distributing stereoscopic multimedia information including a plurality of monomedia information,
A monomedia information generation unit for generating a plurality of monomedia information;
Multimedia Z-axis arrangement information, which is arrangement information in the Z-axis direction when rendering the plurality of mono-media information, and multimedia XY, which is arrangement information in the X / Y-axis directions, when the plurality of mono-media information is drawn on the plurality of mono-media information. A stereoscopic multimedia information generating unit for generating axial multimedia information by adding axis arrangement information;
A multimedia information distribution apparatus including a distribution unit that distributes the stereoscopic multimedia information generated by the stereoscopic multimedia information generation unit. The monomedia information generation unit
An image information generation unit for generating image information;
The multimedia information distribution apparatus according to claim 3, further comprising a character information generation unit that generates character information. The multimedia information distribution apparatus according to claim 4, wherein the image information generation unit includes a stereoscopic image information generation unit that generates stereoscopic image information. The multimedia information distribution apparatus according to claim 4, wherein the character information generation unit includes a three-dimensional character information generation unit that generates three-dimensional character information. A multimedia information distribution apparatus for distributing stereoscopic multimedia information including a plurality of monomedia information,
A monomedia information generation unit for generating a plurality of monomedia information;
Multimedia Z-axis information which is arrangement information in the Z-axis direction when rendering the plurality of mono-media information on the plurality of mono-media information, and multimedia XY axes which are arrangement information in the X / Y-axis directions A stereoscopic multimedia information generating unit for adding information to generate stereoscopic multimedia information;
A 3D television information generating unit for generating 3D television information;
A stereoscopic television information multiplexing unit that multiplexes the stereoscopic television information with the stereoscopic multimedia information;
A multimedia information distribution apparatus including a distribution unit that distributes the stereoscopic multimedia information on which the stereoscopic television information is multiplexed. A multimedia information receiving apparatus for receiving stereoscopic multimedia information including a plurality of monomedia information,
A receiving unit for receiving the stereoscopic multimedia information;
A stereoscopic multimedia screen rendering unit that renders a stereoscopic multimedia screen based on the stereoscopic multimedia information received by the receiving unit;
A multimedia information receiving apparatus comprising: a stereoscopic screen display unit that stereoscopically displays the stereoscopic multimedia screen drawn by the stereoscopic multimedia screen drawing unit. The stereoscopic multimedia screen drawing unit
Multimedia Z-axis arrangement information, which is arrangement information in the Z-axis direction when rendering the multimedia information received by the receiving unit and the mono-media information and the plurality of mono-media information, and arrangement in the X and Y axes A stereoscopic multimedia information separating unit that separates information into multimedia X / Y axis arrangement information;
A monomedia screen drawing unit for drawing a monomedia screen from the monomedia information;
The mono-media screen is arranged in a plane based on the multimedia X / Y-axis arrangement information, and the mono-media screen is arranged in a three-dimensional manner based on the multimedia Z-axis arrangement information to generate a three-dimensional multimedia screen. The multimedia information receiving device according to claim 8, further comprising: a stereoscopic multimedia screen generating unit that performs the operation. The multimedia information receiving unit according to claim 9, wherein the monomedia screen drawing unit draws a stereoscopic monomedia screen. A multimedia information receiving apparatus for receiving stereoscopic multimedia information including a plurality of monomedia information,
A receiving unit for receiving the stereoscopic multimedia information;
A stereoscopic television information separating unit that separates the stereoscopic television information from the stereoscopic multimedia information received by the receiving unit;
A stereoscopic multimedia screen rendering unit for rendering a stereoscopic multimedia screen based on the stereoscopic multimedia information from which the stereoscopic television information is separated;
A stereoscopic television screen drawing unit for drawing a stereoscopic television screen based on the stereoscopic television information separated by the stereoscopic television information separation unit;
A stereoscopic television screen composition unit for compositing the stereoscopic television screen with the stereoscopic multimedia screen;
A multimedia information receiving apparatus including a stereoscopic screen display unit that stereoscopically displays the stereoscopic multimedia screen on which the stereoscopic television screen is combined.

Images