JP2005122501A - Display data editing device, display device, display data editing method, program and recording medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To solve the problem that, when 2D contents where image objects or text objects coexist are converted into 3D contents, those objects may overlap each other when only the amount of parallax is designated for converting a certain object into 3D data. <P>SOLUTION: When a parallax is applied to each of objects, an overlap detecting part 110 checks whether they are overlapping another object. When those objects overlap, an attribute adjusting part 111 adjusts object attributes (the positions, sizes, or amount of parallax or the like) automatically so that those objects can be prevented from overlapping. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to a display data editing device, a display device, a display data editing method, a program, and a recording medium. More specifically, two-dimensional display data including a plurality of objects is converted into at least one three-dimensional object among the plurality of objects. The present invention relates to a display data editing device, a display device, a display data editing method, a program, and a recording medium for editing an object for which display designation has been made into a format that can be stereoscopically displayed.

  A homepage browsed on the Web expresses how a display position and a size of each object such as an image object and a text object appear on the screen by a script. FIG. 7 describes an example of a script. As an image object, a file of image 1 (C: \ image folder \ image 1.jpeg) is designated, and an image position (x = "0" y = "10") The scale ratio (size = "100") for display is specified. In the present invention, such an image on the screen, text, and the like are called objects.

  Such content in which image objects and text objects are mixed is normally displayed in 2D (2D), but can be displayed in 3D (3D) by giving parallax to each object.

  3D display is achieved by displaying parallax images captured from different viewpoints on the left and right eyes of the user. In order to display different parallax images to the left and right eyes, a method of directly projecting different parallax images to the left and right eyes, such as a so-called head mounted display, or using polarized glasses to separate the left and right images using polarized light And a method of separating the left and right images using a barrier in the structure of the display display have been proposed.

  In order to give depth to a certain object, content that is not a pre-captured parallax image but also a mixture of multiple objects such as the above-mentioned content is displayed only for the amount of parallax in the display image for either the left eye or the right eye. By shifting the object, a three-dimensional display of the object is possible.

  FIG. 8 shows an example of the left eye image and the right eye image in 2D display and 3D display, respectively. FIG. 8A shows the 2D display, and the left eye image and the right eye image are the same image. Here, when the position of the heading object in the left-eye image is shifted to the right in order to give depth to the heading object, the heading object appears to pop out (FIG. 8B).

  Incidentally, the prior art of such a stereoscopic image editing apparatus is disclosed in Japanese Patent Laid-Open No. 9-172654. In Japanese Patent Laid-Open No. 9-172654, when a character string is inserted into a 3D image, a deviation for giving a parallax necessary for the inserted character string itself to have a natural depth feeling in the 3D image is disclosed. A method for calculating a quantity is disclosed.

JP-A-9-172654

However, in the stereoscopic image editing apparatus of Patent Document 1, by giving parallax to a certain object, the relative positional relationship with other objects changes, so objects that did not overlap before giving parallax are If parallax is given, they may overlap.
For example, in FIG. 9, when the parallax is given so that the “heading” object pops out, it overlaps with the “image 2” object. When the “Heading” object is shifted to the right in the right-eye image, the “Heading” object overlaps with the “Image 2” object. Therefore, simply specifying the parallax amount in this way causes objects that did not overlap in 2D display to overlap each other, and the overlapping part of either object cannot be seen.

  Originally 3D is to make it look like reality. Therefore, since giving a parallax changes the front-rear relationship of the object position, it is natural that they overlap and cannot be seen. However, when converting to 3D to emphasize one of the 2D objects, it is desirable to show other objects that are not emphasized.

  Moreover, even if it is natural that the content is pure 3D content and cannot be seen due to the context of the object, there are cases where it is desired to show both from the display effect.

  Furthermore, when the 2D display is displayed in 3D, when the objects overlap as described above, it is desired to devise the 3D display so that it looks natural.

  The present invention has been conceived in view of the above circumstances, and the purpose of the present invention is to provide natural parallax for each object in order to make a stereoscopic display in two-dimensional display data in which a plurality of objects are mixed. Display data editing device, display device, display data editing method, program, and recording medium that can realize a stereoscopic display, and more specifically, each object has a parallax for stereoscopic display. Just apply, automatically detect overlapping display of objects, adjust the object attributes (position, size, parallax amount, etc.) to eliminate the overlap, or display overlapping objects while overlapping Display data editing device, display device, display data editing method, program, and recording configured to perform rendering It is to provide a body.

  In order to achieve the above object, the present invention edits two-dimensional display data composed of a plurality of objects into a format that can be stereoscopically displayed with respect to an object for which at least one of the plurality of objects is designated for stereoscopic display. A display data editing device, wherein an overlap is detected based on a detection result by the overlap detection unit, an overlap detection unit that detects display overlap between the object for which the stereoscopic display is specified, and another object, and 2 An object attribute adjusting unit that adjusts an object attribute of at least one of the two objects so as to cancel the overlap is provided.

  With the above-described configuration, the overlap detection unit detects a display overlap between the object for which stereoscopic display is designated and another object, and the object attribute adjustment unit adjusts the object attribute so as to eliminate the overlap. Therefore, only by giving parallax to the object for stereoscopic display, stereoscopic display without overlapping is possible.

  The object attribute to be adjusted for overlap may be any of an object position, an object size, and an object parallax. Also, priorities are set in advance for these object attributes, and overlap cancellation may be adjusted according to the priorities.

  In addition, the present invention is a display data editing apparatus that edits two-dimensional display data composed of a plurality of objects into a format that can be stereoscopically displayed with respect to an object for which at least one of the plurality of objects is designated for stereoscopic display. And at least one of the two objects in which the overlap is detected based on a detection result by the overlap detection unit, and an overlap detection unit that detects an overlap of display between the object for which the stereoscopic display is designated and another object. And a rendering setting unit for setting the rendering conditions.

  With such a configuration, the objects in which the overlap is detected are displayed while being overlapped. However, when viewed from the entire display image, the display is not unnatural.

  Note that the rendering condition may be a rendering order or a portion of the object to be rendered.

  In addition, the present invention is a display device comprising the display data editing device according to the present invention and display means for stereoscopically displaying an object based on data edited by the display data editing device. The display means may have a configuration independent of the display data editing device, or may be a configuration built in the editing device.

  In addition, the present invention is a display data editing method for editing two-dimensional display data composed of a plurality of objects into a format that can be stereoscopically displayed with respect to an object for which at least one of the plurality of objects is designated for stereoscopic display. And an overlap detection step for detecting an overlap of display between the object for which the stereoscopic display is specified and another object, and at least one of the two objects for which the overlap is detected based on a detection result of the overlap detection step. An object attribute adjusting step for adjusting the object attribute so as to cancel the overlap.

  Note that the display data editing method according to the present invention detects an overlap based on an overlap detection step for detecting a display overlap between an object for which stereoscopic display is specified and another object, and a detection result in the overlap detection step. There may be a rendering setting step for setting a rendering condition of at least one of the two objects. Furthermore, the present invention is also applied to a display data editing program for operating a computer as a display data editing device and a recording medium on which the display data editing program is recorded.

  Further, the present invention may be a display method characterized in that an object is stereoscopically displayed based on data edited by the display data editing / collection method according to the present invention. Furthermore, the present invention can also be applied to a display data display program for operating a computer as a display device and a recording medium on which the display program is recorded.

  According to the present invention, the overlap of display between objects is automatically detected, and the object attribute is adjusted so as to eliminate the overlap. Therefore, only by giving parallax to the object to be stereoscopically displayed, stereoscopic display without overlapping is possible.

  In addition, according to the present invention, an overlapping display between objects is automatically detected, and the rendering condition is set by at least one of the two objects from which the overlapping is detected by the rendering setting unit. Therefore, although the object in which the overlap is detected is displayed while being overlapped, the display is not unnatural when viewed from the entire display image.

An outline of the present invention will be described as an embodiment, and then specific contents will be described as examples.
(Embodiment)
A content data editing apparatus will be described as an example of a display data editing apparatus according to the present invention. The content data editing apparatus receives content data (two-dimensional display data) in which a plurality of objects are mixed, attribute information of each object, user setting information for adjusting the object, and information of the object to be converted into 3D, It is checked whether there is an overlap between them. If they overlap, the object attribute is adjusted or the rendering condition of the object is set.

Adjust object attributes
First, a method for adjusting the object attribute by shifting the position so as not to overlap or reducing the size will be described.
If an object to add parallax and the amount of parallax are specified, the amount of deviation required to add the parallax is calculated, and whether or not it overlaps with other objects when the position of the object is shifted based on the calculated amount of deviation Is detected.

In the case of overlapping, it is examined whether or not the overlapping can be eliminated by shifting the position of the object in the direction in which they do not overlap. If it can be resolved, a new object position is set.
In addition to shifting the position, it is examined whether the overlap can be eliminated by reducing the display size of the object. Furthermore, the amount of deviation can be reduced by reducing the parallax, so that the overlap can be eliminated.

  Which attribute among the position, size, and parallax should be preferentially adjusted may be set in advance by the user, or the attribute that requires the least amount of adjustment is examined and adjusted. May be.

  In the user setting, a maximum allowable adjustment amount for each attribute may be set. For example, when changing the size, by setting the maximum adjustment amount that can be allowed for adjustment, such as a change within 120% of the enlargement ratio compared to before the change, it is possible. The system can make adjustments within the specified range. If adjustment cannot be made within the specified range, it is checked whether adjustment is possible using other attributes.

  If the overlapping object is text, adjustment may be made by narrowing the character spacing or changing the font to be used to narrow the text width.

  Of the overlapped objects, whether an object whose parallax amount has been changed is an adjustment target or an object that has not been changed may be set in advance by the user. An object whose parallax amount is always changed may be an adjustment target.

  When the priority order of adjustment of position, size, and parallax is specified, an object that can be adjusted with a priority attribute may be set as an adjustment target. For example, when the user specifies that the position adjustment should be preferentially performed, the position cannot be changed because the object whose parallax amount has been changed overlaps with another object even if the position is changed. If an object whose parallax amount has not changed can be adjusted by changing the position, the object whose parallax amount has not been changed may be used as an adjustment control. Further, an object having a smaller amount to be adjusted may be set as an adjustment target.

  Further, the adjustment target may be determined by comparing the attribute of the object whose parallax amount is changed with the attribute of the object which is not changed.

By comparing the attributes of the object, the depth of the object may be adjusted more deeply. Since it is considered that the parallax is specified so that the object to be conspicuous comes to the front, the object placed in the back is considered to be less important, and this is the adjustment target.
The attribute of the object may be compared to adjust the smaller object size. Since an object to be conspicuous is considered to be large in size, a small object is considered to be less important, and this is an adjustment target.

  The attribute of the object may be compared to adjust the arrangement position of the object farther from the center as viewed from the entire content. Since the object to be conspicuous is considered to be arranged so as to be in the center of the content, it is considered that the object arranged at a position farther from the center is less important, and this is the adjustment target.

  Of course, the front of the screen may be adjusted, the larger one may be adjusted, or the object closer to the center of the screen may be adjusted.

[Rendering condition settings]
If it is set not to adjust any attribute of the object by the user setting, or if the adjustment fails even if the adjustment is performed, the overlapped objects are displayed with being overlapped. At this time, it is necessary to set the rendering conditions of the overlapping objects (specifically, the rendering order or the setting of the portion to be rendered).

  Here, rendering refers to calculating a shadow or the like according to the shape, position, and positional relationship of an object to form a single image that can be drawn on the entire screen. In the case of 3D display, two images of a right eye image and a left eye image are created.

  When objects overlap, which object is drawn for the overlapped part depends on the rendering order. For example, in FIG. 8, if the rendering order is performed with image 2 first and the heading is performed later, the portion of image 2 that overlaps the heading is not displayed (see FIG. 10A). On the other hand, when rendering is performed after the image, the heading portion is not displayed in the portion overlapping the image 2 (see FIG. 10B).

  Since the parallax amount is set so that the “heading” object pops out, it is natural in 3D display that the overlapping part of the image 2 is hidden, but the “heading” object is not hidden. Is natural. Therefore, at least the “Heading” object must be rendered after image 2. That is, when displaying overlapping objects, it is necessary to set the rendering order so that the object placed in front is rendered later.

  A portion to be rendered may be set instead of the rendering order. Set so that only the overlapping part of the object placed behind is not rendered. Since the portion that has not been rendered is not drawn, it is not displayed regardless of the rendering order. As a result, the object placed in front is always drawn without being hidden.

Embodiments of the present invention will be described below with reference to the drawings.
FIG. 1 is a block diagram showing the structure of a 3D content data editing apparatus according to an embodiment of the present invention. Reference numeral 101 denotes an input unit. The input unit 101 specifies content data 116 in which a plurality of objects having attribute information are mixed in the data editing apparatus 100, user setting information 115 for adjusting an object, and object designation as to which object is to be 3D. It fulfills the function of accepting information 114.

  Here, to make an object 3D means to give parallax to the object, and when 3D display is performed by shifting the position of the object in the left eye image by the amount of parallax, Means that it looks three-dimensional. The object attributes include object position information, size information, parallax information, and the like. Detailed contents of the user setting information will be described later.

  Reference numeral 103 denotes a control unit that controls editing. The control unit 103 includes an object attribute storage unit 107 that stores object attribute information among input information, a user setting information storage unit 108 that stores user setting information among input information, and content that stores content data among input information. A data storage unit 109, a program storage unit 104 for storing a program for data editing processing according to the present invention, a memory 105, an overlap detection unit 110, a deviation amount calculation unit 112, an attribute adjustment unit 111, A rendering setting unit 113 and a CPU 106 are included.

  The display program stored in the program storage unit 104 is loaded into the memory 105, the program in the memory 105 is read out by the CPU 106, and various processes are executed as will be described later.

  Information stored in the object attribute storage unit 107, the user setting information storage unit 108, and the content data storage unit 109 is referred to by the control unit 103 as needed, and the object attribute information is changed.

The shift amount calculation unit 112 calculates a shift amount indicating how much the object should be shifted left and right from the attribute information of the object to be converted into 3D and the specified parallax amount.
In the overlap detection unit 110, when an object to be converted into 3D is shifted by the shift amount calculated by the shift amount calculation unit 112, it is checked whether the object to be converted into 3D overlaps with another object.

The attribute adjustment unit 111 refers to the setting information stored in the setting information storage unit 108 and adjusts so that overlapping of overlapping objects is eliminated.
The rendering setting unit 113 sets rendering conditions when overlapping objects are displayed while being overlapped. If there are no overlapping objects, no rendering condition is set.

The output unit 102 receives the content data including the newly adjusted object attribute and the rendering condition information, and transmits the received content data to the display device 117.
The display device 117 receives the data transmitted by the reception unit 118, performs rendering according to the rendering conditions set by the rendering unit 119, and displays the data on the display unit 120. The display device 117 may be configured independently of the editing device, and the editing device may include the functions (rendering unit and display unit) of the display device 117.

Next, details of the editing method by the editing apparatus will be described.
FIG. 2 shows an example of user setting information when adjusting an object. As shown in FIG. 2, as the user setting information, the priority of the attribute to be preferentially adjusted when overlapping each object attribute and the maximum allowable amount at the time of adjustment are used. More specifically, in order to eliminate the overlap, the position is adjusted first, and if the overlap cannot be eliminated simply by adjusting the position, the size and the parallax are adjusted in this order. When the object is a font, if the overlap cannot be resolved by adjusting the position, the adjustment is made in the order of the character spacing and the font type.
If the maximum allowable amount for adjustment is not stated, there is no limit. The description “90%” in the size attribute means that a size reduction of 90% of the original size is allowed. Therefore, when the size is adjusted, if the overlap is eliminated at a reduction rate of more than 90%, the adjustment is successful.

  The user setting information may be set in advance in advance without being input each time content data is input. Further, at the time of input, the priority and the maximum allowable adjustment amount may be set for each object included in the content.

  The setting information includes information for setting whether or not to perform overlap adjustment when objects overlap each other. Further, it may be set whether or not the overlap adjustment is performed for each object. For example, it may be set for each object whether overlap adjustment is performed when “heading” objects overlap, or overlap adjustment is not performed even if “image 1” objects overlap.

 The specification information of the 3D object includes specification of an object indicating which object in the content data is to be 3D, and specification of the amount of parallax. The designation of the amount of parallax is expressed, for example, by adding a positive sign such as “+5” or “+30” when the object is popped forward and “−5” when the object is recessed deeply. Expressed with a negative sign such as “−20”.

 The shift amount calculation unit calculates how much the 3D object should be shifted in order to add the parallax for the specified parallax amount. The method of calculating the shift amount differs depending on how the parallax amount is specified.

  For example, when the designation of the amount of parallax is directly designated in units of pixels, the object attribute is changed so that the object is shifted left and right by the designated pixel amount. Referring to FIG. 7 used in the background art section as an example, the position of the “heading” object is “100” for the X coordinate and “10” for the Y coordinate. At this time, when the parallax amount is designated as “+5” in terms of pixel amount, the shift amount is set to “+5”, and the X coordinate in the left-eye image is “105”. When “−5” is designated, the X coordinate of the left image is “95”.

  Further, when the parallax amount is specified by the pop-out distance from the screen, a deviation amount based on the pop-out distance is calculated. As a method for calculating the deviation amount, a technique known in the 3D technique may be used.

  For reference, the relationship between parallax and distance in stereoscopic vision will be described using the parallel stereo model in FIG. The following explanation is based on "Image Understanding-Mathematics of 3D Recognition-Kenichi Kanaya Morikita Publishing Co., Ltd."

  The parallel stereo model is a model in which the left and right optical axes are parallel, and when it is not parallel, it is called a convergence stereo model. A point P (X, Y, L) in the real space (three-dimensional space) is projected on the left and right images by the parallel stereo model. The coordinates on the left and right images can be obtained by perspectively projecting the point P toward the left and right viewpoints (lens centers) OR and OL. That is, the points PR and PL where the straight line connecting the point P and the points OR and OL intersects the left and right image planes are the coordinates on the point image.

In addition, the distance between the left and right viewpoints is called a base line length B, and the focal length of the camera is f.
In perspective projection,

なる関係が成り立つため、図３のモデルにこの関係を当てはめる。ＯＲを3次元空間上の原点とすると、右画像では、

Since this relationship holds, this relationship is applied to the model of FIG. If OR is the origin in 3D space,

となり、左画像では、

In the left image,

となる関係が得られる。このとき、画像面上でのずれ量Ｄは、式(1)(2)を用いると 次の式で算出される。

Is obtained. At this time, the shift amount D on the image plane is calculated by the following equation using equations (1) and (2).

画像面上でのずれ量が算出されると、左目画像における３Ｄ化オブジェクトの新たな位置座標がわかる。

When the amount of deviation on the image plane is calculated, the new position coordinates of the 3D object in the left-eye image are known.

  The overlap detection unit 110 checks whether the position overlaps with another object from the position coordinates of the 3D object calculated by the grazing amount calculation unit 112. Since the object position on the left-eye image is changed, it is determined whether or not there is an overlap with the 3D object on the left-eye image based on the size and position information of each object.

  The case of the object attribute shown in FIG. 7 will be described. The position of the “heading” object is x = “100” and y = “10”, but when the parallax amount is shifted by “+5”, the position of the heading object on the left-eye image is x = “105”, y = Becomes “10”. Since the size of the “heading” object in the X-axis direction is “100”, the X coordinate position of the right end of the “heading” object is x = “205”. Since the position of the “image 2” object is x = “200”, it can be seen that an overlap occurs.

  The attribute adjustment unit 112 adjusts the attribute of the object in which the overlap is detected, and eliminates the overlap. Here, among the overlapped objects, whether the object whose parallax amount is changed is set as the adjustment target or the object which is not changed may be set in advance by the user. Alternatively, an object whose parallax amount is always changed may be set as an adjustment target.

  Further, the adjustment target may be determined by comparing the attribute of the object whose parallax amount is changed with the attribute of the object which is not changed.

By comparing the attributes of the object, the depth of the object may be adjusted more deeply. Since it is considered that the parallax is specified so that the object to be conspicuous comes to the front, the object placed in the back is considered to be less important, and this is the adjustment target. In the case of the example in FIG. 9, the “image 2” object is arranged at the back, and this is the adjustment target.
The attribute of the object may be compared to adjust the smaller object size. Since an object to be conspicuous is considered to be large in size, a small object is considered to be less important, and this is an adjustment target. In the case of the example in FIG. 9, the “heading” object is smaller, and this is the adjustment target.

  The attribute of the object may be compared to adjust the arrangement position of the object farther from the center as viewed from the entire content. Since the object to be conspicuous is considered to be arranged so as to be in the center of the content, it is considered that the object arranged at a position farther from the center is less important, and this is the adjustment target. In the case of the example of FIG. 9, the “image 2” object is arranged at a position farther from the center, and this is the adjustment target.

  Which object attribute is preferentially compared to determine the adjustment target is set in the user setting information, or a default setting is made in advance.

  When the object to be adjusted is determined, the object attribute is adjusted. In the user setting information shown in FIG. 2, adjustment is performed in the order of position, character spacing, font type, size, and parallax to check whether or not the overlap can be eliminated. When making adjustments, check to see if adjustments can be made within the maximum allowable range.

  The case where the adjustment target is a “heading” object will be described. First of all, it is examined whether the overlap can be eliminated by adjusting the position having a high adjustment priority. Since the overlap between the “Heading” object and the “Image 2” object is 5 pixels, it is necessary to shift at least the heading object to the left by 5 pixels. When the “Heading” object is shifted to the left by 5 pixels, the X coordinate of the left edge of the “Heading” object is “100” for the left eye image and “95” for the right eye image. At this time, it can be seen that it overlaps the “image 1” object on the right-eye image. Therefore, it can be seen that the overlap cannot be eliminated by adjusting the position.

  Since the “Heading” object is a font, it is checked whether it can be adjusted by narrowing the space between characters. If the size in the X-axis direction of the “Heading” object is 95 pixels or less by adjusting the space between characters, the X coordinate in the left eye image on the right edge of the “Heading” object will be to the left of “200”. Can be resolved.

  If the overlap cannot be resolved even after adjusting the character spacing, change the font. If the X-axis size of the “Heading” object becomes 95 pixels or less by changing the font, the X coordinate in the left eye image at the right end of the “Heading” object will be to the left of “200”. Can be resolved.

  If the overlap cannot be resolved even after changing the font, adjust the size of the object. Since the size of the “Heading” object in the X-axis direction only needs to be 95 pixels or less, the overlap can be eliminated by reducing the size by 95%. The maximum allowable size adjustment is 90%, which is an allowable range adjustment. Therefore, the adjustment is successful by reducing the “Heading” object by 95%.

  Further, when adjusting the parallax amount, it is examined how much the left eye image is shifted to the maximum right (left if the object is shifted to the left) without overlapping with other objects. If the maximum deviation amount is within 90%, which is the maximum adjustment allowable amount, compared to the originally calculated deviation amount, the adjustment is successful. In the case of the heading object in the example, since the maximum shift amount is 0 without changing the size, the overlap cannot be eliminated by adjusting the parallax amount.

  The attribute adjustment method has been described with an example in which the “heading” object, which is a 3D object, is the adjustment target, but the same applies to the case where the “image 2” object, which is the overlapping object, is the adjustment target. is there. In the case of an image object, since it is not a font, the adjustment priority is position, size, and amount of parallax.

  Even if the above adjustment is performed, the adjustment may fail depending on the content. Further, even when it is set by the user setting that no attribute of the object is adjusted, the overlapped objects are displayed while being overlapped. At this time, it is necessary to set the rendering order of overlapping objects or the portion to be rendered.

  When displaying overlapping objects, it is necessary to set the rendering order so that the object placed in front is rendered later.

  Therefore, if the adjustment fails, if the adjustment is not performed, the rendering condition is set, the depths of the overlapping objects are compared, and the rendering order is set so that at least the object that comes before is rendered later. .

  An example of rendering order setting is shown. For example, it is assumed that rendering priority information is included in the object attribute parameter for each object, and rendering starts with the object with the smallest number. Since objects that do not overlap with other objects may be rendered in any order, the priority is set to zero. The object with priority 0 is rendered first, and after all objects with priority 0 have been rendered, the process proceeds to rendering of the first and subsequent objects.

  When the rendering order is set, the priority of all objects is 0 as an initial value. In this state, the overlapping objects are compared, and the object that comes to the front is set to the rendering priority of the object that is in the back. The number added by one is used as the rendering priority. As a result, at least the foreground object is rendered after the back object.

  The setting of the rendering order will be specifically described with reference to an example in which “heading”, “image 1”, “image 2”, and “text 1” are arranged as shown in FIG. . First, as shown in Table 1, the priority order of “Heading”, “Image 1”, “Image 2”, and “Text 1” is 0 as an initial value.

このような状態で、「見出し」を飛び出させたために「画像２」と重なり、レンダリング順序を設定する場合は、「見出し」が手前にくるので、「画像２」の優先順位は初期値に１を足した値となり、「見出し」、「画像１」、「画像２」、「テキスト１」の優先順位は表２に示すようになる。

In this state, when “heading” is popped out and overlaps with “image 2” and the rendering order is set, since “heading” comes to the front, the priority order of “image 2” is 1 as the initial value. Table 2 shows the priorities of “Heading”, “Image 1”, “Image 2”, and “Text 1”.

そして、この表２の場合のレンダリング順序は、「画像１」、「画像２」、「テキスト１」（この３つのオブジェクトの間ではレンダリング順序フリー）の次に、優先順位が１である「見出し」を行う。

In the case of Table 2, the rendering order is “Image 1”, “Image 2”, “Text 1” (the rendering order is free among these three objects), and “Heading” having a priority of 1. "I do.

  Next, when “Image 2” is converted to 3D so as to go back, when “Text 1” is newly overlapped (“Heading” is originally overlapped in the previous processing), “Text 1” comes to the front. Is added to the priority of “Image 2”, and the priority of “Heading”, “Image 1”, “Image 2”, and “Text 1” is as shown in Table 3.

そして、この表３の場合のレンダリング順序は、「画像１」、「画像２」（この２つのオブジェクトの間ではレンダリング順序フリー）の次に、優先順位が１である「見出し」、「テキスト１」（この２つのオブジェクトの間ではレンダリング順序フリー）を行う。

The rendering order in the case of Table 3 is “Image 1” and “Image 2” (the rendering order is free between these two objects), followed by “Heading” and “Text 1” with a priority of 1. (Rendering order is free between the two objects).

  Further, when “Image 1” is converted to 3D before “Heading” and overlapped with “Heading”, the priority order of “Image 1” remains 2 and “Heading” remains 1. In this case, the rendering order is “Image 1”, followed by “Heading” and “Text 1” (priority is 1) (the rendering order is free between these two objects). 1 ”.

  In this way, the priority order of the rendering order is set, and rendering is performed according to the set priority order, so that a natural display is obtained when 3D display is performed.

  A portion to be rendered may be set instead of the rendering order. For example, the setting is made so that only the overlapping portion of the object arranged at the back is not rendered. Since the portion that has not been rendered is not drawn, it is not displayed regardless of the rendering order. As a result, the object placed in front is always drawn without being hidden.

  In the designation of a portion not to be rendered, information on a portion not to be rendered is given for each object when setting rendering conditions, and the information is referred to at the time of rendering so that the designated portion is not rendered. The non-rendered part is, for example, coordinates (x, y) = (10, 24), (10, 50), (20, 60), (30, 50), (30, 24), (20 , 0), the coordinates of each vertex of the overlapping part may be specified. When coordinates are specified as (x, y) = (0,0), (0,10), (10,10), (10,0), a rectangular area surrounded by the coordinates of 4 points is rendered Not to be part.

  Next, the processing flow of the embodiment according to the present invention will be described with reference to the flowchart of FIG. First, in step S1 (hereinafter, abbreviated as a step), the content data and the attribute information of the object are received, and information indicating which object is converted into 3D among the objects existing in the content data is parallax amount information. Receive with.

  In S2, user setting information for setting which object attribute is preferentially adjusted when performing overlap adjustment is read. When using the default setting as setting information in the system, it is not necessary to read it.

  After S3, the overlap between objects is checked and overlap adjustment is entered. It is checked whether all of the objects that have not been designated for 3D processing have been processed (S3). If there are unprocessed objects remaining, one of them is selected (S4) and converted to 3D. It is determined whether or not the object has overlapped (S5). If not, the process returns to S3.

  If they overlap in S5, it is determined by referring to the setting information whether the object attribute is adjusted so as to cancel the overlap in S6. If the overlap adjustment is not performed, or if the adjustment fails due to the overlap adjustment, the rendering condition is set in S8 and thereafter.

In step S8, it is determined with reference to the setting information whether the rendering order is set. When setting the order, the depths of the overlapping objects are compared in S10, and the object that comes to the front is set to perform rendering later.
If the rendering order is not set in S8, the overlapping portion of the object placed at the back is cut out in S9, and the rendering condition is set as the portion not to be rendered.

  When the processing of all the objects is completed in S3, it is determined whether or not there are overlapping objects in S11. If not, rendering is performed (S13), and the process ends. If it exists, in step S14, the set rendering condition is referenced, rendering is performed, and the process ends.

  Next, when performing overlap adjustment in S6, processing for determining an object to be subjected to overlap adjustment shown in FIG. 5 is performed. First, in S14, it is determined whether or not to refer to the object attribute in order to determine whether the overlap adjustment is performed on the 3D object or on the overlapping object.

  If the object attribute is not referred to, the setting information is referred to in S15 to determine which object is to be preferentially adjusted. When adjusting the 3D object, the adjustment target is determined as a 3D object in S16. If the setting information is set to preferentially adjust the overlapping object, the overlapping object is determined as an adjustment target in S17.

  In S14, when both of the object attributes are referred to when the adjustment target is determined, the setting information indicating which attribute is to be compared with priority is referred to, and the attribute with a high priority is compared to determine the adjustment target. To do. There are three attributes to be compared: position, size, and depth from the center of the screen, and which attribute is to be preferentially compared is set in the setting information in advance.

  When adjusting the object whose position is far from the center of the screen in S19, the distance between the center of each of the two objects and the center of the screen is compared in S18, and the larger one is determined from the center of the screen. The object is a distant object, and this is the adjustment target.

  When the smaller object is adjusted in S21, the areas of the two objects are compared, and the smaller one is set as the adjustment target (S20).

  In S22, the parallaxes of the two objects are compared to determine which one comes to the front, and the object that comes to the back is set as the adjustment target.

  When a certain object is converted into 3D, the same processing is performed regardless of whether the overlapping object is a 3D object or a 2D object. Therefore, when the overlapped objects are 3D objects, the 3D object in S15 means the object newly converted to 3D this time. Further, the overlapping object in S17 means an object that has been converted to 3D. Which object is to be adjusted is determined by the above-described processing of FIG. 5 as in the case where the overlapping object is a 2D object.

  Next, the process proceeds to the overlap adjustment process shown in FIG. When adjusting the overlap, the setting information is referred to, and the priority object attributes are adjusted in order to determine whether or not the overlap can be eliminated.

  First, in S23, it is determined whether all the attributes have been adjusted. If there are unadjusted attributes, in S24, the setting information is referred to and an attribute with a high priority is extracted from the unadjusted attributes. To do. The setting information will be described in the case of FIG. From this setting information, a position attribute with a high priority is extracted.

  In S25, it is determined whether the extracted attribute is a font adjustment attribute such as a character interval or a font type. In this case, since it is not a font adjustment attribute, overlap adjustment is performed in S27. When performing the overlap adjustment, the adjustment is performed within the range while referring to the maximum allowable amount of adjustment.

  Now, as shown in FIG. 9, when the “Heading” object is in adjustment symmetry, it is checked whether the overlap can be eliminated by adjusting the position. For example, in the example of FIG. 9, since the overlap between the “Heading” object and the “Image 2” object is 5 pixels, it is necessary to shift at least the “Heading” object to the left by 5 pixels. When the “heading” object is shifted to the left by 5 pixels, the X coordinate of the left end of the heading object is “100” for the left eye image and “95” for the right eye image. At this time, it can be seen that it overlaps the “image 1” object on the right-eye image. Therefore, it can be seen that the overlap cannot be eliminated by adjusting the position.

  If the overlap cannot be resolved in S28, the process returns to S23, and the next highest priority attribute is adjusted.

If the extracted attribute is a font adjustment attribute in S25, it is determined in S26 whether the adjustment target is a “text” object. Since the “heading” object is a “text” object, the overlap adjustment is performed in S27.
If the overlap can be eliminated in S28, the adjustment is successful in S29.
If all the attributes have been adjusted in S23, the adjustment fails in S30.

In this way, the above-described processing of the data editing apparatus according to the present invention solves the problem that objects are overlapped by setting parallax when 3D content including a plurality of objects is mixed. When parallax is specified for an object, it is checked whether or not it overlaps with another object, and if it overlaps, it is automatically adjusted so as to eliminate the overlap. This allows the user to specify the parallax without worrying about whether or not they overlap, and facilitates the 3D operation.
In addition, when displaying overlapping objects while overlapping, it is possible to perform rendering settings so that a natural display is obtained when displaying in 3D.

(Other matters)
[Method of adjusting overlap]
In the method for adjusting overlap described above, the setting information is referred to, one object attribute with a high priority is extracted, and it is determined whether or not only one extracted attribute can be adjusted. You may go. For example, when adjustment is performed for a certain attribute, it is assumed that the overlap cannot be resolved within the range of the maximum allowable amount of adjustment. In that case, adjustment is performed for the time being with the maximum value of the maximum allowable amount, and then further adjustment is performed with the attribute having a higher priority. In this way, the overlap may be eliminated by adjusting a plurality of attributes.

  Alternatively, overlap adjustment may be performed for each attribute, and an attribute having the smallest adjustment amount among the adjustable attributes may be adjusted. For example, the overlap adjustment is performed for each attribute of position, size, parallax, and character spacing, and when all the attributes are adjustable, the attribute with the smallest adjustment amount is adjusted.

  When determining whether the adjustment target is a 3D object or an overlapping object, the amount of adjustment is small when overlap adjustment is performed on the attribute with the highest priority when adjusting. This object may be the adjustment target. For example, if the attribute with the highest adjustment priority from the setting information is the position, the 3D object and the overlapped object are respectively overlap-adjusted with the position attribute, and the 3D object is adjusted. When the amount is small, a 3D object is set as an adjustment target. In this case, the attribute to be adjusted is the position attribute.

[About setting information]
Further, in the method of setting the adjustment priority order of the object attribute, it may be set on the condition that the object to be adjusted has a certain value or more for the attribute for each attribute. This is because, when an object having a small size is originally set as an adjustment target, even if the adjustment priority of the size attribute is high, no further adjustment of the size attribute can be performed.

  For example, for objects with a size of 100x100 (pixels) or less, the size attribute is not adjusted, and when the font size is 9 or less, the character spacing is not adjusted. May be.

  The present invention relates to a 3D content data editing apparatus or the like that edits 2D display data composed of a plurality of objects into a format that can be stereoscopically displayed with respect to an object for which at least one of the plurality of objects is designated for stereoscopic display. It can implement suitably.

It is a block diagram which shows the structure of the 3D content data editing apparatus which concerns on one Example of this invention. It is a figure which shows typically the setting information which showed the adjustment priority of the object attribute. It is a figure of the parallel stereo model which shows the relationship between the parallax in stereoscopic vision, and distance. It is a flowchart which shows the whole process of the 3D content data editing apparatus which concerns on one Example of this invention. It is a flowchart which shows the process which determines the object used as the object of overlap adjustment. It is a flowchart which shows the process in the case of performing overlap adjustment. It is a figure which shows the example of a script which displays the content data containing a some object. It is the figure showing the left-eye image at the time of 3D display, and the right-eye image at the time of 2D display, respectively. It is a figure showing the left eye image and the right eye image at the time of 3D display. It is a figure showing the appearance at the time of 3D display.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100: 3D content data editing apparatus 101: Input part 102: Output part 103: Control part 110: Overlap detection part 111: Attribute adjustment part 112: Deviation amount calculation part 113: Rendering setting part 117: Display apparatus 119: Rendering part

Claims (18)

A display data editing device that edits two-dimensional display data composed of a plurality of objects into a format that can be stereoscopically displayed with respect to an object for which at least one of the plurality of objects is designated for stereoscopic display,
An overlap detector for detecting an overlap of display between the object for which the stereoscopic display is designated and another object;
An object attribute adjusting unit that adjusts an object attribute of at least one of the two objects in which the overlap is detected based on a detection result by the overlap detecting unit;
A display data editing apparatus characterized by comprising:   The display data editing apparatus according to claim 1, wherein the object attribute to be adjusted is an object position attribute.   2. The display data editing apparatus according to claim 1, wherein the object attribute to be adjusted is an object size attribute.   The display data editing apparatus according to claim 1, wherein the object attribute to be adjusted is an object parallax attribute.   The display data editing apparatus according to claim 1, wherein the object attributes to be adjusted are an object position attribute, an object size attribute, and an object parallax attribute, and the priority order of these object attributes is set in advance. A display data editing apparatus, wherein overlap elimination is adjusted according to priority. A display data editing device that edits two-dimensional display data composed of a plurality of objects into a format that can be stereoscopically displayed with respect to an object for which at least one of the plurality of objects is designated for stereoscopic display,
An overlap detector for detecting an overlap of display between the object for which the stereoscopic display is designated and another object;
A rendering setting unit configured to set a rendering condition of at least one of the two objects in which the overlap is detected based on a detection result by the overlap detection unit;
A display data editing apparatus characterized by comprising:   7. The content data editing apparatus according to claim 6, wherein the rendering condition is a rendering order.   7. The display data editing apparatus according to claim 6, wherein the rendering condition is a portion of an object to be rendered.   9. A display device comprising: the display data editing device according to claim 1; and display means for stereoscopically displaying an object based on data edited by the display data editing device. A display data editing method for editing two-dimensional display data composed of a plurality of objects into a form that can be stereoscopically displayed with respect to an object for which at least one of the plurality of objects is designated for stereoscopic display,
An overlap detection step of detecting an overlap of display between the object designated for stereoscopic display and another object;
An object attribute adjusting step for adjusting an object attribute of at least one of the two objects in which the overlap is detected based on the detection result of the overlap detecting step;
A display data editing method characterized by comprising:   A display data editing program for operating a computer as the display data editing apparatus according to claim 1.   A recording medium on which the display data editing program according to claim 11 is recorded. A display data editing method for editing two-dimensional display data composed of a plurality of objects into a form that can be stereoscopically displayed with respect to an object for which at least one of the plurality of objects is designated for stereoscopic display,
An overlap detection step of detecting an overlap of display between the object designated for stereoscopic display and another object;
A display data editing method, comprising: a rendering setting step for setting a rendering condition of at least one of two objects for which overlap is detected based on a detection result obtained by the overlap detection step.   A display data editing program for operating a computer as the display data editing apparatus according to claim 6.   A recording medium on which the display data editing program according to claim 14 is recorded.   14. A display method comprising: stereoscopically displaying an object based on data edited by the display data editing method according to claim 10 or 13.   A display data display program for operating a computer as the display device according to claim 9. A recording medium on which the display program according to claim 17 is recorded.

Images