CN100356407C - Data authoring device - Google Patents

Abstract

A data authoring processing device utilizes spatial localization information indicated by an object in the real world and/or a predetermined marker and sets predetermined related information for an information presentation device outputting the predetermined related information. A spatial localization information input section inputs spatial localization information on the object and/or the predetermined marker. A related information setting section sets a display method of the predetermined related information. A spatial localization information display section displays the spatial localization information on the object and/or the predetermined marker which has been input by the spatial localization information input section and displays the predetermined related information according to the display method set by the related information setting section. A data output section outputs the data describing the display setting of the display by the spatial localization information display section.

Description

Data authoring device

Technical field

The present invention relates to a kind of data creation (authoring) equipment, its with set predetermined related information explicitly at the object of real world and/or the spatial orientation information of predetermined labels so that information presentation device is exported this predetermined related information.

Background technology

As the information presentation device of output needle to the predetermined related information of the object of real world and/or predetermined labels, utilizing two-dimensional encoded device is extensively to know altogether.In these devices, there is a kind of spatial orientation information that utilizes object and/or predetermined labels to export the device of relevant information.In this device, as shown in figure 30, read by the video camera (not shown) two-dimensional encoded 601, as the mark that is printed on the business card 600 (being object), and by the process analysis in the computing machine (not shown) through two-dimensional encoded ID.Next, proposed a kind of device, wherein from image file, read the mug shot 602 with the corresponding individual of this ID by this ID appointment, and immediately following business card 600 two-dimensional encoded 601 after it is presented on the display 700 of computing machine.An example of this device for example is disclosed in the Japanese Patent Application Laid-Open 2000-82107 communique.

As in the disclosed device in the Japanese Patent Application Laid-Open 2000-82107 communique, when on showing business card 600 two-dimensional encoded 601 when also showing mug shot 602, mug shot can be presented in the following coordinates regional, this coordinates regional is from the parallel adjacent area that moves on the same plane of two-dimensional encoded 601 position coordinates, and can easily calculate and set output coordinate thus.

Yet, utilizing spatial orientation information to come under the situation of output information at arbitrary object and/or mark, this object and/or mark may adopt all places in the three dimensions, set relevant information so need to consider three dimensions.For example, when the personage who allows to occur with three-dimensional structure in the non-optional position that is arranged in two-dimensional encoded same level as relevant information, and in the time of will on screen, exporting this personage, compare with afore-mentioned, the degree of freedom of the position of setting, size, direction etc. significantly increases, but is difficult to calculate and set output coordinate.

In addition, when following object to be provided with when two-dimensional encoded, information presentation device need be installed in the mode of easy this coding of identification, but also can instruct how this device is installed without any device so far.That is, also the particular characteristic (for example object identification accuracy, outgoing position degree of accuracy etc.) that improves information presentation device is not carried out any consideration.

Therefore, in the setting of relevant information, in actual conditions, carried out repetition test and in actual output device, experimentized so far, and be actually output information before adjusting setting.

Summary of the invention

Purpose of the present invention relates to a kind of data authoring device, it utilizes at the spatial orientation information of the object of real world and/or predetermined labels and sets predetermined related information, so that information presentation device is exported this predetermined related information, and provide a kind of data authoring device, it can make, and employed spatial orientation information is not limited to two dimensional surface when setting predetermined related information, and any operation easily is set simultaneously.

In addition, another object of the present invention provides a kind of data authoring device, and it can improve the various performances of information presentation device, for example " output that it can obtain more to expect " and " mark is present in the position of seeing easily ".

Notice that the object of the real world that the present invention describes is assumed that the object that has existed in real world, for example, as building structure such as building or house, as trees natural thing, traffic signals, pipe arrangement and as the artificiality of furniture.Mark is assumed that various codings, the numeral of the artificial output of setting that is used for information presentation device of expression, perhaps literal, mark (framed symbol) etc.When the object with real world is registered as the mark that is used for information presentation device, this object is served as a mark handle.

According to a first aspect of the invention, a kind of data authoring device is provided, and it utilizes the dimensional orientation information of being represented by the object and/or the predetermined labels of real world, sets predetermined related information, so that export this predetermined related information by information presentation device, this data authoring device comprises:

The spatial orientation information input part, it imports the spatial orientation information of described object and/or described predetermined labels;

Related information setting section, it sets the method that shows described predetermined related information;

The spatial orientation information display part, it shows by the object of described spatial orientation information input part input and/or the spatial orientation information of predetermined labels, and shows predetermined related information according to the display packing by described related information setting section sets; And

Data output section, the data that the display setting that its output shows the spatial orientation information display part is described, described equipment constitutes: the user can select to be shown in the described object on the described spatial orientation information display part and/or the spatial orientation information of predetermined labels, and can set predetermined related information to the spatial orientation information of described selecteed object and/or predetermined labels by described related information setting section.

According to a second aspect of the invention, provide the data authoring device according to first aspect, wherein said predetermined related information comprises the image information object, and

Described spatial orientation information display part shows the spatial orientation information of described image information object.

According to a third aspect of the invention we, provide data authoring device according to first aspect, the spatial orientation information of wherein said spatial orientation information display part display object and the spatial orientation information of predetermined labels both,

Described data authoring device also comprises the geometrical property configuration part, and it sets in the spatial orientation information of the spatial orientation information of object and predetermined labels the geometrical property of at least one arbitrarily.

According to a forth aspect of the invention, provide the data authoring device according to second aspect, wherein said spatial orientation information display part shows the spatial orientation information of predetermined labels and the spatial orientation information of described image information object,

Described data authoring device also comprises the geometrical property configuration part, and it sets at least one the geometrical property in the spatial orientation information of the spatial orientation information of predetermined labels and image information object arbitrarily.

According to a fifth aspect of the invention, provide data authoring device according to second aspect, the spatial orientation information of wherein said spatial orientation information display part display object, the spatial orientation information of predetermined labels, and the spatial orientation information of image information object,

Described equipment also comprises the geometrical property configuration part, and it sets the spatial orientation information of object, the spatial orientation information of predetermined labels arbitrarily, and at least one the geometrical property in the spatial orientation information of image information object.

According to a sixth aspect of the invention, provide the data authoring device according to either side in the third aspect to the five aspects, wherein geometrical property has at least one in bulk, rotation and the shape.

According to a seventh aspect of the invention, provide the data authoring device according to either side in the third aspect to the five aspects, wherein said geometrical property configuration part has the Optimization Dept. that suitably sets geometrical property.

According to an eighth aspect of the invention, provide the data authoring device according to the 7th aspect, wherein said Optimization Dept. has the function that mark and object are set in the following manner automatically,, makes that the surface of mark spatially contacts with the surface of object at least that is.

According to a ninth aspect of the invention, data authoring device according to the 7th aspect is provided, wherein said Optimization Dept. presents at least one in the spatial orientation information of the characteristic of device and environment for use and described image information object, the area of space of automatic setting mark based on described characteristic information.

According to the tenth aspect of the invention, data authoring device according to the 7th aspect is provided, and wherein said Optimization Dept. is used to set the area of space of image information object based at least one automatic setting in the spatial orientation information of the characteristic of described information presentation device and environment for use and mark.

According to an eleventh aspect of the invention, provide the data authoring device according to the 7th aspect, wherein said Optimization Dept. makes their relative position remain unchanged for the position of this object setting mark and image information object simultaneously.

According to a twelfth aspect of the invention, provide the data authoring device according to first aspect, also comprise the demonstration efferent, it was demonstrated before described information presentation device presentation information.

According to a thirteenth aspect of the invention, provide the data authoring device according to the 7th aspect, also comprise image information property settings portion, it sets the image information characteristic of picture information object or predetermined labels arbitrarily.

According to a fourteenth aspect of the invention, provide the data authoring device according to the 13 aspect, wherein said image information characteristic comprises at least one in color, brightness, picture size, colored monochrome information, Format Type and the character script of image.

According to a fifteenth aspect of the invention, provide the data authoring device according to second aspect, wherein said image information object uses three-dimensional coordinate.

According to a sixteenth aspect of the invention, provide the data authoring device according to the 7th aspect, wherein said image information object has Word message.

According to a seventeenth aspect of the invention, provide data authoring device, wherein set at least two for the same object of real world and/or the predetermined related information of identical predetermined labels according to first aspect.

According to an eighteenth aspect of the invention, provide the data authoring device according to the 17 aspect, wherein said at least two existing predetermined related information are the output with same type of different pieces of information capacity.

According to a nineteenth aspect of the invention, provide data authoring device, also comprise output attribute information setting portion according to first aspect, its set with at the relevant output attribute information of the relevant information of predetermined related information.

According to a twentieth aspect of the invention, data authoring device according to the 19 aspect is provided, wherein said output attribute information comprises the timing of output information, the volume of output sound, the brightness of output image, the resolution of output image, the data volume of output image, and by in the information of the characteristic of described information presentation device or environment for use definition at least one.

Description of drawings

Fig. 1 is according to the structure of the data authoring device of first embodiment of the invention and the key diagram of operation;

Fig. 2 is the figure that the demonstration example of first embodiment is shown;

Fig. 3 shows the figure according to the structure of the data authoring device of second embodiment of the invention;

Fig. 4 A shows the figure of the example (No.1) of institute's defined label;

Fig. 4 B shows the figure of the example (No.2) of institute's defined label;

Fig. 5 shows the figure of the demonstration example among second embodiment;

Fig. 6 shows the figure according to the demonstration example in the data authoring device of third embodiment of the invention;

Fig. 7 shows the figure according to the demonstration example in the data authoring device of fourth embodiment of the invention;

Fig. 8 shows the figure according to the demonstration example in the data authoring device of fifth embodiment of the invention;

Fig. 9 shows the figure according to the structure of the data authoring device of sixth embodiment of the invention;

Figure 10 shows the figure according to the demonstration example in the data authoring device of seventh embodiment of the invention;

Figure 11 shows the figure according to the demonstration example in the data authoring device of eighth embodiment of the invention;

Figure 12 shows the figure according to the demonstration example in the data authoring device of ninth embodiment of the invention;

Figure 13 is a pair of mark among the 9th embodiment and the key diagram of arrow;

Figure 14 shows the figure according to the structure of the data authoring device of tenth embodiment of the invention;

Figure 15 shows the figure according to the structure of the data authoring device of eleventh embodiment of the invention;

Figure 16 shows the figure according to the structure of the data authoring device of sixteenth embodiment of the invention;

Figure 17 A shows the figure of the object before the log-on operation when finishing binding mark first;

Figure 17 B shows the figure of the show state before the log-on operation when finishing binding mark first;

Figure 17 C shows the figure of the shape information of the object before the log-on operation when finishing binding mark first;

Figure 17 D shows the figure of the object after the log-on operation when finishing binding mark first;

Figure 17 E shows the figure of the show state after the log-on operation when finishing binding mark first;

Figure 17 F shows the figure of the shape information of the object after the log-on operation when finishing binding mark first;

Figure 18 A shows the figure of the object before the log-on operation when finishing binding mark after a while;

Figure 18 B shows the figure of the show state before the log-on operation when finishing binding mark after a while;

Figure 18 C shows the figure of the shape information of the object before the log-on operation when finishing binding mark after a while;

Figure 18 D shows the figure of the object after the log-on operation when finishing binding mark after a while;

Figure 18 E shows the figure of the show state after the log-on operation when finishing binding mark after a while;

Figure 18 F shows the figure of the shape information of the object after the log-on operation when finishing binding mark after a while;

Figure 19 shows the figure according to the structure of the data authoring device of nineteenth embodiment of the invention;

Figure 20 shows the key diagram according to the function of the data authoring device of nineteenth embodiment of the invention;

Figure 21 is the key diagram of the concrete application example of data authoring device;

The figure of the example that the information when Figure 22 shows by display device realization computing information efferent presents;

Figure 23 shows the input of response from the spatial orientation information input part, watches the figure of an example of the image output under the situation of object from any viewpoint;

Figure 24 shows the input of response from the spatial orientation information input part, watches the figure of another example of the image output under the situation of object from any viewpoint;

Figure 25 shows the figure according to the structure of the information presentation device of the 20 embodiment;

Figure 26 is the key diagram according to the function of the information presentation device of twentieth embodiment of the invention;

Figure 27 shows the figure of the operation (behavior) that PDA with video camera communicates by WLAN and data server;

Figure 28 illustrates reference mark and overlapping demonstration will be provided with the position of next mark on this reference mark the figure of operation;

Figure 29 shows the figure of the indication of the direction that overlapping demonstration video camera will move on reference mark; And

Figure 30 shows the figure by the output example of the legacy equipment of the spatial orientation information output relevant information of utilizing object and/or predetermined labels.

Embodiment

Describe in detail below with reference to accompanying drawings and realize optimization model of the present invention.

[first embodiment]

At first, with the data authoring device of describing according to first embodiment of the invention.

As shown in Figure 1, the data authoring device according to present embodiment comprises: spatial orientation information input part 1; Spatial orientation information display part 2; Related information setting section 3; With data output section 4.At this, the object of spatial orientation information input part 1 input real world and the spatial orientation information a of predetermined labels, and spatial orientation information display part 2 shows the spatial orientation information of being imported by spatial orientation information input part 1.Related information setting section 3 is set predetermined related information b, and edits and upgrade the demonstration of this spatial orientation information display part 2 according to the predetermined related information b that sets.In addition, data output section 4 receives by spatial orientation information display part 2 editors, the display setting that upgrades and show from spatial orientation information display part 2, and the data c that will describe display setting outputs to the information presentation device (not shown).

The operation of the data authoring device of constructing in this way according to present embodiment will be described below.Note, the information presentation device of supposing the object of this data authoring device of use is the PDA with video camera, this PDA with video camera have can input picture video camera, and can will utilize the realtime graphic of this video camera input and the information (image, literal etc.) by the inter-process preparation output to screen.At this, the desired function of supposing this information presentation device is for example " when the PDA that has a video camera when utilization sees the signboard in OO market, to be desirably on the screen of PDA and to see that the someone stands in the place, shop and says " welcome " ".Present embodiment is the data authoring device that preparation is used for the data of this function.There has been signboard in attention in real world, but it is registered as the mark of the output that is used for information presentation device.

At first, by operations of operators according to the data authoring device of present embodiment, the object of spatial orientation information input part 1 input real world and the spatial orientation information a of predetermined labels.At this, the spatial orientation information a of object is corresponding with the three-dimensional coordinate data in OO market, and the spatial orientation information a of predetermined labels is corresponding with the coordinate data of signboard.Notice that this spatial orientation information input part 1 can comprise that for example the storer of computing machine reads the unit.At this, from external memory storage reference and read data files.

Subsequently, in spatial orientation information display part 2, show spatial orientation information a by 1 input of spatial orientation information input part, and the operator of data authoring device sets predetermined related information b in related information setting section 3 when confirming shown spatial orientation information.In the present embodiment, be output because predetermined information will be set at when seeing signboard, so signboard is set at mark.In addition, predetermined related information b comprises people's 3DCG data and voice data " welcome ", and set this predetermined related information b by this way, promptly, when the 3DCG data with the people are arranged on the shop, and when the image of signboard was input to information presentation device, the people appeared at bat shown in the screen of information presentation device and gets in the image, and generated the sound of saying " welcome ".

In concrete establishing method, when preparing relevant information setting screen 3A shown in Figure 2 as related information setting section 3, and when from be presented at the spatial orientation information display screen 2A the display screen 10 by spatial orientation information display part 2, selecting signboard 11, show this relevant information setting screen 3A, and can carry out various types of settings.At this, because utilize selected object (signboard 11) to serve as a mark, so with object definition and be registered as mark.Because export 3DCG data and voice data, so can in this relevant information setting screen 3A, set this effect.When having set the 3DCG data in this way, in spatial orientation information display screen 2A, show these data by spatial orientation information display part 2.That is, in the present invention, because people's 3DCG 12 is outputed on the shop 13, so spatial orientation information display part 2 spatially is arranged on place, shop among the spatial orientation information display screen 2A with people's 3DCG 12.Notice that spatial orientation information display part 2 can utilize skeleton view or three-face view (front surface, side surface, upper surface) to be easy to see the mode of three-dimensional position relation, and it is presented among the spatial orientation information display screen 2A.

The data c of display setting is described from data output section 4 outputs subsequently.The data c that describes display setting comprises: the position and the posture of mark (being signboard at this) coordinate, mark (being signboard at this) image, output image (being operator's 3DCG at this) data, output image, and the voice data of output.Note,, can describe its memory address, and not describe these data itself for Large Volume Data such as the CG picture material.In the present embodiment, in electronic document, describe total data, and read this electronic document by PDA with video camera (as utilizing object).In order to read the document, PDA is connected to data authoring device, and can transmit data from data authoring device.At last, the PDA that will have video camera takes actual place to, shows as: when seeing the signboard in OO market, shop CG personage is overlapping and that be presented in the PDA screen is located, and sends the sound of " welcome ".

Therefore, in data authoring device according to present embodiment, when setting predetermined related information b, the spatial orientation information a of show tags on spatial orientation information display part 2 (is signboard at this) or object (is the shop at this).The operator can set predetermined related information b (is 3DCG and sound at this) in related information setting section 3 when confirming spatial orientation information a.Thus, employed spatial orientation information is not limited to two dimensional surface (in this example, when seeing signboard, the personage occurs in the mode that stands on the shop), and can be easy to set any output.Because can visually confirm various spatial orientation informations and relevant information b simultaneously, so can carry out the emulation in the information presentation device simultaneously.For example, can on the position of expectation and direction, set personage's 3DCG in the mode that realizes better pointing to effect.Therefore, has the effect that to adjust with the output that obtains operator's expectation.

Notice that in the various piece according to the data authoring device of present embodiment, and constitute in whole operation parts of various piece and can use application specific processor, perhaps the CPU of fetch program can carry out calculating.The spatial orientation information a of object and mark needs not to be the three-dimensional data of accurate measurement or preparation, and can be that feature locations coarse data is clearly wherein only arranged.Can be with or without texture (texture) data.

In addition, in the present embodiment, described the situation that relevant information b comprises view data and voice data, but this information can only be view data or only be voice data.Spatial orientation information display part 2 can be presented in the different picture (window) as shown in Figure 2 with related information setting section 3, perhaps also can be included in the same window.Can be from subwindow the definition, the definition of mark etc. of alternative, relevant information, perhaps can import and the select File name.Can use any means, as long as it is for setting this information in the spatial orientation information that shows such as mark, object and relevant information.

When information presentation device have can input picture input media, and can will when outputing to screen, this device can be applied to have changeably the isolated plant of the PDA of video camera, portable phone, PC, portable PC, above-mentioned functions special use etc. by the realtime graphic of input media input and the information (image, literal etc.) by the inter-process preparation with video camera with video camera with video camera.

In addition, can be the equipment that separates with information presentation device according to the data authoring device of present embodiment, perhaps can incorporate in the information presentation device.

Note, in the spatial orientation information display part, show predetermined related information, but that this information needn't be with actual displayed in the information presentation device is identical according to display packing by related information setting section sets.Can be simultaneously displayed on information that the timing point that switched shows, can perhaps can simplify and display image to have only the clearly visible mode display message of display position.

These actual being formed among the whole embodiment that after this describe can be regarded as similarly.

[second embodiment]

Next, second embodiment of the present invention will be described.

As shown in Figure 3, data authoring device according to the present invention also comprises geometrical property configuration part 5 except having the structure according to the data authoring device of first embodiment.The geometrical property of at least one in these geometrical property configuration part 5 any setting objects and the institute's defined label.Notice that the example of predetermined labels comprises the bar code 14 (Fig. 4 A) of the type of distinguishing commodity, square mark 15 (Fig. 4 B) that can be by calculating the position/orientation that obtains the observation video camera etc.

The operation according to the data authoring device of present embodiment of structure will be described in this way below.Note in the present embodiment, identical with the mode of first embodiment, suppose to have the PDA of video camera as information presentation device, and the function of supposing expectation is when seeing mark, at random this mark is pasted the shop, and the CG that shows the people in the PDA screen is just as before he stands in the shop.In the case, in information presentation device, must calculate the position or the direction of the video camera that is provided with among the PDA according to the shape information (distortion, size) of the mark from screen, seen, set three dimensions, and make position before the shop that people's CG stands in three dimensions.Present embodiment is the data authoring device of the information presentation device (PDA with video camera) that is used to satisfy above-mentioned functions.

According to present embodiment, the spatial orientation information a of the spatial orientation information display part 2 of data authoring device display object in display screen and the spatial orientation information a of above-mentioned predetermined labels.In addition, the operator of this data authoring device at random sets at least one geometrical property in object and the mark by geometrical property configuration part 5.

More specifically be described now.When the display screen 10 of hypothesis on the PC as shown in Figure 5, and the part of wanting binding mark in the shop 13 in spatial orientation information display screen 2A around when clicking the mouse right button, the dialog box 5A that mark prepares appears being used for.In addition, when click right mouse button prepares with assigned tags in dialog box 5A, show tags 16 in spatial orientation information display screen 2A.In addition, in display screen 10, the screen of the geometrical property of this mark of display setting (being equivalent to geometrical property configuration part 5) (also being used as the geometrical property setting screen (being used for this mark) of relevant information setting screen 5B).Also set the size of this mark, the texture information that in mark, show at this as the geometrical property setting screen (being used for this mark) of relevant information setting screen 5B.When setting the geometrical property of mark in this way, the geometrical property of the mark 16 that shows in spatial orientation information display screen 2A also changes.Behind show tags in spatial orientation information display screen 2A, the evolution of this mark can be arrived any position, and can be set the more position of expectation.

After setting mark, above-mentioned also as geometrical property setting screen (being used for this mark) nominator's of relevant information setting screen 5B 3DCG as output, and in spatial orientation information display screen 2A demonstration personage's 3DCG 12.Can be after a while with the set positions of this 3DCG 12 to suitable position (is the front in shop 13 at this).

At last,, and read, so that can realize the function expected by information presentation device by the above-mentioned information of data output section 4 output.

In the present embodiment, the spatial orientation information mark a of the spatial orientation information a of spatial orientation information display part 2 show tags and object.For example, the mark that consideration will be printed on paper or the plastics pastes on the object, but in fact, for the position of binding mark, undue remarkable position visually is worthless.Yet,, use this information presentation device just nonsensical if can not input picture.Therefore, as in the present embodiment, in the time of display message in spatial orientation information display part 2 during set information, can be easily set information more suitably.Present embodiment has the geometrical property configuration part 5 of geometrical property of the spatial orientation information a of the spatial orientation information a of any setting object and mark.Because the size, shape of mark etc. can be set in geometrical property configuration part 5, so can set mark according to felicity condition the condition of the easy identification marking of terminal user of using information presentation device (for example under the situation of not damaging view, make).

[the 3rd embodiment]

Next, the data authoring device of a third embodiment in accordance with the invention is described with reference to Fig. 6.Note, in the present embodiment, the PDA that supposes to have video camera in mode identical among first embodiment is an information presentation device, and the function of supposing expectation is at street corner mark to be set artificially, and when seeing this this mark, show the arrow that points to the optional position before this mark in screen.In this information presentation device, must calculate the position and the direction of the video camera that is provided with among the PDA according to the shape information (distortion, size) of the mark of seeing in the screen, set three dimensions, and in this three dimensions, arrow is set in the place ahead of this mark.Present embodiment is the data authoring device of the information presentation device (PDA with video camera) that is used to satisfy above-mentioned functions.

According to present embodiment, the spatial orientation information display part 2 of data authoring device shows the spatial orientation information a of predetermined labels on screen, with the spatial orientation information a of image information object (corresponding with arrow at this).In addition, be provided with geometrical property configuration part 5, it sets the geometrical property of the spatial orientation information and the image information object of predetermined labels arbitrarily.

To more specifically be described below this.When the display screen 10 of hypothesis on the PC as shown in Figure 6, and when clicking right mouse button in the optional position of spatial orientation information display screen 2A, the dialog box 5A of mark preparation appears being used for.When assigned tags prepares, show tags 16 in space orientation display screen 2A.In addition, in display screen 10, the screen of the geometrical property of display setting mark (also being used as the geometrical property setting screen (being used for mark, arrow) of relevant information setting screen 5C) (being equivalent to geometrical property configuration part 5).Also as the geometrical property setting screen (being used for mark, arrow) of relevant information setting screen 5C, set the size of mark, the texture information that will in mark, show etc. at this.When setting the geometrical property of mark, the geometrical property of the mark 16 that shows in spatial orientation information display screen 2A also changes.In spatial orientation information display screen 2A, after the show tags, the change in location of this mark 16 can be arrived any position, and can be set the more position of expectation.

After setting this mark, specify arrow (in the present embodiment by related information setting section 3 as setting screen, will be also be used in combination with this setting screen by geometrical property configuration part 5 as the geometrical property setting screen (being used for mark, arrow) of relevant information setting screen 5C) output, and demonstration arrow 17 in spatial orientation information display screen 2A next.Geometrical property configuration part 5 is set as the size of the arrow of this image information object, the texture information that will show in this arrow etc.In spatial orientation information display screen 2A, show after the arrow 17, the change in location of arrow can be arrived any position, and can be set the more position of expectation.

At last,, and read this information, so that can realize the function expected by information presentation device by the above-mentioned information of data output section 4 output.

In the case, need to set the position and the state of the arrow that will show in mark the place ahead, so that use the terminal user of this information presentation device can easily see this arrow, as in the present embodiment, in spatial orientation information display part 2, show in this position and the state, they are set.Therefore can be according to their Rankine-Hugoniot relations between the two of more suitable condition enactment.For example, when the size of marks or shape are set in geometrical property configuration part 5, can discern the condition of this mark based on failure pattern picture not easily and set this mark.When the size of setting image information object (be arrow at this), shape etc., can set image information object (is arrow at this) by this way, that is, make the terminal user easily see object, for example prevent that arrow is excessive and exceed the screen of PDA.Can change the shape of object in the mode of seeing object orientation easily, perhaps set three-dimensional arrow.

[the 4th embodiment]

Next with reference to the data authoring device of Fig. 7 description according to fourth embodiment of the invention.In the data authoring device according to present embodiment, spatial orientation information display part 2 shows the spatial orientation information a of above-mentioned object, the spatial orientation information a of predetermined labels and this three of spatial orientation information a of image information object in screen.In addition, be provided with the geometrical property configuration part 5 of geometrical property of the spatial orientation information of the spatial orientation information a of any setting predetermined labels and image information object.

In addition, the PDA with video camera is assumed to be the information presentation device as object.In addition, consider that input pastes the situation of the image of mark on the wall, and see that therefore 3DCG personage appears at from wall the position of distance is slightly arranged.

Present embodiment is the data authoring device that is used for information presentation device (PDA with video camera) that satisfies above-mentioned functions.

When the display screen 10 of hypothesis on the PC as shown in Figure 7, and the wall 18 in spatial orientation information display screen 2A near when clicking the mouse right button, the dialog box 5A of mark preparation appears being used for.When appointment is carried out mark when preparing, show tags 16 in spatial orientation information display screen 2A.In addition, in display screen 10, the screen of the geometrical property of display setting mark (also being used as the geometrical property setting screen (being used for mark, personage) of relevant information setting screen 5D) (being equivalent to geometrical property configuration part 5).Also as the geometrical property setting screen (being used for mark, personage) of relevant information setting screen 5D, set the size of mark, the texture information that will in mark, show etc. at this.When setting the geometrical property of mark, the geometrical property of the mark 16 that shows in spatial orientation information display screen 2A also changes.After in spatial orientation information display screen 2A, having shown mark, the position change of this mark can be arrived any position, and can be set the more position of expectation.

After setting this mark, when related information setting section 3 when specifying 3D personage as output, shows 3D personage 19 at setting screen (also being used as the geometrical property setting screen (being used for mark, personage) of relevant information setting screen 5D in the present embodiment) in spatial orientation information display screen 2A.Geometrical property configuration part 5 is set as the personage's of this image information object size etc.After in spatial orientation information display screen 2A, having shown personage 19, personage 19 position the optional position can be able to changed to, and the more position of expectation can be set.

At last, when by the above-mentioned information of data output section 4 output, and when reading above-mentioned information, can realize the function of expecting by information presentation device.

Under the situation of the desired function that will realize information presentation device, consider such as " position of wall that can binding mark ", " with mark be placed as make use the terminal user of this information presentation device can see it easily ", the each point of " position and posture that the personage is manifested; this has improved directional effect " and " when confirming this mark, whether seeing whole personage ", the essential Rankine-Hugoniot relations of setting between " wall ", " mark " and " personage ".

Therefore, in present embodiment, when in the time of three-dimensional ground display message in spatial orientation information display part 2, setting three's spatial orientation information, easily concern when can visually confirm the premises based on the position between the more suitable condition enactment three.

In addition, present embodiment has the geometrical property configuration part 5 of the geometrical property of any setting mark and image information object.Because can suitably set the size, shape of mark etc., thus can be based on not damaging scene easily the condition of identification marking mark is set.When the size of suitably setting the image information object, direction etc., can set object by this way, that is, use the terminal user of this information presentation device can easily see this object.For example, prevent that the personage is excessive or exceed the PDA screen.Alternatively, the posture of object can be set by this way, personage's face can be easily seen.Therefore, have such effect, present at operation information under the situation of device, improve performance in the mode of the output that obtains expectation.

[the 5th embodiment]

Next data authoring device according to fifth embodiment of the invention will be described.

In the present embodiment, geometrical property comprises bulk, rotation and shape, and can adjust the geometrical property of object, mark and image information object in geometrical property setting screen 5E shown in Figure 8.As for the effect when the size change of carrying out mark according to the environment for use of mark recognition performance or information presentation device, rotational transform and the shape conversion, can adjust in the mode of the output that can obtain more to expect.When the size change of carries out image information object, rotational transform and shape conversion, set image has following effect: the image that occurs in the information presentation device is in sight easily, perhaps can see in the screen portions more and showing (for example personage's face etc.).In addition, when the size change of carrying out object, rotational transform and shape conversion, practical object is changed/processes, flag settings is got in sight easily, and can improve directional effect actual the utilization in the occasion.

[the 6th embodiment]

Next, with the data authoring device of describing according to a sixth embodiment of the invention.

As shown in Figure 9, according to present embodiment data authoring device except structure, also comprise Optimization Dept. 6 according to the data authoring device of second embodiment.This Optimization Dept. 6 has automatic setting control function, so that the surface of mark spatially contacts with the surface of object.

That is, consider usually to use under the situation of information presentation device, mark is sticked on the practical object in reality.In the present embodiment, when show tags and object in spatial orientation information display part 2 appointed object want the part of binding mark the time, can be so that this mark and the surperficial contacted mode that is pasted with this mark on it automatically be provided with this mark.

Particularly, described in above-mentioned embodiment, when click right mouse button came assigned tags to prepare in the adjacent domain of the wall in spatial orientation information display screen 2A, this mark occurred.In the case, after mark occurring, click right selects wall to paste, so that with the contacted mode of this wall mark to be set.As inter-process, can be arranged in such a way mark, promptly from by operator's appointment of data authoring device to light normal vector (normal vector) consistent with the normal vector of labeled surface.

Consideration is for example carried out demonstration by three-face view and skeleton view in spatial orientation information display part 2.Yet, operator mark being pasted under the situation on surface by this view of incompatibility, possible mark tilts slightly or leaves.Even concerning the operator who adapts to this view, when mark quantity increased, trouble also increased thereupon, and pasted very effort.If utilize the simple assigned operation as present embodiment that mark is pasted on the surface, even then mark quantity increases, any operator also can easily set demonstration, and need not too much experience.

[the 7th embodiment]

Next data authoring device according to seventh embodiment of the invention will be described.

According to present embodiment, the Optimization Dept. 6 of data authoring device has the spatial orientation information based on the characteristic of information presentation device and environment for use and image information object, the function of the area of space of automatic setting mark.

Particularly, as shown in figure 10, when set will be by spatial orientation information display part 2 displays image information object in spatial orientation information display screen 2A locus (supposing that it is an image information object's position 20) time, according to the data of the camera position (being assumed to be information presentation device position 21) of the field angle data of the video camera of information presentation device and hypothesis, demonstration will be provided with the zone (satisfied mark setting area 22) of mark.The appropriate location of the operator of data authoring device in satisfied mark setting area 22 is provided with mark.In spatial orientation information display screen 2A, show: be subjected to ambient light to influence little position, position (mark is provided with prohibited area 23) that should not actual binding mark, position that can binding mark etc. as lower area.

Mark is being pasted on the practical object so that when using information presentation device in practice, the vital point that influences the ability of information presentation device is to consider " binding mark somewhere; its terminal user that can easily be used this information presentation device is seen ", " binding mark somewhere; make it not be subjected to the influence of extraneous light and discerned easily ", " binding mark makes the personage to occur at assigned address " or the like somewhere.In as present embodiment, automatically set when the position of mark is set, can only mark be set in the operation that mark pastes on this zone by operator by data authoring device.Therefore, can more easily set demonstration, and needn't when adjusting mark, use actual information presentation device to carry out at every turn and confirm to test.

[the 8th embodiment]

Next data authoring device according to eighth embodiment of the invention will be described.

According to present embodiment, the Optimization Dept. 6 of data authoring device has based on the characteristic of information presentation device and the spatial orientation information of environment for use and mark, the function of the area of space of automatic setting image information object.

Particularly, as shown in figure 11, when in spatial orientation information display screen 2A, setting the locus (supposing mark position 24) of wanting binding mark by spatial orientation information display part 2, according to the field angle scope and the hypothesis camera position (suppose information presentation device position 21) of the video camera of information presentation device, allow to occur the setting area (the object setting area 25 of being satisfied with) of image information object.The operator of data authoring device is provided with the image information object in the appropriate location in satisfied object setting area 25.Can show below zone (object is provided with criteria range 26) in spatial orientation information display screen 2A, the condition under the situation that allows to occur the image information object under the condition (object contacts with practical object or be not overlapping) of expectation is satisfied in this zone.

When reality is used information presentation device, allowing to occur under the situation of image information object, the main aspect that influences the performance of information presentation device is to consider " where the personage being set; want to occur in the actual mark of pasting so that make character image clap to get at video camera ", " make personage can spatially not occur " with the overlapping mode of actual post (column), " make the personage to occur 1 " in the mode that spatially contacts with actual ground, " make the personage to occur, become not remarkable " etc. thereby be marked on the screen of information presentation device in the mode that covers mark.

When as in the present embodiment, automatically set when the position of image information object will be set, can only the image information object be set in the operation that object pastes this zone by operator by data authoring device.Therefore, can more easily set demonstration, and needn't when adjust the image information object at every turn, use actual information to present the device execution and confirm to test.

[the 9th embodiment]

Next, with the data authoring device of describing according to ninth embodiment of the invention.

According to present embodiment, the Optimization Dept. 6 of data authoring device sets the position with respect to object when the relative position that keeps mark and image information object is constant.Particularly, as shown in figure 12, can in spatial orientation information display screen 2A, keep the relative position of mark and image information object constant by space orientation display part 2 in, set position with respect to object.

Use in reality under a lot of situations of information presentation device, mark and image information object are handled as a pair of notion.For example, as shown in figure 13, when the image of information presentation device input marking, the direction arrow in screen, occurs, mark 16 and the arrow 17 that occurs are set at a pair of notion, make and see them easilier.In the case, particularly, for example, in the procedure for displaying in spatial orientation information display screen 2A, can when the relative position that keeps mark 16 and image information object (arrow 17) is constant, set position with respect to object.So, can set the position of mark and image information object simultaneously, and needn't set these positions in succession.

When keeping mark and relative position between the image information object constant, setting is during with respect to the position of object, can be only operator by data authoring device the position of setting both is simultaneously set in this paired position.Therefore, can set the position of mark and image information object simultaneously, and needn't set these positions in succession, can more easily set demonstration thus.

[the tenth embodiment]

Next, with the data authoring device of describing according to tenth embodiment of the invention.

According to present embodiment, as shown in figure 14, data authoring device also comprises demonstration efferent 7 except comprising the structure according to the data authoring device of above-mentioned the 6th embodiment.This demonstration efferent 7 has can be in the function of demonstrating before information presentation device output information.

Particularly, in the data authoring device according to present embodiment, preparation has a pattern that is called demo mode, thereby demonstration efferent 7 can be confirmed in the position of expectation or with the output of field angle.

That is, can in the time, confirm output to a certain extent at the display setting of spatial orientation information display part 2 from information presentation device.Yet, arranging the output order, and observe according to this order under the situation of output, perhaps when someone is desirably in the street of the virtual real world of passing by, confirm under the situation of these outputs, as in the present embodiment, demonstration efferent 7 is set separately carries out demonstration, thereby and can experience the output that more presents device near real information.

In addition, the purpose of spatial orientation information display part 2 is limited to and is convenient to export setting.About object, mark and image object, the few relatively spatial orientation information of output data quantity only, and under situation about not showing, set detailed texture information with big data quantity.Therefore, can improve the speed of calculating.In the case, can the demonstration efferent 7 in exhibit textural information so that carry out last inspection.

[the 11 embodiment]

Next, with the data authoring device of describing according to eleventh embodiment of the invention.

According to present embodiment, as shown in figure 15, data authoring device also comprises image information property settings portion 8 except comprising the structure according to the data authoring device of the tenth embodiment.This image information property settings portion 8 sets the image information characteristic of image information object and predetermined labels arbitrarily.

Particularly, for image information object or predetermined labels,, can also set various image informations such as color of image, brightness, picture size, colour and monochrome information, form type and character script etc. except geometrical property.

Thereby, can set visual information substantially, for example " the desired image information object is compared more remarkable with background " and " the expectation mark is compared with background has inapparent color ".Therefore, can improve the performance that actual information presents device.

[the 12 embodiment]

Next data authoring device according to twelveth embodiment of the invention will be described.In the present embodiment, image information to as if having an image of three-dimensional coordinate.

That is, when the output image information object, the spatial disposition of exporting this object is prior aspect, but uses the situation of three-dimensional coordinate specific to image, and the mode that this image occurs is very big because of arrangement or posture difference.In this case, when the spatial orientation information of displays image information object in spatial orientation information display part 2 when carrying out display setting, operator by data authoring device easily carries out setting, and can adjust in the mode that obtains the more output of expectation in addition.That is, the spatial orientation information of use is not limited to two dimensional surface, can easily set any processing, and the operator can adjust in the mode that obtains desired output.

[the 13 embodiment]

Next, description is according to the data authoring device of thriteenth embodiment of the invention.In the present embodiment, the image information object has Word message.

That is, in information presentation device, can in three-dimensional CG, prepare literal three-dimensionally,, perhaps make the plane of the certain size that comprises Word message (virtual signboard etc.) can in the space, occur and show so that this literal in the space, occurs and show.In a word, set to show by this way, that is, make the output that in the procedure for displaying of spatial orientation information display part 2, obtains expectation.Note, under the situation of display text information (may comprise image information) on the whole screen of information presentation device, needn't consider spatial orientation information.Therefore, can in related information setting section 8, set " whole screen display ", and needn't in spatial orientation information display part 2, show any information.

[the 14 embodiment]

Next, with the image creation equipment of describing according to fourteenth embodiment of the invention.In the present embodiment, can set at least two predetermined related information with respect to the object or the same predetermined labels of same real world.

In the case, for example, even, also can set according to the time in such a manner utilizing information presentation device to see under the situation of this same mark, that is, to the right arrow occur in the morning and left arrow occur at night.

[the 15 embodiment]

Next, with the data authoring device of describing according to fifteenth embodiment of the invention.In the present embodiment, can be according to respect to the object of same real world or the predetermined association of same predetermined labels, the output of a plurality of same types with different pieces of information capacity is set.

That is, consider following situation: as the object of information presentation device, preparation realizes all PC patterns, PDA pattern and the portable phone pattern of similar functions.In the case, carrying out data creation for each device is consumption power.Yet performance is according to each equipment and difference, and especially memory span and graphics process performance have very big difference.Therefore, in addition the predetermined related information of same type also have to prepare by different capacity.For example, change the polygon number among the 3DCG, perhaps conversion texture capacity.Yet creating again for each device execution data is consumption power.Therefore, as in the present embodiment,, then can only carry out and once create and operate each device if can set the output of a plurality of same types according to predetermined association with different pieces of information capacity.

[the 16 embodiment]

Next, with the data authoring device of describing according to sixteenth embodiment of the invention.According to present embodiment, as shown in Figure 16, data authoring device also comprises the output attribute information setting portion 9 that can set output attribute information except comprising the structure according to the data authoring device of the 11 embodiment.

At this, exist following message as the output attribute information that can set by output attribute information setting portion 9: the timing of output information (after seeing mark immediately or after the certain hour), sound size (whether exporting big volume), the brightness of the image of exporting (when outdoor application, brightening), the resolution of the image of exporting (device performance according to information presentation device changes), the data volume of the image of exporting (changing) according to object type, and by the characteristic of information presentation device or the information (color is along with the screen type of information presentation device changes) of environment for use definition.

Because present embodiment has the output attribute information setting portion 9 that can set these output attribute information, so can adjust so that can export the more relevant information of expectation.

[the 17 embodiment]

Next the 17th embodiment of the present invention will be described.According to the structure of the data authoring device of present embodiment and similar according to the data authoring device of above-mentioned first embodiment.

In the present embodiment, from the three-dimensional design information in signboard and shop, extract the spatial orientation information a (three-dimensional coordinate data in OO market) of the object among above-mentioned first embodiment and the spatial orientation information a of predetermined labels by three-dimensional CAD.

Particularly, design signboard and shop in three-dimensional CAD, and " mark " is set at attribute information in the three-dimensional design information of signboard.Note, make/be provided with the required various types of information of object, for example shape, color, material, title, component names, and coordinate in this three-dimensional design information representation.To be called shape information from the information about shape, coordinate etc. of three-dimensional design information extraction, and the information of being extracted about attribute except above-mentioned shape information (for example color, material, title and component names) will be called attribute information.

In addition, in data authoring device according to present embodiment, spatial orientation information input part 1 reads the three-dimensional design information in signboard and shop by three-dimensional CAD, and extracts the spatial orientation information a (three-dimensional coordinate data in OO market) of object and wherein " mark " is set at the spatial orientation information a (coordinate data of signboard) of the signboard of attribute information.On spatial orientation information display part 2, show the spatial orientation information a that is extracted.

In addition, related information setting section 3 reads the three-dimensional design information in signboard and shop by three-dimensional CAD, and extracts the predetermined related information b such as the shape and the title of object or signboard.In spatial orientation information display part 2, show the predetermined related information b that is extracted.

Since identical among subsequent treatment and first embodiment, so the descriptions thereof are omitted.

[the 18 embodiment]

Next, the 18th embodiment of the present invention will be described.According to the structure of the data authoring device of present embodiment and similar according to the data authoring device of above-mentioned first embodiment.

For example, mark is set so that carry out related (registration) of the real space (as coordinate system intrinsic in the object) and the model space (as intrinsic coordinate system in the three-dimensional design information of object).Use three-dimensional CAD, side by side design this mark with the design of object.That is, at first, use three-dimensional CAD to prepare the three-dimensional design information of object.Next, the three-dimensional design information of preparation mark.For example, for this mark, component names is set at " mark ".Object and mark are arranged in the model space coordinate system of three-dimensional CAD.

The spatial orientation information display part 2 of data authoring device reads in the three-dimensional design information of the object for preparing in this three-dimensional CAD and the three-dimensional design information of mark, and extracts each spatial orientation information a from three-dimensional design information.Output is used for the data of information presenting device based on this spatial orientation information a.Particularly, the spatial orientation information input part 1 of data authoring device extracts from the three-dimensional design information of object and mark has the information of component names " mark ", and from its component names for extracting the coordinate data of mark shape, mark title and mark the three-dimensional design information of " mark ".From its component names is shape, the title of mark and the coordinate data of mark of extracting object the three-dimensional design information of " mark ".Similarly, from the three-dimensional design information of object, extract shape, the title of object and the coordinate data of object of object.The coordinate data of mark and the coordinate data of object are spatial orientation information a separately.The shape of the shape of mark, the title of mark, object and the title of object are the predetermined related information b that shows in information presentation device, and are imported in the related information setting section 3.

Alternatively, related information setting section 3 reads in the three-dimensional design information of the object for preparing in the three-dimensional CAD and the three-dimensional design information of mark, and can extract their predetermined related information b from this three-dimensional design information.

Note, need to stick in the real world so that in information presentation device, show relevant information by the mark that data authoring device is set, and object from three-dimensional CAD and the acquisition of the Rankine-Hugoniot relations between mark paste position.By utilizing information that mark is arranged in the real world about the Rankine-Hugoniot relations in this three-dimensional CAD.

At this, under situation about mark being sticked on first on the real world, revise object and the relation between the mark (position and posture) in the model space, and carry out the registration of the real space and the model space thus.

Figure 17 A to 17C shows the figure of the shape information (17C) of object (17A), show state (17B) and the object before finishing log-on operation under the situation of binding mark first.Take for object 28 (Figure 17 A), so that obtain the image 27A of mark and the image 28A (17B) of object to its binding mark 27.In addition, produce the model 31 and the object model 32 of mark according to the shape information 29 of mark and the shape information 30 of object (Figure 17 C), and it is overlapping and be presented on the screen 33.At this moment, because mark 27 is used as benchmark, so the image 27A of mark is consistent with the shape information 29 of mark.Therefore, although the image 27A that shows in the screen 33 is consistent with the model 31 of mark, still the image 28A and the object model 32 of replacement and display object.At this moment, because can not move the mark of having pasted 27, so with respect to the position and the posture of the shape information of shape information 30 movement indicias 29 of object, so that obtain shape information 29 '.

Figure 17 D to 17F shows the figure of the shape information (17F) of object (17D), show state (17E) and object after finishing log-on operation.According to log-on operation, the mobile model 31 ' of the image 27A of the mark that shows in the screen 33 and its mark is consistent, and the image 28A of object also with object model 32 consistent (Figure 17 E).In addition, in the time of in the shape information 29 ' of the above-mentioned mark after will moving (Figure 17 F) input space locating information input part 1, can extract with in fact stick on object 28 on the consistent spatial orientation information a of mark 27.

In addition, when binding mark after a while, revise object and the relation between the mark (position and posture) in the real space, and carry out the registration of the real space and the model space thus.

Figure 18 A to 18C shows under the situation of binding mark after a while, the figure of the shape information (18C) of the object before finishing log-on operation (18A), show state (18B) and object.Take for object 28 (Figure 18 A), so that obtain the image 27A of mark and the image 28A (18B) of object to its binding mark 27.Produce the model 31 and the object model 32 of mark in addition according to the shape information 29 of mark and the shape information 30 of object (Figure 18 C), and with its overlapping being presented on the screen 33.At this moment, because mark 27 is used as benchmark, so the image 27A of mark is consistent with the shape information 29 of mark.Therefore, although the image 27A of the mark that shows in the screen 33 is consistent with the model 31 of mark, still the image 28A and the object model 32 of replacement and display object.Therefore, when moving the position of real marking 27 with respect to object 28, object 28 mates with the shape information 30 of object.That is, the position of image observation device movement indicia 27 is so that in the image 28A and object model 32 of the reference object that shows in observation screen 33, make image and object model all mate.

Figure 18 D to 18F shows the figure of the shape information (18F) of object (18D), show state (18E) and object after finishing log-on operation.According to log-on operation, the image 27A of the mark that the warp that shows in the screen 33 moves is consistent with the model 31 of mark, and the image 28A of object also with object model 32 consistent (Figure 18 E).

Described the present invention, but the invention is not restricted to the foregoing description, and obviously, can carry out various improvement and application within the scope of the invention based on embodiment.

For example, in the above-described embodiments, for convenience, be represented as seemingly by picture that these pictures are independently in GUI, but various piece (each screen) can mix and be arranged in the same window such as the operation of the various piece of spatial orientation information display part 2, geometrical property configuration part 5 and related information setting section 3.Can prepare GUI, so that the operator of data authoring device uses when realizing each function.

In addition, also consider the function that data authoring device of the present invention is provided by the network such as the Internet.In the case, when in information presentation device, storing or reading the data c that describes display setting, can wait to concentrate utilization rate by charge.

In addition, in the 17 and the 18 embodiment, prepare three-dimensional design information according to three-dimensional CAD, but obviously, can use the two-dimensional design information (XY one plane, XZ-plane and YZ-plane) of utilizing two-dimentional CAD preparation, and can be three-dimensional design information (XYZ plane) the two-dimensional design information translation.In addition, extract spatial orientation information, but obviously, can utilize three-dimensional CAD in attribute information, to describe spatial orientation information (for example coordinate data) in advance, and can extract it according to shape information.

[the 19 embodiment]

The 19th embodiment of the present invention will be described.In the present embodiment, in the 7th embodiment that reference Figure 10 describes, provide the service condition of a kind of object-based spatial orientation information and information presentation device to determine the concrete grammar of label space locating information.At this, side by side prepare the information that is used to register the real world and the model space with the preparation of the design information of object.Particularly, when showing relevant information (for example the shape of object, title etc. is overlapping/show) near the object that will design in three-dimensional CAD, preparation is as the configuration information of the mark of benchmark, shooting condition etc.

Figure 19 shows the figure according to the structure of the data authoring device of the 19 embodiment.Spatial orientation information input part 100 is parts of the spatial orientation information of input object and/or predetermined labels, and corresponding with the spatial orientation information display part 2 of Fig. 9.Memory device 101 can be stored: camera head parameter 101-2, and it is the parameter of the camera head of composition information presentation device; The posture information 101-1 that is the camera head of now in information presentation device execution information; The spatial orientation information 101-3 of mark; The image information characteristic 101-4 of mark; And the spatial orientation information 101-5 of object.

Optimization Dept. 102 calculates based on the input information from the spatial orientation information 101-5 that comprises the object in the following message block at least of spatial orientation information input part 100 and is not input to the value of at least one remaining information in this message block and the scope that can extract this value as yet, and this message block comprises: camera head parameter 101-2; The posture information 101-1 of camera head; The spatial orientation information 101-3 of mark; The image information characteristic 101-4 of mark; And the spatial orientation information 101-5 of object.Computing information efferent 103 is the data output section 4 corresponding parts with Fig. 9, and input value in the spatial orientation information 101 of the image information characteristic 101-4 of the spatial orientation information 101-3 of the posture information 101-1 of this output camera head parameter 101-2, camera head, mark, mark and object or the value that obtains from this input value.

At this, the spatial orientation information 101-5 of object comprises following two or more information: the posture information of object; Shaped size information; Camera watch region during execution information presents; The zone that camera head can exist; The posture information of the object at least in the zone of mark can be set.

In addition, as information, there is the image information characteristic of spatial orientation information, camera head parameter and the mark of object from 100 inputs of spatial orientation information input part.

In addition, camera head parameter 101-2 has following two or more information: the field angle of camera head, resolution, be used for the required number of pixels of identification marking, and the field angle and the resolution of image fault information at least.

In addition, the posture information 101-1 that is the camera head of now in execution information has positional information and the pose information that is now in execution information, and, have many positional informations and pose information when carrying out in many places under the situation be used for the shooting that execution information presents.

In addition, the spatial orientation information 101-3 of mark comprises and markd position and posture wherein is set and as the shape and size of the mark of geometrical property information.

In addition, the image information characteristic 101-4 of mark comprises the attribute and the type of mark, is mainly texture information.

Figure 20 is the key diagram according to the function of the data authoring device of nineteenth embodiment of the invention.At first, in the message block of the spatial orientation information 101-5 of the image information characteristic 101-4 of the spatial orientation information 101-3 that comprises the posture information 101-1 of camera head parameter 101-2, camera head, mark, mark and object, for example the spatial orientation information 101-5 and the camera head parameter 101-2 of object is input to (step S11) in the Optimization Dept. 102 as input parameter by spatial orientation information input part 100.The not rest parameter (at this, the image information characteristic 101-4 of the posture information 101-1 of camera head, the spatial orientation information 101-3 of mark and mark) (step S12) of input is calculated as yet with reference to memory device 101 by Optimization Dept. 102.Next, the parameter (step S13) that calculates from 103 outputs of computing information efferent.

After this concrete application example of above-mentioned data authoring device will be described.Consider factory, automobile navigation device, construction site etc., but will describe situation in the factory as example at this.

Figure 21 shows the demonstration example of the inside plants of seeing from above.At this, consider the configuration information, shooting condition of preparation mark etc. etc., this mark is near the shape of object, title etc. are overlapping/benchmark when being presented at the various objects (buildings) that utilize the three-dimensional CAD design.

At first, by input from spatial orientation information input part 100, memory device 101 storages: the position and the shape information of the object 139 to 143 shown in Figure 21; And the surperficial 139-1 to 143-1 (representing) of each object of checking with needs and overlooker 146 the relevant information of route via 145-1 to 145-4 (representing) by the thick arrow among the figure by the thick line among the figure.In addition, memory device 101 store in inspection, use such as the field angle of camera head and the camera head parameter of resolution.In memory device 101, also store other useful information about mark.Optimization Dept. 102 determines that according to the various information of storage in the memory device 101 best camera position and direction, the mark checked is provided with position and posture, and label size and type, and via computing information efferent 103 output foregoings.

For example, when input information be position, posture and the shape information of object 139 to 143; The surperficial 139-1 to 143-1 that needs each object 139 to 143 of inspection; The zone of mark can be set; And during overlooker 146 route via, the camera head parameter that the position of outgoing inspection shooting and direction, mark are provided with position and posture, label size and type and employed camera head is as the remaining information of input not as yet.

In the case, the information that export is not limited to a kind of mode, exports the information of certain limit sometimes.When overlooker 146 takes all factors into consideration when coming to select particular value from the scope that will export such as the number of the mark of needs setting and size, can easily determine the setting relevant with shooting with this mark.Also can respond input and from the customizing messages scope of being exported, specify a particular value or narrower range, and recomputate the value or the scope that can obtain by remaining information.

In addition, as another example, when input information is the camera head parameter; Position, posture and the shape information of object 139 to 143; The surperficial 139-1 to 143-1 that needs each object 139 to 143 of inspection; The zone of mark can be set; And during overlooker 146 route via 145-1 to 145-4,, and check camera position and direction as the remaining information of input and the information exported is that mark is provided with position and posture, label size and type not as yet.When needs use a plurality of mark, calculate the marker combination that wherein is not easy to occur identification error from the type of being registered.This comprises such meaning: calculate the position of a plurality of marks and the relation of posture by this way, that is, can prevent to select except judgement to have the group echo of highly similar texture, also with the posture information of high precision computation camera head more.For example, calculate under the situation of the position of camera head and posture at a plurality of marks from the image of taking by camera head, when the difference between the coordinate figure of the XYZ of camera coordinates system of camera head is big as far as possible for the relation of the position between a plurality of marks, can calculate the position and the posture of camera head.This is because a plurality of marks can be handled as a big mark.Especially, the situation that the difference of the relation of the position between a plurality of marks on the Z-direction (camera head depth direction) is big is preferred for position and the posture of calculating camera head with satisfied degree of accuracy.Under the situation of calculating the marker combination that is not prone to identification error, as mentioned above, the position relation between a plurality of marks is a criterion.

Figure 22 shows the example that the information when realizing computing information efferent 103 by display device presents.Near each object 139 to 143, show mark 150 to 155.Video camera 165 is shown as the camera head with the visual field A that can take object 140 and mark 151.Also show video camera 164 with the visual field B that can take object 141 and mark 152.Also show video camera 163 with the visual field C that can take object 142 and mark 153.Also show video camera 162 with the visual field D that can take object 143 and mark 154.Also show video camera 160 with the visual field E that can make a video recording to object 143 and mark 154,155.Also show video camera 160 with the visual field F that can make a video recording to object 139,140 and mark 150,151.

In addition, output information needs not to be the two-dimensional signal shown in Figure 21,22, and in response to from the input of spatial orientation information input part 100 and watch from any viewpoint under the situation of object 139 to 143, can output image.Figure 23,24 shows an example of image output in this case.The CAD that Figure 23 illustrates emulation shows, and the position 201 that mark will be set is shown.Figure 24 is illustrated in the demonstration of the photographic images in the real space, and shows pasted mark 150 on wall.

According to the 19 above-mentioned embodiment, because presented the configuration information and the shooting condition of mark etc. in advance, so can reduce the step number that mark is set in mark setting operation (presenting preparation as information) significantly.

[the 20 embodiment]

After this 20th embodiment of the present invention will be described.The 20 embodiment relates to support is provided with mark based on the spatial orientation information that sets mark operation.More specifically, the spatial orientation information based on mark is provided with first mark.Use information presentation device at this first mark.This information presentation device presents second and the spatial orientation information of follow-up mark according to the same way as in presenting with the information that relates to object (mark is considered as object), and supports the setting of mark.

Figure 25 shows the figure according to the structure of the information presentation device of the 20 embodiment.Memory device 301 can be stored: the camera head parameter 301-2 of parameter that presents the camera head of device as configuration information; The posture information 301-1 that is the camera head of now in information presentation device execution information; The spatial orientation information 301-3 of a plurality of marks; The image information characteristic 301-4 of a plurality of marks; And the spatial orientation information 301-5 of object.302 pairs of images that comprise a following mark at least of camera head are made a video recording, and this mark is present in the camera watch region in the real world and known its position and posture with respect to reference mark as benchmark.Computing equipment 303 calculates the posture information of camera head 302 according to the photographic images and the information in the memory device 301 that comprise the mark of being taken by camera head 302.Display device 304 is carried out the overlapping demonstration of photographic images and information.At this, in display device 304, not the reference mark that shows in a plurality of marks, but the spatial orientation information of show tags.Input media 300 is used for revising at least one among the image information characteristic 301-4 of the spatial orientation information 301-3 of mark of memory device 301 and mark.

The spatial orientation information that can in display device 304, show in addition, the reference mark mark that also is not provided with in addition in a plurality of marks.

In addition, can also in display device 304, show the spatial orientation information that mark is set beyond the reference mark in a plurality of marks.

Figure 26 is the key diagram according to the function of the information presentation device of twentieth embodiment of the invention.At first, 302 pairs of marks as benchmark of camera head are taken (step S21).Next, computing equipment 303 calculates the position and the posture (step S22) of camera head 302 according to captured marking image.Next, computing equipment 303 reference storage device 301 produce by next mark position pose information being superimposed upon the image (step S23) that obtains on the photographic images.Next, in display device 304, show the superimposed image (step S24) that is produced.

After this concrete application example of above-mentioned information presentation device will be described.Figure 27 shows the figure of the operation of the PDA 500 with the video camera 502 that communicates by WLAN and data server 503.When the user utilizes 502 pairs of marks that have been provided with of video camera to take, PDA 500 will send to data server 503 by WLAN by taking the marking image that obtains.Data server 503 calculates the position and the posture of video camera 502 according to the spatial orientation information of the degree of reflection of transmission mark, the kind of storage mark, and mark.Server sends image with institute and is assumed to be reference mark, and the spatial orientation information of the kind of another mark and this mark is superimposed upon on the reference mark producing image, and image is turned back to PDA 500.Go up at the display screen (is LCD at this) of the display device 501 of PDA500 and to show the image that is received.

The figure of operation that Figure 28 shows reference mark 400 and stack and show waits to be provided with the position 402 of next mark on this reference mark 400.The user can see the kind of the mark that shows in display screen, and the spatial orientation information of waiting to be provided with the current mark of next mark.

Note, under the situation of the spatial orientation information that does not comprise another mark in the shooting image that in display screen, shows, as shown in figure 29, show with to the relevant order 401 of which direction mobile camera 502.

Note, can carry out the position of video camera and the calculating of posture in data server 503 sides or in the PDA500 side, and the generation of information stack image.Present embodiment is not limited to the form such as PDA500 and data server 503.PDA 500 can be connected to data server 503 by cable, and PDA 500 can be notebook PC.Data server 503 can be installed among the PDA500.

In addition, in PDA 500, video camera 502 needn't combine with display device 501 as shown in Figure 27, and video camera 502 can be separated with display device 501.Therefore, video camera 502 can be set to the position that object is taken, and can be when display device 501 being shifted to the position of waiting to be provided with mark and observing display screen the independent mark setting operation of carrying out.

In addition, when in projector etc., showing the content identical with up-sizing, can easily see the command information that is used for the mark setting with the displaying contents that shows among the PDA 500.

According to above-mentioned the 20 embodiment, because in information presents in the prearranged mark setting operation, present the position of waiting to be provided with next mark based on reference mark, thus the error during mark is provided with reduced, and significantly reduced the step number that mark is set.

(being also noted that)

Can from above-mentioned specific embodiment, extract the present invention of following structure.

(1) a kind of data authoring device, its setting is used for the predetermined related information of information presentation device, so that by utilizing the spatial orientation information of being represented by the object and/or the predetermined labels of real world to export this predetermined related information, this equipment comprises:

The spatial orientation information input part, the spatial orientation information of its input object and/or predetermined labels;

Related information setting section, it sets the method that shows predetermined related information;

The spatial orientation information display part, it shows by the object of spatial orientation information input part input and/or the spatial orientation information of predetermined labels, and it shows predetermined related information according to the display packing by related information setting section sets; And

Data output section, the data of the display setting that shows by the spatial orientation information display part are described in its output.

(corresponding embodiment)

The embodiment relevant with this data authoring device of describing in (1) is corresponding to the first to the 16 embodiment.

(function and effect)

The function and the effect of this data authoring device described in (1) will be described with reference to figure 1.As example, the desired function of supposing information presentation device (is the PDA with video camera at this) be " expectation is when utilizing the PDA with video camera to see the signboard in OO market; by overlapping on the shop of CG in the PDA screen and show the personage, and see this personage say ' welcome! .The data authoring device that uses description to this is as an example.

At first, the object of spatial orientation information input part 1 input real world and/or the spatial orientation information a of predetermined labels.At this, the three-dimensional coordinate data in spatial orientation information a and OO market and the coordinate data of signboard are corresponding.Subsequently, display space locating information a in spatial orientation information display part 2.The operator of data authoring device sets predetermined related information b in related information setting section 3 when confirming spatial orientation information a.At this, predetermined related information and people's 3DCG data and say that the voice data of " welcome " is corresponding.Set output by this way,, and when signboard being input in the screen of information presentation device, the personage occurring and sound " welcome " promptly when people's 3DCG data are set on the shop.The data c of display setting is described by data output section 4 outputs subsequently.At this, suppose in e-file, to have described these data, and by reading this e-file as the information presentation device that utilizes object.Finally, realized the desired function of information presentation device (PDA that has video camera herein).

In this data authoring device of in (1), describing, in order to set predetermined related information, display space locating information a in spatial orientation information display part 2, and the operator of data authoring device can set predetermined related information b in related information setting section 3 when confirming spatial orientation information a.Therefore, used spatial orientation information is not limited to two dimensional surface (in this example, when seeing signboard, the people occurs in the mode that stands on the shop), and can easily set any output.Because can confirm to vision spatial orientation information a and relevant information b simultaneously, so can carry out the emulation in the information presentation device simultaneously.Thereby, have following effect: can adjust to obtain the desired output of operator.

(2) according to the data authoring device of (1), wherein predetermined related information comprises the image information object, and

The spatial orientation information display part shows the spatial orientation information of this image information object.

(corresponding embodiment)

The embodiment relevant with this data authoring device of describing in (2) is corresponding to the first to the 16 embodiment.

(function and effect)

The function and the effect of this data authoring device of describing in (2) will be described.The relevant information b of this data authoring device of describing (2) comprises the image information object, and spatial orientation information display part 2 shows the spatial orientation information of this image information object.

When will in screen, presenting and during output image, the spatial disposition of exporting this image is prior aspect.Its mode very big-difference occurs because of posture.In the case, when the spatial orientation information of spatial orientation information display part 2 displays image information objects when carrying out display setting, the operator of data authoring device can be easy to carry out this setting, can judge to obtain more the mode of desired output in addition.That is, used spatial orientation information is not limited to two dimensional surface, can easily set any operation, and can adjust in addition to obtain the desired output of operator of data authoring device.

(3) according to the data authoring device of (1) or (2), the spatial orientation information of the spatial orientation information of spatial orientation information display part display object and predetermined labels wherein,

This equipment also comprises the geometrical property configuration part, and it sets in the spatial orientation information of the spatial orientation information of object and predetermined labels the geometrical property of at least one arbitrarily.

(corresponding embodiment)

The embodiment relevant with this data authoring device of describing in (3) is corresponding to the second to the 16 embodiment.

(function and effect)

The function and the effect of this data authoring device of describing in (3) will be described.In the spatial orientation information display part 2 of this data authoring device of in (3), describing, utilize the spatial orientation information of display object such as coordinate space and predetermined labels.In addition, this equipment has geometrical property configuration part 5, and it sets at least one geometrical property (referring to Fig. 3) of object and mark arbitrarily.

The example of predetermined labels comprises the two-dimensional encoded of the various projects of difference and can pass through the square mark (with reference to Fig. 4) of the position/orientation of acquisition observation camera such as calculating.In this data authoring device of in (3), describing, the spatial orientation information of display object and this mark in spatial orientation information display part 2.For example consider the mark that prints on paper or the plastics is sticked on the object, if but in the reality position of binding mark too showy, then this is unfavorable for scenery, if but can not input picture the time, then use information presentation device just nonsensical.Therefore, as this data authoring device of describing in (3), when the information of this two aspect is set when showing information aspect two in spatial orientation information display part 2 when, can easily come set information based on the condition that is more suitable for.(3) this data authoring device of describing in has geometrical property configuration part 5, and it sets at least one geometrical property of the spatial orientation information of object and mark arbitrarily.When geometrical property configuration part 5 is for example set label size, shape etc., can come setting property based on the condition that is more suitable for (for example, the condition of easy identification marking under the situation of not damaging landscape).

(4) according to the data authoring device of (2), wherein the spatial orientation information display part shows the spatial orientation information of predetermined labels and the spatial orientation information of image information object,

This equipment also comprises the geometrical property configuration part, and it sets at least one geometrical property of the spatial orientation information of the spatial orientation information of predetermined labels and image information object arbitrarily.

(corresponding embodiment)

The embodiment relevant with this data authoring device of describing in (4) is corresponding to the 3rd to the 16 embodiment.

(function and effect)

The function and the effect of this data authoring device of describing in (4) will be described.In the spatial orientation information display part 2 of this data authoring device of in (4), describing, show the spatial orientation information of predetermined labels and image information object.In addition, this equipment has geometrical property configuration part 5, and it sets at least one geometrical property of the spatial orientation information of predetermined labels and image information object arbitrarily.

In this information presentation device, consider to make a certain image information object appear at respect to the situation in the appropriate location of mark.For example, there is following situation, when the image of information presentation device input marking, overlapping the place ahead that is presented at mark of arrow to the right.

In the case, need be before mark desired location and posture that object is occurred, make and use the terminal user of information presentation device can easily see this object.

Thereby, in this data authoring device of in (4), describing, when setting the information of this two aspect in the information that in spatial orientation information display part 2, shows two aspects, can easily set between the two Rankine-Hugoniot relations according to more suitable condition.(4) data authoring device of describing in has geometrical property configuration part 5, and it sets at least one geometrical property of the spatial orientation information of object and mark arbitrarily.For example, when the size of the 5 pairs of marks in geometrical property configuration part or shape are set, can mark be provided with based on the condition of identification marking easily under the situation of not damaging landscape.When the size of setting the image information object, shape etc., can set image information object (being arrow to the right) by this way at this, promptly make to use the terminal user of information presentation device easily to see this object, for example, prevent that arrow is excessive and from screen, stretch out.Change the shape of object in the mode of the direction of seeing object easily, perhaps set three-dimensional arrow.

(5) according to the data authoring device of (2), the spatial orientation information of the spatial orientation information of the spatial orientation information of spatial orientation information display part display object, predetermined labels and image information object wherein,

This equipment also comprises the geometrical property configuration part, and it sets at least one geometrical property of the spatial orientation information of the spatial orientation information of spatial orientation information, predetermined labels of object and image information object arbitrarily.

(corresponding embodiment)

The embodiment relevant with this data authoring device of describing in (5) is corresponding to the 4th embodiment to the 16 embodiment.

(function and effect)

The function and the effect of this data authoring device of describing in (5) will be described.In the spatial orientation information display part 2 of this data authoring device of in (5), describing, show about the spatial orientation information of object, the spatial orientation information of predetermined labels and the spatial orientation information of image information object.In addition, this equipment has geometrical property configuration part 5, the geometrical property of at least one of the above-mentioned three kinds of spatial orientation informations of these geometrical property configuration part 5 any settings.

In this information presentation device, consider the situation of binding mark on respect to the appropriate location of object, and make the situation that the specific image information object occurs in the appropriate location with respect to mark.For example, when the image of the mark that will paste on wall is input in the information presentation device, in the position of leaving wall a little, see 3DCG personage occurring.

In the case, have to consider set Rankine-Hugoniot relations between " wall ", " mark 1 note " and " personage " somewhere such as the various aspects of " wall where can binding mark ", " place mark make use the terminal user of this information presentation device can easily see it ", " can improve the position and the posture that the personage occurs that make of direction effect " and " when confirming mark, whether seeing whole personage ".

In order to address the above problem, in this data authoring device of in (5), describing, when when in spatial orientation information display part 2, carrying out 3-D display, setting three's spatial orientation information, can be when visually confirming above-mentioned aspect, the position of easily setting between the three based on more suitable condition concerns.

In addition, this data authoring device of describing in (5) has at least one the geometrical property configuration part 5 of geometrical property of any setting object, mark and image information object.For example, when the size of suitable setting mark, shape etc., can mark be set based on the condition of under the situation of not damaging landscape, easily discerning this mark.When the size of suitable setting image information object, direction etc., use the terminal user of information presentation device to see object easily, the task that for example prevents is excessive or stretch out from screen, perhaps posture can be arranged so that and see personage's face easily.As the spatial orientation information of object, remove the part of masked segment, change the size of mark and mark is set easily discerning this mark, and processing being set and revising practical object according to change.Thus, has the effect of when reality is used information presentation device, improving the recognition performance of mark.

Therefore, all above-mentioned functions all have such effect of improving performance, thereby obtain the output of expectation under the situation of operation information treating apparatus.

(6) according to any one data authoring device in (3) to (5), wherein geometrical property has at least one in bulk, rotation and the shape.

(corresponding embodiment)

The embodiment relevant with this data authoring device of describing in (6) is corresponding to the 5th to the 16 embodiment.

(function and effect)

The function and the effect of this data authoring device of describing in (6) will be described.In this data authoring device of describing in (6), geometrical property has at least one of bulk, rotation and shape, and can adjust the geometrical property of object, mark and image information object.

As for effect, when as one man carrying out the size change, rotational transform of mark and shape conversion, can adjust to obtain the more output of expectation with the environment for use of mark recognition performance or information presentation device.When the alteration of form of carries out image information object, rotational transform and shape conversion, have the image setting that will occur in the information presentation device and get the effect of seeing easily, perhaps be shown as the easier effect of seeing (for example personage's face etc.) in screen portions.When the size change of carrying out object, rotational transform and shape conversion, use change/processing practical object in the scene in reality, flag settings is got see easilier, and can improve the direction effect.

(7) data authoring device of any in the basis (3) to (5), wherein the geometrical property configuration part has Optimization Dept., and it suitably sets geometrical property.

(corresponding embodiment)

To the relevant embodiment of this data authoring device of describing in (7) corresponding to the 6th to the 16 embodiment.

(function and effect)

The function and the effect of this data authoring device of describing in (7) will be described.(7) this data authoring device of describing in has Optimization Dept. 6, is used for suitably setting geometrical property in geometrical property configuration part 5, and can sets optimal conditions (referring to Fig. 9) in the process of the geometrical property of adjusting object, mark and image information object.In order to set optimal conditions, for example, provide following function: the size of adjusting mark or image information object according to the field angle of the video camera of the image input part of information presentation device; The candidate who presents the position of placing mark according to the visual field; Perhaps automatic binding mark on object.Note optimizing as used herein and not meaning that the acquisition optimal solution, but represent the wide in range meaning, promptly proposed several better condition, several solutions of the performance that perhaps automatically is improved.

Because can come to set geometrical property based on optimal conditions by the function by Optimization Dept. 6 by this way, so have following effect: the operator of data authoring device can the easier output of setting expectation in information presentation device.

(8) according to the data authoring device of (7), wherein said Optimization Dept. has the function that mark and object are set as follows automatically, that is, the surface of mark spatially contacts with the surface of object at least.

(corresponding embodiment)

The embodiment relevant with this data authoring device of describing in (8) is corresponding to the 6th to the 16 embodiment.

(function and effect)

The function and the effect of this data authoring device of describing in (8) will be described.In this data authoring device of describing in (8), Optimization Dept. 6 has the function that mark is set automatically in the surface of mark surperficial contacted mode spatially automatic and object.Usually consider when reality is used information presentation device, mark to be sticked on the practical object.In this data authoring device of in (8), describing, when specifying the object part that to paste in the process of show tags and object in spatial orientation information display part 2, mark to be set automatically with the surperficial contacted mode that will paste.Particularly, when object surface is wall, mark to be set from the normal vector of the point of the operator's appointment by data authoring device and the corresponding to mode of normal vector of labeled surface.In spatial orientation information display part 2, consider to carry out and show by for example three surface view or skeleton view, but when the operator of uncomfortable this view from the teeth outwards during binding mark, mark possibility slight inclination or separation.Even for the operator of this view of custom, when the number of mark increased, trouble also increased thereupon, and pasted very effort.If as utilizing simple assigned operation to come binding mark from the teeth outwards in this data creation device of describing in (8), even then when the number increase of mark, any operator also can both easily set demonstration, and needn't consider experience.

(9) according to the data authoring device of (7), wherein Optimization Dept. is based on the characteristic and the environment for use of information presentation device, and at least one among both of the spatial orientation information of image information object automatically set the area of space of mark.

(corresponding embodiment)

The embodiment relevant with this data authoring device of describing in (9) is corresponding to the 7th to the 16 embodiment.

(function and effect)

The function and the effect of this data authoring device of describing in (9) will be described.In this data authoring device of describing in (9), Optimization Dept. 6 has based on the characteristic of information presentation device and environment for use, and at least one among both of the spatial orientation information of image information object automatically set the function of the area of space of mark.

Mark is being pasted on the practical object so that under the situation of actual use information presentation device, the importance that influences the performance of information presentation device is to consider " where binding mark; so that use the terminal user of information presentation device to see easily ", " where binding mark; so that not easily discerned by the influence of outer beam ", " where binding mark is so that the personage occurs at assigned address " etc.

(9) this data authoring device of describing in is based on the characteristic and the environment for use of information presentation device, and the area of space of at least one the automatic setting mark of the spatial orientation information of image information object among both.Particularly, for example, when having set in the process that shows in spatial orientation information display part 2 wherein the locus of image information object should occur the time, according to the field angle data of the video camera of information presentation device and the camera position data of hypothesis, demonstration will be provided with the zone of mark.The operator of data authoring device can be provided with mark in the appropriate location in this zone.Spatial orientation information display part 2 can show and is subjected to outer writing to influence little zone or the binding mark or the zone of physics binding mark thereon thereon.

When with as in the data authoring device that (9) are described, when automatic setting should be provided with mark regional, can be only the operation of operator's binding mark on this zone by data authoring device set mark.Therefore, can more easily set demonstration, and needn't when adjusting mark, use actual information to present device at every turn and carry out the affirmation test.

(10) according to the data authoring device of (7), wherein Optimization Dept. is based on the characteristic and the environment for use of information presentation device, and at least one among both of the spatial orientation information of mark automatically set the area of space that the image information object will be set.

(corresponding embodiment)

The embodiment relevant with this data authoring device of describing in (10) is corresponding to the 8th to the 16 embodiment.

(function and effect)

The function and the effect of this data authoring device described in (10) will be described.In this data authoring device of describing in (10), Optimization Dept. 6 has based on the characteristic of information presentation device and environment for use, and the function of the area of space of at least one the automatic setting image information object of the spatial orientation information of mark among both.

When using information presentation device, reality makes under the situation of image information object appearance, the importance that influences the performance of information presentation device is to consider " setting the personage where; make and can character image occur when getting the mark for the treatment of actual stickup by the video camera bat ", " make and to occur the personage as follows; promptly; this personage is spatially not folded with actual column weight ", " make and to occur the personage as follows; promptly; this personage spatially contacts with actual ground ", " make and the personage to occur in the mode that covers mark, become not obvious " etc. thereby be marked in the screen of information presentation device.

(10) this data authoring device of describing in is automatically set the area of space of image information object based in the spatial orientation information of the characteristic of information presentation device and environment for use and object at least one.Particularly, for example, when set in the process that in spatial orientation information display part 2, shows wherein should binding mark the locus time, according to the field angle zone of the video camera of information presentation device and the position of hypothesis video camera, the setting area of image information object should appear in demonstration.The operator of data authoring device can be provided with the image information object in the appropriate location in this zone.In spatial orientation information display part 2, can show the zone of satisfying following condition, that is, make can object contact with practical object or the condition of nonoverlapping expectation under the image information object appears.

When as in the data authoring device of describing in (10), when automatic setting waited to be provided with image information object regional, the image information object was set in the operation of can be only pasting object by the operator on this zone.Therefore, can more easily set demonstration, and needn't when adjust the image information object at every turn, use actual information to present device and carry out the affirmation test.

(11) according to the data authoring device of (7), wherein Optimization Dept. sets their position with respect to object when the relative position that keeps mark and image information object is constant.

(corresponding embodiment)

The embodiment relevant with this data authoring device of describing in (11) is corresponding to the 9th to the 16 embodiment.

(function and effect)

The function and the effect of this data authoring device of describing in (11) will be described.In this data authoring device of describing in (11), Optimization Dept. 6 sets the position with respect to object when the relative position that keeps mark and image information object is constant.

When reality is used information presentation device, in many cases, regard mark and image information object as a pair of notion.For example, under the situation of the image of information presentation device input marking, direction arrow (as shown in figure 13) appears on screen, and when notion being set by this easier arrow of seeing indicia and appearance.At this moment, particularly, for example, in the procedure for displaying in spatial orientation information display part 2, can be when the relative position that keeps mark and image information object be constant, setting can be set the position of mark and image information object simultaneously, but not in succession they be set during with respect to the position of object.

When the relative position that is keeping mark and image information object in this way is constant, when setting the position with respect to object, can be only operator by data authoring device carry out this right set positions and set both positions simultaneously.Thus, can more easily set demonstration.

(12) according to any one data authoring device of (1) to (11), also comprise the demonstration efferent, this demonstration efferent is demonstrated before by the information presentation device presentation information.

(corresponding embodiment)

The embodiment relevant with this data authoring device of describing in (12) is corresponding to the tenth to the 16 embodiment.

(function and effect)

The function and the effect of this data authoring device of describing in (12) will be described.(12) this data authoring device of describing in has demonstration efferent 7, can demonstrate before by information presentation device output information (with reference to Figure 14).When the various information of output in spatial orientation information display part 2, can confirm output to a certain extent from information presentation device.Yet, output is being sorted and seeing with this order under the situation of output, perhaps when being desirably in the virtual street of passing real world, someone confirms under the situation of output, as in this data authoring device of describing in (12), demonstration efferent 7 independently is set carries out demonstration, thereby can make output present the output of device near actual information.The purpose of spatial orientation information display part 2 is not limited to the setting being convenient to export.As for object, mark and image object, only output has the spatial orientation information of relatively small number according to amount, and sets and to have the detailed text message of big data quantity, and does not show.Therefore, can improve computing velocity.In the case, in demonstration efferent 7, can videotex information so that carry out final inspection.

(13) according to the data authoring device of (2), also comprise image information property settings portion, this image information property settings portion sets the image information characteristic of image information object or predetermined labels arbitrarily.

(corresponding embodiment)

The embodiment relevant with this data authoring device of describing in (13) is corresponding to the 11 embodiment to the 16 embodiment.

(function and effect)

The function and the effect of this data authoring device of describing in (13) will be described.(13) this data authoring device of describing in has image information property settings portion 8, and it sets the image information characteristic (with reference to Figure 15) of image information object or predetermined labels arbitrarily.As for image information object or predetermined labels, except geometrical property, can also set various image informations, for example color of image, brightness and literal type.Therefore, can set " the desired image information object is compared more remarkable with background ", " color of expectation mark is compared not remarkable with background " etc.Thus, can improve the performance that actual information presents device.

(14) according to the data authoring device of (13), wherein the image information characteristic comprises at least one in color, brightness, picture size, colored monochrome information, Format Type and the character script of image.

(corresponding embodiment)

The embodiment corresponding with the data authoring device of describing in (14) is corresponding to the 11 to the 16 embodiment.

(function and effect)

The function and the effect of this data authoring device of describing in (14) will be described.In the data authoring device of describing in (14), the image information characteristic has at least one in color of image, brightness, picture size, colour and monochrome information, Format Type and the character script.These characteristics can be relatively easily changed, and this change can be seen immediately.Thus, when setting various image information, can set " the desired image information object is remarkable with respect to background ", " the expectation mark is not remarkable with respect to background " etc. easily.Thus, can improve the performance that actual information presents device.

(15) according to the data authoring device of (2), wherein the image information object uses three-dimensional coordinate.

(corresponding embodiment)

The embodiment relevant with this data authoring device of describing in (15) is corresponding to the 12 embodiment to the 16 embodiment.

(function and effect)

The function and the effect of the data authoring device of describing in (15) will be described.In the data authoring device of in (15), describing, image information to as if image with three-dimensional coordinate notion.Under the situation of output image information object, the spatial disposition for the treatment of object output is prior aspect, and specific to having at image under the situation of three-dimensional coordinate, and it mode occurs along with arrangement or posture and significantly different.In the case, when the spatial orientation information of displays image information object in spatial orientation information display part 2 is carried out display setting, can easily carry out setting by the operator of data authoring device, and can judge in addition to obtain the more output of expectation.That is, employed spatial orientation information is not limited to two dimensional surface, can easily set any operation, and the operator can judge to obtain the output of expectation.

(16) according to the data authoring device of (2), wherein the image information object has Word message.

(corresponding embodiment)

The embodiment relevant with this data authoring device of describing in (16) is corresponding to the 13 to the 16 embodiment.

(function and effect)

The function and the effect of the data authoring device of describing in (16) will be described.In this data authoring device that (16) are described, the image information object has Word message.Above-mentioned image information object can be by the literal outside the conventional scenery image of video camera shooting, the picture of preparation etc.In information presentation device, can in three-dimensional CG, prepare literal three-dimensionally, so that in the space, occur and demonstration, perhaps can be so that the plane (virtual signboard etc.) of the certain size that comprises Word message in the space, occurs and show.In a word, in the procedure for displaying in the spatial orientation information display part 2 of this data authoring device in (16), set the output that shows with the acquisition expectation.Note, under the situation of display text information (can comprise image information) on the whole screen at information presentation device, needn't consider spatial orientation information.Thereby, can in spatial orientation information display part 2, not show under the situation of any information, in related information setting section 3, set " whole screen display ".

(17) according to the data authoring device of (1), it sets same target and/or relevant at least two predetermined related information of same predetermined labels with real world.

(corresponding embodiment)

With the embodiment of this data authoring device of describing in (17) corresponding to the 14 to the 16 embodiment.

(function and effect)

The function and the effect of this data authoring device of describing in (17) will be described.Example as using information presentation device for example, even watch same mark, also occurs to the right arrow for making in the morning according to time set sometimes, and occurs arrow left in the afternoon.Also exist in the sex of the terminal user of this information presentation device of registration use in advance in the information presentation device, and point to the situation of the arrow of lavatory according to sex change.Also exist, switch the situation of different CG continuously when seeing a certain mark.

In this data authoring device of in (17), describing, can set at least two in many predetermined related information relevant with the same object of real world or identical predetermined labels.Handle above-mentioned situation in this way, and can improve the performance of information presentation device.

(18) according to the data authoring device of (17), wherein at least two existing predetermined related information are the output with same type of different pieces of information capacity.

(corresponding embodiment)

The embodiment relevant with this data authoring device of describing in (18) is corresponding to the 15 and the 16 embodiment.

(function and effect)

The function and the effect of this data authoring device of describing in (18) will be described.Consideration prepares to realize that according to using PC pattern, PDA pattern and the portable phone pattern of similar functions are all as information presentation device.In the case, carrying out data creation for each device requires great effort.Yet performance is different because of each device, and especially memory capacity and graphics process performance have very big-difference.Therefore, in addition the predetermined related information of same type also have to the capacity preparation that changes.For example, polygon quantity or the conversion texture capacity among the change 3DCG.Yet, require great effort for each device re-executes data creation.Therefore, as in this data authoring device of describing in (18), in the time can setting the output of a plurality of same types, can only once create and handle each device with different pieces of information capacity.

(19) according to the data authoring device of (1), also comprise output attribute information setting portion, it is set and the output attribute information relevant with respect to the relevant information of predetermined related information.

(corresponding embodiment)

The embodiment relevant with this data authoring device of describing in (19) is corresponding to the 16 embodiment.

(function and effect)

The function and the effect of this data authoring device of describing in (19) will be described.When using information presentation device, select or adjust relevant information according to certain attribute information sometimes.The example of information comprises the timing of exporting this information (after seeing mark immediately or certain hour), the size of sound etc.(19) data authoring device of describing in has the output attribute information setting portion 9 (referring to Figure 16) that can set above-mentioned output attribute information.Therefore, can adjust in the exportable more mode of the relevant information of expectation.

(20) data authoring device of basis (19), wherein output attribute information comprises the resolution of the timing of output information, the size of wanting output sound, the brightness of wanting output image, the image that will export, the data volume of the image that will export, and by in the information of the characteristic of information presentation device or environment for use definition at least one.

(corresponding embodiment)

The embodiment relevant with this data authoring device of describing in (20) is corresponding to the 16 embodiment.

(function and effect)

The function and the effect of this data authoring device of describing in (20) will be described.The output attribute information of this data authoring device of describing (20) be output information timing, want output sound size, want output image resolution, want the data volume of output image, and in the information of characteristic by the information related information equipment or environment for use definition at least one, and can set each information by output attribute information setting portion 9.

Can adjust each information like this, promptly by to such as the timing of wanting output information (after seeing mark immediately, perhaps certain hour); The size of sound (whether exporting big volume); The brightness of the image of exporting (when outdoor application, brightening); The resolution of the image of exporting (along with the device performance variation of information presentation device); The data volume of the image of exporting (along with the object kind changes); And the attribute information of the information of characteristic by information presentation device or environment for use definition (color is along with the screen type of information presentation device changes) sets, and can export the relevant information of expectation.

(21) according to any one data authoring device of (1) to (20), wherein the spatial orientation information input part is from the three-dimensional design information extraction spatial orientation information of object and/or predetermined labels.

(corresponding embodiment)

The embodiment relevant with this data authoring device in (21) is corresponding to the 17 and the 18 embodiment.

(function and effect)

The function and the effect of this data authoring device of describing in (21) will be described.In this data authoring device of in (21), describing, because spatial orientation information input part 1 extracts the spatial orientation information a (for example three-dimensional coordinate data in OO market) of object and/or the spatial orientation information a (for example coordinate data of signboard) of predetermined labels from three-dimensional design information, so input space locating information easily.

(22) according to the data authoring device of (21), wherein the spatial orientation information input part extracts spatial orientation information from the shape information and/or the attribute information of the three-dimensional design information of object and/or predetermined labels.

(corresponding embodiment)

The embodiment relevant with this data authoring device of describing in (22) is corresponding to the 17 and the 18 embodiment.

(function and effect)

The function and the effect of this data authoring device of describing in (22) will be described.When the three-dimensional design information of design object, design simultaneously will be arranged on the mark on the object.For example, component names is set at " mark ", and spatial orientation information input part 1 reading object of the data authoring device of describing in (22) and the three-dimensional design information of mark.In addition, this one has the information of component names " mark " from the three-dimensional design information extraction, and extracts spatial orientation information from the shape information and/or the attribute information of three-dimensional design information.

Thus, the user needn't set mark separately by testing repeatedly.Because can obtain in detail arrangement information from three-dimensional design information about the mark of object, thus when the user can set mark in real space with reference to this information.

(23) according to any one data authoring device in (1) to (22), wherein related information setting section is from the three-dimensional design information extraction relevant information of object and/or predetermined labels.

(corresponding embodiment)

The embodiment relevant with this data authoring device of describing in (23) is corresponding to the 17 and the 18 embodiment.

(function and effect)

The function and the effect of this data authoring device of describing in (23) will be described.In this data authoring device of in (23), describing, because the three-dimensional design information of related information setting section 3 reading object and/or predetermined labels, and extract predetermined related information b, so can easily import predetermined related information such as the shape or the title of object and/or predetermined labels.

(24) according to the data authoring device of (23), wherein related information setting section is extracted relevant information from the shape information and/or the attribute information of the three-dimensional design information of object and/or predetermined labels.

(corresponding embodiment)

The embodiment relevant with this data authoring device of describing in (24) is corresponding to the 17 and the 18 embodiment.

(function and effect)

The function and the effect of this data authoring device of describing in (24) will be described.When the three-dimensional design information of design object, design simultaneously waits to be arranged on the mark on the object, for example, component names is set at " mark ", and related information setting section 3 reading object of the data authoring device of describing in (24) and the three-dimensional design information of mark.In addition, this one has the information of component names " mark " from the three-dimensional design information extraction, and extracts relevant information from the shape information of three-dimensional design information and/or attribute information.Thus, can easily import predetermined related information.

(25) according to any one data authoring device in (21) to (24), wherein the three-dimensional design information of object and/or predetermined labels is the design information by the three-dimensional CAD preparation.

(corresponding embodiment)

The embodiment relevant with this data authoring device of describing in (25) is corresponding to the 17 and the 18 embodiment.

(function and effect)

The function and the effect of this data authoring device of describing in (25) will be described.In the data authoring device of in (25), describing, because the three-dimensional design information that will design by three-dimensional CAD is used for the design of object or predetermined labels, so can prepare three-dimensional design information separately in order to extract spatial orientation information.

(26 according to any one data authoring device in (21) to (24), and wherein the three-dimensional design information of object and/or predetermined labels is by the two-dimensional design information that is prepared by two-dimentional CAD is changed the information that obtains.

(corresponding embodiment)

The embodiment relevant with this data authoring device of describing in (26) is corresponding to the 17 and the 18 embodiment.

(function and effect)

The function and the effect of this data authoring device of describing in (26) will be described.In this data authoring device of in (26), describing, even can use by the two-dimensional design information that is prepared by two-dimentional CAD being carried out the three-dimensional design information that three-dimensional conversion obtains.

(27) data authoring device of basis (7), wherein the value of at least one remaining information in not input information group or the scope is calculated as yet by Optimization Dept., this message block or scope can be by adopting based on the value from the input information of spatial orientation information input part, this input information comprises the spatial orientation information of object at least, and this one exports to the computing information efferent with numerical value or scope, and

This message block comprises: the camera head parameter of parameter that presents the camera head of device as configuration information; The posture information that is the camera head of now in information presentation device execution information; The spatial orientation information of mark; The image information characteristic of mark; And the spatial orientation information of object.

(corresponding embodiment)

The embodiment relevant with this data authoring device of describing in (27) is corresponding to the 19 embodiment.

(function and effect)

The function and the effect of this data authoring device of describing in (27) will be described.In this data authoring device of in (27), describing, because in the mark setting operation, presented the configuration information of mark etc. or imaging conditions setting in advance in presenting as information in advance, so can significantly reduce the number of steps that mark is set.

(28) according to the data authoring device of (27), wherein the predetermined information from the input of spatial orientation information input part is the image information characteristic of spatial orientation information, camera head parameter and the mark of object.

(29) according to the data authoring device of (27), wherein the predetermined information from the input of spatial orientation information input part is the spatial orientation information and the camera head parameter of object.

(30) according to the data authoring device of (27), wherein the camera head parameter has two or more information in the following information, comprises at least: field angle and resolution (field angle of camera head and resolution); The pixel quantity that identification marking is required; And image fault information.

(31) data authoring device of basis (27), wherein the posture information that is current camera head in execution information has in execution information and is current positional information and pose information, and under the situation of the shooting that presents in a plurality of positions execution information of carrying out, have many positional informations and pose information.

(32) according to the data authoring device of (27), wherein the spatial orientation information of mark comprises: position and posture that mark is set; And the shape of the mark of the geometrical property information that serves as a mark.

(33) according to the data authoring device of (27), wherein the image information characteristic of mark comprises the texture information of this mark.

(34) data authoring device of basis (27), wherein the spatial orientation information of object has two or more information in the following information, comprises at least: the posture information of the object in the posture information of object and shape information, shape information, execution information are current captured zone, the zone that has camera head and the zone that mark will be set.

(35) a kind of information presentation device comprises:

Memory device, the information of its storage by determining according to any one data authoring device in (1) to (34);

Input media is used for not determining under the situation of reference mark selection reference mark from a plurality of marks as yet;

Camera head is used for image is taken, and this image comprises the mark that exists at least one real world in camera watch region, and knows position and the posture of this mark with respect to reference mark;

Computing equipment, its basis comprise by the photographic images of the mark of being taken by camera head and the information in the memory device, calculate the posture information of camera head; And

Display device, its overlapping and demonstration institute's image of taking the photograph and information,

Wherein display device shows the spatial orientation information of the mark that also is not provided with except reference mark in a plurality of marks.

(36) according to the information presentation device of (35), wherein display device also shows the spatial orientation information that mark is not set outside the reference mark in a plurality of marks.

(37) according to the information presentation device of (35), wherein display device shows the reference mark spatial orientation information that mark is set in addition in a plurality of marks.

(38) according to the information presentation device of (35), have, so that the function that at least one information in the image information characteristic of the spatial orientation information of mark and mark is made amendment based on the information in the information correction memory device that is input in the input media.

(39) a kind of information presentation device comprises:

Memory device, it stores image information characteristic and these three kinds of information of camera head parameter of the spatial orientation information of a plurality of marks, a plurality of marks;

Camera head is used for image is taken, and this image comprises a mark that exists in the real world in camera watch region at least and knows position and the posture of this mark with respect to reference mark;

Computing equipment, it calculates the posture information of camera head according to comprising by the photographed images of the captured mark of camera head and the information in the memory device; And

Display device, it is overlapping and show captured image and information,

Wherein display device shows the spatial orientation information except showing reference mark in a plurality of marks.

(corresponding embodiment)

The embodiment relevant with this information presentation device of describing in (39) is corresponding to the 20 embodiment.

(function and effect)

The function and the effect of this information presentation device of describing in (39) will be described.In this information presentation device of in (39), describing, present predetermined set in the process because in the mark setting operation, present position that next mark should be set as information based on reference mark, so reduced the error during mark is provided with, and significantly reduced the step number that mark is set.

(40) according to the information presentation device of (39), wherein display device shows the spatial orientation information that mark also is not set except reference mark in a plurality of marks.

(41) according to the information presentation device of (39), wherein display device shows the spatial orientation information that mark is set except reference mark in a plurality of marks.

(42) according to the information presentation device of (39), also comprise input media, be used for revising at least one information in the image information characteristic of mark of the spatial orientation information of mark and memory device, and

Has the function of the information in the memory device being made amendment based on the input of input media.

Commercial Application

According to the present invention, a kind of data authoring device is provided, its utilize real world object and/ Or the spatial orientation information of predetermined labels sets predetermined related information, so that information presentation device is defeated Go out this predetermined related information, the spatial orientation information that wherein uses in setting predetermined related information is not Be limited to two dimensional surface, can easily set any processing, and can improve information presentation device Various performances, for example obtain the output of more expectation and in the position of seeing easily mark be set.

Claims (20)

1, a kind of data authoring device, the spatial orientation information that this equipment utilization is represented by the object and/or the predetermined labels of real world is set predetermined related information, so that information presentation device is exported described predetermined related information, described apparatus characteristic is that described equipment comprises:

The spatial orientation information input part, it imports the spatial orientation information of described object and/or described predetermined labels;

Related information setting section, it sets the method that shows described predetermined related information;

The spatial orientation information display part, it shows by the described object of described spatial orientation information input part input and/or the spatial orientation information of described predetermined labels, and it shows described predetermined related information according to the display packing by described related information setting section sets; And

Data output section, the data of the demonstration of described spatial orientation information display part being carried out display setting are described in its output,

Described equipment constitutes: the user can select to be shown in the described object on the described spatial orientation information display part and/or the spatial orientation information of predetermined labels, and can set predetermined related information to the spatial orientation information of described selecteed object and/or predetermined labels by described related information setting section.

2, data authoring device according to claim 1, wherein said predetermined related information comprises the image information object, and

Described spatial orientation information display part shows the spatial orientation information of described image information object.

3, data authoring device according to claim 1, wherein said spatial orientation information display part show the spatial orientation information of described object and described predetermined labels spatial orientation information the two,

Described equipment also comprises the geometrical property configuration part, the geometrical property of at least one in the spatial orientation information of the described object of any setting in this geometrical property configuration part and the spatial orientation information of described predetermined labels.

4, data authoring device according to claim 2, wherein said spatial orientation information display part show the spatial orientation information of described predetermined labels and described image information object spatial orientation information the two,

Described equipment also comprises the geometrical property configuration part, the geometrical property of at least one in the spatial orientation information of the described predetermined labels of any setting in this geometrical property configuration part and the spatial orientation information of described image information object.

5, data authoring device according to claim 2, wherein said spatial orientation information display part show the spatial orientation information of the spatial orientation information of described object, described predetermined labels and the spatial orientation information of described image information object,

Described equipment also comprises the geometrical property configuration part, the geometrical property of at least one in the spatial orientation information of the spatial orientation information of the described object of any setting in this geometrical property configuration part, the spatial orientation information of described predetermined labels and described image information object.

6, according to any one described data authoring device in the claim 3 to 5, wherein said geometrical property has at least one in bulk, rotation and the shape.

7, according to any one described data authoring device in the claim 3 to 5, wherein said geometrical property configuration part has Optimization Dept., and it suitably sets described geometrical property.

8, data authoring device according to claim 7, wherein said Optimization Dept. has following function: spatially with the surperficial contacted mode of described object described mark and described object are set automatically with the surface of described at least mark.

9, data authoring device according to claim 7, wherein said Optimization Dept. is based in the spatial orientation information of the characteristic of described information presentation device and environment for use and described image information object at least one, the area of space of the described mark of automatic setting.

10, data authoring device according to claim 7, wherein said Optimization Dept. is based in the spatial orientation information of the characteristic of described information presentation device and environment for use and described mark at least one, and automatic setting waits to set the area of space of described image information object.

11, data authoring device according to claim 7, wherein said Optimization Dept. sets their positions with respect to described object when the relative position that keeps described mark and described image information object is constant.

12, data authoring device according to claim 1 also comprises the demonstration efferent, and it was demonstrated before by described information presentation device presentation information.

13, data authoring device according to claim 2 also comprises image information property settings portion, and it sets the image information characteristic of described image information object or described predetermined labels arbitrarily.

14, data authoring device according to claim 13, wherein said image information characteristic comprise at least one in color, brightness, picture size, colored monochrome information, Format Type and the character script of image.

15, data authoring device according to claim 2, wherein said image information object uses three-dimensional coordinate.

16, data authoring device according to claim 2, wherein said image information object has Word message.

17, data authoring device according to claim 1, it sets at least two described predetermined related information for the same target and/or the same predetermined labels of real world.

18, data authoring device according to claim 17, wherein said at least two existing predetermined related information are the output with same type of different pieces of information capacity.

19, data authoring device according to claim 1 also comprises output attribute information setting portion, and described output attribute information setting portion sets the output attribute information relevant with described relevant information at described predetermined related information.

20, data authoring device according to claim 19, the data volume of the resolution of the brightness of the size of the sound that wherein said output attribute information comprises the timing of exporting described information, will export, the image that will export, the image that will export, the image that will export, and in the information of characteristic by information presentation device or environment for use definition at least one.

Images