JP2002298149A - Data synthesizing device, data synthesizing method, mechanically readable recording medium with data synthesizing program recorded thereon, and data synthesizing program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a data synthesis with excellent practicability. SOLUTION: When the information on a parts 2j described on the template data 1C of a template 1i which is a desired scenario and desired as an object for synthesis is selected out of the parts specifying information of the plurality of parts 2j displayed by a parts selection and display unit 202 by operating a user arbitrary input unit 204, synthesis is performed by a parts coupling part 218, a parts interpreting part 220 and a part selection/determination unit 222 by using the desired parts 2j corresponding to the selected information, and the obtained synthesis data as a result of execution are displayed on a synthesis data display unit 208.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a data synthesizing apparatus, a data synthesizing method, a machine-readable recording medium recording a data synthesizing program, and a data synthesizing program. The present invention relates to a data synthesizing apparatus, a data synthesizing method, a machine-readable recording medium storing a data synthesizing program, and a data synthesizing program for synthesizing a plurality of data in accordance with the above-mentioned method.

[0002]

2. Description of the Related Art Conventionally, in a process of synthesizing multimedia data such as animation data, a user needs to use a dedicated synthesizing tool to select and edit data for synthesis by himself / herself. was there. As an example of such a data synthesis processing device, there is an animation creation processing device disclosed in Japanese Patent Publication No. 7-43774. In this device, a basic technique for synthesizing attributes of a plurality of image data is shown. However, this publication does not disclose linking user interface information for appropriately synthesizing an image and animation creation processing in accordance with a scenario desired by a user, or a display procedure of data obtained by synthesis. Therefore, conventionally, the data used for the synthesis processing suitable for the scenario desired by the user is displayed so that the user can easily select the data, and the display of the data obtained by the synthesis according to the attribute of the data used for the synthesis is conventionally performed. Since it is not easy to change the method or modify the data obtained by the synthesis, there is a problem that the method is not practical.

In the technique disclosed in the above-mentioned publication, when combining data using a plurality of data, it is necessary to generate an intermediate frame having attribute information of the data used for the combining. Whenever the changed data is changed, it is necessary to regenerate the intermediate frame each time, and the management of the data obtained by the synthesis becomes complicated, which is not practical.

It is therefore an object of the present invention to provide a data synthesizing apparatus, a data synthesizing method, a machine-readable recording medium storing a data synthesizing program, and a data synthesizing program which are excellent in practical use.

[0005]

According to one aspect of the present invention, a data synthesizing processing apparatus presents object specifying information for specifying a plurality of objects that can appear in a scenario according to scenario information indicating a desired scenario. Presenting means; object selecting means for selecting the desired object from the plurality of objects in accordance with an external input based on the object specifying information presented by the presenting means; and the object selected by the object selecting means. Data specifying means for specifying object data corresponding to the object in a previously prepared object data group; and combining processing of the plurality of object data specified by the data specifying means in accordance with the scenario information to generate combined data. Data composition And a stage.

[0006] Therefore, from the object specifying information of a plurality of objects presented by the presenting means, the object selecting information which only appears in a desired scenario and is desired as a target of the combining process is selected by the object selecting means. Thus, the combined data can be obtained by combining the data of the selected desired object via the data specifying unit and the data combining unit.

Therefore, when the user synthesizes data of a desired object in accordance with a desired scenario and obtains synthesized data, the object selecting means can simply perform an external input for a selection operation.
It is practical.

[0008] The above-described data synthesizing apparatus may further include a scenario selecting means for selecting the desired scenario from a plurality of types of the scenarios based on an external input.

Therefore, the user only has to input an external input for selecting a scenario in the scenario selecting means in order to select a desired scenario.

In the data synthesizing apparatus described above, the scenario information includes attribute information indicating an attribute of the synthetic data corresponding to the scenario. In the synthesizing process, the desired data specified in the data group is The attribute indicated by the attribute information is associated.

Therefore, the attribute of the desired object selected from the data group to be synthesized is associated with the attribute corresponding to the scenario in the synthesis processing. Therefore, data of a data group prepared in advance can be shared between various desired scenarios.

[0012] The above-mentioned data synthesizing apparatus further comprises an output means for outputting the synthesized data generated by the data synthesizing means in accordance with the scenario information, wherein the attribute data includes the synthesized data by the output means. It is characterized in that output mode information for determining an output mode for each of the plurality of object data at the time of output is included.

Therefore, when the composite data is output by the output means, each of the plurality of object data generating the composite data is output according to the corresponding output mode determined by the desired scenario.

Therefore, at the time of outputting the synthesized data, each object data generating the synthesized data can be output in a desired scenario.

In the data synthesizing apparatus described above, the output mode information includes information on the arrangement of each of the plurality of object data.

Therefore, at the time of outputting the synthesized data, each object data generating the synthesized data can be output in an arrangement according to a desired scenario.

In the above-described data synthesizing processing apparatus, the output mode information includes information on output timing for each of the plurality of object data.

Therefore, at the time of outputting the synthesized data, each object data generating the synthesized data can be output at an output (appearing) timing according to a desired scenario.

[0019] In the above-described data synthesizing apparatus, the output mode information includes information on a motion of each of the plurality of object data.

Therefore, at the time of outputting the synthesized data, each object data generating the synthesized data can be output with a motion according to a desired scenario.

In the above-described data synthesizing processing apparatus, the output mode information indicates a format at the time of output of the plurality of object data.

Therefore, at the time of outputting the composite data, each object data generating the composite data can be output according to a format according to a desired scenario.

In the above-described data synthesizing apparatus, the output means has an association output means for outputting the synthesized data in association with arbitrary data.

Therefore, the combined data generated by the combining process can be output in association with arbitrary data, so that the output form of the combined data can be diversified.

In the data synthesizing apparatus described above, the scenario information includes information for specifying the arbitrary data and related content information for specifying the related content.

Therefore, the contents related to the arbitrary data associated with the composite data can be specified by the scenario information used to generate the composite data.

In the above-described data synthesizing apparatus, the related content information is indicated by time information included in the arbitrary data.

Therefore, when the combined data and the arbitrary data are output in association with each other, they can be output in association with each other in accordance with the time information of the arbitrary data. Therefore, the data can be output in association with, for example, date calendar information and clock information included in the arbitrary data.

[0029] In the above-described data synthesizing apparatus, the related content information is indicated by position information included in the arbitrary data.

Therefore, when the combined data and the arbitrary data are output in association with each other, they can be output in association with each other in accordance with the position information of the arbitrary data. Therefore, the data can be output in association with, for example, a sketch or map information included in the arbitrary data.

In the data synthesizing apparatus described above, the related content information is indicated by personal information included in the arbitrary data.

Therefore, when the combined data and the arbitrary data are output in association with each other, they can be output in association with each other in accordance with the personal information of the arbitrary data. Therefore, the data can be output in association with, for example, information of an address book or a telephone directory included in the arbitrary data.

[0033] In the above-described data synthesizing processing apparatus, for each of the synthesized data generated by the data synthesizing means, scenario instruction data indicating the scenario information of the synthesized data and the object used for generating the synthesized data. The image processing apparatus further includes composite data storage means for storing object instruction data indicating the object data in the data group in association with each other, wherein the output means includes a corresponding composite data desired in the composite data storage means. According to the scenario information indicated by the scenario instruction data, the object data in the object data group indicated by the corresponding object instruction data is synthesized and output.

Therefore, the object data used for generation of the composite data stored in the composite data storage means is specified and specified in the object data group by the corresponding object specifying data. Is used, the synthesized data stored in the synthesized data storage means is not configured. Therefore, even if the object data used for the synthesis is modified between the time of the synthesis and the time of the reproduction, even if
Since there is no need to perform a combining process, it is easy to use.

A data synthesizing method according to another aspect of the present invention includes a presentation step of presenting object specifying information for specifying a plurality of objects that can appear in a scenario according to scenario information indicating a desired scenario; An object selecting step of selecting the desired object from the plurality of objects according to an external input based on the object specifying information presented by the presenting step; and an object corresponding to the desired object selected by the object selecting step A data specifying step of specifying data in a previously prepared object data group; and a data generating step of generating a composite data by performing a synthesis process on the plurality of object data specified by the data specifying step in accordance with the scenario information. And a data synthesis step.

In a machine readable recording medium according to still another aspect of the present invention, a data synthesis processing program for executing the above-described data synthesis processing method by a computer is recorded.

A data composition processing program according to still another aspect of the present invention is a program for executing the above data composition processing method by a computer.

[0038]

Embodiments of the present invention will be described below with reference to the drawings.

In each of the embodiments, the data to be combined used in the combining process is called a component, and the data obtained by performing the combining process using one or more pieces of the data to be combined is called combined data. Parts are data that indicate objects (objects) such as people, objects, characters, sounds, and lights that appear in the scenario. Such parts include image data (still image data, moving image data), audio data, and text data. It is not limited, and other types of data may be included.

In each of the embodiments, the component as the data to be combined is displayed according to the category suitable for the scenario desired by the user, and the user can select one of the displayed components from among the displayed components.
By simply selecting the desired component, the combining process using the component desired by the user can be realized. In addition, in the synthesizing process, a file (hereinafter, referred to as a template) in which information indicating the attribute of the synthetic data such as what component is to be displayed (output) at what position and at what timing is described. A combining process is performed based on the content to generate combined data.

FIG. 1 is a functional block diagram of a data synthesizing processing system according to each embodiment of the present invention. FIG. 2 is a configuration diagram of an information processing apparatus equipped with the data synthesis processing system according to each embodiment of the present invention. The device in FIG. 2 may be mounted on a portable telephone, or may be mounted on various information processing terminals including a portable information processing terminal.

Referring to FIG. 2, the information processing apparatus includes a CRT
Monitor 1 consisting of (cathode ray tube) and liquid crystal display
10, a keyboard 150, a mouse 160, a CPU (abbreviated central processing unit) 122 for centrally controlling and monitoring the information processing device itself, and a ROM (Read Only Memory)
y) or a memory 124 including a RAM (abbreviation for random access memory), a fixed disk 126, F
A D (flexible disk) 132 is detachably mounted, an FD driving device 130 for accessing the mounted FD 132, a CD-ROM (Compact Disc Read Only)
Memory) 142 is removably mounted, a CD-ROM drive 140 for accessing the mounted CD-ROM 142, and a communication interface 180 for communicatively connecting various communication networks 182 including the Internet and the information processing apparatus. including. These units are interconnected via a bus.

Further, the information processing apparatus may be provided with a magnetic tape device to which a cassette type magnetic tape is removably mounted to access the magnetic tape.

Referring to FIG. 1, the data synthesizing system includes a user interface 200 corresponding to mouse 160, pen tablet 170, keyboard 180 and monitor 110 in FIG. 2, and a processing function by a program executed by CPU 122 in FIG. The corresponding synthesis processing engine 210 and the template database 23 corresponding to the memory 124 or the fixed disk 126 in FIG.
0, a component database 240 and a compositing database 250.

The template database 230 has a plurality of types of templates 1i (i = 1, 2, 3,..., N).
Is stored. The template 1i includes template name information 1A, template genre 1B, template data 1C, and composite data type 1D. The template name information 1A is information for uniquely identifying the template 1i in the template database 230. The plurality of templates 1i in the template database 230 belong to one of a plurality of genres. The template genre information 1B indicates the genre of the template to which the template 1i belongs.
Used as a key to search for i. The template data 1C indicates information for specifying one or more components used for synthesis (number of components, component name), and information on parameter values of attribute information corresponding to each component when the components are synthesized. The composite data type information 1D indicates the type of the format of the corresponding composite data. For example, the type of the format of the composite data such as animation (animation GIF, flash, etc.), image (JPEG, etc.) is specified by the composite data type information 1D.

The component database 240 stores a plurality of types of components 2j (j = 1, 2, 3,...) Used for synthesis.
m) is stored. Each component 2j has component name information 2
A, component classification information 2B, component data type information 2C, and component data 2D.

The component name information 2A indicates an identifier for uniquely identifying the component 2j in the component database 240. The part classification information 2B includes genre data 21B and keyword data 22B.

The parts classification information 2B is stored in the parts database 24.
0 is used as a key for retrieving a part for the composition processing. For example, if the genre data 21B indicates "weather forecast" and the keyword data 22B is set as "sunny", the genre data 21B is used as a component of the synthesis processing according to the template 1i corresponding to the scenario of sunny and cloudy in the weather forecast. The part 2j (as the part relating to "sunny") is searched. The component data type information 2C indicates the type of the format of the component 2j. For example, animation (animation GIF, flash, etc.), image (J
PEG, etc.).

The component data 2D indicates the data content of the component 2j according to the format indicated by the corresponding component data type information 2C. The component data 2D is registered in the component database 240 in a state in which it can be displayed using a display tool prepared in advance in the system corresponding to the format indicated by the corresponding component data type information 2C.

The template 1i and the component 2j may be created by the user operating the user's arbitrary input unit 04 and registered in the template database 230 and the component database 240, or those created by other systems may be registered. It may be done. In that case,
The information may be registered via the communication network 182 or a recording medium.

In the synthesizing database 250, a plurality of synthesized data 3h (h = 1, 2,
.., K) are stored. The composite data 3h includes a composite data identifier 3A, template information 3B, and composite data contents 3C. The combined data identifier 3A is information for uniquely identifying the combined data 3h in the combining database 250. The template information 3B indicates one of the templates 1i in the template database 230 used when the synthesis processing is performed on the synthesis data 3h.

The composite data content 3C is composed of the composite data 3h
Is generated in the component database 240.

The user interface 200 includes a component selection display processing unit 202, an arbitrary user input unit 204, a template selection display processing unit 206, and a combined data display processing unit 208. The component selection display processing unit 202 operates so that the user can select the component 2j to be used for the combining process. The user arbitrary input unit 204 operates so that the user can input various data for the composition processing, such as character data for filling the balloon of the animation. The template selection display processing unit 206 acts so that the user can specify a template 1i corresponding to a scenario desired by the user.

The combined data display processing section 208 operates to display the combined data obtained by the combining processing on the monitor 110.

The synthesis processing engine 210 includes a template interpreting section 212, a template selecting / deciding section 214, a database searching section 216, a component combining section 218, and a component interpreting section 2.
20 and a part selection / determination unit 222. The database search unit 216 includes a template database 230,
Parts database 240 and synthesis database 25
Search for 0.

At the time of generating the synthesized data, for example, the template database 230 is searched by using information such as a given template name and genre as a key, and one or more templates 1i corresponding to the key are specified, and the specified Read template name information 1A and template genre information 1B of one or more templates 1i,
This is given to the template selection determining unit 214. Since the template selection determining unit 214 provides the provided information to the template selection display processing unit 206, the template selection display processing unit 206 displays this information on the monitor 110. In the template selection display processing unit 206, the information specified by the user from among the displayed information of the one or more templates 1i is provided to the template selection determination unit 214. Is determined as a template for the combining process.

The template interpreter 212 receives the template data 1C of the template 1i determined by the selection.
, And obtains information indicating what kind of component 2j is to be synthesized and how to synthesize it.
Give 16 The database search unit 216 searches the component database 240 based on the interpreted and provided information on the component 2j, and provides one or more candidate components 2j obtained as a result of the search to the component selection display processing unit 202.
Since the component selection display processing unit 202 displays the given one or more candidates for the component 2j to the user via the monitor 110, the user specifies a desired component 2j from the displayed candidates for the component 2j.

The component selection / determination unit 222 determines the component 2j specified by the user as the component 2j for the combining process. The component interpreting unit 220 interprets the component data 2D of the component 2j determined in this way according to the corresponding component data type information 2C, and synthesizes the template 1i selected and determined by the user for the synthesis process. The format is converted to the format indicated by the type information 1D.

The component connection unit 218 interprets and converts the format of the component data 2D interpreted by the component interpretation unit 220.
Is converted to correspond to attribute information such as position information indicated by the template data 1C of the selected and determined template 1i, and the converted plurality of component data 2
D is combined to generate composite data.

In the synthesizing process according to such a series of procedures, a template 1i specified by the user, a component 2j specified by the template 1i, and information such as characters arbitrarily input by the user are used to generate synthesized data. After the generation processing, the synthesized data obtained as a result is stored in the synthesis database 250 via the database search unit 216 in the form of the synthesized data 3h.

It is assumed that the component interpreting unit 220 previously holds format correspondence information for associating the synthesizable formats, and the component combining unit 218 also determines which part of the format corresponds to the attribute information. Information and parameter value information corresponding to the attribute information are stored in advance.

(Embodiment 1) A data synthesis procedure according to Embodiment 1 using the above-described data synthesis processing system will be described. In the first embodiment, the combining process
For example, a case where animation data of a weather forecast is acquired will be described.

Here, it is assumed that parts 2j whose genre data 21B is “weather” and keyword data 22B is “clear”, “cloudy”, “rain” and “storm” are stored in part database 240 in advance. Suppose. In addition, the template name information 1A clearly indicates “Sunny then rain”, the number of components used for synthesis in the template data 1C is “2”, and the component names used for synthesis are “Component 1” and “Component 2”. Template 1i is stored in the template database 230 in advance.
Assume that it is stored in. In the template data 1C of the template 1i, the genre is indicated as “weather” and the keyword is “sunny” as the attribute information corresponding to the part 1, and the genre is “weather” and the keyword as the attribute information corresponding to the part 2. Is indicated as “rain” and the combined data type information 1D is “animation”
Is described.

FIG. 3 shows a flowchart of the data synthesizing process according to the first embodiment. First, the user specifies a desired genre for the template 1i via the user arbitrary input unit 204 (step S290).
The database search unit 216 specifies the desired genre,
For example, the template database 230 is searched based on “weather forecast”, and the template name information 1A and the template genre information 1B of one or more templates 1i having the template genre information 1B corresponding to the desired genre are read, and the template selection / Since it is provided to the determination unit 214, the template selection / determination unit
4 displays the template name information 1A and the template genre information 1B for the given one or more templates 1i on the screen of the monitor 110 via the template selection display processing unit 214, and presents the template 1i candidates to the user. (Step S300). A screen 400 displayed in this case is shown in FIG.

When the user selects a desired template 1i from the displayed screen 400, for example, FIG.
Is selected by operating the user's arbitrary input unit 204, the template name information 1A of the selected template 1i is transmitted to the template interpreting unit 2 via the template selecting / determining unit 214.
12 and the component connection unit 218 (step S31).
0).

The template interpreting section 212 converts the template 1 specified by the given template name information 1A.
i is read out from the template database 230 via the database search unit 216, the content is interpreted, and the number of component 2j to be combined, the component name, the attribute information, and the composite data type are interpreted based on the corresponding template data 1C. Information 1D is acquired (steps S320 and S320).
330).

Next, the template interpreting unit 212 searches the component database 240 via the database searching unit 216 using the acquired component name as a key, specifies the component 2j to be subjected to the combining process, and A part 2j whose genre data 21B and keyword data 22B are “weather and sunny” and “weather and rain”, respectively, is acquired. Since the acquired component 2j is provided to the component selection display processing unit 202 via the component selection / determination unit 222, the component selection display processing unit 202 monitors the classified component classification information 2B for each of the provided components 2j. Display at 110. As a result, candidates for the component 2j for the combining process are presented to the user (steps S340 and S35).
0).

A screen 410 shown in FIG. 4B is an example of a screen presented to the user in order to select a component to be subjected to the composition processing. The user operates the user arbitrary input unit 204 to display two parts 2 corresponding to fine 1 and rain 1 indicated by arrows as a target of the combining process from the screen 410 of FIG.
When j is specified, the component selection / determination unit 222 determines this as the component 2j selected by the user and gives it to the component interpretation unit 220 (step S370).

The component interpreting unit 220 converts the determined component data 2D of each component 2j according to the format indicated by the corresponding combined data type information 1D, and provides the converted data to the component combining unit 218 (step S380).

The part combination unit 218 generates the template data 1C of the template 1i selected in step S310.
Attribute information (information such as the position at which the component is to be placed or the motion of the component is specified) is generated in accordance with the format indicated by the corresponding combined data type information 1D, and the component selection / The component data 2D provided from the determination unit 222 are combined. As a result, composite data is generated (step S390).

The generated combined data is additionally registered in the combining database 250 in the form of the combined data 3h.
Further, the component data 2D that is provided to the combined data display processing unit 208 and combined is displayed on the monitor 110 in accordance with the associated attribute information. The composite data is data that can be reproduced by a display tool prepared in advance for the corresponding format. As a result, a screen based on the combined data is displayed on the monitor 110 such that a rain animation is presented after a sunny animation.

Here, in the screens of FIGS. 4A and 4B, the template 1i and the component 2
Although the information for specifying j is displayed, it may be displayed as image data for easier selection.

FIG. 5 is a description example of the contents of the template data 1C of the template information 1i of FIG. As shown, the content of the template data 1C is XML (ex
In accordance with a unified format such as tensible Markup Language), it is described as attribute information corresponding to synthesized data obtained by the synthesis processing. For attribute information items,
It is possible to arbitrarily set data indicating a tag or a parameter for each of the components 2j to be combined,
It is assumed that what tags and parameters are used are defined in advance in an XML data definition (DTD: Document type Definition) or the like. The contents of the template data 1C are interpreted by a template interpreting unit 212 including a function capable of interpreting a unified format such as an XML parser, and are referred to as information for a synthesis process.

The template data 1C shown in FIG.
Tags 40 to 43 and tags 44 and 45 corresponding to 0 to 53 are included. The tag 44 is a tag 44 corresponding to the data 541 to 545.
1 to 445, and the tag 45 includes tags 451 to 455 corresponding to the data 551 to 555.

The data 50 indicates the corresponding template name information 1A. The data 51 is a component 2j to be synthesized.
Indicates the number of The data 52 indicates the format indicated by the corresponding combined data type information 1D. The data 53 indicates the name of the component 2j to be combined.

The data 541 to 545 correspond to the first part 2j
And attribute data associated with the second component 2j. Similarly, data 551 to 555 indicate attribute information associated with the second component 2j. Here, the component 2 to be synthesized
Although the case where the number of j is two is illustrated, the number of parts is two.
Not limited to individual.

The data 541 and 551 correspond to the corresponding part 2j
Genre data 21B. Data 542 and 5
52 indicates the keyword data 22B of the corresponding part 2j. When the corresponding tags 443 or 453 indicate arrangement information, which is one type of attribute information, the data 543 and 553 are parameters corresponding to the arrangement information, such as an absolute position, a relative position, a label designation position, and an arrangement information file. Indicates one of the specified positions. The type of parameter corresponding to the tag 543 or 553 can be added as appropriate.

The absolute position shown here is the display position of the corresponding part 2j when the composite data is displayed. For example, (X, Y) = (10, 1) for the absolute coordinates
0). In the case of the relative position, it is expressed in the same manner as the absolute coordinate according to the relative coordinate. However, when it is used as information for the composite data, the calculation is performed according to the display size. For example, when the display size is doubled, (X, Y) = (10, 10) becomes (X, Y) = (2
0, 20).

In the case of the label designation position, the position is designated by the label in the display area to which the label is assigned in advance. For example, when the component 2j is arranged and displayed in the display area to which the label “empty” is assigned, the data 543 or 553 indicates “empty”. Information indicating which position in the display area the label “empty” indicates is stored in advance in a format that can be processed by the template interpreting unit 212.

The arrangement information file designation position means that, when an arrangement information file is created such that the user intuitively sets the position using an editor or the like capable of generating the arrangement information file, the information of the file itself indicates the position. Therefore, the file is designated by the data 543 or 553.

The motion information of the corresponding part 2j indicated by the data 544 and 554 is interpreted and acquired by the template interpreting section 212. Data 544 and 554
Is a fixed motion that is a parameter corresponding to the motion information,
Indicates one of the specified motion and the motion information file specification.

The motion information indicates the motion of the corresponding component 2j on the display of the composite data. For example, tag 44
In the case where the component 2j indicated by is the data representing the sun, it is designated by the data 544 as motion information indicating a motion such as rotation of the sun. When the parameter of the motion information is a standard motion, the information on the motion is registered in advance in the component database 240 together with an identifier such as a keyword (not shown), and thus the standard motion information is designated. For example, a motion called “rotation” is designated by the standard motion information. When the motion information is “specified motion”, a coordinate position indicating the motion is specified.

When the motion information is “motion information file designation”, if the user intuitively sets the motion and creates the motion information file using an editor or the like that can generate the motion information file, the file itself is created. Since the information indicates the motion, the file is specified. Here, the motion information file is, for example, a file that stores coordinate system information indicating the trajectory of the ball when the ball moves up and down.

The data 545 and 555 correspond to the part 2
By indicating j and the synchronization information for specifying the synchronization regarding the display of the composite data, one of a plurality of types of parameters such as an absolute time, a relative time, and a synchronization information file can be specified. The synchronization information indicates the display timing of the component 2j in displaying the composite data. When the combined data is a still image, data corresponding to the tag 445 or 455 is not described. The type of parameter corresponding to the synchronization information is D
It can be additionally defined by TD. For example, when the synchronization information indicated by the data 555 corresponding to the tag 455 of the component 2j is indicated by “absolute time = display after 5 seconds”, the component 2j is displayed 5 seconds after the display of the composite data is started. Indicates that

Synthetic data 3 of synthesizing database 250
Each of h includes composite data contents 3C made up of pointer information indicating the component 2j to be synthesized in the component database 240, and template information 3B indicating template data 1C describing attribute information in synthesis of each component 2j. In other words, since the composite data 3h does not include the component 2j to be composed, if the component data 2D of the component 2j needs to be modified, the corresponding component in the component database 240 It is only necessary to update the data of the component data 2D of the component 2j, and there is no need to perform the combining process again on the composite data 3h using the component 2j after data correction as a composition target.

When displaying the desired combined data 3h registered in the combining database 250 on the monitor 110,
The synthesized data display processing unit 208 outputs the corresponding synthesized data content 3
It acts to display C on the monitor 110. Specifically, when the desired name of the composite data 3h is input from the user arbitrary input unit 204, the corresponding composite data identifier is input from the database for synthesis 250 via the database search unit 216 using the input name as a key. 3A is read out, and the combined data display processing unit 2
08. The composite data display processing unit 208 converts the component data 2 of the component 2j of the component database 240 specified by the composite data content 3C of the given composite data 3h.
D is synthesized based on the template data 1C of the template 1i of the template database 230 specified by the template information 3B, and converted according to the data format indicated by the corresponding synthesized data type information 1D. To be displayed.

(Embodiment 2) In the present embodiment 2, in order to associate the synthesized data with arbitrary data, it is not shown in the template data 1C of FIG. 5, but it specifies what the arbitrary data is. Tag <corresponding data>
And parameter indicating the content of association <corresponding parameter>
Attribute information is added. The optional data includes
The composite data created by the above-described procedure may be included.

FIG. 6 is a flowchart of the synthesizing process according to the second embodiment. FIGS. 7A and 7B are diagrams showing examples of a display screen according to the second embodiment. Here, attribute information for associating with arbitrary data is <corresponding data>
Indicates “Calendar”, and <corresponding parameter> is set with “Time information”. For example, one or more parts 2j in the category of “when, where, and who did what” are based on the scenario of “playing tennis with Taro near the company on New Year's Day” according to the synthesis processing method of the first embodiment. It is assumed that the synthesized data content 3C generated as described above is associated with arbitrary data indicating a calendar image. In this case, the <corresponding data> indicates “calendar” in the template data 1C of the corresponding template 1i,
<Corresponding parameter> is set in “time information”.

For example, when the time information of <corresponding parameter> indicates “time stamp at the time of combining”, the time stamp information at the time of combining is added as attribute information of the combined data. A synthesis processing procedure based on such template data 1C will be described with reference to FIG.

First, the user operates the user arbitrary input section 204 to input information indicating the desired composite data 3h, and the composite data display processing section 208 transmits the input information via the database search section 216. The composite database 250 is searched based on the input data, and the desired composite data 3h having the composite data identifier 3A corresponding to the input information
Is read (step S500).

Then, the composite data type (format type) 1D of the template 1i of the template database 230 specified by the template information 3B of the read desired composite data 3h is extracted, and based on the description contents of the corresponding template data 1C. The attribute information of <corresponding data> is extracted (steps S510 and S520). The <corresponding parameter> indicated by the extracted attribute information is extracted (step S530).

Then, mapping is performed according to the extracted attribute information. Specifically, the component database 24 indicated by the pointer information of the corresponding composite data content 3C
0 is combined with the component data 2D of the component 2j according to the corresponding template data 1C, and the combined data type 1D
2 based on the combined data obtained by the format conversion, the data of "Calendar" indicated by <corresponding data>, and the "time stamp at the time of combination" indicated by <corresponding parameter>, that is, not shown in FIG. Mapping is performed by association based on the time measurement information by the timer, and displayed on the monitor 110 as shown in FIG. 7A (step S540). FIG. 7B shows an enlarged image of the combined data based on the combined data content 3C displayed in FIG. 7A.

Here, since January 1 is indicated by “time stamp at the time of combination” which is the time information of <corresponding parameter>, that is, processing by the combined data display processing unit 208 is performed on January 1. Therefore, a screen display according to the above-described desired scenario is performed as shown in FIG. However, if such processing cannot be performed on January 1, it is difficult to match the above-described scenario.

Therefore, the time information of <corresponding parameter> in the template data 1C can be described as “designated time stamp” or “arbitrary time stamp”. In the case where such a description is made, the user inputs the user's arbitrary input unit
Is referred to as time information for mapping. Therefore, even when the synthesizing process cannot be performed on January 1, the image of FIG. 7A that matches the above-described scenario can be obtained.

(Embodiment 3) Next, Embodiment 3 will be described. FIGS. 8A and 8B show the third embodiment.
It is a figure which shows the example of a display screen by. Here, in order to associate the synthesized data contents 3C with arbitrary data, attribute information based on a tag <corresponding data> for specifying what the arbitrary data is and a parameter <corresponding parameter> indicating the contents of the association are added. You. Here, position information is used as attribute information.

[0096] As shown in FIG.
Although not shown in the template data 1C of the template 1i for associating (see FIG. 8B) with the map data which is arbitrary data, <corresponding data> is “map”.
In <corresponding parameter>, attribute information set as "position information" is described.

For example, when the position information of the <corresponding parameter> indicates "GPS data at the time of synthesis", the data indicating the position of the information processing terminal in FIG. It is added as attribute information. When the combined data display processing unit 208 interprets that the description content of the template data 1C indicated by the template information 3B of the desired combined data 3h has a correspondence with the map data as arbitrary data, the combined data display processing unit 208 combines the map data with the combined data. Mapping is performed according to the position information (“GPS data at the time of synthesis”) of the <corresponding parameter>, and displayed on the monitor 110 as shown in FIG.
FIG. 8B shows an enlarged image of the combined data based on the combined data content 3C displayed by mapping in FIG. 8A.

Note that this display processing is similarly performed according to the procedure of the above-described flowchart of FIG.

(Embodiment 4) In Embodiment 4, the combined data is displayed in association with an address book which is arbitrary data. FIGS. 9A and 9B are diagrams showing examples of a display screen according to the fourth embodiment. The template data 1C of the template 1i that associates the synthesized data with the address book includes:
A tag <corresponding data> for specifying what the arbitrary data is and attribute information based on a parameter <corresponding parameter> indicating the content of association are added. here,
Attribute information such that <correspondence data> is “address book” and <correspondence parameter> is “personal information” is set.

For example, when the personal information of <corresponding parameter> is indicated as “name”, the data of an arbitrary name specified by the user by operating the user arbitrary input unit 204 during the combining process is the attribute information of the template data 1C. Will be added as When the combined data display processing unit 208 interprets that there is an association with the address book based on the template data 1C indicated by the template information 3B of the desired combined data 3h, the combined address data and the combined data contents 3C
Are mapped based on the personal information, and a screen as shown in FIG. 9A based on the combined data obtained as a result is displayed on the monitor 110. FIG. 9B shows FIG.
The image of the combined data based on the combined data content 3C mapped and displayed in (A) is shown in an enlarged manner.

Note that this display processing is similarly performed in accordance with the procedure of the flowchart shown in FIG.

(Fifth Embodiment) Next, a fifth embodiment will be described.

The processing functions described above are realized by a program. In the fifth embodiment, this program is stored in a computer-readable recording medium.

In this embodiment, this recording medium is
The ROM such as the ROM of the memory 124 required for the processing by the information processing apparatus shown in FIG. 2 may be a program medium itself, or a magnetic tape device and a CD-ROM as external storage devices. Drive device 14
0 may be a program medium that can be read by inserting a magnetic tape or CD-ROM 142 as a storage medium into a program reading device such as 0. In any case, the stored program is the CPU 12
2 may be accessed and executed, or in any case, the program is read once and the read program is stored in a predetermined program storage area of the apparatus of FIG. A method of loading, reading, and executing by the CPU 122 may be used. It is assumed that the loading program is stored in the information processing apparatus in advance.

Here, the above-mentioned program medium is a recording medium which is configured to be separable from the main body of the information processing apparatus. ROM142 / MO (Magnetic Optical
Disc) / MD (Mini Disc) / DVD (Digital Vers)
atile Disc), card system such as IC card (including memory card) / optical card, mask ROM, EPROM (Erasableand
Programmable ROM), EEPROM (Electrically
It may be a medium that fixedly carries a program including a semiconductor memory such as an EPROM) or a flash ROM.

Further, in the present embodiment, since the information processing apparatus is configured to be connectable to a communication network 182 including the Internet, a program is downloaded from communication network 182 and carries the program in a fluid manner. It may be a medium. When the program is downloaded from the communication network 182 in this way, the download program may be stored in the information processing apparatus main body in advance, or may be installed in the information processing apparatus main body in advance from another recording medium. May be used.

The content stored in the recording medium is not limited to a program, but may be data.

The embodiments disclosed this time are to be considered in all respects as illustrative and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

[0109]

According to the present invention, it is only necessary to select the object specifying information of an object which appears in a desired scenario and is desired as a target of the composition processing from the presented object specifying information of a plurality of objects. ,
The data of the selected desired object can be synthesized to obtain synthesized data. Therefore, when the user synthesizes the data of the desired object according to the desired scenario to obtain the synthesized data, the user only needs to perform the simple operation of performing the external input for the object selecting operation.
It is practical.

[Brief description of the drawings]

FIG. 1 is a functional configuration diagram of a data synthesis processing system according to each embodiment of the present invention.

FIG. 2 is a configuration diagram of an information processing apparatus equipped with a data synthesis processing system according to each embodiment of the present invention.

FIG. 3 is a flowchart of a data synthesis process according to the first embodiment.

FIGS. 4A and 4B are diagrams showing examples of a display screen for selection according to the first embodiment.

FIG. 5 is a diagram illustrating an example of a description of the contents of template data 1C of template information 1i of FIG. 1;

FIG. 6 is a flowchart of a combining process according to the second embodiment.

FIGS. 7A and 7B are diagrams showing examples of a display screen according to the second embodiment; FIGS.

FIGS. 8A and 8B are diagrams showing examples of a display screen according to the third embodiment.

FIGS. 9A and 9B are diagrams showing examples of a display screen according to the fourth embodiment. FIGS.

[Explanation of symbols]

200 user interface, 210 synthesis processing engine, 230 template database, 240 parts database, 250 synthesis database, 1i
Template, 2j parts, 3h synthetic data, 1C
Template data, 3C synthesized data contents.

Continued on the front page F term (reference) 5B050 BA08 CA07 EA24 FA02 5B057 CE08 CH01 CH11 CH14 5C053 FA14 FA23 FA27 GA11 GB06 GB19 GB36 HA29 JA21 KA05 KA24 LA06 LA15

Claims (15)

[Claims] 1. A presentation unit that presents object identification information that identifies a plurality of objects that can appear in a scenario according to scenario information that indicates a desired scenario, and based on the object identification information presented by the presentation unit. Object selecting means for selecting a desired object from the plurality of objects according to an external input; and specifying object data corresponding to the desired object selected by the object selecting means in a previously prepared object data group. And a data synthesizing unit for synthesizing the plurality of object data specified by the data specifying unit in accordance with the scenario information to generate synthesized data. 2. The scenario information includes attribute information indicating an attribute of the combined data corresponding to the scenario, and the desired data specified in the data group is indicated by the attribute information in the combining process. The data synthesis processing device according to claim 1, wherein the attributes are associated with each other. 3. An output unit for outputting the combined data generated by the data combining unit in accordance with the scenario information, wherein the attribute information includes the attribute information when the combined data is output by the output unit. 3. The data synthesizing apparatus according to claim 2, wherein output mode information for determining an output mode for each of the plurality of object data is included. 4. The data synthesis processing apparatus according to claim 3, wherein the output mode information includes information on an arrangement of each of the plurality of object data. 5. The output mode information according to claim 3, wherein the output mode information includes information on an output timing for each of the plurality of object data.
2. The data synthesis processing device according to 1. 6. The data synthesizing apparatus according to claim 3, wherein the output mode information includes information on a motion of each of the plurality of object data. 7. The data synthesizing processing apparatus according to claim 2, wherein said output means has an association output means for outputting said composite data in association with arbitrary data. 8. The data synthesizing apparatus according to claim 7, wherein the scenario information includes information specifying the arbitrary data and related content information specifying the related content. 9. The data synthesis processing device according to claim 8, wherein the related content information is indicated by time information included in the arbitrary data. 10. The data synthesizing apparatus according to claim 8, wherein the related content information is indicated by position information of the arbitrary data. 11. The data synthesis processing device according to claim 8, wherein the related content information is indicated by personal information included in the arbitrary data. 12. For each piece of the synthesized data generated by the data synthesizing means, scenario instruction data indicating the scenario information of the synthesized data and the object in the object data group used for generating the synthesized data. Combined data storage means for storing object instruction data indicating data in association with each other, and the output means, wherein the desired combined data in the combined data storage means is designated by the corresponding scenario instruction data. 12. The data synthesizing processing apparatus according to claim 3, wherein the object data in the object data group indicated by the corresponding object instruction data is synthesized and output according to scenario information. 13. A presentation step of presenting object identification information for identifying a plurality of objects that can appear in the scenario according to scenario information indicating a desired scenario, and based on the object identification information presented by the presentation step. An object selecting step of selecting the desired object from the plurality of objects according to an external input; and specifying object data corresponding to the desired object selected in the object selecting step in a previously prepared object data group. A data specifying step of performing a data combining step of combining the plurality of object data specified by the data specifying step in accordance with the scenario information to generate combined data. Method. 14. A machine-readable recording medium on which a data synthesis processing program for executing a data synthesis processing method by a computer is recorded, wherein the data synthesis processing method is based on scenario information indicating a desired scenario. A presentation step of presenting object identification information for identifying a plurality of objects that may appear in the scenario; and an external input based on the object identification information presented by the presentation step, the object selected from the plurality of objects. An object selecting step of selecting an object; a data specifying step of specifying object data corresponding to the desired object selected in the object selecting step in a prepared object data group; and the data specifying step Characterized in that it comprises a data combining step of generating a combined data by combining the processing in accordance with the scenario information more specific the plurality of object data are, machine-readable recording medium recording the data synthesizing program. 15. A data synthesis processing program for executing a data synthesis processing method on a computer, the data synthesis processing method comprising: a plurality of objects that can appear in the scenario in accordance with scenario information indicating a desired scenario. A presentation step of presenting object identification information for identifying the object; an object selection step of selecting the desired object from the plurality of objects according to an external input based on the object identification information presented in the presentation step; A data specifying step of specifying object data corresponding to the desired object selected in the object selecting step in a previously prepared object data group; and the plurality of objects specified in the data specifying step. Characterized in that it comprises a data combining step of generating a combined data by combining the processing in accordance with the scenario information Todeta, data synthesizing program.