JP2001275058A - Method and device for generating explanatory sentence of video content, method and device for programming digest video, and computer-readable recording medium with program for making computer implement the same methods recorded thereon - Google Patents

Abstract

PROBLEM TO BE SOLVED: To generate explanatory sentences having a smooth sentence flow giving no sense of incongruity to a viewer (user) by making clear the connections and relations between explanatory sentences generated from respective video scenes. SOLUTION: A video content explanatory sentence generating device 100 is equipped with an explanatory sentence generation part 101 which receives pieces of character information consisting of fragmentary character strings explaining the contents of respective retrieved video scenes and generates explanatory sentences explaining the video contents of the video scenes by using the character information, a video content decision part 102 which decides the contents of the individual video scenes according to the inputted character information, and a connection expression selection part 103 which selects connection expression out of a sequential connection, reverse connection, parallelism, addition, and selection according to the relation between successive video scenes according to the decision result of the video content decision part 102; and the explanatory sentence generation part 101 connects and outputs explanatory sentences of corresponding successive video scenes by using the connection expression selected by the connection expression selection part 103.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION The present invention relates to a technique for adding supplementary information of a video (video information) as an index with the digitization of broadcasting and creating a digest version of the video using the index. Video content description generation method, video content description generation device and recording medium for generating video description of video content of video scene, and creation of digest video program using generated video content description How to make digest video into a program,
The present invention relates to a digest video programmer and a recording medium.

[0002]

2. Description of the Related Art In recent years, digitalization of broadcasting has been rapidly progressing on a worldwide scale, and BS (Broadcast Sa) has been developed.
Preparations for digital broadcasting and digital terrestrial broadcasting are steadily progressing. This has dramatically changed the way television is viewed,
Storage-type viewing and non-linear viewing are also possible.

Here, a description will be given of a digest creation system in a non-linear viewing mode which has been proposed by the present applicants. The present applicant first searches for a video scene assumed to be an important scene using the index for a video to which supplementary information is added as an index, and retrieves a digest version of the video (digest video).
We devised a digest creation system that creates a video, and in this digest creation system, it is enough to generate an outline of the cross-sectional index as an explanatory sentence because the video scenes determined to be important scenes also include audio commentary The idea of generating a description of the video content has been considered. In addition, when creating a digest video using an index, a digest creation device that creates a digest video that reflects the preferences of a viewer (user) who uses the video is also proposed.

[0004] Details of the above technology are described below.
Has been revealed. Takako Hashimoto, et al .: "Study of Digest Viewing Method Using Program Index", Proceedings of the Society of Image Information and Television Engineers, March 1999, pp. 7-12. Takako Hashimoto et al .: "Prototype of Digest Creation Method Using Program Index", Data Engineering Workshop (DEWS'99) Proceedings CD-ROM, March 1999
Month. Takako Hashimoto et al .: "Trial Production of Digest Creation Method for TV Receiving Terminal", ADBS99 Proceedings, December 1999.

[0005]

However, the above-described process of generating a description of a video content has the following problems. First, for each video scene that is the search result,
Because each fragmentary index is used to generate the description independently, the description is unclear in the connection before and after and the relevance, and the flow of the sentence is smooth for the viewer (user) without discomfort. No description could be generated. Second, since the description is generated using only the fragmentary index of each video scene that is the search result,
It was not possible to generate a preamble sentence or a postscript sentence as a brief explanatory sentence for clarifying the meaning of each video scene as a search result in the preceding and following video scenes. Third, although it is possible to create a digest video reflecting the preference of a viewer (user) who uses the video in the digest creation device, the digest video (video scene) is generated in the process of generating a description of the video content. The description is generated only from the fragmentary index given to the user, and it is not possible to generate the description reflecting the taste of the viewer (user).

Further, according to the prior art, it is possible to use a digest video created using a digest creation device as a simple program by reproducing the digest video as it is, but a program is automatically created from the digest video. It was not possible to create a program by performing an effect reflecting the tastes of the viewers (users).

[0007] The present invention has been made in view of the above, and clarifies the connection and relevance of the description sentence from each video scene before and after, so that the viewer (user) has a smooth and comfortable feeling. A first object is to generate an explanatory sentence of a sentence flow.

Further, the present invention has been made in view of the above, and is an outline explanation for clarifying the meaning of each video scene as a search result in the preceding and following video scenes. A second object is to make it possible to generate a preamble sentence or a postscript sentence as a simple sentence.

Further, the present invention has been made in view of the above, and it is a third object of the present invention to be able to generate an explanatory sentence reflecting the taste of a viewer (user).

Further, the present invention has been made in view of the above, and has been made to automatically create a program from a digest video and to create a program in which an effect reflecting the taste of a viewer (user) has been performed. It is a fourth object of the present invention to provide a digest video programming method or a digest video programming apparatus.

[0011]

According to a first aspect of the present invention, there is provided a method for generating a description of a video content.
Each video scene retrieved as a digest video scene from one video stream is provided with a plurality of pieces of character information including a fragmentary character string or information that can be converted into a character string that describes the content. In the case, in the video content description generating method for generating a video description of each video scene using the text information, the content of each video scene is determined from the text information, Depending on the relationship, select a connection expression from among tangent, reverse connection, parallel, addition, selection, etc., and use the selected connection expression to generate a description of the video content connecting the description of the previous and next video scene Is what you do.

According to a second aspect of the present invention, there is provided a method for generating a description of a video content, wherein the content of each video scene retrieved as a digest video scene from a video stream structured using a hierarchical structure is described. When a plurality of pieces of character information including a fragmentary character string or information that can be converted to a character string are added, a description sentence that describes the video content of each video scene is generated using the character information. In the method of generating a description of the video content, determine the content of each video scene from the character information, according to the relationship between the previous and next video scene, sequential, reverse connection, parallel, addition, select a connection expression from among the selection, Using the selected connection expression, a description of the video content is generated by connecting the description of the relevant video scene before and after.

According to a third aspect of the present invention, in the method of generating a description of a video content according to the second aspect, when generating the description of a video scene of a certain hierarchy, By using a hierarchical structure, a preamble sentence, which is a preamble of the explanatory note, is generated from the character information of the video scene of the upper layer of the video scene of the relevant layer together with the descriptive text indicating the video content of the video scene of the relevant layer. is there.

According to a fourth aspect of the present invention, in the method for generating a description of a video content according to the second or third aspect, when generating a description for a video scene of a certain hierarchy, By using the hierarchical structure, a postscript that is a postscript of the explanatory note is generated from the character information of the video scene of the upper layer of the video scene of the layer, together with the descriptive text indicating the video content of the video scene of the layer. Things.

According to a fifth aspect of the present invention, there is provided the video content description generating method according to any one of the first to fourth aspects, further comprising the step of generating a video scene description. In doing so, the sentence expression of the explanatory note is changed according to the preference of the user, using preset user preference information.

According to a sixth aspect of the present invention, there is provided a method for generating a description of a video content, wherein each video scene retrieved from one video stream as a scene for a digest video is
When a plurality of pieces of character information including a fragmentary character string or information that can be converted into a character string that describes the content is added, a description that explains the video content of each video scene using the character information is added. In the method for generating a description of a video content to be generated, when generating a description of each video scene, the sentence expression of the description is used by the user's preference information set via the setting means. It is changed according to taste.

According to a seventh aspect of the present invention, in the method of generating a description of a video content according to the fifth or sixth aspect, the emotion of the user with respect to the video content is previously determined for each video scene. A plurality of parameters for calculating the degree of dynamic change are defined as emotion degree parameters, and when the sentence expression of the explanation is changed according to the user's preference, the emotion corresponding to each video scene is changed. Using the degree parameter and the preference information, the degree value of the emotional reaction of the user to each video scene is calculated, and the emotional expression is shown in the description explaining the video content of the video scene based on the degree value. An emotion expression is added.

According to a eighth aspect of the present invention, in the method of generating a description of a video content according to the seventh aspect, the plurality of emotion degree parameters are added to the video scene. The degree is quantified by a combination of the contents of the character information and the contents of the preference information, and the degree value is calculated using the quantified degree.

According to a ninth aspect of the present invention, there is provided a video content description generating apparatus, wherein a fragmentary character string describing the content of each video scene retrieved as a digest video scene from one video stream is provided. Alternatively, when a plurality of pieces of character information composed of information that can be converted into a character string are added, a description generator that generates a description describing the video content of the video scene using the character information. In the sentence generation device, a video content determining unit that determines the content of each video scene from the character information, and based on the determination result of the video content determining unit, a sequential connection, a reverse connection, parallel, Connection expression selecting means for selecting a connection expression from addition and selection, wherein the explanatory sentence generation means uses the connection expression selected by the connection expression selection means to select a connection expression. That it is intended to connect the description of the front and rear of the video scene.

A video content description generating apparatus according to a tenth aspect is directed to a video content structured using a hierarchical structure, for each video scene retrieved as a digest video scene from a video stream. When a plurality of pieces of character information including a fragmentary character string to be described or information that can be converted to a character string is added, a description to generate a description describing a video content of a video scene using the character information. In the video content description generation device having a generation unit, a video content determination unit that determines the content of each video scene from the character information, based on the determination result of the video content determination unit, by the relationship between the previous and next video scene, Connection expression selecting means for selecting a connection expression from among sequential connection, reverse connection, parallel, addition, and selection, wherein the explanatory sentence generation means selects the connection expression with the connection expression selection means. Using the connection representations, appropriate it connects the descriptions before and after the video scene.

[0021] In the video content description generating apparatus according to claim 11, the video content description generating apparatus according to claim 10 further comprises: Is generated, using the hierarchical structure described above, together with the descriptive text indicating the video content of the video scene of the hierarchical level, and the character information of the video scene of the hierarchical level higher than the video scene of the hierarchical level becomes a preamble to the description. This is to generate a foreword sentence.

A video content description generating apparatus according to claim 12 is the video content description generating apparatus according to claim 10 or 11, further comprising:
When generating a description of a video scene of a certain hierarchy, the description of the video content of the video scene of the hierarchy is used together with a description of the video content of the video scene of the hierarchy using the hierarchical structure. A postscript sentence to be a postscript of the explanatory note is generated from the character information.

Further, according to a thirteenth aspect of the present invention, there is provided a video content description generating apparatus for each video scene retrieved as a digest video scene from one video stream.
When a plurality of pieces of character information including a fragmentary character string or information that can be converted to a character string that describes the content is added, a description sentence that describes the video content of the video scene is generated using the character information. In the video content description generating apparatus having a description generating means, a plurality of parameters for calculating a degree of a user's emotional change with respect to the video content are previously defined for each video scene as an emotion degree parameter. Using the stored storage means, setting means for setting user preference information, and the emotion degree parameter and preference information corresponding to each of the video scenes, the degree of the user's emotional reaction to each video scene Calculating means for calculating a value, wherein the description generating means generates a description explaining the video content of the video scene using the character information, Based on the fit value is for adding the emotion statements indicating emotional expressions.

According to a fourteenth aspect of the present invention, in the video content description generating apparatus according to the thirteenth aspect, a plurality of parameters of the emotion degree parameter are added to the video scene, and The degree is digitized by a combination of the content of the preference information and the content of the preference information, and the calculating means calculates the degree value using the digitized degree.

According to a fifteenth aspect of the present invention, there is provided a recording medium on which a program for causing a computer to execute the method for generating a description of a video content according to any one of the first to eighth aspects is recorded.

A digest video program conversion method according to claim 16, wherein each video scene retrieved from one video stream as a digest video scene, and a video created for each of the video scenes A digest video program is created by inputting a description of the content and providing the description of the video content in voice or text via a preset virtual character in addition to the reproduction of each video scene. A method for converting a digest video into a program, comprising a description of the video scene and the video content,
A degree value of the emotional reaction of the virtual character to the video content of each video scene is input, and an effect of expressing the emotion of the virtual character is produced based on the degree value for each video scene.

[0027] According to a seventeenth aspect of the present invention, there is provided a digest video program conversion method, wherein a digest video image scene and a video content description sentence generating method according to the seventh aspect are used together with the digest video image scene. A digest video programming method for creating a digest video program by inputting the explanatory text, the preamble text, the postscript text, and the degree value, wherein, in addition to the reproduction of each video scene, a preset virtual character In addition to providing the description, the preamble, and the postscript via audio, the effect of expressing the emotion of the virtual character is produced based on the degree value for each video scene.

Also, a digest video programmer according to claim 18 is provided in which each video scene retrieved from one video stream as a digest video scene, a pre-created description of each video scene, Foreword,
A digest video programmer that inputs a postscript sentence and a degree value indicating a degree of emotional change of a user with respect to the video content, and creates a digest video program. A video file generating means for generating a video file by associating the description, the preamble, the postscript and the degree value for each video scene, and a program storing at least various configuration information of a program including at least a virtual character as a program definition file A definition file database, an effect definition database in which a plurality of emotion expression levels are set, and an effect template storing one effect method for each of the emotion expression levels is stored;
Selecting means for inputting the video file, determining a degree of emotional expression based on a degree value for each video file, and selecting an effect expression effect template according to the degree of emotional expression from the effect definition database; A program description file, a video file, and a rendering template, and a description sentence based on the selected rendering template for each video file, at least as a reproduction timing of the video scene and a sound of the virtual character, It is provided with effect processing means for performing a program effect process for each video file by setting a preamble sentence, a postscript sentence, the output timing of audio, and the motion of the virtual character.

According to a nineteenth aspect of the present invention, there is provided the digest video programming apparatus according to the eighteenth aspect, wherein the various types of configuration information of the program in the program definition file include at least one virtual character. ,
It consists of information such as the studio set of the program, the number and position of cameras, CG lighting, CG props, sound, program title, supermarket settings, and the like.

According to a twentieth aspect of the present invention, there is provided the digest video programming apparatus according to any one of the eighteenth to nineteenth aspects, wherein the degree value is an emotion such as emotion, emotion, and so on. A plurality of effect templates classified as emotion index information and the degree of emotional expression as a key index are stored in the effect definition database, and the selecting means includes: When selecting the effect template,
Based on the degree value, the degree of emotion type information and emotion expression used as a key index is determined, and all the effect templates are selected from the effect definition database.

The digest video programming apparatus according to claim 21 is the digest video programming apparatus according to claim 20, wherein the degree value can be constituted by a plurality of degree values. The effect definition database stores a plurality of effect templates in which a plurality of emotion type information and a degree of emotional expression of the plurality of emotion type information are classified as a key index, and the selecting means includes: When selecting a template, a plurality of emotion type information to be used as a key index and a degree of emotion expression of the plurality of emotion type information are determined based on the plurality of degree values, and all corresponding expression definitions from the effect definition database are determined. This is for selecting an effect template.

The digest video programming apparatus according to claim 22 is the digest video programming apparatus according to any one of claims 18 to 21, further comprising:
The program definition file includes a designation unit for designating a desired program definition file from a plurality of program definition files. The program definition file database stores a plurality of program definition files. When performing the program effect processing in file units, the program effect processing in the video file unit is performed based on various kinds of configuration information by inputting the program definition file specified through the specifying means. .

A digest video programming apparatus according to claim 23 is the digest video programming apparatus according to claim 22, wherein the rendering template is applicable to a defined rendering method. Information is set, and when there are a plurality of effect templates selected by the selecting means, the effect processing means refers to the program environment information of each effect template and specifies the program definition specified via the specifying means. Select one of the production templates executable in the program environment provided by the file,
The program effect processing is performed for each video file.

According to a twenty-fourth aspect of the present invention, there is provided the digest video programming apparatus according to the twenty-third aspect, wherein the effect template includes a defined effect method for one digest image. Use number limitation information for limiting the number of times of use when performing program conversion can be set, and the effect processing means selects one of the executable effect templates and then uses the use number limitation information in the effect template. Is set, the number of times the selected effect template has been used in the past is compared with the use count limitation information to determine whether or not the template can be used. This is for selecting an effect template.

According to a twenty-fifth aspect of the present invention, there is provided the digest video programming apparatus according to any one of the twentieth to twenty-fourth aspects. Processing is
When the selection of the effect template of one video file is completed by the selection means, the sequential processing function of selecting and processing the effect template to be used, and the selection of the effect template of all the video files by the selection means are ended. Waiting, selecting an effect template to be used in each video file, and having a batch processing function for processing, wherein the effect processing means, when performing processing using the batch processing function, the selecting means With reference to all the selected effect templates, for each set of effect templates having the same degree of emotion type information and emotion expression, the number of times the set has been selected is determined. When there are a plurality of different effect templates in one set, the number of selection of each effect template should be uniform. And selects the output template.

A digest video programming apparatus according to a twenty-sixth aspect is the digest video programming apparatus according to the twenty-fifth aspect, wherein the effect templates are emotion type information and degree of emotion expression included in each effect template. Of the degree values associated with the, it is possible to set designation information that specifies that the video file having the highest degree value or the video file having the lowest degree value to be used for the program effect processing, and the effect processing means If there is a rendering template in which the designation information is set, the rendering template is compared with the degree values of all the selected video files, and the rendering template is determined to have the maximum degree value or the minimum degree. It is used only for the program effect processing of a video file having a value.

A recording medium according to a twenty-seventh aspect stores a program for causing a computer to execute the digest video programming method according to the sixteenth or seventeenth aspect.

[0038]

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, a method for generating a description of a video content, a device for generating a video content description, a method for converting a digest video into a program, a device for converting a digest video into a program and a method for causing a computer to execute the method will be described. An embodiment of a computer-readable recording medium on which a program is recorded will be described in detail with reference to the accompanying drawings.

[Embodiment 1] FIG. 1 is a schematic configuration diagram of a video content explanation generating apparatus according to Embodiment 1. The video content description generating apparatus 100 according to the first embodiment inputs a plurality of pieces of character information including a fragmentary character string that describes the content of each video scene retrieved as a digest video scene from a digest creation engine (not shown). A description generating unit 101 that generates a description describing the video content of the video scene using the character information; a video content determining unit 102 that determines the content of each video scene from the input character information;
A connection expression selection unit 103 for selecting a connection expression from forward, reverse, parallel, addition, and selection based on the relationship between the preceding and following video scenes based on the determination result of the video content determination unit 102;
Consists of

Here, it is assumed that a video stream structured using a hierarchical structure is used. For example, structuring using a hierarchical structure means that the entire video is the highest level,
The video scenes are sequentially divided such that the highest hierarchy is divided into logically meaningful video scenes (video units) to form the next hierarchy, and the divided video scenes are further divided into the next hierarchy. It can be easily realized by dividing and structuring. Also, each of the video scenes of the structured video stream has a plurality of pieces of character information composed of fragmentary character strings (or information that can be converted into character strings) describing the contents as indexes. I do.

A digest creation engine searches for a digest video scene from a structured video stream, and retrieves each of the searched video scenes and a fragmentary character string (character information) describing the content. Regarding the output technique, the technique previously filed by the present applicant (for example, Japanese Patent Application No. 11-058916, “Digest creating apparatus, digest creating method, and computer recording a program for causing a computer to execute the method”) It can be easily realized by using a readable recording medium ").

The description generating unit 101 connects and outputs the description of the relevant video scene before and after using the connection expression selected by the connection expression selecting unit 103.
Further, when generating a description about a video scene of a certain hierarchy, the description generation unit 101 uses a hierarchical structure to generate a description.
Along with a description showing the video content of the video scene of the hierarchy,
Based on the character information of the video scene of the higher hierarchy of the video scene of the hierarchy, a preamble sentence which is a preamble of the description and a postscript which is a postscript of the description are generated.

The operation of the above configuration will be described in the order of the process of adding a connection expression and the process of generating a preamble / postscript sentence. Connection Expression Addition Processing This connection expression addition processing is performed by the video content determination unit 102
And the connection expression selection unit 103. In the process of adding a connection expression, an explanatory sentence is generated from a character string (character information) that describes each video scene, and instead of presenting them continuously, attention is paid to the content relationship between the preceding and following video scenes. Add the appropriate connection between the two legends. As a result, the flow of a sentence composed of a plurality of explanatory sentences in which the explanatory sentences of the respective video scenes are arranged becomes smooth, which helps the viewer understand the situation.

First, a description will be given of a function for inputting character information of two video scenes cut out as digest videos by the digest creation engine, analyzing the contents of the video scenes, and judging the relationship therebetween. Hereinafter, this function is referred to as a connection relation determination function.

Generally, there are the following five types of connection relations, and the connection relation judgment function takes any one of these as a return value. 1. Parallel: Represents the meaning of arranging. Example: Also, and, or, and. 2. Addition: Represents the meaning of addition. Example: And, moreover, additionally. 3. Choice: Represents the meaning of choosing one or the other. Example: Or, or, or. 4. Tangent: what is stated before is the cause of what is stated later,
An indication of the reason. Example: So, therefore, and therefore, and so, then. 5. Inverse: An indication that what is said before and what is after are inversely related. Example: But, however, it is, however, that, however, however.

Character information input from the digest creation engine is given as an argument of the connection relation determination function. In the first embodiment, in addition to a fragmentary character string that describes the content of a video scene, a digest creation engine calculates the value of an importance determination parameter described later, and generates a video content description generation device as character information. Output to 100,
In the video description generating apparatus 100, the value of the importance determination parameter is used together with the character string as an argument of the connection relation determination function.

Hereinafter, a connection relation determination function for a baseball program will be specifically described as an example. Representative connection expressions in the case of a baseball program include the following additional connection and reverse connection expressions. * Additional connection between video scenes with additional points: Example: More → “<More>, One Out, Runner 2
Base run, 3rd base, XX, home run, ,, "* Reverse connection expression when scoring chance is missed: Example: But → → proceeded to runner XX 3rd base. <But> 4th XX center fly Collapse ,,,, "

When the video for which the description is to be generated is baseball, the importance determination parameters used in the connection relation determination function are as follows. Note that each of them takes a positive value. * Attack level (importance judgment parameter) Indicates the level that is offensive. Raises during aggressive events such as hits and home runs. * Excitement level (importance determination parameter) Indicates the expectation and excitement of the viewer. For example, the batting order is 3,
The price goes up when the 4th or 5th cleanup at bat or the runner is on 3rd base and has a specific chance. * Pitcher level (importance judgment parameter) Indicates the pitcher and defense condition. Increases during strikes and continuous strikeouts.

FIG. 2 shows an algorithm of the connection relation discrimination function. In the example of this algorithm, in order to simplify the explanation, when the class of the structure of the video for which the description is to be generated is a small class such as a bat or pitching class (in other words, the hierarchy of the video scene described above is a lower hierarchy) Case)
And in the case of a large inning class (in other words,
The above-described video scene hierarchy is a higher hierarchy). In the former, the calculated value is biased by the excitement level using [attack level-pitcher level] as an index (content index level). The magic numbers α, β, and γ are set to 5, 6, and 0, respectively. The relationship between innings is calculated based on the change in score.

In the case of baseball, the return value of the connection relation discrimination function is either addition or reverse connection. However, in exceptional cases, it is not possible to deny having a value other than this, but in most cases, it is considered that these two types are used. Note that the connection relation determination function does not depend on the taste of the viewer. For example,
Regardless of the fans of either team, the reversal is a reverse connection, and adding points is an addition.

Processing for Generating Preamble / Postscript Sentences When generating a description of a video scene, the description sentence generation unit 101 converts various situations at that time, preconditions, and the like as preambles as necessary. Present. Further, a certain video scene is described, and before the description of the next video scene, information on the result of the video scene as a whole is presented as a postscript if necessary. These preamble sentences and postscript sentences are generated from the character information of the parent scene of the corresponding video scene (the video scene of the higher hierarchy) using the hierarchical structure of the video scene.

Specifically, for example, in the case of a baseball video, a preamble sentence (expression of the preamble) is generated from information indicating the situation of the video scene being processed at that time. For example, if the character information added to the parent scene includes: ・ Score status ・ Attack team name ・ Out count ・ Base runner ・ Pitcher name ・ Batter name ・ Ball count, if there are “5 backs, XX attacks, 1 A character string such as "out, runners 2, 3rd base ,," can be automatically generated as a preamble sentence.

The postscript sentence (expression of the postscript) generates information on the result, for example, information on the result, such as a result of the match, a result of the runner starting, and a score result, from the information indicating the situation at that time.

As described above, according to the video content description generating method and the video content description generating apparatus of the first embodiment, the content of each video scene is determined from the character information, and based on the relationship between the preceding and following video scenes, To select a connection expression from sequential, reverse, parallel, addition, selection, etc., and use the selected connection expression to generate a description of the video content connecting the description of the previous and next video scene, Clarify the connections and relevance before and after the description generated from each video scene,
It is possible to generate a description of a flow of a sentence that is smooth for the viewer (user) without any discomfort.

When generating a description about a video scene of a certain hierarchy of each video scene obtained as a search result from a video stream structured using the hierarchical structure, the hierarchical structure is used to generate a description. In order to generate a preamble sentence that is the preamble of the explanation from the character information of the video scene of the hierarchy of, the search result is used to clarify what meaning each video scene has in the previous and next video scene A preamble sentence can be generated as a brief explanatory sentence. Similarly, in order to generate a postscript sentence that is a postscript of the explanatory note from the character information of the video scene of the higher hierarchy of the video scene of the relevant hierarchy, how each video scene that is the search result is It is possible to generate a postscript sentence as an outline explanatory sentence for clarifying the meaning.

[Second Embodiment] FIG. 3 is a schematic block diagram of a video content explanation generating apparatus according to a second embodiment. The video content description generating apparatus 200 according to the second embodiment inputs a plurality of pieces of character information including a fragmentary character string that describes the content of each video scene retrieved as a digest video scene from a digest creation engine (not shown). A description generating unit 201 that generates a description describing the video content of the video scene using the character information; and a degree of the user's emotional change in the video content (preference level) for each video scene in advance. ), A storage unit 202 that defines and stores a plurality of parameters as emotion degree parameters, a setting unit 203 for setting user preference information, an emotion degree parameter and a preference corresponding to each video scene. A calculating unit 204 for calculating a degree value (preference level value) of a user's emotional reaction to each video scene using the information It is.

Note that the plurality of emotion degree parameters are added to the video scene and the degree (preference level) is quantified by a combination of the contents of character information and the contents of preference information. The calculation unit 204 calculates a degree value (preference level value) using the digitized degree.

Further, as will be described in detail later, in the second embodiment, when the description generating unit 201 generates the description explaining the video contents of the video scene using the character information, the description is calculated by the calculation unit 204. An emotion expression sentence indicating an emotion expression is added based on the degree value (preference level value).

In the above configuration, the operation of the emotional expression generation process (emotional expression adding process), which is a main part of the second embodiment, will be described specifically. In the emotion expression generation process, when generating a description from the character information of each video scene, the expression method is changed not only by objectively describing facts but also by using the preference information of the viewer. For example, if the search result is content that is happy for the viewer, an expression full of joy is generated, and if the search result is sad content, an expression expressing sad feeling is generated. In the emotion expression generation process according to the second embodiment, the emotion expression is represented by an explanatory sentence (sentence) using the preference information of the viewer, but the emotion expression generation process itself includes music in a video, color tone of a screen, and the like. Can be reflected in the effect of the virtual character, the expression of the virtual character speaking the explanation, and the like.

Here, a series of emotion expression generation processing by the storage unit 202, the setting unit 203, the calculation unit 204, and the explanation sentence generation unit 201 is described as a function of calculating a viewer's preference level (degree) with respect to search results (hereinafter, referred to as a function). , Described as an emotion degree discrimination function).

Hereinafter, the case of baseball will be described as an example. FIG. 4 shows an algorithm of the emotion degree discrimination function. The preference level is calculated first from the standpoint that the user is an attacking team fan. When the user's preference set in the preference information is the defense team, the sign is reversed at the end. In other words, if the attacking team is on the flow of attack, the degree of joy (the degree of the user's emotional change: positive change) will be high, while the degree of sadness (the user's The degree of emotional change: negative change) increases.

The value is amplified as the preference of the user increases. The amplification adjustment value φ is set to “5” in the figure. This makes it possible to express emotional changes of the user, for example, when a favorite player is appearing, a good scene is more happy and a bad scene is more sad.

Note that this algorithm is based on the assumption that
It is created on the assumption that the user's preference set by the preference information is the same as the team to which the favorite player belongs and the team to which he supports.

Image Content Explanation Generating Apparatus 2 of Embodiment 2
At 00, when the character information of each video scene is input,
The calculating unit 204 reads the emotion degree parameter corresponding to each video scene from the storage unit 202, refers to the preference information set in the setting unit 203, and refers to the preference information corresponding to the emotion degree parameter and the corresponding character information. Is set and calculation is performed to obtain the value of the preference level of the target video scene. Next, the description generation unit 201 inputs the character information of each video scene to generate a description explaining the video content of the video scene, and based on the preference level (degree value) obtained by the calculation unit 204. An emotion expression sentence indicating an emotion expression is added. For example, when the value of the preference level of the video scene is (preference level> θ), an emotion expression sentence indicating an emotion of being happy is added. The description is "two out, runner 3
We will reverse with a timely hit of base and Takahashi. ", The sentence of emotional expression" I did it. "Is added, and the explanation sentence" It reverses with a timely hit of two-out, runner third base, Takahashi. I did it. " .

As described above, according to the method for generating a description of a video content and the apparatus for generating a video content description according to the second embodiment, the description generating means uses the character information to explain the video content of the video scene. When a sentence is generated, an emotional expression sentence indicating an emotional expression is added based on the degree value, so that it is possible to generate an explanatory sentence reflecting tastes in conformity with the sense of the viewer (user). In other words, by generating a description reflecting the preference more flexibly (or stepwise) in accordance with the degree value of the emotional reaction of the user, a personal description according to the preference of the user is generated. A sentence can be created.

Also, in the second embodiment, the degree of the plurality of emotion degree parameters is quantified by a combination of the contents of the character information and the contents of the preference information added to the video scene. Since the degree value is calculated using the determined degree, it is possible to generate an explanatory sentence reflecting tastes further adapted to the senses of the viewer (user). In other words, an emotional expression can be added more flexibly (or stepwise) according to the degree of emotional reaction of the user, and a personalized description reflecting the user's preference is created. be able to.

[Embodiment 3] In Embodiment 3, a method of generating a description of a video content using a description generation algorithm based on a hierarchical structure of a video will be described. FIG.
Indicates an explanatory note generation function (explanatory note generation algorithm) according to the third embodiment. As shown in the figure, the explanation generating function sequentially generates an explanation by using a recursive call while using the connection relation determining function and the emotion degree determining function described in the first or second embodiment.

For example, when generating an explanatory note for a video scene, it is first checked whether or not the video scene is at the top of a class (hierarchy). If it is the head, there is no previous video scene, so the connection relation discrimination function is not called. For each class hierarchy, a preamble sentence and a postscript sentence are added to a set of class instances at the same level.
For example, in baseball, a preamble sentence such as “5 backs, XX attacks, one out, runners 2 and 3rd base” is generated from character information. As the postscript, a score status at the end of the inning, an outline description of the inning, and the like are generated.

The calculated emotion level value is used in various parts of the explanation generating function. In generating the foreword,
Positive value: If you are happy, add an expression such as "happily ,,,". Conversely, a negative value: if sad, add an expression such as "Unfortunately ,,,". In addition, in the case of generating a postscript sentence, add expressions such as "It was really good" and "It was a completely disappointing result".

FIG. 6 is an explanatory diagram showing the order in which explanatory texts are generated for a certain game when the explanatory text generation function of the third embodiment is used. If the viewer is a Hiroshima fan, the description for each will be (1)-
It becomes like (17). If a corresponding sentence is not required, no explanation is generated. In the figure,
The order in which explanatory texts are generated is described using arrows and numbers.

(1) On October 3, a XX vs XX battle was held at Tokyo Dome. (2) One table, Hiroshima attack, (4) At XX at bat, a solo home run was made. (5) It was good. (6) After finishing the table once, XX pre-empts 1-0 with XX home runs. (7) Unfortunately, however, one time, it was immediately reversed to XX. (8) First (9) The lead batter XX made a hit in front of the center. (10) XX is back. (11) In addition, (12) XX is on the foreball. (13) Runner, first and second base. XX, pinch. (14) Moreover, unfortunately (15) XX timely hits, 2 points added. Xx
It is the reverse of 1-2. (17) I finished the back once, and it was reversed to XX 1: 2 and XX. That's a shame.

As described above, according to the third embodiment, the description of the video content is generated by using the description generation algorithm based on the hierarchical structure of the video, so that the effects of the first and second embodiments can be obtained. In addition, the description can be more clearly created using the hierarchical concept expression, and the sentence can be made more readable. In particular, according to the third embodiment, it is possible to obtain an effect that the hierarchical structure of a video can be used for general purposes.

Here, a description will be given of a case where the method for generating a description of a video content and the video content description generating apparatus according to the first to third embodiments are applied to a digest creation system. FIG. 7 is a schematic diagram of a digest creation system that incorporates the video content description generation method of the present invention as a video text generation function, and outputs a scene (video scene) cut out by the digest generation engine and a brief description thereof. An outline of the entire system up to how the information is finally displayed on the TV device after the completion will be described. In the figure, a user interface (UIF) for performing an operation interactively with a TV viewer is referred to as a program viewing user interface.
abbreviated as "O.V. Program Viewer".

The description (character string) and the video scene generated by the digest creation engine are input to a description generation function, and are generated as a description including a connection expression, an emotion expression, and a structural expression. This generated description,
Each video scene, the calculated connection type and preference level are passed to the PV.

[0075] Since the PV is a user interface for watching TV, it is required to have an action description capability that can be performed in a TV program scenario. TVML is known to satisfy this requirement. Note that this T
Hayashi, Orihara, Shimoda, et al .: "Language specifications and CG description method of TV program description language TVML", 3rd Intelligent Information Media Symposium, pp75-8
0, 1997. It is described in.

The TVML is a language widely described and widely used as a language for describing a scenario of a TV program. Therefore, the PV interpreter can use the TVML interpreter as a TV program description language. Note that the following functions of the TVML can be realized by calling the TVML interpreter from the PV interpreter. * Selection and arrangement of CG characters and actions in scenarios (tilting the head, etc.) * Setting of camera position, switching between multiple cameras, pan and tilt * Video and audio file playback * Video effects * Subtitle display

The moving image output by the digest creation system is finally reproduced by the moving image reproduction function of TVML. Further, in the PV description language, it is desirable to be able to describe a TV-like effect such as a change in illumination at a scene transition or a zoom-in action of a camera.

Further, as shown in the figure, a database of the character design, the character vocabulary thereof, etc. is made as a TVML library. For example, the PV can search the vocabulary database of the currently selected character, find the dialogue when that character speaks that type of connected language, and embed it in the code.
Specifically, in the case of multilingual support, the inverse concatenation expression "but", "but", "howev"
er ”and so on.

In the digest creation system as described above, in addition to realizing a simple video search query, how to present a digest video obtained as a search result in an easy-to-understand manner is a major problem. It is clear that incorporating the content description generation method and the video content description generation apparatus as one description generation function is very useful for solving this problem.

The method of generating a description of a video content according to the first to third embodiments described above is realized by executing a program prepared in advance by a computer in accordance with the above-described description and the procedure shown in each flowchart (algorithm). be able to. This program includes a hard disk, floppy (registered trademark) disk, CD-RO
It is provided by being recorded on a computer-readable recording medium such as M, MO, and DVD. Or it can be distributed over a network.

[Fourth Embodiment] A fourth embodiment of the present invention is directed to a digest video programming method and a digest video programming apparatus according to the present invention. The digest video programming apparatus according to the fourth embodiment inputs each video scene retrieved as a digest video scene from one video stream, and a description of the video content created for each video scene. In addition to the reproduction of each video scene, a digest video program is created by providing a description of the video content in voice or text via a preset virtual character. Of the virtual character with respect to the video content of each video scene, and the effect of expressing the emotion of the virtual character is performed based on the degree value for each video scene.

In addition to the video scene for the digest video, a description of each video scene generated by the video content description generating apparatus 200 of the second embodiment, a preamble, a postscript, and a degree value are input. Create a program. At this time, in addition to the reproduction of each video scene, an explanatory sentence, a preamble sentence, and a postscript sentence are provided as audio via a preset virtual character, and the emotion of the virtual character is determined based on the degree value for each video scene. This is to produce an expression.

FIG. 8 is a block diagram showing a digest video programming apparatus 400 according to the fourth embodiment. In addition, 2
Reference numeral 00 denotes the video content description generating apparatus according to the second embodiment described above.
At 00, for each video scene retrieved as a digest video scene, a description value, a preamble text, a postscript text, and a degree value indicating the degree of emotional change of the user to the video content, and a super value ( caption)
Is generated, and these six pieces of information are passed to the digest video programmer 400.

In the fourth embodiment, these six pieces of information will be described as follows. Video scene (video scene) Preface description (preamble) Event description (description) Postscript description (postscript) Super (super) Emotion level parameter (degree value with emotion type information)

However, of these six pieces of information, information other than the video scene is generated as required, or information need not be set as required. Here, the emotion level parameter has emotion type information for indicating the type of emotion such as emotion, emotion, and so on. Emotion type information includes specific emotion types such as "happy", "fun", "laughable", "surprised", "sad", "frustrated", "sorry", and "relief". Is set.

Further, the emotion level parameter can be composed of a plurality of emotion level parameters. For example, the emotion level parameter has an emotion type information of "frustrated" and an emotion level information of "sorry". The emotion level parameter of one video scene may be configured using two emotion level parameters including the emotion level parameter. By using a plurality of emotion level parameters in this way, it is possible to express an emotion such as “regretful and disappointing” by combining the contents of each emotion type information and use it as information.

The digest video programmer 400 according to the fourth embodiment includes a video file generator 401, a program definition file database 402, an effect definition database 403, an effect template selector 404, an effect processor 405, PVML interpreter 406 and TVML
Player 407 and TV (television: display device))
408. Although not shown in the figure, the apparatus further includes a designation unit for designating a desired program definition file from a plurality of program definition files described later. This designation means can be easily constituted by a display screen of a personal computer, a keyboard or the like.

The video file generation unit 401 inputs an event description, a preamble description, a postscript description, a super (caption) and an emotion level parameter for each video scene from the video content description generation device 200, and converts the program into a program. As a processing unit, a video file is generated for each video scene by associating an event description, a preamble description, a postscript description, and an emotion level parameter.

The program definition file database 402 stores
Various configuration information of the program is stored as a program definition file. Examples of the various configuration information of the program in the program definition file include at least one virtual character, a studio set of the program, the number and position of cameras, CG lighting, C
Information such as G props, sounds, program titles, and supermarket settings. Note that a plurality of the program definition files are stored in advance, and addition and change can be easily performed by setting various types of configuration information in a predetermined format.

The effect definition database 403 stores a plurality of effect templates. The effect templates are stored at least for each degree of emotional expression set in a plurality of stages (for example, very, usually, a few three stages). Each production method is defined. These effect templates are classified and stored using the emotion type information and the degree of emotion expression as key indexes.

Further, in the effect definition database 403,
A plurality of effect templates in which a plurality of emotion type information and a degree of emotion expression of the plurality of emotion type information are classified as a key index are also stored.

Further, in the effect template, program environment information indicating a program environment to which the defined effect method can be applied is set.
Use number limitation information for limiting how many times a digest video can be used in a program conversion is set as necessary.

The effect template is a video file having the highest emotion level parameter or an image having the lowest emotion level parameter among the emotion level parameters associated with the emotion type information and the degree of emotion expression included in each effect template. Designation information for designating the file to be used for the program effect processing can be set as required.

The effect template selection unit 404 inputs a video file, determines the degree of emotion expression based on the emotion level parameter for each image file, and obtains an emotion expression corresponding to the degree of emotion expression from the effect definition database 403. Select a production template. Specifically, when selecting an effect template, the emotion type information and the degree of emotion expression to be used as a key index are determined based on the emotion level parameter, and all applicable effect templates are selected from the effect definition database 403. I do.

The effect template selection unit 404
When the emotion level parameter of one video file is composed of a plurality of emotion level parameters, a plurality of emotion type information to be used as a key index based on the plurality of emotion level parameters when selecting an effect template. Then, the degree of the emotional expression of the plurality of pieces of emotion type information is determined, and all corresponding effect templates are selected from the effect definition database.

The effect processing unit 405 includes a program definition file,
A video file and a rendering template are input, and at least the playback timing of a video scene and an event description, a preamble description, and a postscript description output as audio of a virtual character based on the rendering template selected for each video file. By setting the setting and output timing of the voice, and the operation of the virtual character,
Performs program production processing for each video file. At this time, the program definition file to be used uses the program definition file specified via the specifying means.

In the above configuration, an outline of the processing of the digest video programmer 400 will be described with reference to FIG. The digest video programmer 400 first inputs the input files (foreword description, event description, postscript description) generated by the video content description generator 200.
Super and emotion level parameters) and video (each video scene for digest video) are input. Naturally, a plurality of video scenes for the digest video are output, and the input file is generated and output for each video scene. Depending on the video scene, there may be no foreword explanation and afterword explanation.

Further, as described in the first to third embodiments, the above three explanations already include an emotion expression, a connection expression, and a hierarchical structure expression. The emotion level parameter (degree value having emotion type information) from which the emotion expression is created in the video content explanation generating apparatus 200 is
The digest video is passed to the programmer 400 as it is for use in determining the effect of the video scene.

The video file generation unit 401 performs the processing in S9 of FIG.
As indicated by 01, a video file is generated in correspondence with the input video scene, preamble description, event description, postscript description, super and emotion level parameters.

The effect template selection unit 404 determines the emotion ID (degree of emotion expression) from the emotion level parameter for each video file (that is, for each video scene) as shown in S902 to S904 in FIG. Specifically, the application range of the value (level value) of the emotion level parameter is defined for each emotion ID in advance as the emotion expression definition file, and the emotion ID belonging to the emotion level parameter is determined for each scene (S902). , S903), and selects all applicable effect templates from the effect definition database 403 using the obtained emotion ID as a key index (search key).

Here, when the emotion level parameter is composed of a plurality of emotion level parameters, the emotion ID in which the plurality of emotion level parameters are defined is targeted, and the plurality of emotion level parameters are all used as key indexes. Is determined, and all the effect templates are selected from the effect definition database 403. For example, if the emotion level parameters are two, p1 and p2,
In the case of (p1: -5 to -3) and (p2: 5 to 6), the emotion ID is set to "regret and disappointment".

In the emotion expression definition file, a plurality of definitions of the emotion ID and the value range pattern of the emotion ID are arranged, and the emotion ID that matches the pattern first is examined in order from the top.

Next, the effect template selection unit 404
The effect template corresponding to the selected emotion ID is selected. Basically, the relationship between the emotion ID and a certain effect template prepared in advance is a one-to-many relationship. One emotion ID
The reason why a plurality of effect templates are prepared in order to provide the effect with diversity so as not to become a boring program. For example, for the emotion ID “Very happy”, a set of four production templates that define the following production methods is prepared, so that when the “Very happy” scene comes, , One of the effect templates can be selected. (Direction Method 1) Make your face bright red and stand up (Direction Method 2) Weep with tears (Direction Method 3) Sing for three years (Direction Method 4) Break a ball and fly a dove

A point to be noted when defining an effect template is to first set an effect environment framework (program environment information). For example, it is necessary to determine how many virtual characters to appear, what to use as props, and the like. Similarly, it is necessary to set the program environment in the program definition file. Thus, the program environment (production environment) is stored in both the production template and the program definition file.
Is set, the same environment can be used consistently during one program.

For example, if the caster virtual character is 2
If a person is determined first and a corresponding program definition file is determined, then only effects (effect templates) that match the environment framework of two people are combined. An environment identifier (program environment information) is described in the effect template and the program definition file, and is used to confirm that the environment is the same.

In the fourth embodiment, the effect template and the program definition file are described in PVML. Also,
When creating an effect template, the effect is defined using the following two types of variables. (Variable 1) Information passed from the video content description generation device 200 Example: “Event description” is a variable & etetscript
t (Variable 2) Items defined in the program definition file Example: Virtual characters are & Castnn (nn is a subscript) Music and sound effect files are & Soundnn

Since the effect template merely writes the PVML code using the defined variables, the synchronization between the contents can be freely described. For example, the following synchronization method can be considered. (1) First, a virtual character speaks a foreword explanation. (2) Next, the following is performed in parallel. (2a) Reproduction of video scene (2b) Talking of event description (2c) Super (caption) display (3) After that, a postscript description is spoken.

[0108] The effect processing unit 405 performs the processing in S905 shown in FIG.
Execute First, a program definition file, a video file, and an effect template are input, and based on the effect template selected for each image file, at least a reproduction timing of a video scene, an event description to be output as a sound of a virtual character, and a preamble description. By setting the sentence, the postscript description, the output timing of the sound, and the motion of the virtual character, the program effect processing is performed for each video file. At this time, the program definition file to be used uses the program definition file specified via the specifying means.

Further, when there are a plurality of effect templates selected by the effect template selection unit 404, the program environment information of each effect template is referred to and matched with the program environment of the program definition file specified via the specifying means ( It is determined whether or not matching is performed, and one of the effect templates (that is, executable effect templates) that match is selected, and a program effect process is performed for each video file.

The effect template selection unit 404
After selecting one of the effect templates that can be executed, if the number-of-times-of-use information is set in the effect template, the number of times the selected effect template was used in the past and the number-of-times-of-use information can be compared and used. It is determined whether or not there is, and if not usable, another executable effect template is selected.

Specifically, the effect processing unit 405 determines the effect template of each video scene, and then refers to the program definition file and stores the actual data in the above-mentioned variable of the effect template (PVML code) of each video scene. I will embed. The processing flow of FIG. 9 illustrates batch processing for finally creating a PVML code in a lump. On the other hand, when it is desired to proceed with the process interactively with the program user, a sequential process of generating and executing a PVML code for each video scene is performed.

Further, as shown in S906 in FIG. 9, a separate definition group file is created for sharing a group of operations and effects in a subroutine, and a separate definition group file in which the effects are encapsulated is designated to create a series. You can also choose to direct the production.

[0113] As described above, when the selection of an effect template for one video file is completed, the effect processing unit 405 selects the effect template to be used as a program effect process for each image file, After the effect template of the video file has been selected, a batch process is performed in which the effect template to be used in each video file is selected and then processed.

As another modified example of performing the batch processing,
For example, by referring to all the effect templates selected by the effect template selection unit 404, for each set of effect templates having the same degree of emotion type information and emotional expression, the number of times the set has been selected is calculated. When a plurality of different effect templates exist in one set among the sets selected multiple times, the effect templates may be selected so that the number of times of selecting each effect template is uniform. In other words, the number of times selected for each emotion ID is obtained, and among the emotion IDs selected a plurality of times,
Regarding the emotion ID for selecting multiple effect templates,
The effect templates are selected such that the number of selections of each effect template is uniform.

Further, as another modified example of performing the batch processing, the effect processing unit 405 determines that if there is an effect template in which the specified information is set, all the effect templates for which the corresponding effect template has been selected are selected. The emotion level parameters of the video files may be relatively compared, and the corresponding effect template may be used only for the program effect processing of the video file having the maximum emotion level parameter or the minimum emotion level parameter.

Next, referring to FIGS. 10A and 10B,
A screen example of a digest video program displayed on the TV 408 according to the fourth embodiment will be described. The screen of the TV 408 (PVUI screen) is shown in FIG.
A material display area 1001 for displaying a superimposed character, a studio area 1002 for displaying the action of a virtual character and a studio effect (including set, lighting, camera position, etc.), and an operation menu selection by a user (viewer) And an operation menu area 1003 to be used.

In the fourth embodiment, the number of areas is 1
It is a tiled layout without overlapping. The reason why the tiled layout is used as the multi-window display mode is that it is easier for users who are unfamiliar with computers to adjust to the display mode, depending on the user's computer operation skills. It may be selectable.

FIG. 11 shows an example of a final PVML code created as a digest video program by the digest video programmer 400 according to the fourth embodiment. First,
For one video scene of the digest video, first, the virtual character (BOB) speaks the preamble description, and then the event description by the virtual character (BOB) and the reproduction of the video scene are performed in parallel. It is described.

The <head> portion corresponds to the program definition file portion, and the <body> portion is the program body. Parallel processing and sequential processing are <par>, <
seq> tag.

The language specification of the PVML is basically <method, target object, parameter sequence related to method>. However, since there are cases where a large number of methods are described for the target object, the following method sequence is used. "<Set>" as a tag to specify the target object
Was prepared. A frequently used macro such as hurray movement is PV
It is separately defined in advance as an ML library.

The position layout description described in the <head> section will be described. In advance, when the layout of the head section is designated, the screen is divided vertically (<vertic
al>), and then horizontal division (<hor
isontal>). The size is linked while maintaining the relationship of the divided tree information. Therefore, the operation menu area becomes large and the studio area becomes small by the following size changes. FIG.
In the case of the screen shown in (a), the screen is changed to the screen shown in FIG. <viewchange area = "display" duration = "2" dstx = "0" dsty = "0" dstheight = "500" dstwidth = "500"/>

The PVML used in Embodiment 4 is SMI
Since the various functions of L and TVML are called and used, the contents of the production are restricted by the specifications of SMIL and TVML. However, the description language is not particularly limited, and the digest video of the present invention is converted into a program. Obviously, other description languages are applicable in the method and the digest video programming device.

In the fourth embodiment described above, it is easy to switch between the explanation of the virtual character (the audio output of the foreword explanation, the event explanation, and the postscript explanation), the reproduction of each video scene of the digest video, and the display of the supermarket. Can be synchronized while maintaining consistency. This makes it possible to give a presentation that is easy to understand. Also, in the created program, the virtual characters are explained and explained by the virtual characters, and the second embodiment is used.
Of the virtual character using the degree value (emotion level parameter) calculated by the video content description generation device 200, the emotion expression is expressed by the viewer when the created program is evaluated. Helped them understand and became familiar and comfortable.

[0124] The above-described method for converting a digest video to a program according to the fourth embodiment can be realized by executing a previously prepared program on a computer in accordance with the procedure described in the above description. This program is for hard disk, floppy disk, CD-RO
It is provided by being recorded on a computer-readable recording medium such as M, MO, and DVD. Or it can be distributed over a network.

[0125]

As described above, according to the method for generating a description of a video content according to the present invention (claims 1 and 2), the content of each video scene is determined from character information and the relationship between the preceding and following video scenes is determined. Thus, a connection expression is selected from among sequential connection, reverse connection, parallel, addition, selection, etc., and a description of the video content is generated by connecting the description of the previous and next video scenes using the selected connection expression. Therefore, it is possible to clarify the connection before and after and the relevance of the description generated from each video scene, and generate a description of the flow of the text that is smooth for the viewer (user) without discomfort.

According to the video content description generating method of the present invention (claim 3), in the video content description generating method of claim 2, the video stream structured using a hierarchical structure is provided. When generating a description of a video scene of a certain hierarchy of each video scene obtained as a search result from the search result, a description of the video content of the video scene of the hierarchy is used together with a description of the video scene of the hierarchy using the hierarchical structure. In order to generate an introductory sentence that is the preamble of the explanatory note from the character information of the video scene in the upper layer of the video scene, it is necessary to determine the meaning of each video scene that is the search result in the preceding and following video scenes An introductory sentence can be generated as a brief explanatory sentence for clarity.

According to the method for generating a description of a video content according to the present invention (claim 4), the method for generating a description of a video content according to claim 2 or 3 is structured using a hierarchical structure. When generating a description of a video scene of a certain hierarchy of each video scene obtained as a search result from the video stream, the hierarchical structure is used, together with a description showing the video content of the video scene of the hierarchy, and In order to generate a postscript sentence that is a postscript of the explanatory note from the character information of the video scene of the higher hierarchical level of the video scene of the hierarchical level, what meaning does each video scene as a search result have in the preceding and following video scenes It is possible to generate a trailer sentence as a brief explanatory sentence for clarifying the fact.

Further, according to the method of generating a description of a video content according to the present invention (claims 5 and 6), when generating a description of a video scene, a user's preference information set in advance is used. Since the sentence expression of the description is changed according to the user's preference, it is possible to generate a description reflecting the preference of the viewer (user).

According to the method of generating a description of a video content of the present invention (claim 7), in the method of generating a description of a video content according to claim 5 or 6,
A plurality of parameters for calculating the degree of emotional change of the user with respect to the video content are defined as emotion degree parameters, and when changing the sentence expression of the description according to the user's preference, Using the emotion degree parameter and the preference information corresponding to the video scene, the degree value of the emotional reaction of the user to each video scene is calculated, and a description describing the video content of the video scene based on the degree value is calculated. In addition, since an emotion expression sentence indicating an emotion expression is added, a description sentence reflecting tastes can be generated in accordance with the sense of the viewer (user). In other words, by generating a description reflecting the preference more flexibly (or stepwise) in accordance with the degree value of the emotional reaction of the user, a personal description according to the preference of the user is generated. A sentence can be created.

According to the method of generating a description of a video content according to the present invention (claim 8), in the method of generating a description of video content according to claim 7, a plurality of parameters of the emotion degree parameter are set in the video scene. The degree is quantified by a combination of the contents of the character information and the contents of the taste information added to the information, and the degree value is calculated using the quantified degree, so that the degree is further adapted to the sense of the viewer (user). Thus, it is possible to generate an explanatory sentence reflecting tastes. In other words, it is possible to flexibly (or gradually) add an emotional expression sentence according to the degree of emotional reaction of the user,
Further, it is possible to create a personal description that reflects the user's preference.

Further, according to the video content description generating apparatus of the present invention (claims 9 and 10), the video content determination means for determining the content of each video scene from the character information and the determination result of the video content determination means are provided. Connection expression selection means for selecting a connection expression from forward, reverse, parallel, addition, and selection based on the relationship between the preceding and following video scenes, and the description generating means selects the connection expression by the connection expression selecting means Using the connection expression
Smooth text flow without any discomfort for viewers (users) by clarifying the connections and relevance of the descriptions generated from each video scene, by connecting the descriptions of the relevant video scenes before and after Can be generated.

According to the video content explanation generating apparatus of the present invention (claim 11), in the video content explanation generating apparatus according to claim 10, the explanation generating means is structured using a hierarchical structure. When generating a description for a video scene of a certain hierarchy of each video scene obtained as a search result from the searched video stream, a hierarchical structure is used together with a description showing the video content of the video scene of the hierarchy. In order to generate an introductory sentence that is an introductory sentence of the explanatory note from the character information of the video scene of the upper layer of the video scene of the relevant layer, the meaning of each video scene as a search result is For example, a preamble sentence can be generated as an outline explanatory sentence for clarifying whether or not the sentence has the text.

Further, according to the video content description generating apparatus of the present invention (claim 12), in the video content description generating apparatus according to claim 10 or 11, the description generating means uses a hierarchical structure. When generating a description of a video scene of a certain hierarchy of each video scene obtained as a search result from the structured video stream, a description showing the video content of the video scene of the hierarchy using the hierarchical structure In addition to the sentence, in order to generate a postscript sentence that is a postscript of the explanatory note from the character information of the video scene of the higher hierarchy of the video scene of the relevant hierarchy, how each video scene as a search result is It is possible to generate a postscript sentence as an outline explanatory sentence for clarifying the meaning.

Further, according to the video content description generating apparatus of the present invention (claim 13), for each video scene, a plurality of parameters for calculating the degree of emotional change of the user with respect to the video content in advance. Means for defining and storing an emotion degree parameter as an emotion degree parameter, setting means for setting user preference information, and a user for each video scene using the emotion degree parameter and preference information corresponding to each video scene. Calculating means for calculating a degree value of the emotional reaction of the subject, wherein the description generating means generates a description explaining the video content of the video scene using the character information, based on the degree value Since an emotional expression sentence indicating an emotional expression is added, it is possible to generate an explanatory sentence reflecting tastes in conformity with the sense of the viewer (user). In other words, by generating a description reflecting the preference more flexibly (or stepwise) in accordance with the degree value of the emotional reaction of the user, a personal description according to the preference of the user is generated. A sentence can be created.

According to the video content description generating apparatus of the present invention (claim 14), in the video content description generating apparatus of claim 13, a plurality of emotion degree parameters are added to the video scene. The degree is quantified by the combination of the contents of the text information and the contents of the taste information, and the calculation means calculates the degree value using the quantified degree. In this way, it is possible to generate an explanatory sentence reflecting the preference.
In other words, an emotional expression can be added more flexibly (or stepwise) according to the degree of emotional reaction of the user, and a personalized description reflecting the user's preference is created. be able to.

According to a computer-readable recording medium of the present invention (claim 15), a method for causing a computer to execute the method for generating a description of a video content according to any one of claims 1 to 8 is provided. Record the program,
By reading and executing this program by a computer, the same effect as the method for generating a description of a video content according to any one of claims 1 to 8 can be achieved.

Further, according to the digest video programming method of the present invention (claim 16), the degree of emotional reaction of the virtual character to the video content of each video scene, together with the description of the video scene and the video content. To create a virtual character emotional expression based on the degree value for each video scene, automatically create a program from the digest video and reflect the viewer's (user's) preferences. It is possible to provide a method of converting a digest video into a program for creating a program to which a program is applied.

According to the digest video programming method of the present invention (Claim 17), in addition to the reproduction of each video scene, an explanatory note,
In order to provide a preamble sentence and a postscript sentence in audio, and to produce an emotional expression of the virtual character based on the degree value for each video scene, a program is automatically created from the digest video, and a viewer (user The present invention can provide a method for converting a digest video into a program, which creates a program in which an effect reflecting the preference of (1) is performed.

According to the digest video programming apparatus of the present invention, a description, a preamble, a postscript, and a degree value are made to correspond to each video scene as a program processing unit. Video file generating means for generating a video file, a program definition file database storing at least various configuration information of a program including at least a virtual character as a program definition file, a plurality of emotion expression levels are set, and each emotion expression level is set. Inputting an effect definition database storing effect templates each defining one effect method, and video files, determining the degree of emotional expression based on the degree value for each video file,
Selecting means for selecting an effect expression template corresponding to the degree of emotion expression from the effect definition database, and inputting a program definition file, a video file, and an effect template, based on the effect template selected for each image file, At least the playback timing of the video scene, the description sentence, the preamble sentence, the postscript sentence output as the sound of the virtual character, and the output timing of the sound,
Effect processing means for performing program effect processing for each video file by setting the action of the virtual character, so that a program is automatically created from the digest video and the taste of the viewer (user) is determined. It is possible to provide a digest video programming phase method for creating a program with a reflected effect.

According to the digest video programming apparatus of the present invention (claim 19), in the digest video programming apparatus according to claim 18, the various types of configuration information of the program in the program definition file include at least one program. Two virtual characters, a studio set of programs, the number and position of cameras,
Since it is composed of information such as CG lighting, CG props, sound, program title, supermarket setting, etc., various programs can be constructed by setting or changing these various types of configuration information.

Further, according to the digest video programming apparatus of the present invention (claim 20), in the digest video programming apparatus according to any one of claims 18 to 19, the degree value is determined by the degree of excitement. A plurality of effect templates having emotion type information for indicating types of emotions such as sadness and the like, and a plurality of effect templates classified as a key index based on the emotion type information and the degree of emotion expression, are stored in the effect definition database. Determines the emotion type information to be used as a key index and the degree of emotional expression based on the degree value when selecting an effect template, and selects all applicable effect templates from the effect definition database. Expressions of emotions such as sorrow can be reflected in the performance.

According to the digest video programmer of the present invention (claim 21), the digest video programmer of claim 20 further comprises a plurality of degree values. In the effect definition database, a plurality of effect templates in which a plurality of emotion type information and a degree of emotional expression of the plurality of emotion type information are classified as a key index are stored. When selecting a template, a plurality of emotion type information to be used as a key index and a degree of emotion expression of the plurality of emotion type information are determined based on a plurality of degree values, and all corresponding effect templates are determined from the effect definition database. To select a more detailed combination of multiple emotion types, such as It can be reflected in the effect the emotional expression.

According to the digest video programming apparatus of the present invention (claim 22), the digest video programming apparatus according to any one of claims 18 to 21 further comprises a plurality of program definitions. A program defining file for designating a desired program definition file from the files; the program definition file database stores a plurality of program definition files; In this case, the program definition file specified through the specifying means is input, and the program rendering process is performed for each video file based on the corresponding various types of configuration information. Therefore, it is easy to set or change the program of the digest video. Can be done.

According to the digest video programming apparatus of the present invention (claim 23), in the digest video programming apparatus according to claim 22, the defined rendering method is applied to the rendering template. Possible program environment information is set, and if there are a plurality of effect templates selected by the selecting means, the effect processing means refers to the program environment information of each effect template and designates the program designated through the specifying means. In order to select one of the effect templates that can be executed in the program environment provided in the definition file and perform the program effect processing for each video file, match the effect method defined in the effect template with the environment of the program to be created. Sex can be easily taken. In other words, it is possible to always produce a program with an effect that does not cause discomfort.

According to the digest video programming apparatus of the present invention (claim 24), in the digest video programming apparatus according to claim 23, the rendering template includes one of the defined rendering methods. Number-of-times-of-use information that limits the number of times a digest video is used to make a program can be set. After selecting one of the executable effect templates, the effect processing means If the information is set, the number of times the selected effect template has been used in the past is compared with the information on the number of times of use to determine whether or not it can be used. To select the same production template, in other words, it can be set so that the same production method is not used repeatedly more than a certain degree. Or to avoid the rut of production, it is possible to ensure that production can not be tired. Further, if the setting is made so that the information is used only once,
It can be effectively used only once in one digest video program.

According to the digest video programming apparatus of the present invention (claim 25), in the digest video programming apparatus according to any one of claims 20 to 24, the video file in the effect processing means is provided. When the selection of the effect template of one video file is completed by the selecting means, the program effect processing in units is a sequential processing function of selecting and processing the effect template to be used, and selecting the effect template of all the video files by the selecting means. Waits for the end, selects a rendering template to be used in each video file, and then has a batch processing function to process.The rendering processing means is selected when performing processing using the batch processing function. An effect template having the same degree of emotion type information and emotion expression with reference to all effect templates selected by the means. For each set, the number of times the set is selected is obtained. If a plurality of different effect templates exist in one set among the sets selected multiple times, the number of times of selecting each effect template is uniform. In order to select a production template, when creating a digest video program, if there is no time, use the sequential processing function to execute the program production processing, and if there is enough time, use the batch processing function. By using this, it is possible to perform a natural effect that is less noticeable.

Further, according to the digest video programming apparatus of the present invention (claim 26), in the digest video programming apparatus according to claim 25, the effect template includes the emotion type information and the emotion type information of each effect template. It is possible to set designation information for designating the use of the video file having the highest degree value or the video file having the lowest degree value among the degree values associated with the degree of emotional expression in the program effect processing. When there is a rendering template for which the designated information is set, the processing unit relatively compares the degree values of all the video files for which the rendering template is selected, and determines the rendering template to be the maximum degree value or the minimum degree value. Is used only for the program production processing of video files having a degree value of Plate, that can be selected presentation method.

Further, the recording medium of the present invention (claim 27)
The digest according to claim 16 or 17, wherein a program for causing a computer to execute the digest video programming method according to claim 16 or 17 is recorded, and the program is read and executed by the computer. An effect similar to that of the method of converting a video into a program can be obtained.

[Brief description of the drawings]

FIG. 1 is a schematic configuration diagram of a video content description generating device according to a first embodiment.

FIG. 2 is an explanatory diagram illustrating an algorithm of a connection relation determination function according to the first embodiment;

FIG. 3 is a schematic configuration diagram of a video content description generating device according to a second embodiment.

FIG. 4 is an explanatory diagram illustrating an algorithm of an emotion degree discrimination function according to the second embodiment.

FIG. 5 is an explanatory diagram showing an explanatory sentence generation function (explanatory sentence generation algorithm) according to the third embodiment;

FIG. 6 illustrates a case where the description generating function according to the third embodiment is used.
FIG. 9 is an explanatory diagram showing in which order a description is generated for a certain game.

FIG. 7 is a schematic diagram of a digest creation system that incorporates a video sentence generation method according to the present invention as a video sentence generation function.

FIG. 8 is a block diagram of a digest video programming apparatus according to a fourth embodiment.

FIG. 9 is an explanatory diagram showing a schematic flow of processing of the digest video programmer.

FIG. 10 is an explanatory diagram showing an example of a screen of a digest video program displayed on a TV according to the fourth embodiment.

FIG. 11 is an explanatory diagram showing an example of a final PVML code created as a digest video program by the digest video programmer of the fourth embodiment.

[Explanation of symbols]

 REFERENCE SIGNS LIST 100 video content description generation device 101 description generation unit 102 video content determination unit 103 connection expression selection unit 200 video content description generation unit 201 description generation unit 202 storage unit 203 setting unit 204 calculation unit 400 digest video programming device 401 video file generation unit 402 program definition file database 403 production definition database 404 production template selection unit 405 production processing unit 406 PVML interpreter 407 TVML player 408 TV

[Procedure amendment]

[Submission date] February 14, 2001 (2001.2.1)
4)

[Procedure amendment 1]

[Document name to be amended] Statement

[Correction target item name] Claim 15

[Correction method] Change

[Correction contents]

[Procedure amendment 2]

[Document name to be amended] Statement

[Correction target item name] Claim 18

[Correction method] Change

[Correction contents]

[Procedure amendment 3]

[Document name to be amended] Statement

[Correction target item name] Claim 26

[Correction method] Change

[Correction contents]

[Procedure amendment 4]

[Document name to be amended] Statement

[Correction target item name] 0005

[Correction method] Change

[Correction contents]

[0005]

However, the above-described process of generating a description of a video content has the following problems. First, for each video scene that is the search result,
Because each fragmentary index is used to generate the description independently, the description is unclear in the connection before and after and the relevance, and the flow of the sentence is smooth for the viewer (user) without discomfort. No description could be generated. Second, since the description is generated using only the fragmentary index of each video scene that is the search result,
Search results each video scene is is not possible to generate a preface statements and afterword sentence of as What does it mean to order of summary descriptive text to clarify whether or not to have a in the before and after of the video scene Was. Third, although it is possible to create a digest video reflecting the preference of a viewer (user) who uses the video in the digest creation device, the digest video (video scene) is generated in the process of generating a description of the video content. The description is generated only from the fragmentary index given to the user, and it is not possible to generate the description reflecting the taste of the viewer (user).

[Procedure amendment 5]

[Document name to be amended] Statement

[Correction target item name] 0008

[Correction method] Change

[Correction contents]

[0008] The present invention was made in view of the above, the search results each video scene is found either to clearly be because of to have what meaning in before and after the video scene A second object is to make it possible to generate a preamble sentence or a postscript sentence as a brief explanatory sentence.

[Procedure amendment 6]

[Document name to be amended] Statement

[Correction target item name] 0028

[Correction method] Change

[Correction contents]

Also, a digest video programmer according to claim 18 is provided in which each video scene retrieved from one video stream as a digest video scene, a pre-created description of each video scene, Foreword,
Enter the degree value indicating the degree physician emotional change in the user against footing statements and the video content, a program device of digest video for creating a digest video program, as a processing unit of a program of, 1 A video file generating means for generating a video file by associating the description, the preamble, the postscript and the degree value for each video scene, and a program storing at least various configuration information of a program including at least a virtual character as a program definition file A definition file database, an effect definition database in which a plurality of emotion expression levels are set, and an effect template storing one effect method for each of the emotion expression levels is stored;
Selecting means for inputting the video file, determining a degree of emotional expression based on a degree value for each video file, and selecting an effect expression effect template according to the degree of emotional expression from the effect definition database; A program description file, a video file, and a rendering template, and a description sentence based on the selected rendering template for each video file, at least as a reproduction timing of the video scene and a sound of the virtual character, It is provided with effect processing means for performing a program effect process for each video file by setting a preamble sentence, a postscript sentence, the output timing of audio, and the motion of the virtual character.

[Procedure amendment 7]

[Document name to be amended] Statement

[Correction target item name] 0036

[Correction method] Change

[Correction contents]

A digest video programming apparatus according to a twenty-sixth aspect is the digest video programming apparatus according to the twenty-fifth aspect, wherein the effect templates are emotion type information and degree of emotion expression included in each effect template. Of the degree values associated with the, it is possible to set designation information that specifies that the video file having the highest degree value or the video file having the lowest degree value to be used for the program effect processing, and the effect processing means If there is a rendering template for which the specified information is set, the rendering template is compared with the degree values of all the selected video files, and the rendering template is determined to have the maximum degree value or the minimum degree value. It is used only for program effect processing of a video file having a degree value.

[Procedure amendment 8]

[Document name to be amended] Statement

[Correction target item name] 0055

[Correction method] Change

[Correction contents]

When generating a description about a video scene of a certain hierarchy of each video scene obtained as a search result from a video stream structured using the hierarchical structure, the hierarchical structure is used to generate a description. to from the character information of the hierarchy of the video scene generate foreword sentence as a foreword description, each video scene is a search result, to whether with what sense in before and after the video scene clearly An introductory sentence can be generated as a brief explanatory sentence. Similarly, in order to generate a postscript sentence that is a postscript of the explanatory note from the character information of the video scene of the higher hierarchy of the video scene of the relevant hierarchy, how each video scene that is the search result is It does mean the outline descriptive sentences to <br/> order to clarify whether with, it is possible to generate a postscript statement.

[Procedure amendment 9]

[Document name to be amended] Statement

[Correction target item name] 0089

[Correction method] Change

[Correction contents]

The program definition file database 402 stores
Various configuration information of the program is stored as a program definition file. Examples of the various configuration information of the program in the program definition file include at least one virtual character, a studio set of the program, the number and position of cameras, CG lighting, C
Information such as G props, sounds, program titles, and supermarket settings. It should be noted that a plurality of the program definition files are stored in advance, and addition and change can be easily performed by setting various types of configuration information in a predetermined format.

[Procedure amendment 10]

[Document name to be amended] Statement

[Correction target item name] 0092

[Correction method] Change

[Correction contents]

[0092] Further, the rendering templates, the program environment information presentation method as defined illustrates a possible programming environment applied is set, also the program of one of the digest video and presentation method defined The use number limitation information for limiting how many times can be used is set as necessary.

[Procedure amendment 11]

[Document name to be amended] Statement

[Correction target item name] 0103

[Correction method] Change

[Correction contents]

Next, the effect template selection unit 404
The effect template corresponding to the selected emotion ID is selected. Basically, the relationship between the emotion ID and a certain effect template prepared in advance is a one-to-many relationship. One emotion ID
The reason why a plurality of effect templates are prepared in order to provide the effect with diversity so as not to become a boring program. For example, than in particular are prepared for the emotion ID of "very happy", a collection of the following four rendering template presentation method is the definition of,
When the "very happy" scene comes, it is possible to select one effect template from the scene as appropriate. (Direction Method 1) Make your face bright red and stand up (Direction Method 2) Weep with tears (Direction Method 3) Sing for three years (Direction Method 4) Break a ball and fly a dove

[Procedure amendment 12]

[Document name to be amended] Statement

[Correction target item name]

[Correction method] Change

[Correction contents]

[0115] Further, as another modified example of when performing batch processing, effect processing unit 405, specified information is set Tei
If the effect template exists, the effect template is compared with the emotion level parameters of all the selected video files, and the effect template is compared with the image having the maximum emotion level parameter or the minimum emotion level parameter. It may be used only for the program effect processing of the file.

[Procedure amendment 13]

[Document name to be amended] Statement

[Correction target item name] 0126

[Correction method] Change

[Correction contents]

According to the video content description generating method of the present invention (claim 3), in the video content description generating method of claim 2, the video stream structured using a hierarchical structure is provided. When generating a description of a video scene of a certain hierarchy of each video scene obtained as a search result from the In order to generate an introductory sentence that is the preamble of the explanatory note from the character information of the video scene in the upper layer of the video scene, it is necessary to determine the meaning of each video scene that is the search result in the preceding and following video scenes clearly in as summary descriptive text to order, it is possible to generate a preface statement.

[Procedure amendment 14]

[Document name to be amended] Statement

[Correction target item name] 0127

[Correction method] Change

[Correction contents]

According to the method for generating a description of a video content according to the present invention (claim 4), the method for generating a description of a video content according to claim 2 or 3 is structured using a hierarchical structure. When generating a description of a video scene of a certain hierarchy of each video scene obtained as a search result from the video stream, the hierarchical structure is used, together with a description showing the video content of the video scene of the hierarchy, and In order to generate a postscript sentence that is a postscript of the explanatory note from the character information of the video scene of the higher hierarchical level of the video scene of the hierarchical level, what meaning does each video scene as a search result have in the preceding and following video scenes or as to order of summary descriptive text to clarify the, it is possible to generate a postscript statement.

[Procedure amendment 15]

[Document name to be amended] Statement

[Correction target item name]

[Correction method] Change

[Correction contents]

According to the video content explanation generating apparatus of the present invention (claim 11), in the video content explanation generating apparatus according to claim 10, the explanation generating means is structured using a hierarchical structure. When generating a description for a video scene of a certain hierarchy of each video scene obtained as a search result from the searched video stream, a hierarchical structure is used together with a description showing the video content of the video scene of the hierarchy. In order to generate an introductory sentence that is an introductory sentence of the explanatory note from the character information of the video scene of the upper layer of the video scene of the relevant layer, the meaning of each video scene as a search result is as to order of summary descriptive text to clarify whether or not to have a, it is possible to generate a preface statement.

[Procedure amendment 16]

[Document name to be amended] Statement

[Correction target item name]

[Correction method] Change

[Correction contents]

Further, according to the video content description generating apparatus of the present invention (claim 12), in the video content description generating apparatus according to claim 10 or 11, the description generating means uses a hierarchical structure. When generating a description of a video scene of a certain hierarchy of each video scene obtained as a search result from the structured video stream, a description showing the video content of the video scene of the hierarchy using the hierarchical structure In addition to the sentence, in order to generate a postscript sentence that is a postscript of the explanatory note from the character information of the video scene of the higher hierarchy of the video scene of the relevant hierarchy, how each video scene as a search result is Do not meaning as to order of summary descriptive text to clarify whether or not to have a, it is possible to generate a postscript statement.

[Procedure amendment 17]

[Document name to be amended] Statement

[Correction target item name] 0147

[Correction method] Change

[Correction contents]

Further, according to the digest video programming apparatus of the present invention (claim 26), in the digest video programming apparatus according to claim 25, the effect template includes the emotion type information and the emotion type information of each effect template. It is possible to set designation information for designating the use of the video file having the highest degree value or the video file having the lowest degree value among the degree values associated with the degree of emotional expression in the program effect processing. When there is a rendering template for which the designation information is set, the processing unit relatively compares the degree values of all the video files for which the rendering template is selected, and determines the rendering template to be the maximum degree value or Effectively used because it is used only for program production processing of video files with the minimum degree value Plates, i.e. it is possible to select the presentation method

[Procedure amendment 18]

[Document name to be amended] Statement

[Correction target item name] 0148

[Correction method] Change

[Correction contents]

Further, the recording medium of the present invention (claim 27)
Is aft to record a program for executing a program method of digest video according to the computer to claim 16 or 17, by reading and executing the program in a computer, according to claim 16 or 17 The same effect as in the method of converting the digest video into a program can be obtained.

[Procedure amendment 19]

[Document name to be amended] Drawing

[Correction target item name] Figure 2

[Correction method] Change

[Correction contents]

FIG. 2

Continued on the front page (72) Inventor Takako Hashimoto 1-3-6 Nakamagome, Ota-ku, Tokyo Inside Ricoh Company (72) Inventor Atsushi Iizawa 1-3-6 Nakamagome, Ota-ku, Tokyo Inside Ricoh Company F-term (reference) 5B091 AA15 CA12 CA21 CA26 CD00 5C025 BA14 BA25 BA27 BA28 CA09 CA12 CB10 DA05 5C053 FA06 FA14 GB09 GB11 GB12 HA30 JA16 KA24 (54) [Title of invention] Method of generating description of video content, generation of video description Apparatus, digest video programming method, digest video programming apparatus, and computer-readable recording medium storing program for causing a computer to execute the method

Claims (27)

[Claims] For each video scene retrieved from one video stream as a digest video scene, a fragmentary character string or a plurality of characters composed of information that can be converted to a character string, which describes the content of the video scene. In the case where information is added, in a video content description generating method for generating a description describing the video content of each video scene using the text information, the content of each video scene is determined from the text information. , A connection expression is selected from forward, reverse, parallel, addition, selection, etc., depending on the relationship between the preceding and following video scenes, and the description of the preceding and following video scenes is connected using the selected connection expression. A method of generating a description of a video content, comprising generating a description of the content. 2. For each video scene retrieved as a digest video scene from a video stream structured using a hierarchical structure, it can be converted into a fragmentary character string or a character string that describes the content. In the case where a plurality of pieces of character information including unique information are added, in the method of generating a description of a video content that uses the text information to generate a video description of the video content of each video scene, Judge the content of the video scene, select the connection expression from the order, reverse connection, parallel, addition, selection, etc. according to the relationship between the previous and next video scenes, and use the selected connection expression to select the relevant previous and next video scene Generating a description of the video content to which the description is connected. 3. When generating a description of a video scene of a certain hierarchy, the description of the video content of the video scene of the hierarchy is used together with the description of the video scene of the hierarchy using the hierarchy structure. 3. The method according to claim 2, wherein a preamble sentence, which is a preamble to the explanatory note, is generated from the character information of the hierarchical video scene. 4. When generating a description for a video scene of a certain hierarchy, the description of the video content of the video scene of the hierarchy is used together with a description of the video content of the video scene of the hierarchy using the hierarchical structure. 4. The method according to claim 2, wherein a postscript to be a postscript of the description is generated from the character information of the hierarchical video scene. 5. A method for generating a description of a video scene, comprising the steps of:
The method according to any one of claims 1 to 4, wherein the sentence expression of the explanation is changed according to a user's preference. 6. For each video scene retrieved as a digest video scene from one video stream, a plurality of characters consisting of a fragmentary character string or information that can be converted into a character string that describes the content of the scene. In the case where information is added, in the method for generating a description of a video content that generates a description explaining the video content of each video scene using the character information, A description generating method for video contents, wherein the text description of the description is changed according to the user's preference using the user's preference information set via the setting means. 7. For each video scene, a plurality of parameters for calculating the degree of emotional change of the user with respect to the video content are defined as emotion level parameters, and the sentence expression of the explanation is used. When changing according to the user's preference, using the emotion degree parameter and preference information corresponding to each video scene, a degree value of the user's emotional reaction to each video scene is calculated, and the degree value is calculated. 7. The method according to claim 5, wherein an emotional expression sentence indicating an emotional expression is added to a description explaining the video content of the video scene based on the content. 8. The plurality of emotion degree parameters are quantified by a combination of the contents of character information added to the video scene and the contents of preference information, and the quantified degrees are used. The method according to claim 7, wherein the degree value is calculated by the following method. 9. For each video scene retrieved as a digest video scene from one video stream, a plurality of characters consisting of a fragmentary character string or information that can be converted into a character string that describes the content of the video scene. In the case where information is added, in a video content description generating device having a description generating means for generating a description explaining the video content of the video scene using the character information, A video content determining means for determining content, and a connection expression for selecting a connection expression from forward, reverse, parallel, addition, and selection based on a relationship between preceding and following video scenes based on a determination result of the video content determining means. Selecting means, the description generating means connecting the description of the relevant video scene before and after using the connection expression selected by the connection expression selecting means. Characteristic video content description generation device. 10. For each video scene retrieved as a digest video scene from a video stream structured using a hierarchical structure, it can be converted into a fragmentary character string or a character string describing its contents. A plurality of pieces of text information composed of various pieces of information, the video content description generation device having a description generation unit configured to generate a description describing a video content of a video scene using the text information; Video content determining means for determining the content of each video scene from the character information, Based on the determination result of the video content determining means, by the relationship between the previous and next video scene, from sequential, reverse, parallel, addition, selection Connection expression selecting means for selecting a connection expression, wherein the explanatory sentence generation means uses the connection expression selected by the connection expression selection means to select a video scene before and after the connection A video content description generating apparatus, characterized in that the description is connected. 11. The description generating means, when generating a description about a video scene in a certain hierarchy, uses the hierarchical structure together with a description indicating the video content of the video scene in the hierarchy. 11. The video content description generating apparatus according to claim 10, wherein a preamble sentence, which is a preamble of the description, is generated from the character information of the video scene of the hierarchy higher than the video scene of the hierarchy. 12. The apparatus according to claim 1, wherein said description generating means generates a description about a video scene of a certain hierarchy by using said hierarchical structure together with a description showing video contents of the video scene of said hierarchy. 12. The video content description generating apparatus according to claim 10, wherein a postscript to be a postscript of the description is generated from character information of a video scene of a higher hierarchy of the video scene of the hierarchy. 13. For each video scene retrieved from one video stream as a digest video scene, a fragmentary character string or a plurality of characters consisting of information that can be converted into a character string that describes the content of the video scene. In the case where information is added, in a video content description generating apparatus having a description generating means for generating a description explaining the video content of the video scene using the character information, Storage means for defining and storing a plurality of parameters for calculating the degree of emotional change of the user with respect to the content as emotion degree parameters; setting means for setting user preference information; Calculating means for calculating a degree value of a user's emotional reaction to each video scene using an emotion degree parameter and preference information corresponding to the scene; Wherein, when generating a description to explain the video content of the video scene using the character information, the description generating means adds an emotion expression based on the degree value. Characteristic video content description generation device. 14. The plurality of emotion degree parameters are quantified by a combination of the contents of character information and the contents of preference information added to the video scene. 14. The apparatus according to claim 13, wherein the degree value is calculated using the determined degree. 15. A computer-readable recording medium on which is recorded a program for causing a computer to execute the method of generating a description of a video content according to any one of claims 1 to 8. 16. A video image retrieved from one video stream as a scene for a digest video and a description of video content created for each video scene are input, and In addition to reproduction, a digest video program creation method for creating a digest video program by providing a description of the video content in audio or text via a preset virtual character, Along with the description of the video content, a degree value of the emotional response of the virtual character to the video content of each video scene is input, and for each video scene, the effect of the emotional expression of the virtual character is produced based on the degree value. A method of converting a digest video into a program. 17. A video scene for a digest video, and the description, preamble, postscript, and degree value of each video scene generated by using the video content description generation method according to claim 7. A digest video programming method for inputting and creating a digest video program, wherein in addition to the reproduction of each of the video scenes, the description, the preamble, and the postscript are transmitted through a preset virtual character. And producing an emotional expression of the virtual character based on the degree value for each video scene. 18. A video image retrieved from one video stream as a scene for a digest video, a description sentence, a preamble sentence of each video scene created in advance,
This is a digest video programmer that inputs a postscript and a degree value indicating the degree of emotional change of the user with respect to the video content, and creates a digest video program. A video file generating means for generating a video file by associating the description, the preamble, the postscript and the degree value for each video scene, and a program storing at least various configuration information of a program including at least a virtual character as a program definition file A definition file database, a plurality of emotion expression levels, an effect definition database storing effect templates each defining one effect method for each of the emotion expression degrees, and inputting the video file, The degree of emotional expression is determined for each file based on the degree value, and the effect definition database And selecting means for selecting an effect template of an emotion expression corresponding to the degree of the emotion expression from the program definition file, the video file and the effect template, and for each image file, based on the selected effect template. By setting at least the playback timing of the video scene, the setting of the description sentence, the preamble sentence, the postscript sentence and the output timing of the audio output as the sound of the virtual character, and the operation of the virtual character, An effect processing means for performing a program effect process, comprising: a digest video program converting device. 19. The program configuration information of the program definition file includes at least one virtual character, a program studio set, the number and position of cameras, CG lighting, CG
19. The digest video programming apparatus according to claim 18, comprising information such as props, sounds, program titles, and supermarket settings. 20. The degree value has emotion type information for indicating the type of emotion such as emotion, anger and so on. The effect definition database classifies the emotion type information and the degree of emotion expression as a key index. A plurality of effect templates are stored, the selecting means, when selecting the effect template, based on the degree value, determines the degree of emotion type information and emotion expression used as a key index,
20. Select all the effect templates from the effect definition database.
The digest video programming apparatus according to any one of the above. 21. Further, the degree value can be composed of a plurality of degree values, and the effect definition database stores a plurality of emotion type information and a degree of emotion expression of the plurality of emotion type information. A plurality of effect templates classified as a key index are stored, and the selecting means, when selecting the effect template, based on the plurality of degree values, a plurality of emotion type information used as a key index and 21. The digest video programming apparatus according to claim 20, wherein a degree of emotion expression of a plurality of emotion type information is determined, and all of the effect templates are selected from the effect definition database. 22. A program definition file for designating a desired program definition file from a plurality of program definition files, wherein the program definition file database stores a plurality of program definition files. The effect processing means, when performing the program effect processing in the video file unit, inputs a program definition file specified through the specifying means, and executes the program in the video file unit based on the corresponding various configuration information. The digest video programming apparatus according to any one of claims 18 to 21, wherein effect processing is performed. 23. The effect template, wherein program environment information to which a defined effect method can be applied is set, and the effect processing means includes a plurality of effect templates selected by the selecting means. Referring to the program environment information of each effect template, selecting one of the effect templates executable in the program environment provided by the program definition file specified via the specifying means, and 23. The digest video programming apparatus according to claim 22, wherein the apparatus performs processing. 24. The effect template can set use number limitation information for limiting the number of times a defined effect method is used when one digest video is made into a program. After selecting one of the executable effect templates, if the use template is set with the use number limitation information, the number of times the selected effect template has been used in the past is compared with the use number limit information. 24. The digest video programming apparatus according to claim 23, wherein it is determined whether or not it is usable, and when it is not usable, another executable effect template is selected. 25. The program effect processing for each video file in the effect processing means is a sequential processing function of selecting and processing an effect template to be used when the selection means finishes selecting an effect template of one video file. A batch processing function of waiting for the selection of the rendering templates of all video files by the selection means to be completed, selecting a rendering template to be used in each video file, and then processing the rendering templates. The means, when performing processing using the batch processing function, refers to all effect templates selected by the selecting means, for each set of effect templates with the same degree of emotion type information and emotion expression , The number of times the set is selected, and among the sets selected a plurality of times, different effect templates are included in one set. If there are multiple, each program apparatus of digest video according to any one of claims 20 to 24 selected number of the effect template and selects the rendering template to be uniform. 26. The effect template includes a video file having the highest degree value or a video file having the lowest degree value among the degree values associated with the emotion type information and the degree of emotion expression included in each effect template. It is possible to set designation information designating that it is used for a program production process. If there is a production template in which the designation information is set, all the video files for which the relevant production template is selected 28. The digest video according to claim 25, wherein the relative effect templates are relatively compared, and the corresponding effect template is used only for the program effect process of the video file having the maximum or the lowest effect value. Programmer. 27. A computer-readable recording medium having recorded thereon a program for causing a computer to execute the digest video programming method according to claim 16 or 17.