JP2003018582A - Digest distribution system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a digest distribution system generating and distributing information for an individual at an optimum timing in a push type service for which a provider generates and distributes digests and program relating information for each user. SOLUTION: Under the broadcasting environment where supplementary information is transmitted as program additional information together with program video images composed of a plurality of successive frames, the digest distribution system is constituted of a distribution server 200 inputting the program video images and the program additional information and generating and distributing the digest of the program video image and the program additional information and a reception terminal 300 for viewing the digest distributed from the distribution server 200. When the program additional information is inputted, the distribution server 200 determine whether or not the kind of the inputted program additional information matches with preset start specifying information and generates and distributes the digest in the case that they match.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention inputs the program video and the program additional information under a broadcasting environment in which the program video consisting of a plurality of consecutive frames and its supplementary information are transmitted as the program additional information. The present invention relates to a digest distribution system having a distribution server that generates and distributes a digest of a program video and program additional information, and a receiving terminal for viewing the digest distributed from the distribution server, and more specifically, the program additional information. Digest distribution that realizes event-driven digest generation triggered by the occurrence of events such as reception of events and changes in the feature amount of video content, and can dynamically generate and deliver digests at certain points during the program Regarding the system.

[0002]

2. Description of the Related Art In recent years, the digitization of broadcasting has been rapidly progressing on a global scale.
S (Broadcast Satellite) digital broadcasting has started, and terrestrial digital broadcasting is also 2003.
The year is about to begin. As a result, the viewing style of the television changes drastically, and not only conventional real-time viewing but also storage-based viewing and non-linear viewing are possible.

The digest creating system in the non-linear viewing mode proposed by the present applicants will be described below. The present applicants first search for a video scene that is supposed to be an important scene using the program additional information, targeting a program video to which supplementary information is added as program additional information such as a video index, and then digest the video. We devised a digest creation system that creates a version (digest video). In this digest creation system, the video scenes that have been determined to be important scenes also include audio commentary, so it is sufficient to generate an outline of the cross-sectional index as an explanatory text, so the explanation of the video content I have considered the generation process.

The details of the above technique will be described below.
Has been revealed by. Takako Hashimoto, et al .: "Examination of Digest Viewing System Using Program Index", Proceedings of Broadcasting System Study Group of the Institute of Image Information and Television Engineers, March 1999, pp. 7-12. Takahashi Hashimoto, et al .: "Prototype of Digest Creation Method Using Program Index", Data Engineering Workshop (DEWS'99) Proceedings CD-ROM, March 1999
Month. Takako Hashimoto, et al .: "Trial Production of Digest Creation Method for TV Reception Terminals", ADBS99 Proceedings, December 1999. Yukari Shirata, et al .: "Examination of Digest Explanatory Text Generation Method", IPSJ DBS Study Group 120-1
5, January 2000, Kobe. Takako Hashimoto, et al .: "Prototype of digest creation system for soccer program", 11th Data Engineering Workshop (DEWS'00) Proceedings CD-ROM, 2000.

In these prototype systems, the present applicants have analyzed the semantics of the video contents using the program additional information as the basic supplementary information added to the program video, and important scenes reflecting the user's preference. It is possible to determine and cut out (extract video), and realize a function of generating explanatory text for it.

[0006] On the other hand, services using mobile terminals such as i-mode (trademark, NTT Corporation) have become popular.
Current mobile phones cannot receive and clip video, but IMT20 scheduled to start in 2001
According to the mobile phone service of 00, reception / reproduction of moving images will be possible. The mobile terminal is a terminal owned by each user, and personal applications are considered to be more effective.

Under such circumstances, it is considered to realize the digest video (digest of program video) and the method of distributing program-related information related to the video, which the applicants have studied, as a mobile phone service. The following applications can be considered in this case. In the following description, the program-related information indicates all the information related to the program video, the program additional information is one of the program-related information, and the information generated from the program additional information is also the program-related information. It becomes information.

[0008] The first method is to register personal preferences in advance with an application service provider, and the provider will generate and deliver digests and program-related information to individual users (personalized information push type service). Realization of). In the second method, the user We
b) Accessing the site to register one's own preferences, a web page for individual users is generated based on the preference information, and a method for the user to browse the page (realization of a personalized pulling service for web pages) ).

If the above-mentioned application can be realized, it becomes possible to know the outline of the program and the related information of the program even in a situation where the TV cannot be seen such as in the workplace or while moving. Moreover, since personalized information is delivered, effective services can be realized for individual users.

[0010] Therefore, the present applicants have the following first method.
We thought about realizing a push service of personalized information. In this case, the target distribution content is the digest scene of the program video and information related to the program (still image, text, moving image, etc.).
That is, in a broadcasting environment in which program video consisting of a plurality of consecutive frames and its supplementary information are transmitted as program additional information, the program video and program additional information transmitted from the broadcasting station are received to generate a digest. It was considered to realize a digest distribution system including a distribution server for distribution and a receiving terminal for viewing the digest distributed from the distribution server.

In order to realize a push service of personalized information, it is desired to provide a mechanism of how to automatically generate information to be distributed and when to distribute the information (timing of distribution). How to automatically generate the information to be distributed can be realized by using the above technologies (1) to (3) provided by the present applicants.

[0012]

However, with only the above techniques (1) to (4), by registering the personal preference in the application service provider (distribution server) in advance, the provider can provide digests and program-related information to individual users. However, no technology has been provided for "timing of distribution" of when to distribute the generated personalized information.

The present invention has been made in view of the above, and in a push-type service in which a provider generates and distributes digests and program-related information to individual users, information for individual generation is generated at optimum timing. The purpose of the present invention is to provide a digest distribution system that can be distributed.

[0014]

In order to achieve the above object, in the digest distribution system according to the first aspect, the supplementary information is transmitted as the program additional information together with the program video composed of a plurality of consecutive frames. In a broadcasting environment, a distribution server that inputs the program video and program additional information, generates and distributes a digest of the program video and program additional information, and a receiving terminal for viewing the digest distributed from the distribution server When the program addition information is input, the distribution server determines whether the type of the input program addition information matches preset designation information, and In this case, a digest is generated and delivered.

According to the present invention, when the distribution server inputs the program additional information that matches the preset start designation information, the distribution server generates and distributes the digest. That is, with the input of the program additional information as a trigger, personalized information is generated and distributed at an optimal timing.

The digest delivery system according to claim 2 is the digest delivery system according to claim 1, wherein the start designation information can be set in advance in the delivery server via the receiving terminal. And

According to the present invention, the start designation information can be set in advance in the distribution server via the receiving terminal. Therefore, by setting the type of desired program additional information as the start designation information, the desired additional information can be set. Using the input of the type of additional program information as a trigger, personalized information is generated and distributed at an optimal timing.

The digest distribution system according to claim 3 is the digest distribution system according to claim 1 or 2, wherein the start designation information can be set in the distribution server individually for each receiving terminal. The delivery server may generate and deliver a digest for each receiving terminal based on the start designation information set individually for each receiving terminal.

According to the present invention, when the start designation information is individually set in the distribution server for each receiving terminal, the distribution server determines, for each receiving terminal, on the basis of the start designation information individually set for each receiving terminal. Generate and deliver the digest. That is, with the input of the program additional information as a trigger, personalized information is generated and distributed at an optimal timing for each receiving terminal.

The digest delivery system according to claim 4 is the digest delivery system according to any one of claims 1 to 3, wherein a plurality of the start designation information can be set, and the start designation information can be set. It is characterized in that the processing priority can be set for the plurality of start designation information.

According to the present invention, it is possible to set a plurality of start designating information and set a processing priority for the plurality of set start designating information. It is possible to use a combination of priorities.

Further, the digest distribution system according to a fifth aspect of the invention provides the program video and the program additional information under a broadcasting environment in which the program video consisting of a plurality of consecutive frames and the supplementary information thereof are transmitted as the program additional information. A digest distribution system comprising: a distribution server that inputs and generates and distributes a digest of the program video and program additional information; and a receiving terminal for viewing the digest distributed from the distribution server,
When the distribution server inputs the program additional information,
The value of the parameter indicating the feature amount of the video content in the program video is calculated based on the input program additional information, and the calculated value of the parameter or the cumulative value of the parameter is compared with a predetermined set value to obtain the value. Alternatively, when the cumulative value reaches the set value, a digest is generated and distributed.

According to the present invention, the value of the parameter indicating the characteristic amount of the video content is calculated based on the input program additional information, and the calculated value of the parameter or the cumulative value is compared with a predetermined set value, Generates and distributes a digest when the value or cumulative value reaches the set value.

The digest distribution system according to a sixth aspect is the digest distribution system according to the fifth aspect, wherein there are a plurality of parameters indicating the characteristic amount of the video content, and a plurality of parameters are provided via the receiving terminal. The type of parameter to be compared with the set value can be set in the delivery server from among the above parameters.

According to the present invention, the kind of the parameter to be compared with the set value from among the plurality of parameters is set in the distribution server via the receiving terminal, so that the desired parameter is used and the individual is selected at the optimum timing. Generate and deliver information for

The digest delivery system according to claim 7 is the digest delivery system according to claim 5 or 6, wherein the set value can be set in the delivery server individually for each receiving terminal. The distribution server is characterized by generating and distributing a digest for each receiving terminal based on the setting value set individually for each receiving terminal.

According to the present invention, when the setting values are individually set in the distribution server for each receiving terminal, the distribution server gives a digest for each receiving terminal based on the setting values individually set for each receiving terminal. Generate and deliver. That is, personalized information is generated and distributed at an optimal timing for each receiving terminal.

Further, the digest distribution system according to the present invention is a program image broadcast from a broadcasting station under a broadcasting environment in which a program image consisting of a plurality of consecutive frames and supplementary information thereof are transmitted as program additional information. And a distribution server that receives the program additional information and generates and distributes the digest, and a receiving terminal for viewing the digest distributed from the distribution server, wherein the distribution server is When the program additional information is received, a plurality of consecutive frames designated by the plurality of received program additional information are extracted as scenes from the program video, and when the program additional information is received, the plurality of received frames are received. Based on the program additional information, the semantic feature of the frame in the program video is determined. Semantic characteristic amount calculating means for each frame, accumulating means for accumulating the scene extracted by the extracting means and the semantic characteristic amount of the frame calculated by the semantic characteristic amount calculating means, and receiving the program additional information Then, it is determined whether or not the type of the received program additional information matches the preset designation information, and if they match, start information output means for outputting the start information for generating the digest, and When the start information is output from the start information output unit, a scene in which a frame having a high semantic feature amount exists from the extracted scenes is prioritized based on the semantic feature amount of the frames accumulated by the accumulating unit. And a digest generating / delivering unit for generating a digest and delivering the digest to the receiving terminal.

Further, the digest distribution system according to claim 9 is a program video broadcast from a broadcasting station under a broadcasting environment in which program video consisting of a plurality of consecutive frames and supplementary information thereof are transmitted as program additional information. And a distribution server that receives the program additional information and generates and distributes the digest, and a receiving terminal for viewing the digest distributed from the distribution server, wherein the distribution server is When the program additional information is received, a plurality of consecutive frames designated by the received plurality of program additional information are extracted as scenes from the program video, and the plurality of received program additional information are analyzed to generate a composite image. An extracting unit for generating meaningful composite information, and receiving the program additional information, A plurality of program additional information and the composite information generated by the extracting means, and a semantic feature quantity calculating means for calculating a semantic feature quantity of a frame in the program video for each frame; A storage unit that stores the scene extracted by the extraction unit, the composite information generated by the extraction unit, and the semantic feature amount of the frame calculated by the semantic feature amount calculation unit, and the extraction unit generates the composite information. And a start information output means for determining whether the generated composite information matches the preset composite information and, if they match, outputting start information for generating a digest, and the start information output. When the start information is output from the means, a high semantic feature amount is extracted from the extracted scenes based on the semantic feature amount of the frames accumulated by the accumulating unit. Select a scene frame is present predominantly, to generate a digest,
Digest generating / delivering means for delivering to the receiving terminal.

The digest distribution system according to a tenth aspect of the present invention is a program video transmitted from a broadcasting station in a broadcast environment in which program video consisting of a plurality of consecutive frames and supplementary information thereof are transmitted as program additional information. And a distribution server that receives the program additional information and generates and distributes the digest, and a receiving terminal for viewing the digest distributed from the distribution server, wherein the distribution server is When the program additional information is received, a plurality of consecutive frames designated by the plurality of received program additional information are extracted as scenes from the program video, and when the program additional information is received, the plurality of received frames are received. Semantic feature amount of the frame in the program video based on the program additional information Semantic characteristic amount calculating means for calculating each frame, accumulating means for accumulating the scene extracted by the extracting means and the semantic characteristic amount of the frame calculated by the semantic characteristic amount calculating means, and the semantic characteristic amount calculation When the semantic feature amount of the frame is calculated by the means, the calculated value is compared with a predetermined set value, and if the calculated value is equal to or larger than the set value, output of start information for generating a digest is started. When the start information is output from the information output unit and the start information output unit, a frame having a high semantic feature amount from the extracted scenes based on the semantic feature amount of the frame accumulated by the accumulating unit. Is preferentially selected to generate a digest and distribute the digest to the receiving terminal.

Further, the digest delivery system according to the eleventh aspect of the present invention is a program video transmitted from a broadcasting station in a broadcasting environment in which program video consisting of a plurality of consecutive frames and supplementary information thereof are transmitted as program additional information. And a distribution server that receives the program additional information and generates and distributes the digest, and a receiving terminal for viewing the digest distributed from the distribution server, wherein the distribution server is When the program additional information is received, a plurality of consecutive frames designated by the plurality of received program additional information are extracted as scenes from the program video, and when the program additional information is received, the plurality of received frames are received. Semantic feature amount of the frame in the program video based on the program additional information Semantic characteristic amount calculating means for calculating each frame, accumulating means for accumulating the scene extracted by the extracting means and the semantic characteristic amount of the frame calculated by the semantic characteristic amount calculating means, and the semantic characteristic amount calculation When the semantic feature quantity of the frame is calculated by the means, the accumulated semantic feature quantity is calculated using the calculated value of the semantic feature quantity and the value of the semantic feature quantity of the frame accumulated in the accumulating means. A start information output unit that calculates a value, compares the calculated cumulative value with a predetermined setting value, and outputs start information for generating a digest when the cumulative value reaches the setting value, When the start information is output from the start information output unit, a scene in which a frame having a high semantic feature amount exists among the extracted scenes based on the semantic feature amount of the frame accumulated by the accumulating unit Preferentially selected, and generate a digest, and further comprising a, a digest generation and distribution means for distributing to the reception terminal.

[0032]

[Outline of the present invention]

[Schematic Configuration of Digest Distribution System of Present Embodiment] [Definition of Data Used in Present Embodiment] [Operation of Each Module of Present Embodiment] [Operation of Digest Generation / Distribution Processing by Reception Event] Operation of Digest Generation / Distribution Processing by Annotation Generation] [Operation of digest generation / distribution processing by status parameter value] will be described in detail with reference to the accompanying drawings.

[Outline of the Present Invention] The digest distribution system of the present invention is a push type service in which a provider generates digests and program-related information for individual users and distributes them, and generates information for individual at optimum timing. Then, it can be delivered.

The digest distribution system of the present invention inputs the program video and the program additional information under a broadcasting environment in which the program video consisting of a plurality of consecutive frames and the supplementary information thereof are transmitted as the program additional information. Distribution server that generates and distributes digests by
A digest distribution system having a receiving terminal for viewing a digest distributed from a distribution server.

However, here, the distribution server does not necessarily have to receive the program video and the program additional information transmitted from the broadcasting station in real time. For example, the program video and the program additional information received by another device are stored in the CD. , MO,
The case of inputting through various media such as a DVD is also included.

The digest to be generated and distributed is
A digest of the program video only, a digest of the program additional information generated from the program additional information, or a digest of both the program video and the program additional information can be considered. Further, when distributing the digest, information related to the generated digest may be added as program-related information.

The following are possible delivery timings in the push type service. (1) Distribution with Event of Program Video (Video Information) Separated For example, in the case of a baseball program, digest and program related information are generated and distributed at timings such as inning end / start, bats end / start, and score addition. (2) Distribution according to the importance of the video content (in this case, the importance is calculated after an event has occurred) For example, in a baseball program, such as home run, reversal, or the end of a favorite batter's bat Immediately after such an event, the digest and program-related information are generated and distributed. (3) Distribution according to the importance of the video content (analyzing the situation) For example, in a situation where it is determined that it is important, such as when the batting of the 4th batter and the starting of the batting of the favorite batter start at the chance of one-batter reverse Deliver relevant information (in which case video digest may not be needed).

In order to realize the distribution timings (1) to (3) described above, the present invention proposes a digest distribution system adopting the "event-driven digest generation and distribution method". It is assumed that the event that triggers the distribution timing is a group of events indicating the structure of the program (additional program information related to the structure of the program) and the value of the importance determination parameter in the digest generation method that is a conventional technique. There is a change.

In other words, the present invention realizes event-driven digest generation triggered by events such as reception of program additional information, scene extraction, and generation of semantic description of video. By this event-driven digest generation, a digest at a certain point in the middle of the program can be dynamically generated and distributed.

Further, in the present invention, the digest generation processing model satisfying the following required specifications is used as a precondition. To be able to judge the significance of meaning at a certain point on the video. Being able to dynamically calculate the above-mentioned importance while receiving the program additional information. Able to extract important scenes in real time during digest generation and distribution.

The technology for satisfying the above-mentioned required specifications has been already provided by the present applicants,
Specifically, in a broadcast environment in which supplementary information is transmitted as program additional information together with the program video, a scene in the program is dynamically extracted by an event of receiving the program additional information. When a scene is extracted, an annotation (supplementary explanation: corresponding to the composite information of the present invention) that more semantically describes the content of the program additional information in the scene is generated and added. .

It is assumed that the extraction and the annotation generation are defined by the rule described by the regular expression of the supplementary information, triggered by the reception event of the program additional information.

Further, the semantic feature amount (status parameter value) of the program is dynamically calculated by the reception event of the program additional information. The status parameter calculation is defined by a status parameter calculation rule triggered by a reception event of the program additional information and an annotation generation event (annotation generation event).

[Schematic Configuration of Digest Distribution System of this Embodiment] FIG. 1 shows a schematic configuration of the digest distribution system of this embodiment. As shown in the figure, it is supplemented with a program video consisting of a plurality of consecutive frames. A broadcasting station 100 that transmits information as program additional information, and a broadcasting station 10
A distribution server 200 that receives a program video and program additional information transmitted from 0, generates a digest, and distributes the digest.
And a receiving terminal 300 for viewing the digest distributed from the distribution server 200.

The broadcasting station 100 and the distribution server 200
The number of receiving terminals 300 is not particularly limited. As the receiving terminal 300, a mobile phone, a desktop computer, a notebook computer, a PD
It is possible to use a device having a video transmitting / receiving function and a display function such as A (portable information terminal).

The distribution server 200 is the broadcasting station 10
Although the case where the program video and the program additional information are received from 0 is shown as an example, the case of directly inputting the program video and the program additional information broadcast in the past directly from the medium storing the same is basically the same. It is included in the category of invention.

[Definition of Each Data Used in this Embodiment] Next, the definition of each data used in the distribution server 200 of the digest distribution system of this embodiment will be described. The distribution server 200 of the present embodiment generates a digest of program video in real time. Also,
The distribution server 200 dynamically calculates the importance at a certain point on the video by the importance determination based on the event-driven processing method, and the important scene (Scen
e) is extracted.

The processing data of the distribution server 200 are two, that is, a frame (f) which is a program video and a Primitive Descriptor (p) which is the program additional information described below. These two data are produced and broadcast by the broadcasting station 100. The distribution server 200 receives these data and generates and distributes the digest.

Frame (f) The program video is a sequence f ₁ ... F _{n of} Framef _i which is a still image.
Is. Each Frame is composed of a frame number fno serving as an identifier and a time code timecode indicating the elapsed time (relative time from the first Frame) represented by the Frame. Below, a subsequence of consecutive Frames is called a Frame sequence.

Primitive Descriptor (p) The basic program additional information added by the broadcasting station 100 is called a basic descriptor (hereinafter referred to as P-Descriptor).
Each P-Descriptor p _i becomes the start point of its description information
It is associated with Frame f _j . Each p is represented by the following set.

P-Descriptor: p = (eid, fno, type, a
ttr ₁ ,…, attr _n ) pid: P-Descriptor ID fno: Frame number of the associated Frame type: P-Descriptor type attr ₁ ,…, attr _n : P-Descriptor attribute

The type type of the P-Descriptor indicates the type of program additional information. For example, in the case of a baseball broadcast, "game_star"
Match breaks such as "t", "inning_start", "at_bat", "pitch", "hit", "home_run", "out" and "at_"
A type of P-Descriptor that indicates the type of action or play such as "bat" can be considered.

The attribute indicated by attr ₁ , ..., Attr _n is P-Des
This is an attribute determined by the type type of criptor, and the attribute value of each p _i is set. For example: In the case of P-Descriptor "pitch", "pitcher_name", "batter_name", score information, etc. are attributes. The attribute determined by the P-Descriptor type is called the P-Descriptor schema.

The relationship between Frame f _j and P-Descriptor p _i is one-to-many. Multiple P-Des for one Frame
In some cases, criptor is associated, and in some Frames, P-Descriptor is not associated. Figure 2 shows Frame and P-Desc
Show the relationship with riptor.

Next, the data generated by the distribution server 200 using the above processing data will be described. The data generated by the distribution server 200 includes Scene and P-
There are Descriptor Annotation (annotation: complex information of the present invention) and Status Parameter (status parameter: semantic feature amount of the present invention). Figure 2 shows Frame and P-Descri
Indicates the relationship between ptor, Scene, Annotation, and Status Parameter.

Scene (s) Scene is a Frame sequence that is semantically cohesive. Scenes can be represented by the following pairs.

[0057] Scene: s = (sid, type, ffno, lfno) sid: Scene ID type: Scene type ffno: Frame number of the starting frame lfno: Frame number of end frame

Here, the type type of Scene indicates the type of Scene. For baseball programs, "inning"("inning _star
from the "t" event to the next "inning_start" event),
"Pitch" (from "pitch" event to the next "pitch"),
Various types of Scene are possible such as "reversal". The start frame number ffno and the end frame number lfno indicate the start and end Frames of the Frame sequence corresponding to the Scene.

Annotation (a) The distribution server 200 automatically generates a description having a composite meaning from the information of a plurality of P-Descriptors, and
It is the supplementary information of P-Descriptor. Annotation
(Annotation: composite information of the present invention). Annota
tion a is represented by the following set.

Annotation: a = (aid, type, pid) aid: Annotation ID type: Annotation type pid: ID of the corresponding P-Descriptor

Annotation type type represents the type of Annotation. For example, in the case of a baseball program, Annotations such as "timely hit" and "reversal home run" can be considered. Anno of P-Descriptor "hit" and "home _run" respectively
It becomes tation, and ID for specifying the P-Descriptor is set in pid.

Status Parameter (p) Status Parameter (Status Parameter: Semantic Feature Amount) is an index indicating the degree of importance at a certain point on the video, and is calculated based on a preset status parameter calculation rule. Although it depends on the type of program, multiple Status Parameters are generally calculated for one Frame on the video. The status parameter calculation rule is P
-Fired by event-driven generation of Descriptor and Annotation.

[0063] Status Parameter: p = (type, fno, value) type: Parameter type fno: Frame number of the corresponding Frame value: the value of the parameter

The type type of Status Parameter represents the type of importance (same meaning as semantic feature quantity, hereinafter, may be described as importance). For example, in the case of a baseball program, there are Status Parameters such as "attack level" indicating the degree of aggressiveness and "pitcher level" indicating the pitcher's condition. The value of the importance at the time indicated by the timecode of the Frame specified by fno is value.

[Operation of Each Module of this Embodiment] Next, the operation of each module of the distribution server 200 of this embodiment will be described. FIG. 3 is an explanatory diagram showing the operation of each module of the distribution server 200 according to the present embodiment.

The processing modules of this system (distribution server 200) include the following. * Scene extraction module (extraction means of the present invention) * Status parameter calculation module (semantic feature amount calculation means of the present invention) * Digest / program related information generation module (digest generation / distribution means of the present invention) * Digest / related information Monitoring module (start information output means of the present invention) * Digest / program related information generation event issuing module (start information output means of the present invention) * Delivery timing / preference information setting module

The events processed by the distribution server 200 are as follows. * P-Descriptor reception event * Scene extraction event * Annotation generation event * Status parameter calculation event * Digest generation start event * Digest related information change event

Now, referring to FIG. 3, the distribution server 2
An outline of the digest generation / distribution process in 00 will be described. The following numbers correspond to the numbers in the figure and indicate the respective processes. Note that the digest generation DB in the figure corresponds to the storage means of the present invention, and stores the calculated status parameters, the generated scenes and annotations, and the usage profile in which the distribution timing of each receiving terminal 300 is set. .

When the program additional information (P-Descriptor) broadcast from the broadcasting station is received, a P-Descriptor reception event occurs. In response to the occurrence of the P-Descriptor reception event, the scene extraction rule is fired in the scene extraction module, scene extraction (Scene extraction) is performed, and annotation generation (Annotation generation) is performed for the program additional information in the scene. When the annotation is generated, the Annotation generation event is issued to the status parameter calculation module and the digest / program related information generation module.

The status parameter calculation module fires the status parameter calculation rule in response to the occurrence of the P-Descriptor reception event and the Annotation generation event, and calculates the value of the status parameter (Status Parameter). When the status parameter value is calculated, the status parameter calculation event is
Issued to the related information monitoring module.

When (a) an event related to digest / program related information generation is received, (b) an annotation is generated, or (c) the value of the status parameter is changed, the digest / related information monitoring module , The digest related information change event is issued to the digest / program related information generation event issuing module. Here, the digest related information change event is
Issued upon receipt of a scene extraction event and status parameter calculation event. Further, which of (a) to (c) the digest / related information monitoring module issues the digest related information change event can be selected and set in later-described.

Upon receiving the digest-related information change event, the digest / program-related information generation event issuing module analyzes the content of the event and generates a digest generation start event to generate the individual digest / program-related information of the user. Issue. Upon receiving the digest generation start event, the digest / program related information generation module starts generation of the digest. Also, the generated digest is
It is delivered to each user (that is, each receiving terminal 300).

Selecting and setting to issue the digest related information change event according to any of the above (a) to (c) is the same as setting the delivery timing. The user can set the three distribution timings in the distribution server 200 via the individual receiving terminals 300 in advance. Specifically, the user is the receiving terminal 30
When the distribution timing at which the user wants information is transmitted to the distribution server 200 using 0, the distribution timing / preference information setting module of the distribution server 200 causes the profile information (use Set each delivery timing in (Profile).

Next, the "scene extraction module", the "status parameter calculation module" and the "digest / program related information generation module" will be specifically described in this order.

“Scene Extraction Module” In the present embodiment, Scene extraction and Annotation generation are given as “scene extraction rules”. This rule is defined in advance and stored in a database. The scene extraction rule is specifically expressed in the following markup language.

[0076] Here, the Scene type, pattern, and Annotation designation are non-terminal symbols.

[0077] Where start P-Descriptor, end P-Descriptor, P-Desc
The riptor pattern is a non-terminal symbol.

[0078] Here, Annotation type and P-Descriptor position are non-terminal symbols.

When a pattern is established in the received P-Descriptor, a Scene of the type indicated by the Scene type is generated. Start P-Descriptor, End P-Descriptor is Scen
It specifies the range of matching for e extraction. When the start P-Descriptor is received, matching of the P-Descriptor pattern is started. If the matching P-Descriptor pattern is completed before the end P-Descriptor occurs, the Scene is extracted.

If the end P-Descriptor is received before the pattern matching, the pattern matching process is stopped. If the start P-Descriptor and end P-Descriptor are omitted, the P-Descriptor will be in the range from the start to the end of the program.
The matching process of the or pattern will be executed.

The P-Descriptor pattern is a P-Descriptor
It is represented by the regular expression of p _i . In the P-Descriptor pattern, parentheses "()" that specify the priority of the operation, """and" $ "that represent the start and end P-Descriptor of the Scene can also be used.
Also, various conditions related to the P-Descriptor attribute data attr can be specified using square brackets "[]". The event is 1
The operator that indicates that it occurs more than once is "+", and the operator that repeats 0 times or more is "*". Events of any type are represented by ".".

When the Scene extraction is completed, the Annotation designated by the Annotation designation is added to the P-Descriptor referenced at the P-Descriptor position. Refer to the P-Descriptor position for the P-Descriptor pattern
Descriptors are enclosed in "\ (... \)" and specified by the number in that order.

An example of the scene extraction rule is shown below.

The above example is a rule for generating a reverse Scene. After P-Descriptor "inning_start"
, "Hit", "four _ball", "dead _ball" or "H
Receives "R". At that time, the attacking team has a lower score than the defensive team, and then receives "add_score" indicating one or more points, and immediately after that, the attacking team has a higher score. Extract the Scene as a reverse Scene.

When the Scene is extracted, the P-Des in the pattern
criptor (hit, four_ball, dead_ball or HR, \ 1
Annotation "trigger of reversal" is generated and added. Furthermore, in the next matching add_score, Annotat is added to the last add_score (referenced by \ 2 [$]).
ion is generated and added.

By this Scene extraction and Annotation generation processing, while receiving the basic program additional information, the semantic unity of the video is found, and Annota having a complex meaning is detected.
It is possible to add tion. In addition, since the Scene extraction rule is defined by the regular expression of supplementary information, the Scene
e Extraction can be performed easily. Also, the Scene to extract
It is easy to specify and change, and various Scenes can be extracted.

Next, the "status parameter calculation module" will be described. In the present embodiment, the calculation of status parameters is given as a “status parameter calculation rule”. This rule is also defined in advance and stored in a database.

In order to determine the semantic importance (semantic feature amount) of a certain Frame f _i on the video, Status Parameters p ₁ , ... P _n indicating the importance of f _i are calculated. Here, this calculation process will be specifically described.

The value of Status Parameter p _i is calculated by the following status parameter calculation rule. Here, the trigger event name and rule designation are non-terminal symbols.

Trigger event name = (P-Descriptor type | Annotation type) Here, the P-Descriptor type and Annotation type are non-terminal symbols.

Rule specification = <type> Status Parameter type </><op> operator </><value> value | expression </> where Status Parameter type, operator, value | expression is a non-terminal symbol .

The trigger event name is P-Descript
Specify the or type and Annotation type. Specified P-
When the Descriptor reception event or Annotation generation event is received, the rules described below are fired.

In the rule specification, the name of the Status Parameter type and its calculation formula (operator and value or formula) are defined. In case of P-Descriptor reception event, corresponding Frame
Calculate the value of Status Parameter in. Annotation
In the case of a generated event, the value of the Status Parameter of the Frame corresponding to the P-Descriptor to which the Annotation is added is calculated. For the operator, specify four arithmetic operators.

At this time, the Status has already been
If the Parameter value has been calculated, obtain a new value based on that value. If not calculated, a value is obtained with an initial value of 0.

An example of the status parameter calculation rule is shown below. (Example 1) <Status _Parameter _Calc_Rule><trigger> home _run </> // P-Descriptor "home_run" reception event <rule><type> Attack level </><op> + </><value> 5 </></></ Status_Parameter _Calc_Rule>

(Example 2) <Status _Parameter _Calc_Rule> <trigger> Trigger of reversal </> // Annotation "Inversion trigger" generation event <rule> <type> Attack level </> <op> + </> <value> 2 </> </> </ Status_Parameter_Calc_Rule>

The above is the P-Descriptor "ho
Status Paramet when receiving the reception event of "me_run" and the generation event of Annotation "trigger of reverse"
This is an example in which the er calculation procedure is described. When the "home_run" reception event is received, as shown in (Example 1), the corresponding Fr
The value of the "attack level" parameter in ame is increased by 5. When the “reverse trigger” Annotation is generated by extracting the “reverse” Scene, the attack level of the corresponding Frame is incremented by 2, as shown in (Example 2).

By this event-driven status parameter calculation processing, it is possible to dynamically calculate the importance degree while receiving the program additional information.

Next, the "digest / program related information generation module" will be described. The digest / program related information generation module generates a digest based on the digest generation rule as shown below.

[0100] Here, digest generation range, extraction Scene type, Statu
s Parameter expression, digest total time, and extraction specified value are non-terminal symbols.

Digest generation range = <start> Start time code </>{<start> End time code </>} Here, the start time code and the end time code are non-terminal symbols.

The digest generation rule is automatically generated when the user specifies the distribution timing or the like via the distribution timing / preference information setting module. In the digest generation range, the range for generating the digest in the target video is specified. When the end time code is omitted, it indicates that the digest is generated while receiving in real time. Extraction “Digest candidate scenes” [s _i ] are extracted according to the type of Scene.

Further, the following description can be made in the Status Parameter expression. (A) Attack level (B) Attack level + user preference level * 0.5

The designation of (a) above is the designation of generating a digest based only on the attack level (the kind of the semantic feature used for generating the digest). In addition, the designation of (a) is a designation of generating a digest based on a value obtained by adding the user preference level * 0.5 times to the attack level.

For the Frame in each candidate scene, Status
Calculate the value according to the parameter formula. This value is called the "importance value" of each frame. A scene is selected according to the following policy based on this importance value.

When the digest total time is designated via the digest / program related information generating module, the Scene having a higher importance value is selected in order until the digest total time becomes equal to the designated digest total time.

When the designated extraction value is designated by the digest / program related information generation module, a scene having an importance value equal to or higher than the designated value is selected and reconstructed in time series to generate a digest.

In the above configuration, the following (a)-
Generation and distribution of the digest according to the present embodiment will be described by taking as an example the case where each of the three distribution timings in (c) is set. (A) A digest is generated and delivered when an event related to the digest / program related information generation is received. (B) A digest is generated and delivered when the annotation is generated. (C) A digest is generated and delivered when the value of the Status Parameter is changed.

[Digest generation by reception event
Operation of Distribution Processing] First, (a) a case where a digest is generated and distributed when an event related to generation of digest / program related information is received will be described. For example, consider a case where video digest information and program-related information are distributed when the following event is received. In addition,
As shown in FIG. 3, what kind of event (program additional information) is to be generated and distributed when using the reception terminal 300 and the distribution timing / preference information setting module is used. It is preset in the profile. Here, it is assumed that an inning start event ("inning_start") is set as the start designation information of the present invention.

Inning start event ("inning_star
When receiving the program additional information, the distribution server 200 determines whether or not the type of the received program additional information matches the start designation information (inning start event), and if they match, generates a digest. In other words, when the distribution server 200 receives the inning start event, the digest / related information monitoring module issues a digest related information change event, and the digest / program related information generation event issuing module receives it. A digest generation start event is issued to the digest / program related information generation module.

The digest / program-related information generation module generates digest / program-related information for each user based on information such as P-Descriptor (program additional information), status parameters, and annotations. At that time, if the information has already been distributed to the target user, the digest / program related information is generated and distributed only for the difference information.

FIG. 4 shows the results of the game analysis up to the second inning of the game between Giants and Hiroshima on October 3, 1998. A digest is generated when the innings of the second back are completed and the inning start event of the third front is received. The following is an example of digest information and program-related information generated up to the second time. In the figure, 401 is a graph in which the horizontal axis is the time axis (time) of the program video and the vertical axis is the value of the status parameter, and 402 is the structure of the program video. The presence of multiple status parameter values at the same time on the graph 401 is due to simultaneous calculation and display of multiple types of status parameters.

Digest information (including corresponding digest video scenes) 1st table Hiroshima Eto's sacrifice strikes 1st time Back giant Takahashi's timely hit reverse 2nd back giant Kawaso's hit 2nd back giant Matsui's 3 runs Home run

Program related information Player profile Batting information Yesterday's home run scene Takahashi today

The above digest information and program related information are generated and distributed to the receiving terminal 300 of each user.

As described above, the type of the program additional information (the type of event) for designating the distribution timing is previously transmitted by the individual users to the distribution server 200 using their respective receiving terminals 300 to generate a digest. Since it is set in the profile information (use profile) for each receiving terminal 300 stored in the DB, the distribution server 20
At 0, the receiving terminal 300 is referred to by referring to the usage profile.
Based on the start designation information (type of program additional information) individually set for each, a digest can be generated and distributed at the distribution timing desired by each user.

[0117] It is also possible to set a plurality of start designation information (types of program additional information) in the user profile corresponding to one receiving terminal 300. For example, in addition to the above start specification information (inning start event),
Set start specification information (home run event),
A digest is generated and delivered even when a home run occurs.

Further, in addition to setting a plurality of start designating information, by setting the priority of processing to a plurality of preset start designating information, in addition to setting the start designating information, The delivery timing can also be adjusted (set) by specifying. For example, assume that a plurality of pieces of start designation information and their priorities are set in advance in the usage profile as follows. Here, it is assumed that the larger the numerical value of the priority, the higher the priority. Start designation information (Priority) Inning start event (Priority 1) Home run event (Priority 5) Strikeout event (Priority 3)

When a plurality of pieces of start designation information and their priorities are set in this way, if priority 1 is designated as the delivery timing, start designation information of priority 1 or higher (inning start event, home run event, strikeout) Event) occurs, a digest is generated and delivered. If priority 3 is specified under the same condition, a digest is generated and distributed when priority 3 or higher, that is, when there is a strikeout and when there is a home run.

Therefore, when a mobile phone is used as the receiving terminal 300 and a digest is delivered, the result is received as a digest for each inning, and when there is a strikeout and a home run, the result up to that time is used as a digest. The digest can be received and the digest can be acquired at the distribution timing desired by the user.

[Operation of Digest Generation / Distribution Processing by Annotation Generation] Next, (b) a case of generating / delivering a digest when Annotation is generated will be described. For example, consider a case where digest information and program-related information are distributed when the following annotations are generated. It should be noted that, as shown in FIG. 3, what kind of annotation is generated to generate and distribute the digest is determined by the usage profile via the receiving terminal 300 and the distribution timing / preference information setting module. It is set in advance. Here, it is assumed that annotation (reverse) is set.

Annotation: Upon receiving the program additional information, the reverse rotation distribution server 200 generates an annotation from the received program additional information, and determines whether the generated annotation matches a preset annotation (reverse rotation). And if they match,
Generate and deliver the digest.

In other words, when the scene extraction module of the distribution server 200 generates an annotation (reverse), it issues an Annotation generation event to the digest / program related information generation module. The digest / program-related information generation module analyzes the annotation based on the Annotation generation event, and issues the digest-related information change event when the annotation "reverse" is generated. In response to this, the digest / program related information generation event issuing module issues a digest generation start event to the digest / program related information generation module, and the digest / program related information is generated.

The following is an example of digest information / program-related information when the annotation of "reversal" occurs due to a timely hit by Takahashi in the battle between Giants and Hiroshima on October 3, 1998.

Digest information (including corresponding digest video scenes) 1st table Hiroshima Eto's sacrifice strikes 1st back giant Shimizu hit 1st back giant Takahashi's timely hit reverses

Program related information Player profile Batting information The reversal scene of yesterday Takahashi today

The above digest information and program-related information are generated and delivered to the receiving terminal 300 of each user.

When the annotation set in this way is generated, by generating and distributing the digest, the digest can be acquired at the distribution timing desired by the user.

[Operation of Digest Generation / Distribution Processing According to Status Parameter Value] Next, the case where (c) a digest is generated / distributed when the status parameter (Status Parameter) value is changed will be described.

In the present embodiment, there are two ways of specifying the delivery timing by changing the value of the status parameter, (a) and (a), and each will be described below with examples. (A) Deliver when the status parameter value exceeds a certain value. (A) In a certain scene, when the integrated value of the status parameter exceeds a certain value, it is delivered.

(A) When the value of the status parameter exceeds a certain value, it will be delivered. The excitement level parameter is when the third base runner has a chance to reverse by one shot and the bat at the cleanup starts (a chance scene). The value rises sharply. It is assumed that the digest information and the related information are designated to be delivered when the excitement level exceeds a certain value.

Here, from among a plurality of status parameters (eg, attack level parameter, pitcher level parameter, excitement level parameter), the receiving terminal 30 is preliminarily selected.
It is assumed that the excitement level parameter is set to 0 in the usage profile as a parameter to be compared with the set value. The parameter to be compared with this set value is also set in the usage profile corresponding to each receiving terminal 300, similarly to the start designation information described above.

When the excitement level value increases in the scene of the chance as described above, the digest / related information monitoring module issues a digest related information change event. In response to this, the digest / program related information generation event issuing module issues a digest generation start event to the digest / program related information generation module, and the digest / program related information is generated.

The following is the value of the excitement level above the set value (here, 10) at the start of the bats at Takahashi in the battle between Giants and Hiroshima on October 3, 1998 (excitement level value ≧ 10).
In the case of, the digest / related information delivery is designated. At the beginning of the bat at Takahashi, the score is 0
-1 (the giant loses by 1 point), Shimizu on the 1st and 3rd bases,
There is Hitoshi and the excitement level is rising.

Digest information (including corresponding digest video scenes) 1st time Hiroshima Eto's sacrifice hits 1st lead back giant Hitoshi Hitoshi Foreball 1st base back giant Shimizu hit

Program-related information Player profile batting average information Yesterday's chance scene Takahashi's chance scene (September 26) ← Shows what kind of result Takahashi had in the same chance scene in the game on September 26

The above digest information and program related information are generated and delivered to the receiving terminal 300 of each user.

Each user selects the status parameter type in advance and transmits it to the distribution server 200 using each receiving terminal 300, and the digest generation DB
Since the profile information (usage profile) for each receiving terminal 300 stored in is stored in the distribution server 200, the distribution server 200 refers to the usage profile to determine the status parameter type set individually for each receiving terminal 300. Based on this, the digest can be generated and distributed at the distribution timing desired by each user.

(A) In the case where the integrated value of the status parameter exceeds a certain value in a certain scene, the distribution is performed, for example, in a certain inning scene, if the hit or the addition of points continues, the integrated value (cumulative value) of the attack level increases. To go. As the integral value increases, the importance of the inning scene itself also increases. When the integrated value exceeds a certain value, it is possible to execute information distribution in real time by specifying information distribution in advance for scenes of increasing importance.

The following is a case where the digest / related information distribution is specified when the integration value of the attack level is ≧ 15 (setting value) at the start of the bats at Takahashi in the battle between Giants and Hiroshima on October 3, 1998. Here is an example. In one back inning, due to the timely hit of Takahashi, the integrated value of the attack level exceeds the set value (15). Information is distributed by the change of this value.

Breakdown: Hit (+2), Baseball on base (+1), Timely hit (+4), Reverse (+)
5) Add 2 points (+ 2 * 2)

Digest information (including corresponding digest video scenes) 1st table Hiroshima Eto's sacrifice strikes 1st back Giant Hitoshi Foreball first base 1 back Giant Shimizu hit

Program related information Player profile batting average information Yesterday's chance scene Takahashi's chance scene (September 26th) ← Shows what kind of result Takahashi had in the same chance scene on September 26th

The above digest information and program-related information are generated and distributed to the receiving terminal 300 of each user.

As described above, by using the digest distribution system of this embodiment, in the push type service in which the provider generates and distributes the digest and program-related information to each user, Information can be generated and distributed.

In the above-mentioned embodiment, the baseball program is explained as an example of the program image, but the program image is not limited to this. For example, from a program for distributing stock information etc. to an individual or a news program, etc. Needless to say, it can be applied to all push-type services in which a provider generates digests and program-related information for individual users and delivers them, such as when delivering only information required by individuals in real time. .

[0147]

As described above, in the digest distribution system (Claim 1) of the present invention, when the program additional information that matches the preset start designation information is input, the distribution server generates a digest. In a push-type service in which a provider generates and delivers digests and program-related information to individual users for delivery,
It is possible to generate and distribute personalized information at an optimal timing.

In the digest delivery system (claim 2) of the present invention, the start designation information can be set in advance in the delivery server via the receiving terminal, so that the desired type of program additional information can be designated to start. By setting the information as information, it is possible to generate and distribute personalized information at an optimal timing by using the input of the type of desired program additional information as a trigger.

Further, in the digest delivery system of the present invention (claim 3), when the start designation information is individually set in the delivery server for each receiving terminal, the delivery server sets the start designation set individually for each receiving terminal. Based on the information
Since the digest is generated and distributed for each receiving terminal, the personalized information can be generated and distributed at an optimal timing for each receiving terminal by using the input of the program additional information as a trigger.

In addition, the digest delivery system of the present invention (claim 4) can set a plurality of start designation information and a processing priority for the plurality of set start designation information. In, it is possible to use a combination of a plurality of start designation information and processing priorities, and it is possible to generate and distribute personalized information at the optimum timing desired by the user.

Further, the digest distribution system of the present invention (claim 5) calculates the value of the parameter indicating the characteristic amount of the video content based on the input program additional information, and determines the calculated value of the parameter or the total value. Compare with the setting value of
When the value or cumulative value reaches the set value, a digest is generated and distributed, so in a push type service where the provider generates and distributes digest and program related information to each user, it is for personal use at the optimum timing. Information can be generated and distributed.

Further, the digest delivery system of the present invention (claim 6) can set the kind of parameter to be compared with the set value from the plurality of parameters in the delivery server via the receiving terminal. Furthermore, it is possible to generate and distribute personalized information at the optimum timing desired by the user.

Further, in the digest delivery system of the present invention (claim 7), when the set values are individually set in the delivery server for each receiving terminal, the delivery server sets the set values individually set for each receiving terminal. Based on this, since the digest is generated and distributed for each receiving terminal, it is possible to further generate and distribute the personalized information at the optimum timing desired by the user.

Further, in the digest distribution system of the present invention (claim 8), when the distribution server receives the program additional information, a plurality of consecutive frames designated by the received plurality of program additional information are transmitted from the program video. Extracting means for extracting as a scene, and, when receiving the program additional information, a semantic feature calculating means for calculating, for each frame, a semantic feature of a frame in the program video based on the received plurality of program additional information, A storage unit that stores the scene extracted by the extraction unit and the semantic feature amount of the frame calculated by the semantic feature amount calculation unit, and when the program additional information is received, the type of the received program additional information is set in advance. Start information output means for determining whether or not the specified information matches, and if matched, outputting start information for generating a digest; When the start information is output from the start information output unit, a scene in which a frame having a high semantic feature amount is preferentially selected from the extracted scenes is given priority based on the semantic feature amount of the frames accumulated by the accumulating unit. Since it has a digest generation / distribution means for selecting and generating a digest and distributing it to the receiving terminal, it is most suitable for the push type service in which the provider generates and distributes the digest and program-related information to individual users. Information for individuals can be generated and delivered at a timing.

Further, in the digest delivery system (claim 9) of the present invention, when the delivery server receives the program additional information, a plurality of consecutive frames designated by the plurality of received program additional information are transmitted from the program video. Extraction means for extracting as a scene and for analyzing a plurality of received program additional information to generate composite information having a composite meaning, and for receiving the program additional information, the received plurality of program additional information and the extracted means. Based on the generated composite information, the semantic feature quantity calculating means for calculating the semantic feature quantity of the frame in the program video for each frame, the received program video, the scene extracted by the extracting means, and the extracting means The composite information is generated by the storage unit that stores the complex information and the semantic feature amount of the frame calculated by the semantic feature amount calculation unit, and the extraction unit. From the start information output means and the start information output means for determining whether the generated composite information matches the preset composite information and, if they match, outputting the start information for generating the digest When the start information is output, a scene in which a frame having a high semantic feature amount exists is preferentially selected from the extracted scenes based on the semantic feature amount of the frames accumulated by the accumulating unit, and the digest is digested. Since it is equipped with a digest generation / distribution means for generating and distributing to the receiving terminal, the provider creates and distributes digest and program-related information to each user, and pushes the Information can be generated and distributed.

Further, in the digest delivery system (claim 10) of the present invention, when the delivery server receives the program additional information, a plurality of consecutive frames designated by the plurality of received program additional information are transmitted from the program video. When the extraction means for extracting as a scene and the program additional information are received,
Based on the received plurality of program additional information, the semantic feature amount calculating means for calculating the semantic feature amount of the frame in the program video for each frame, and the scene extracted by the extracting means and the semantic feature amount calculating means When the semantic feature quantity of the frame is calculated by the storage means for accumulating the semantic feature quantity of the frame and the semantic feature quantity calculation means, the calculated value is compared with a predetermined set value, and the calculated value is calculated. When the start information is output from the start information output means and the start information output means for outputting the start information for generating the digest when the value is equal to or more than the set value, based on the semantic feature amount of the frame accumulated by the accumulating means, Then, from the extracted scenes, a scene in which a frame having a high semantic feature quantity exists is preferentially selected, a digest is generated, and the digest is generated and distributed to the receiving terminal. Due to a signal means, the provider in a push-type service for delivering to generate a digest and program-related information to a user individual's can be distributed to generate information for individuals at an optimum timing.

Further, in the digest delivery system of the present invention (claim 11), when the delivery server receives the program additional information, a plurality of consecutive frames designated by the received plurality of program additional information are transmitted from the program video. When the extraction means for extracting as a scene and the program additional information are received,
Based on the received plurality of program additional information, the semantic feature amount calculating means for calculating the semantic feature amount of the frame in the program video for each frame, and the scene extracted by the extracting means and the semantic feature amount calculating means When the semantic feature amount of the frame is calculated by the accumulating unit that accumulates the semantic feature amount of the selected frame and the semantic feature amount calculating unit calculates the value of the calculated semantic feature amount and the frame that is accumulated in the accumulating unit. Using the value of the semantic feature amount of, the cumulative value of the semantic feature amount is calculated, the calculated cumulative value is compared with a predetermined set value, and when the cumulative value reaches the set value, a digest is given. When the start information is output from the start information output unit that outputs the start information to be generated and the start information output unit, it is higher than the extracted scene based on the semantic feature amount of the frame accumulated by the accumulating unit. Meaning A scene frame exists with feature values preferentially selected, and generate a digest,
Since it has a digest generation / delivery means for delivering to the receiving terminal, in a push-type service in which a provider generates and delivers digest and program-related information to individual users, information for individuals is generated at optimal timing. Can be delivered.

[Brief description of drawings]

FIG. 1 is a schematic configuration diagram of a digest distribution system according to the present embodiment.

FIG. 2 is data (Frame, P-) used in this embodiment.
Descriptor, Scene, Annotation, Status Parameter)
It is explanatory drawing which shows the relationship of.

FIG. 3 is an explanatory diagram showing the operation of each module of the distribution server according to the present embodiment.

FIG. 4 is an explanatory diagram showing digest generation and distribution according to distribution timing according to the present embodiment.

[Explanation of symbols]

100 broadcasting stations 200 distribution servers 300 receiving terminal

─────────────────────────────────────────────────── ─── Continuation of front page (51) Int.Cl. ⁷ Identification code FI theme code (reference) H04N 7/16 (72) Yukari Yoshiura 1-3-6 Nakamagome, Ota-ku, Tokyo Within Ricoh Co., Ltd. (72) Inventor Atsushi Iizawa 1-3-6 Nakamagome, Ota-ku, Tokyo F-term in Ricoh Co., Ltd. (reference) 5C063 AA01 AB03 AB07 AC01 AC10 CA23 CA36 DA03 DA07 DA13 DB10 5C064 BA01 BB07 BC07 BC18 BC23 BD02 BD03 BD08 BD09 5K030 GA18 HA08 HB02 HC01 HC09 JL01 JL02 JL07 JT03 KA01 KA06 KA13 KX28 LD13

Claims (11)

[Claims] 1. In a broadcasting environment in which program video consisting of a plurality of consecutive frames and its supplementary information are transmitted as program additional information, the program video and program additional information are input to obtain the program video and program additional information. A digest distribution system having a distribution server for generating and distributing the digest, and a receiving terminal for viewing the digest distributed from the distribution server, wherein the distribution server inputs the program additional information. ,
A digest distribution system characterized by determining whether or not the type of inputted program additional information matches preset start designation information and, if they match, generating and distributing a digest. 2. The digest distribution system according to claim 1, wherein the start designation information can be set in the distribution server in advance via the receiving terminal. 3. The start designation information can be set in the distribution server individually for each receiving terminal, and the distribution server receives the start designation information based on the start designation information individually set for each receiving terminal. 3. The digest is generated and distributed for each terminal.
The digest distribution system described in. 4. A plurality of the start designation information can be set, and a processing priority can be set for the plurality of set start designation information. The digest distribution system described in any one of. 5. The program video and the program additional information are input in a broadcast environment in which the program video consisting of a plurality of consecutive frames and its supplementary information are transmitted as the program additional information, and the program video and the program additional information are input. A digest distribution system having a distribution server for generating and distributing the digest, and a receiving terminal for viewing the digest distributed from the distribution server, wherein the distribution server inputs the program additional information. ,
The value of the parameter indicating the feature amount of the video content in the program video is calculated based on the input program additional information, and the calculated value of the parameter or the cumulative value of the parameter is compared with a predetermined set value to obtain the value. Alternatively, a digest distribution system, wherein a digest is generated and distributed when the cumulative value reaches the set value. 6. There are a plurality of parameters indicating the characteristic amount of the video content, and the kind of the parameter to be compared with the set value can be set in the distribution server from the plurality of parameters via the receiving terminal. The digest distribution system according to claim 5, wherein 7. The set value can be set in the distribution server individually for each receiving terminal, and the distribution server sets each receiving terminal based on the setting value set individually for each receiving terminal. The digest distribution system according to claim 5 or 6, wherein the digest is generated and distributed. 8. In a broadcast environment in which program video consisting of a plurality of consecutive frames and its supplementary information are transmitted as program additional information, the program video and program additional information transmitted from a broadcast station are received and a digest is received. A digest distribution system having a distribution server for generating and distributing, and a receiving terminal for viewing a digest distributed from the distribution server, wherein the distribution server receives the program additional information, and receives the program additional information. Consecutive multiple frames specified by multiple program additional information,
An extraction unit that extracts a scene from the program video, and, when the program additional information is received, a semantic feature that calculates a semantic feature amount of a frame in the program video for each frame based on the received plurality of program additional information. Characteristic amount calculating means, accumulating means for accumulating the semantic characteristic amount of the scene extracted by the extracting means and the frame calculated by the semantic characteristic amount calculating means; and when the program additional information is received, the received program additional information The start information output unit that outputs the start information for generating a digest when it determines whether or not the type matches the preset start information, and the start information from the start information output unit. Is output, it has a high semantic feature amount from the extracted scenes based on the semantic feature amount of the frames accumulated by the accumulating unit. Digest distribution / distribution means for generating a digest by preferentially selecting a scene in which a frame exists, and distributing the digest to the receiving terminal. 9. A program video and program additional information transmitted from a broadcasting station are received in a broadcast environment in which program video consisting of a plurality of consecutive frames and supplementary information thereof are transmitted as program additional information, and a digest is received. A digest distribution system having a distribution server for generating and distributing, and a receiving terminal for viewing a digest distributed from the distribution server, wherein the distribution server receives the program additional information, and receives the program additional information. Consecutive multiple frames specified by multiple program additional information,
Extracting means for extracting a scene from the program image and analyzing a plurality of received program additional information to generate composite information having a composite meaning; and, when receiving the program additional information, receiving a plurality of received program additional information. Semantic feature amount calculation means for calculating, for each frame, the semantic feature amount of the frame in the program video based on the information and the composite information generated by the extraction means, and the received program video, extracted by the extraction means And a composite information generated by the extracting unit and a semantic feature amount of the frame calculated by the semantic feature amount calculating unit; and a complex information generated by the extracting unit. Start information that determines whether the composite information matches the preset composite information and, if they match, outputs the start information for generating the digest When the start information is output from the output unit and the start information output unit, a frame having a high semantic feature amount from the extracted scene is generated based on the semantic feature amount of the frames accumulated by the accumulating unit. A digest distribution system comprising: a digest generation / distribution unit that preferentially selects an existing scene, generates a digest, and distributes the digest to the receiving terminal. 10. Under a broadcast environment in which program video consisting of a plurality of consecutive frames and its supplementary information are transmitted as program additional information, the program video and program additional information transmitted from a broadcasting station are received and a digest is received. A digest distribution system having a distribution server for generating and distributing, and a receiving terminal for viewing a digest distributed from the distribution server, wherein the distribution server receives the program additional information, and receives the program additional information. Consecutive multiple frames specified by multiple program additional information,
An extraction unit that extracts a scene from the program video, and, when the program additional information is received, a semantic feature that calculates a semantic feature amount of a frame in the program video for each frame based on the received plurality of program additional information. A characteristic amount calculation means, a storage means for accumulating the scene extracted by the extraction means and the semantic feature amount of the frame calculated by the semantic feature amount calculation means; and the semantic feature of the frame by the semantic feature amount calculation means When the amount is calculated, a start information output unit that compares the calculated value with a predetermined set value and outputs start information for generating a digest when the calculated value is equal to or larger than the set value, and the start When the start information is output from the information output unit, a high semantic feature amount is extracted from the extracted scenes based on the semantic feature amount of the frames accumulated by the accumulating unit. A digest distribution system comprising: a digest generation / distribution unit that preferentially selects a scene in which the frame is included, generates a digest, and distributes the digest to the receiving terminal. 11. Under a broadcast environment in which program video consisting of a plurality of consecutive frames and its supplementary information are transmitted as program additional information, the program video and program additional information transmitted from a broadcasting station are received and a digest is received. A digest distribution system having a distribution server for generating and distributing, and a receiving terminal for viewing a digest distributed from the distribution server, wherein the distribution server receives the program additional information, and receives the program additional information. Consecutive multiple frames specified by multiple program additional information,
An extraction unit that extracts a scene from the program video, and, when the program additional information is received, a semantic feature that calculates a semantic feature amount of a frame in the program video for each frame based on the received plurality of program additional information. A characteristic amount calculation means, a storage means for accumulating the scene extracted by the extraction means and the semantic feature amount of the frame calculated by the semantic feature amount calculation means; and the semantic feature of the frame by the semantic feature amount calculation means When the amount is calculated, the value of the calculated semantic feature amount and the value of the semantic feature amount of the frame accumulated in the accumulating unit are used to calculate and calculate the cumulative value of the semantic feature amounts. Start information output means for comparing the cumulative value with a predetermined setting value and outputting start information for generating a digest when the cumulative value reaches the setting value; When the start information is output from the means, a scene in which a frame having a high semantic feature quantity exists is preferentially selected from the extracted scenes based on the semantic feature quantity of the frames accumulated by the accumulating means. And a digest generating / delivering unit for generating a digest and delivering the digest to the receiving terminal.