JP4494821B2 - Content / metadata transmission / reception system, content / metadata synchronization method, program for causing computer to execute the method, and receiving terminal - Google Patents

Description

The present invention relates to a content metadata transmission and reception system for transmitting and receiving content and metadata, content metadata synchronization method, a program for executing the method on a computer, relates the receiving terminal as well, the content and the metadata are transmitted in particular separately content metadata transmission and reception system, content metadata synchronization method can be correlated to receive, program for executing the method on a computer, to a receiving terminal as well.

  2. Description of the Related Art In recent years, when multimedia content including video / audio is received and viewed, a technology for processing content using metadata (metadata) that is information included in a property of a data file has become widespread. In BS digital broadcasting using BS satellite and terrestrial digital broadcasting, a viewing method has been proposed in which content with metadata is distributed and the content is viewed in a variety of ways using metadata received at a receiving terminal. .

  For example, an invention has been made that generates a search index by synchronizing a video with characteristic information and time information of the video (Patent Document 1). According to the present invention, the video information and the time information of the video are synchronized, and the search index of the video information can be generated.

JP 2003-274353 A

  However, the invention of Patent Document 1 receives index information to which time information is not added even if a search index can be generated in synchronization with video and video time information. It was not possible to synchronize with the content corresponding to.

  With the digitization of broadcasting, metadata is added to the content to be distributed, but when adding metadata to the content, the content creator and the metadata producer are the same and distributed If it is a recording type content for which metadata can be prepared in advance, it is possible to accurately describe the time information of the content in the metadata and distribute the content and the metadata in association with each other. However, in general, metadata may not be prepared in advance for content that is broadcast live in live broadcasts. If the content creator and the metadata creator are different, accurately describe the time information of the content in the metadata. There are many cases where this is not possible. In particular, in a service that distributes metadata in real time, there is a problem that it is difficult to generate metadata in real time because it takes time to extract time information by accurately associating content with metadata. .

  In addition, when time information is not added to content, it is difficult for a side that generates and distributes metadata to add time information to metadata describing the content. In addition, when the viewing of the content is started in the receiving terminal, if time information is not added to the content, it becomes more difficult to match the time of the metadata and the content.

The present invention has been made in view of the above problems, and an object of the present invention is to receive a content and metadata that are distributed separately, and to automatically associate the content and metadata with each other. synchronization method, a program for executing the method on a computer, is to provide a receiving terminal as well.

In order to solve the above-described problems and achieve the object, the invention according to claim 1 is a content / metadata transmission / reception system, a content distribution server for distributing content including video and audio, and the content distribution server A metadata distribution server having metadata generation means for receiving the content to be distributed and generating and distributing metadata related to the content, the content distributed by the content distribution server, and the metadata distribution server A receiving terminal having synchronization means for receiving the metadata and associating the content with the metadata , wherein the metadata distribution server analyzes a feature amount representing a feature of the received content. An analysis unit; and the metadata generation unit includes the analysis unit. The content feature quantity analyzed by the first analysis means is distributed in association with the metadata, and the receiving terminal further comprises second analysis means for analyzing the feature quantity representing the feature of the content, The synchronization unit receives the feature amount information by the first analysis unit distributed by the metadata generation unit, and the feature amount information by the first analysis unit in the received information and the second analysis unit The content and the metadata are associated with each other based on the feature amount obtained by.

According to the first aspect of the present invention, even if the time information is not added to the content, the content terminal and the content feature received in association with the metadata are obtained at the information terminal. By comparing, content and metadata can be associated with each other.

Further, the invention according to claim 2 is the content / metadata transmission / reception system according to claim 1 , wherein the metadata generation means uses the feature amount information analyzed by the first analysis means as the metadata. The synchronization unit receives the feature amount information added to the metadata transmitted by the metadata generation unit, and the feature amount added to the received metadata. The content and the metadata are associated with each other on the basis of the information and the feature amount obtained by the second analysis unit.

According to the invention of claim 2 , even if time information is not added to the content, the feature amount of the content is compared with the feature amount of the content received by being added to the metadata in the information terminal. By doing so, content and metadata can be associated with each other.

Further, the invention according to claim 3 is the content / metadata transmission / reception system according to claim 1 or 2 , wherein the first analysis means of the metadata distribution server is the feature quantity by the first analysis means. Is determined to be equal to or greater than the threshold value, the content portion corresponding to the feature value is set as a metadata base point, and the metadata generation means The time information of the metadata is described and transmitted by offset values before and after the metadata base point set by the first analysis means, and the second analysis means of the information terminal is configured to transmit the second time information of the metadata. When the feature value by the analysis unit is compared with a predetermined threshold value and it is determined that the feature value is equal to or greater than the threshold value, the content portion corresponding to the feature value is converted. Based on the metadata base point by the first analysis unit and the content base point by the second analysis unit, and by the offset value before and after. The content is associated with the metadata.

According to the invention of claim 3, there is no time information in the receiving terminal by comparing the base point based on the feature amount set by the metadata distribution server with the base point based on the feature amount set by the receiving terminal. Even in this case, it is possible to associate content with metadata.

According to a fourth aspect of the present invention, in the content / metadata transmission / reception system according to the third aspect , the first analysis means uses a color feature, a cut point at which a scene changes, and a frame as the feature amount to be analyzed. Calculating one or more feature amounts of matching, silent section, audio power, audio spectrum, and image pattern, and setting and delivering a base point of the metadata according to the calculated one or more feature amounts; The second analysis means analyzes one or more feature values of a color feature, a cut point at which a scene changes, a frame matching, a silent section, an audio power, an audio spectrum, and a picture pattern as the feature values to be analyzed. Calculating and setting the base point of the content according to the calculated one or more feature quantities, and the synchronization means is set before the first analysis means to receive Based on the base point of the content that the base point of the metadata second analysis unit is set, wherein the in which correspondence between the metadata and the content by the front and rear of the offset value.

According to the fourth aspect of the present invention, one or more feature amounts of the color feature in the content, the cut point at which the scene switches, the frame matching, the silent section, the audio power, the audio spectrum, and the image pattern are calculated. By comparing the base points set by the calculated one or more feature quantities, it is possible to associate content and metadata even when there is no time information at the receiving terminal.

The invention according to claim 5 is the content / metadata transmission / reception system according to claim 3 or 4 , wherein the first analysis means sets a plurality of base points of the metadata and performs the second analysis. The means sets a plurality of base points of the content, and the synchronization means sets the content and the content based on the set offset points before and after the plurality of base points of the metadata and the plurality of base points of the content. The metadata is associated with the metadata.

According to the fifth aspect of the present invention, by comparing a plurality of base points based on the feature amount set by the metadata distribution server with a plurality of base points based on the feature amount set by the receiving terminal, the time at the receiving terminal is compared. Even when there is no information, it is possible to more accurately associate content and metadata.

Also, the invention according to claim 6 is the content / metadata transmission / reception system according to claim 3 or 5 , wherein the first analysis means uses the delimiter at which the scene of the content is switched as a feature amount as a base point of the metadata And the second analyzing means sets a break point at which the scene of the content is switched as a feature amount to the base point of the content.

According to the sixth aspect of the present invention, since an accurate base point can be set, by comparing the base points based on the feature values set by the receiving terminal, the receiving terminal can cope with content and metadata even when there is no time information. The attachment can be performed more accurately.

The invention according to claim 7 is the content / metadata transmission / reception system according to any one of claims 3 to 6 , wherein the metadata generation means converts time information of the metadata into the metadata. As an offset retroactive to the immediately preceding base point and offset value information to the immediately following base point, it is delivered in addition to the metadata, and the synchronization means of the information terminal is a base point set by the second analyzing means And the time information specified by the offset value information added to the metadata, the content and the metadata are associated with each other.

According to the seventh aspect of the present invention , the metadata can be correlated retroactively by specifying the metadata based on the base points before and after the metadata. Content and metadata can be associated with each other while avoiding waste.

The invention according to claim 8 is the content / metadata transmission / reception system according to any one of claims 3 to 7 , wherein the first analysis means periodically sets a base point of the metadata at a predetermined time. The second analysis unit periodically sets the base point of the content at a predetermined time, and the synchronization unit sets the periodic base point of the metadata set by the first analysis unit. And the content and the metadata are associated with each other based on the periodic base point of the content set by the second analysis means.

According to the eighth aspect of the present invention, even when the receiving terminal starts receiving the content from the middle, the base point can be compared by receiving the periodic base point. Content and metadata can be efficiently associated with less time waste.

The invention according to claim 9 is a content / metadata synchronization method, wherein a content distribution step of distributing content including video and audio, and metadata relating to the content distributed in the content distribution step are generated. A metadata generation step for distributing the content, a synchronization step for receiving the content distributed in the content distribution step and the metadata distributed in the metadata generation step, and associating the received content with the metadata; , only including, a first analysis step of analyzing the feature amount representing the feature of the content received, including further the meta data generation step, the feature amount of the content that is analyzed in the first analyzing step Is distributed in association with the metadata, and represents the characteristics of the received content. A second analysis step of analyzing a feature amount, wherein the synchronization step includes the feature amount of the content by the first analysis step associated with the metadata distributed in the metadata generation step; Receiving information, and associating the content with the metadata based on the feature amount information obtained by the first analysis step and the feature amount obtained by the second analysis step in the received information. Features.

According to the invention of claim 9 , even if time information is not added to the content, by comparing the feature amount of the content with the feature amount of the content received in association with the metadata, Content and metadata can be associated with each other.

The invention according to claim 1 0, in the content metadata synchronization method according to claim 9, wherein the metadata generating step, the said characteristic quantity of information analyzed in the first analyzing step meta The synchronization process receives and receives the information on the feature amount by the first analysis process added to the metadata transmitted in the metadata generation process. The content and the metadata are associated with each other based on the feature amount information added to the metadata and the feature amount analyzed in the second analysis step.

According to the claim 1 0 in such invention, even as time information even has not been added to the content by comparing the feature amounts of content, and a feature amount of the content received is added to the metadata Content and metadata can be associated with each other.

The invention according to claim 1 1, in the content metadata synchronization method according to claim 9 or 1 0, wherein the first analysis step, the first analysis the feature amount predetermined teeth by step When it is determined that the feature value is equal to or greater than the threshold value compared with a threshold value, the content portion corresponding to the feature value is used as a base point of metadata, and the metadata generation step includes the first analysis. The time information of the metadata is described and transmitted with offset values before and after the metadata base point set in the process, and the second analysis step includes the feature amount obtained by the second analysis step. When it is determined that the feature value is equal to or greater than the threshold value compared to a predetermined threshold value, the content portion corresponding to the feature value is set as a content base point, and the synchronization step includes receiving Based on the base point of the metadata by the first analysis step and the base point of the content by the second analysis step, the content and the metadata are associated with each other by the front and back offset values. Features.

According to the invention of the claim 1 1, and the base point by the feature that has been set in the metadata, by comparing the base point by the feature set in the content, even if no time information to the content content And metadata can be associated.

The invention according to claim 1 2, in the content metadata synchronization method of claim 1 1, wherein the first analysis step, as the feature quantity to be analyzed, the cut point color feature, the scene changed, One or more feature quantities of frame matching, silence interval, voice power, voice spectrum, and image pattern are calculated, and the base point of the metadata is set and distributed by the calculated one or more feature quantities In the second analysis step, as the feature quantity to be analyzed, at least one of a color feature, a cut point at which a scene changes, a frame matching, a silent section, an audio power, an audio spectrum, and a picture pattern is used. Calculating a quantity, setting a base point of the content by the calculated one or more feature quantities, and the synchronization step is performed before the first analysis step to be received is set. Based on the base point of the content base and said second analyzing step metadata set, wherein the in which correspondence between the metadata and the content by the front and rear of the offset value.

According to the claim 1 2 in such invention, calculates the color feature in the content, the cut point scene is switched, the matching of the frame, a silence section, speech power, speech spectrum, and one or more feature quantities among Emon Then, by comparing the base points set by the calculated one or more feature quantities, it is possible to associate the content with the metadata even when there is no time information in the content.

Further, according the invention in claims 1 to 3, in the content metadata synchronization method of claim 1 1 or 1 2, wherein the first analysis step, a plurality sets the origin of the metadata, the second In the second analysis step, a plurality of base points of the content are set, and in the synchronization step, based on the plurality of base points of the set metadata and the plurality of base points of the content, The content and the metadata are associated with each other.

According to the invention of the claims 1 to 3, a plurality of base points by the feature that has been set in the metadata, by comparing the plurality of base points by the set characteristic quantity to the content, is no time information to the content Even in such a case, the content and metadata can be more accurately associated.

The invention according to claim 1 4, in the content metadata synchronization method of claim 1 1 or 1 3, wherein the first analysis step, the meta delimiter of the switching of the scene of the content as a feature quantity It is set as a data base point, and the second analysis step is characterized in that a break at which the content scene is switched is set as a feature amount at the base point of the content.

According to the invention of the claims 1 to 4, by comparing the base point by the feature set in the content and metadata can be set the correct base in the content, the content even if there is no time information to the content And metadata can be more accurately associated.

The invention according to claim 1 5, in the content metadata synchronization method according to any one of claims 1 1 to 1 4, wherein the metadata generating step, the time information of the meta data, the As an offset retroactive to the base point immediately before the metadata and offset value information to the base point immediately after the metadata, it is added to the metadata and distributed, and the synchronization step includes a base point set in the second analysis step and The content is associated with the metadata based on time information specified by the offset value information added to the metadata.

According to the invention of the claims 1 to 5, by identifying the metadata by the front and rear base metadata, it is possible to make correspondence between metadata retroactively, wasting metadata received It is possible to associate content and metadata while avoiding this.

The invention according to claim 16 is the content / metadata synchronization method according to any one of claims 11 to 15 , wherein the first analysis step sets a base point of the metadata for a predetermined time. The second analysis step periodically sets the base point of the content at a predetermined time, and the synchronization step periodically sets the metadata set by the first analysis step. The content and the metadata are associated with each other based on a valid base point and a periodic base point of the content set in the second analysis step.

According to the sixteenth aspect of the present invention, even when the content is received from the middle, the base points can be compared by receiving the periodic base points. Content and metadata can be efficiently associated with each other.

The invention according to claim 17 is a program which causes a computer to execute the content / metadata synchronization method according to any one of claims 9 to 16 .

According to the seventeenth aspect of the present invention, it is possible to cause a computer to execute the content / metadata synchronization method according to any one of the ninth to sixteenth aspects.

The invention according to claim 18 is a receiving terminal that receives content including video and audio distributed from a content distribution server and metadata generated based on the content by the metadata distribution server. A synchronization device having synchronization means for associating the received content with the metadata, wherein the metadata distribution server analyzes a feature amount representing the feature of the content, and the analyzed feature amount of the content is the metadata The synchronization device further includes an analysis unit that analyzes a feature quantity of the content received from the content distribution server, and the synchronization unit receives the metadata from the metadata distribution server. Receiving the feature amount of the content distributed in correspondence with the metadata A feature amount of the content associated with the said metadata by distribution server, that based on the feature amount of the content that has been analyzed by said analyzing means, and in which correspondence between the said content metadata Features.

According to the invention of claim 18 , even if time information is not added to the content, the information terminal obtains the feature amount of the content and the feature amount of the content received in association with the metadata. By comparing, content and metadata can be associated with each other.

The invention according to claim 19 is the receiving terminal according to claim 18 , characterized in that the receiving terminal is a DVD (Digital Versatile Disc) recorder.

According to the nineteenth aspect of the present invention, the present invention can be applied to a DVD recorder capable of separately receiving and associating the content distributed from the content distribution server and the metadata distributed from the metadata distribution server.

The invention according to claim 2 0, in the receiving terminal according to claim 18 or 19, wherein the receiving terminal is characterized by an HDD (HardDiscDrive) recorder.

According to the claim 2 0 in such invention can be applied and the content distributed from the content distribution server, and metadata distributed from the metadata delivery server to HDD recorder which can be correlated with received separately.

The invention according to claim 2 1, in the receiving terminal according to any one of claims 18 to 2 0, the receiving terminal, characterized in that it is a portable telephone.

According to the invention of the claim 2 1, it can be applied and the contents distributed from the content distribution server, and metadata distributed from the metadata distribution server to the mobile phone which can be correlated with received separately.

With reference to the accompanying drawings, such content metadata transmission and reception system in the present invention, the content metadata synchronization method, a program for executing the method on a computer, it will be described in detail an embodiment of a receiving terminal as well .

(1. Content / metadata transmission / reception system according to Embodiment 1)
(1.1. Configuration of Content / Metadata Transmission / Reception System)
FIG. 1 is a functional block diagram of the content / metadata transmission / reception system according to the first embodiment. The content / metadata transmission / reception system according to the first embodiment includes a content distribution server 1, a metadata distribution server 10, and a receiving terminal 20 connected to a network 2. In FIG. 1, only one server 1, 10 and receiving terminal 20 are shown, but the number is not limited to one.

  The content distribution server 1 generates multimedia content including video and audio by adding time information, and distributes the multimedia content to the metadata distribution server 10 and the receiving terminal 20 via the network 2.

  The metadata distribution server 10 includes a metadata generation unit 11. The metadata generation unit 11 receives the content distributed from the content distribution server 1 and describes time information added to the content, and generates metadata corresponding to the received content. The metadata generation unit 11 distributes metadata describing time information to the receiving terminal 20.

  The receiving terminal 20 includes a synchronization unit 21. The synchronization unit 21 receives metadata to which time information distributed from the metadata generation unit 11 of the metadata distribution server 10 is added. Further, the synchronization unit 21 receives content to which time information distributed from the content distribution server 1 is added.

  FIG. 2 is a diagram for explaining an association operation between content and metadata in the content / metadata transmission / reception system according to the first embodiment. Here, the metadata generation unit 11 receives a flow 51 of content distributed with time information added, and generates metadata 52 with time information added. The synchronization unit 21 of the receiving terminal 20 receives the flow 51 of content to be distributed and reads time information added to the received content. Further, the synchronization unit 21 receives the metadata 52 to which time information is added from the metadata generation server 10 and associates it with the time information of the content data 51 that has already been read. As shown in FIG. 2, time information is added to the metadata 52. For example, in the case of a batter Matsui's batting scene between 3:00 and 4:00, the metadata generation unit 11 ,

<Time> 3: 00-4: 00
<Who> Matsui

The metadata 52 is created and transmitted to the receiving terminal 20. The receiving synchronization unit 21 reads the metadata 52, reads the time information of the content data 51, and associates that the batter is Matsui during the time of the content from 3:00 to 4:00.

  This method can be applied when time information is added to content, such as in the M-PEG2 format. When time information is added to the content, the metadata generation unit 11 describes the time information in the metadata.

(1.2. Procedure for associating contents and metadata)
FIG. 3 is a flowchart for explaining a procedure for associating contents and metadata. The content distribution server 1 distributes content to which time information is added (step S101). The metadata generation unit 11 is in a state where the distributed content can be received (step S102), and when received (Yes in step S102), the metadata generation unit 11 analyzes the content (step S103) and obtains time information. In addition, metadata is generated and distributed to the receiving terminal 20 (step S104). If no content is received (No in step S102), the process waits as it is.

  The synchronization unit 21 of the receiving terminal 20 is ready to receive the distributed content (step S105). When the synchronization unit 21 receives the content (Yes in step S105), the synchronization unit 21 analyzes the time information of the content (step S106). . The synchronization unit 21 is ready to receive metadata distributed from the metadata generation unit 11 (step S107). If not received (No in step S107), the synchronization unit 21 stands by.

  When the synchronization unit 21 receives the metadata (Yes in step S107), the synchronization unit 21 checks the synchronization of the metadata time information and the content time information (step S108). If the synchronization is not established (step S108). ), The process returns to step S107 again and waits for reception of metadata.

  When the synchronization unit 21 can synchronize the metadata time information and the content time information (Yes in step S108), the synchronization unit 21 associates the content with the metadata (step S109).

(1.3. Effect)
Even if the reception terminal 20 receives the content and the metadata separately, the time information added to the content is compared with the time information described in the metadata, and the content and metadata having the same time information are compared. Can be related accurately.

(2. Content / metadata transmission / reception system according to Embodiment 2)
(2.1. Configuration of content / metadata transmission / reception system)
In the content / metadata transmission / reception system according to the second embodiment, when the time information is not added to the content to be distributed, or when the time information added to the content cannot be acquired by the metadata distribution server, the metadata distribution server Then, the feature amount representing the feature of the content is analyzed in the information terminal. The metadata distribution server 10 generates and distributes metadata to which the feature amount is added, and receives the metadata to which the distributed feature amount is added. And synchronize metadata. Here, feature amount information is used as an alternative to the time information that is the basis for associating content and metadata in the content / metadata transmission / reception system according to the first embodiment.

  FIG. 4 is a functional block diagram of the content / metadata transmission / reception system according to the second embodiment. The content / metadata transmission / reception system according to the second embodiment is different from that of the first embodiment in that the metadata distribution server 10 further includes a first analysis unit 12 that analyzes the feature amount of the received content, and the receiving terminal 20. Is further provided with a second analysis unit 22 for analyzing the feature amount of the received content. The synchronization unit 21 associates content and metadata by comparing feature amounts.

  The feature quantity analyzed by the first analysis unit 12 and the second analysis unit 22 is one of scene switching, color feature, cut point, frame matching, silent section, audio power, audio spectrum, and image pattern. That's it. The first analysis unit 12 analyzes the received content and calculates the feature amount.

  Recently, an image pattern has been used as one of the retrieval techniques for moving images. This image pattern can be detected and used as a feature amount. A print pattern is clue information for finding a desired moving image from a moving image archive. Like a human fingerprint, it is information that can identify a moving image with a small amount of information and should be used easily and stably. It has been studied as something that can be done. As for the print crest, for example, Abstract No. 023-004 "Audio Visual Complex Information Processing", "Video Search Method Using Picture Patterns-Application to Current Television Broadcasting" (Authors: Takahashi Katsunao, Sugiura Maki, Murai Masato, Terashima Nobuyoshi, Known techniques by Hideyoshi Tominaga) can be applied.

  For example, if this image printing technique is used, it is possible to narrow down a specific point of the moving image using the characteristics of the moving image.

  FIG. 5 is a diagram for explaining generation of metadata by the metadata generation unit. The first analysis unit 12 of the metadata distribution server 10 analyzes the received content 81 and calculates a feature amount. A graph denoted by reference numeral 83 is a graph showing a feature amount with respect to time. The first analysis unit 12 determines the calculated special feature amount with the threshold value 85, and on the time axis with respect to the content portions (84-1, 84-2) that give the feature amount of the threshold value 85 or more. Is set as the base point (82-1, 82-2).

  The metadata generation unit 11 generates metadata 86 between the two base points (82-1, 82-2). The generated metadata 86 is specified on the content 81. If the base point for time adjustment can be set with sufficient time depending on the implementation, it is desirable to set the time information as a positive offset value and a negative offset value as an offset value from the preceding and following base points. The metadata 86 in FIG. 5 indicates that the description of the contents of the metadata is specified twice from the starting point by the plus time and the minus time as <time>. By describing the time information of the metadata twice, even when viewing is started halfway, the associating operation can be performed immediately.

  When the metadata is specified, a time axis may be used, or the number of frames may be used. When the time axis is used, the base point for time adjustment is a point on the content having a special feature amount or having a feature amount exceeding a certain threshold. For example, a video frame section, an audio section, etc. Can be mentioned.

  Alternatively, the timing for dividing the content such as a commercial (CM) included in the content can be used as a base point for time adjustment.

  In addition, the synchronization determination by the synchronization unit 21 can be made by comparing the distance between the base points or the size of the feature amount at the base point.

  Here, it is desirable that the time adjustment base point set from the feature amount is periodically flowed. By periodically setting, even when the receiving terminal starts receiving the content and metadata in the middle of the content, it becomes possible to associate the metadata with the content as needed.

  Information on the feature quantity that is the base point for time adjustment can also be distributed as metadata. The feature amount information is distributed by generating metadata every time a time adjustment base point is generated. In that case, the content of the metadata may be only information on the base point.

  Further, the feature amount information that is the base point for time adjustment can be distributed as other information without being distributed as metadata.

  In the receiving terminal 20, the second analysis unit 22 extracts a base point from the content feature amount information received from the content distribution server 1 in the same manner as the first analysis unit 12. The synchronization unit 21 reads the base point information related to the received metadata 86 and compares the base point information of the metadata 86 read and the base point information extracted by the second analysis unit 22 to compare the content and the metadata. Take synchronization. The synchronization unit 21 selects a point on the content that matches the time adjustment base point described in the metadata, and sets the selected point as the time adjustment base point. Based on the selected time adjustment base point, content information is specified on the time axis using time offset information described in the metadata, and the content and the metadata are associated with each other.

(2.2. Procedure for associating contents and metadata)
FIG. 6 is a flowchart illustrating a procedure for associating content and metadata according to the second embodiment. The operation of each part of the content / metadata transmission / reception system according to the second embodiment and the procedure for associating the content / metadata will be described with reference to FIGS.

  The content distribution server 1 distributes content (step S201). The first analysis unit 12 of the metadata distribution server is in a state of receiving the content distributed from the content distribution server 1 (step S202). If not received (No in step S202), the first analysis unit 12 stands by. When receiving the content (Yes in step S202), the first analysis unit 12 analyzes the feature amount of the content, compares the analyzed feature amount with a predetermined threshold value, and extracts a base point (step S203). .

  Here, for example, scene switching frame information is used as the feature amount. The first analysis unit 12 detects a scene change of the content. The metadata generation unit 11 creates metadata by adding the base point information that is the scene switching frame information detected by the first analysis unit 12, and transmits the metadata to the reception terminal 20 (step S204).

  The second analysis unit 22 of the receiving terminal 20 is in a state in which the content distributed by the content distribution server 1 can be received (step S205). If not received, the second analysis unit 22 continues to be in a standby state (No in step S205). In the case (Yes in step S205), the second analysis unit 22 analyzes the scene switching frame information in the content as the feature amount of the content, compares the analyzed feature amount with a predetermined threshold value, and determines the base point. Extraction is performed and a base point is set (step S206).

  The synchronization unit 21 is in a state where it can receive metadata to which base point information that is scene switching frame information distributed from the content distribution server 1 is added (step S207), and when not received (No in step S207), The reception ready state is continued as it is. When receiving the metadata transmitted from the metadata generation unit 11 (Yes in step S207), the synchronization unit 21 detects the base point information (in this case, switching frame information) added to the metadata, and the second analysis unit The synchronization with the base point analyzed in this case (switching frame information in this case) is determined (step S208). If the synchronization unit 21 cannot synchronize the feature amount (No in step S208), the process returns to step S207. If the synchronization unit 21 can synchronize the feature amounts (Yes in step S208), the content and the metadata are associated with each other by the obtained synchronization (step S209).

(2.3. Effect)
Even when the time information is not added to the content sent from the content delivery server, the metadata delivery server analyzes the feature amount of the content, adds it to the metadata, sends it to the receiving terminal, and receives the metadata. In the terminal, the content and metadata can be synchronized by analyzing the feature amount of the content received from the content distribution server and comparing it with the feature amount added to the metadata. Can be associated.

(3. Content / Metadata Transmission / Reception System According to Embodiment 3)
(3.1. Configuration of Content / Metadata Transmission / Reception System)
The content / metadata transmission / reception system according to the third embodiment is different from the first and second embodiments in that a plurality of feature amounts are used in synchronization between content and metadata. It is more accurate to synchronize content by using multiple feature values for one metadata than to determine synchronization between content and metadata by one feature value for one metadata Because it becomes.

  The configuration of the content / metadata transmission / reception system according to the third embodiment is the same as that of the content / metadata transmission / reception system according to the second embodiment, and will be described with reference to FIG. Further, the procedure is different from step S208 in FIG. 6, and therefore step S208 will be particularly described.

  FIG. 7 is a diagram for explaining that the synchronization unit determines the synchronization of a plurality of base points in the content / metadata transmission / reception system according to the third embodiment.

  The second analysis unit 22 analyzes the feature quantity 61 with respect to the frame of the content distributed from the content distribution server 1. Here, the horizontal axis represents the number of frames, but a time axis may be used as an alternative. Here, the direction in which the number of frames increases is the passage of time.

  It is desirable that the first analysis unit 12 and the second analysis unit 22 include a storage unit (not shown) that stores at least temporarily information on feature amounts with respect to the number of frames. The storage unit can be constituted by a buffer, for example. Alternatively, it may be stored in an HDD (hard disk drive) (not shown).

  The received frame advances as the content is transmitted, and the feature amount of the analyzed content changes with respect to the advanced frame. Reference numeral 61 is a graph showing the feature quantity with respect to the number of frames.

  The second analysis unit 22 of the receiving terminal 20 compares the feature amounts analyzed with a predetermined threshold value, and employs the number of frames corresponding to the feature amount that is equal to or greater than the predetermined value as a base point. The adopted base point is referred to herein as a base point group (2). Here, the base points in the base point group (2) are P1 to P10 as shown in FIG. Reference numeral 62 indicates a base point group (2) set for the frame. The number of base points is 10 as an example of the number of base points in the section to be examined, and is not limited to a numerical value of 10.

  On the other hand, in the metadata generation unit 11, the first analysis unit 12 analyzes the feature quantity with respect to the number of frames of content distributed in the same manner as the second analysis unit 22, performs threshold processing, and performs the base point group (1). Q1 to Q5 are acquired. Reference numeral 63 indicates a base point group (1) at a certain time acquired by the first analysis unit 12. Here, the base point group (1) is composed of five base points, and is not limited to the number.

  The base point group (1) that is a set of base points is associated with, associated with, or added to the metadata, and is transmitted by the metadata generation unit 11. The synchronization unit 21 receives the metadata to which the transmitted base point group (1) is added or related.

  Since the base point group (1) received by the synchronization unit 21 is a plurality of base points arranged at a certain time interval, any part of the base point group (2) analyzed and set by the second analysis unit 22 Should match. The synchronization unit 21 determines synchronization between the base point group (1) and the base point group (2). The determination method will be described with reference to FIG. 7. First, Q1 and P1 are combined, and then it is determined whether or not P2, Q2-P5, and Q5 match each other, and the degree of matching at each point is calculated and summed up. To do. If the total degree of coincidence is equal to or greater than a predetermined threshold value or the highest, it is determined that the coincidence at that time corresponds to the base point groups.

(3.2 Procedure for synchronizing content and metadata)
FIG. 8 is a flowchart illustrating a procedure in which the synchronization unit determines the synchronization of content and metadata by comparing a plurality of base points by the first analysis unit and the second analysis unit. The flowchart of FIG. 8 explains the procedure for determining synchronization based on a plurality of base points extracted from the feature amount in step S208 shown in FIG.

  The synchronization unit 21 analyzes the feature amount by the second analysis unit 22 and distributes the base point Pi of the plurality of base point groups (2) extracted by comparing the analyzed feature amount with the threshold value and the metadata distribution server 10. In order to determine the coincidence of the base point Qi of the base point group (1) by the first analysis unit 12 that has been made, first, i = 1 is set (step S301). As a result, P1 and Q1 are first combined (step S302). Thereafter, it is determined whether P2 and Q2 to P5 and Q5 match. Let f be a function for calculating the degree of coincidence indicating whether or not they match. It is assumed that f takes a value of 1 if they match and 0 if they do not match. That is, f (Pi + k, Q1 + k) takes a value of 1 or 0.

  Thus, the degree of coincidence of each Pi point is obtained by the function f, and the total Ci is calculated. It is determined whether or not the total value Ci is 4.5 or more. The threshold value of 4.5 corresponds to a case where 90% of the five match, and is not particularly limited to this number (step S304). Here, N is the total number of base points in the section to be examined. Here, N = 10.

  If Ci is not 4.5 or more (No in step S304), it is determined whether i is larger than the above total number N-5 (step S306). If i is larger (Yes in step S305), from the beginning. Start over (step S301). In this case, an error may be used (not shown). If i is not larger than N−5 (No in step S305), i = i + 1 is set, and the process returns to step S302. Here, the case where Ci is not 4.5 or more is the case of 63-1 to 63-4 which do not match shown in FIG.

  On the other hand, if it is determined that Ci is 4.5 or more (Yes in step S304), it is determined that Pi determined by i at that time matches Q1, and that Pi + 2, Q2-Pi + 5, and Q5 match thereafter (step). S305). The base point group (1) thus added to the metadata matches the content base point (2) set in the synchronization unit 21 on the frame axis indicated by reference numeral 63-4.

  Here, instead of Ci ≧ 4.5, a method of obtaining i where Ci has the maximum value may be used.

  The metadata can be specified as an offset from the base point group (1). Further, when a plurality of base point groups are set, the metadata can be positioned with reference to the plurality of base point groups, and the metadata can be specified on the frame axis or the time axis. In this case, the metadata may be positioned as a negative offset and a positive offset from the front and rear base points. Thus, by specifying metadata with a negative offset and a positive offset, the synchronization unit 21 can specify the metadata retroactively. For this purpose, as described above, the second analysis unit 22 includes a buffer, and temporarily stores content received in the past for a certain period of time and base point information extracted from the content.

(3.3. Effect)
Synchronize content and metadata more accurately by extracting a plurality of base points that have feature points higher than a predetermined value or the maximum feature points in the content, and associate the content and metadata with each other be able to. In addition, by specifying metadata with a negative offset and a positive offset with respect to the base point, it is possible to identify the metadata retrospectively and associate it quickly with the content. Waste can be eliminated.

(4. Example)
(4.1. Example 1)
FIG. 9 is a diagram for explaining the first embodiment of the content / metadata transmission / reception system. The content / metadata transmission / reception system according to the first embodiment is a system that distributes metadata for professional baseball video to a home server. In the first embodiment, the video content 92 is directly distributed from the stadium 91 and received by the metadata generation system system 93.

  In the metadata generation system 93, a first analysis unit (not shown) analyzes content contents by the method according to the above-described embodiment, and extracts a base point for time adjustment. At the same time, a metadata generation unit (not shown) generates metadata about an event that has occurred on a professional baseball video. At this time, an offset value from the extracted time adjustment base point is described in the metadata 94 as time information. In the figure, <time> 18: 10-18: 11 + 900 </> is offset information from the base point. The created metadata 94 is distributed to the home server (96, 97) which is a receiving terminal through the Internet 95 or the like.

  The home server (96, 97) receives professional baseball video by satellite broadcasting via the broadcasting satellite 98. The home server (96, 97) uses the received professional baseball video and metadata to associate video and metadata on the home server (96, 97). Based on this association, reflecting the user's preference, for example, only “Matsui's batting scene” is stored in the home server (96, 97), or only the scoring scenes are collected and stored in the home server (96, 97). Video can be recorded and processed based on personal preferences.

  Here, the home server which is a receiving terminal can be constituted by a DVD (Digital Versatile Disc) recorder. By applying the association between content and metadata according to the embodiment, video based on personal preference can be selected and recorded on a DVD.

  In addition, the home server which is a receiving terminal here can be configured by an HDD (Hard Disc Drive) recorder. By applying the association between content and metadata according to the embodiment, a video based on personal preference can be selected and recorded on the HDD.

  Here, instead of the home server, the receiving terminal can be constituted by a mobile phone. By applying the association between content and metadata according to the embodiment, a video based on personal preference can be selected and viewed or recorded on a mobile phone.

(4.2. Example 2)
FIG. 10 is a diagram for explaining the association between content and metadata based on the silent part included in the moving image content in the content / metadata transmission / reception system according to the second embodiment. In the content / metadata transmission / reception system according to the second embodiment, a silent time point is used as the feature amount of the moving image content transmitted from the content distribution server to generate a time adjustment base point. The first analysis unit 12 of the metadata distribution server 10 that analyzes the feature amount of the moving image and the second analysis unit 22 of the receiving terminal 20 detect a silent portion included in the moving image content (101, 102).

  The first analysis unit 12 detects the silent part of the moving image content 101 within a certain range, and as a result, detects a plurality of silent part positions (101-1, 101-2, 101-3). Here, the frame corresponding to the silent part (101-1, 101-2, 101-3) is set as a base point. Note that which part of the plurality of silent part combinations is set as the actual time adjustment base point depends on the implementation. For example, in the second embodiment, the first silent frame received by the synchronization unit 21 of the receiving terminal 20 from the metadata generation unit 11 is set as a time adjustment base point.

  The 2nd analysis part 22 of the receiving terminal 20 extracts the silence area (102-1, 102-2, 102-3) on the moving image content 102 received from the content delivery server 1 as a feature-value. Then, the synchronization unit 21 combines the silence information (101-1, 101-2, 101-3) delivered from the metadata generation unit 11 of the metadata delivery server 10 and the extracted silence part (102-1). , 102-2, and 102-3), the same silent portion position is detected and synchronized.

  When the synchronization unit 21 determines the synchronization of the silent part position, the correspondence between the base point of the moving image frame and the base point describing the metadata is obtained, and the meta specified by the offset value from the base point by the associated silent part. Data time can be adjusted.

(4.3. Example 3)
FIG. 11 is a diagram for explaining the association between content and metadata when the receiving terminal starts receiving the transmitted content halfway in the content / metadata transmission / reception system according to the third embodiment. In the third embodiment, the receiving terminal 20 can perform time adjustment even when reception of the content transmitted from the content distribution server 1 is started halfway.

  The metadata generation unit 11 of the metadata distribution server 10 periodically generates and transmits base point information (111-1, 111-2, 111-3) for time adjustment. In the receiving terminal 20, when the reception of the content is started in the middle, the base point that has been transmitted and received and analyzed first is used as the time adjustment information (111-3).

  When the first base point (115-1) of the transmitted time adjustment is detected, the metadata transmitted earlier than the base point (115-1) of the time adjustment is used as a negative offset 116 of the immediately subsequent time adjustment. Since the time is specified, the metadata information before receiving the time adjustment base point can be specified, so that it is possible to avoid wasting the base point information received.

  For this purpose, the receiving terminal 20 includes a storage unit (not shown) that receives and at least temporarily stores the content to be transmitted, thereby associating the metadata specified by the minus offset with the content. it can.

  In this way, in the third embodiment, the metadata is associated with the content by the negative offset value traced back to the past from the base information received first, so that it is possible to avoid wasting the received metadata efficiently and efficiently. Content and metadata can be handled.

(5. Hardware configuration and recording medium)
FIG. 12 is a diagram illustrating a hardware configuration example of a content distribution server, a metadata distribution server, and a receiving terminal in the content / metadata transmission / reception system according to the embodiment. Each of the content distribution server, metadata distribution server, and receiving terminal described above can be realized by executing a program prepared in advance on a computer system such as a personal computer, a workstation, or a microcomputer. The computer 200 is entirely controlled by a CPU (Central Processing Unit) 201. The CPU 201 includes a ROM (Read Only Memory) 202, a RAM (Random Access Memory) 203, a hard disk drive (HDD: Hard Disk Drive) 204, a graphic processing device 205, an input interface 206, and a communication device 208 via a bus 207. It is connected. The ROM 202 and the RAM 203 store at least a part of an OS (Operating System) program and application programs to be executed by the CPU 201. The RAM 203 stores various data necessary for processing by the CPU 201. The HDD 204 stores an OS, various driver programs, application programs, detected data, and the like.

  A monitor 211 is connected to the graphic processing device 205. The graphic processing device 205 displays an image on the screen of the monitor 211 in accordance with a command from the CPU 201. A keyboard 212 and a mouse 213 are connected to the input interface 206. The input interface 206 transmits signals sent from the keyboard 212 and the mouse 213 to the CPU 201 via the bus 207.

  With the hardware configuration as described above, the processing functions of the present embodiment can be realized. In order to implement the present embodiment on the computer 200, a driver program is mounted on the computer 200.

  The content / metadata transmission / reception program executed by the content distribution server, the metadata distribution server, and the receiving terminal of the present embodiment is an installable format or executable format file, such as a CD-ROM, floppy (R). ) It is provided by being recorded on a computer-readable recording medium such as a disk or DVD.

  Further, the content / metadata transmission / reception program of the present embodiment may be provided and distributed by storing it on a computer connected to a network such as the Internet and downloading it via the network.

As described above, content metadata transmission and reception system according to the present invention, the content metadata synchronization method, a program for executing the method on a computer, receiving terminal as well, the video reception associating to receive content and metadata It is useful for technology, and particularly useful for video receiving terminals such as home servers, DVD recorders, and mobile phones that receive and associate content and metadata.

1 is a functional block diagram of a content / metadata transmission / reception system according to Embodiment 1. FIG. FIG. 6 is a diagram for explaining an association operation between content and metadata in the content / metadata transmission / reception system according to the first embodiment. It is a flowchart explaining the matching procedure of a content and metadata. 6 is a functional block diagram of a content / metadata transmission / reception system according to a second embodiment. FIG. It is a figure explaining the production | generation of the metadata by a metadata production | generation part. 10 is a flowchart illustrating a procedure for associating content and metadata according to the second embodiment. FIG. 10 is a diagram illustrating that a synchronization unit determines synchronization of a plurality of base points in a content / metadata transmission / reception system according to a third embodiment. It is a flowchart explaining the procedure in which a synchronization part determines the synchronization of a content and metadata by comparing the several base points by a 1st analysis part and a 2nd analysis part. It is a figure explaining Example 1 of a content metadata transmission / reception system. In the content / metadata transmission / reception system according to the second embodiment, the content and metadata are associated with each other based on the silent portion included in the moving image content. In the content / metadata transmission / reception system according to the third embodiment, it is a diagram for explaining the association between content and metadata when a receiving terminal starts receiving content to be transmitted halfway. It is a figure which shows the hardware structural example of the content delivery server in the content metadata transmission / reception system by embodiment, a metadata delivery server, and a receiving terminal.

DESCRIPTION OF SYMBOLS 1 Content delivery server 2, 95 Network 10 Metadata delivery server 11 Metadata production | generation part 12 1st analysis part 12
20 receiving terminal 21 synchronizing unit 22 second analyzing unit 96, 97 home server

Claims (21)

A content distribution server for distributing content including video and audio;
A metadata distribution server having metadata generation means for receiving the content distributed by the content distribution server and generating and distributing metadata related to the content;
A receiving terminal having synchronization means for receiving the content distributed by the content distribution server and the metadata distributed by the metadata distribution server and associating the content with the metadata;
The metadata distribution server further includes a first analysis unit that analyzes a feature amount representing a feature of the content to be received,
The metadata generation unit distributes the feature amount of the content analyzed by the first analysis unit in association with the metadata,
The receiving terminal further comprises second analysis means for analyzing a feature amount representing the feature of the content,
The synchronization unit receives the feature amount information by the first analysis unit distributed by the metadata generation unit, and the feature amount by the first analysis unit in the received information and the second analysis unit The content / metadata transmission / reception system , wherein the content and the metadata are associated with each other based on a feature amount . The metadata generation means adds the feature amount information analyzed by the first analysis means to the metadata and distributes it.
The synchronization unit receives the feature amount information added to the metadata transmitted by the metadata generation unit, and the feature amount information added to the received metadata and the second analysis unit content metadata transmission and reception system according to claim 1, characterized in that on the basis of the feature quantity is intended for associating the said and the content metadata. When the first analysis unit of the metadata distribution server compares the feature amount by the first analysis unit with a predetermined threshold value and determines that the feature amount is equal to or greater than the threshold value, Set the content part corresponding to the feature amount as the base point of the metadata,
The metadata generation means describes and transmits time information of the metadata by offset values before and after the metadata base point set by the first analysis means,
When the second analysis unit of the information terminal compares the feature amount by the second analysis unit with a predetermined threshold value and determines that the feature amount is equal to or greater than the threshold value, Set the content part corresponding to the amount as the base point of the content,
The synchronization means, based on the base point of the metadata by the first analysis means and the base point of the content by the second analysis means, receives the content and the metadata by the front and back offset values. 3. The content / metadata transmission / reception system according to claim 1 , wherein the content / metadata transmission / reception system is associated with each other. The first analysis means may include one or more feature values among color features, cut points at which scenes are switched, frame matching, silence intervals, audio power, audio spectrum, and image prints as the feature values to be analyzed. Calculating, distributing the metadata based on the calculated one or more feature values,
The second analysis means analyzes one or more feature values of a color feature, a cut point at which a scene changes, a frame matching, a silent section, an audio power, an audio spectrum, and a picture pattern as the feature values to be analyzed. Calculating a base point of the content according to the calculated one or more feature quantities;
The synchronization means, based on the base point of the metadata set by the first analysis means and the base point of the content set by the second analysis means, receives the content and the content by the front and back offset values. 4. The content / metadata transmission / reception system according to claim 3 , wherein the content / metadata transmission / reception system is associated with metadata. The first analysis means sets a plurality of base points of the metadata,
The second analysis means sets a plurality of base points of the content,
The synchronization unit is configured to associate the content with the metadata by the offset values before and after based on a plurality of base points of the set metadata and a plurality of base points of the content. The content / metadata transmission / reception system according to claim 3 or 4 . The first analysis unit sets a break point at which the scene of the content is switched as a feature amount as a base point of the metadata,
The content / metadata transmission / reception system according to claim 3 or 5 , wherein the second analysis unit sets a break point at which the scene of the content is switched as a feature amount as a base point of the content. The metadata generation means distributes the metadata time information as an offset retroactive to the base point immediately before the metadata and offset value information to the base point immediately after the metadata, and distributes the metadata.
The synchronization unit of the information terminal is configured to determine the content, the metadata, and the metadata based on a base point set by the second analysis unit and time information specified by the offset value information added to the metadata. content metadata transmission and reception system according to any one of claims 3 to 6, characterized in that associating. The first analysis means periodically sets a base point of the metadata at a predetermined time,
The second analysis unit periodically sets a base point of the content at a predetermined time,
The synchronization unit is configured to determine the content and the metadata based on a periodic base point of the metadata set by the first analysis unit and a periodic base point of the content set by the second analysis unit. The content / metadata transmission / reception system according to any one of claims 3 to 7 , wherein A content distribution process for distributing content including video and audio;
A metadata generation step of generating and distributing metadata related to the content distributed in the content distribution step;
Receiving the content distributed in the content distribution step and the metadata distributed in the metadata generation step, and associating the received content with the metadata,
A first analysis step of analyzing a feature amount representing the feature of the content to be received;
The metadata generation step distributes the feature amount of the content analyzed in the first analysis step in association with the metadata,
A second analysis step of analyzing a feature amount representing the feature of the content to be received;
The synchronization step receives the feature amount information of the content by the first analysis step associated with the metadata distributed in the metadata generation step, and the first analysis in the received information The content / metadata synchronization method , wherein the content and the metadata are associated with each other on the basis of the feature amount information by the step and the feature amount by the second analysis step . In the metadata generation step, the feature amount information analyzed in the first analysis step is added to the metadata and distributed.
The synchronization step receives the feature amount information from the first analysis step added to the metadata transmitted in the metadata generation step, and the feature amount information added to the received metadata The content / metadata synchronization method according to claim 9 , wherein the content and the metadata are associated with each other based on the feature amount analyzed in the second analysis step. In the first analysis step, when the feature amount obtained in the first analysis step is compared with a predetermined threshold value and it is determined that the feature amount is equal to or greater than the threshold value, the first analysis step corresponds to the feature amount. The content part is the base point of the metadata,
In the metadata generation step, the time information of the metadata is described and transmitted by offset values before and after the metadata base point set in the first analysis step,
The second analysis step corresponds to the feature amount when the feature amount in the second analysis step is compared with a predetermined threshold value and the feature amount is determined to be greater than or equal to the threshold value. Using the content part as the base point of the content,
In the synchronization step, the content and the metadata are obtained by the offset values before and after based on the base point of the metadata by the first analysis step to be received and the base point of the content by the second analysis step. content metadata synchronization method according to claim 9 or 1 0, characterized in that associating. In the first analysis step, as the feature quantity to be analyzed, one or more feature quantities of a color feature, a cut point at which a scene changes, a frame matching, a silent section, an audio power, an audio spectrum, and a picture pattern are included. Calculating, distributing the metadata based on the calculated one or more feature values,
In the second analysis step, as the feature quantity to be analyzed, one or more feature quantities of a color feature, a cut point at which a scene changes, a frame matching, a silent section, an audio power, an audio spectrum, and a picture pattern are included. Calculating a base point of the content according to the calculated one or more feature quantities;
In the synchronization step, based on the base point of the metadata set by the first analysis step to be received and the base point of the content set by the second analysis step, the content and the content by the offset value before and after content metadata synchronization method of claim 1 1, characterized in that associating the metadata. The first analysis step sets a plurality of base points of the metadata,
The second analysis step sets a plurality of base points of the content,
In the synchronization step, the content and the metadata are associated with each other by the front and back offset values based on the set base points of the metadata and the base points of the content. content metadata synchronization method of claim 1 1 or 1 2. In the first analysis step, a break point at which the scene of the content is switched is set as a feature amount as a base point of the metadata,
The second analysis step, content metadata synchronization method of claim 1 1 or 1 3, characterized in that for setting the base point of the content delimiter of the switching of the scene of the content as a feature quantity . In the metadata generation step, the time information of the metadata is added to the metadata and delivered as an offset retroactive to the past to the base point immediately before the metadata and offset value information to the base point immediately after the metadata,
The synchronization step associates the content with the metadata based on the base point set in the second analysis step and the time information specified by the offset value information added to the metadata. content metadata synchronization method according to any one of claims 1 1 to 1 4, characterized in that. The first analysis step periodically sets a base point of the metadata at a predetermined time,
The second analysis step periodically sets a base point of the content at a predetermined time,
The synchronization step is based on the periodic base point of the metadata set by the first analysis step and the periodic base point of the content set by the second analysis step. The content metadata synchronization method according to any one of claims 1 to 15 , wherein the content metadata synchronization method is characterized in that A program for causing a computer to execute the content metadata synchronization method according to any one of claims 9 to 16 . Synchronization having synchronization means for receiving content including video and audio distributed from the content distribution server and metadata generated based on the content by the metadata distribution server and associating the received content and the metadata Equipped with equipment,
When the feature amount representing the feature of the content is analyzed by the metadata distribution server, and the analyzed feature amount of the content is distributed in association with the metadata,
The synchronization device further includes an analysis unit that analyzes a feature amount of the content received from the content distribution server,
The synchronization means receives the feature amount of the content distributed in association with the metadata from the metadata distribution server, and the feature amount of the content associated with the metadata by the metadata distribution server; , receiving terminal, wherein the based on the feature value of the content that is analyzed by the analyzing means, <br/> be those for associating the said and the content metadata. The receiving terminal, receive terminal according to claim 18, characterized in that a DVD (Digital Versatile Disc) recorder. The receiving terminal, the receiving terminal according to claim 18 or 19, characterized in that a HDD (Hard Disc Drive) recorder. The receiving terminal, receive terminal according to any one of claims 18 to 2 0, which is a portable telephone.

Images