JP7198564B2 - Content production system, content production device and content production method - Google Patents

Description

The present invention relates to a content production system, a content production apparatus, and a content production method, and more particularly to a content production system, a content production apparatus, and a content production method for editing archived contents (materials) to produce broadcast materials.

Broadcasting stations archive content assets from which broadcast materials are edited, and it is common for a plurality of editors to preview these contents and edit broadcast materials to be broadcast.

In such an editing system, searching for scenes (predetermined content sections) that are likely to be reused conventionally requires previewing and confirming each content from beginning to end, which takes time. By registering text information and thumbnail images for each scene and searching based on them, the preview work can be made more efficient. The burden on the operator is also increased.

In view of this, video editing systems have been proposed that aim to increase the value of archived content assets by making it possible to select target scenes more efficiently (for example, Patent Document 1).

The invention disclosed in Patent Document 1 is an archive system that includes a video editing terminal and a database. Store in historical data. Then, based on the editing history data, a payout count display bar for each time period, which graphically displays the past payout count per unit time (color shading, etc.), is displayed on the preview operation screen. In addition, by sliding the slide bar, a desired scene is previewed, and a time zone to be paid out can be selected using the display bar for the number of payouts by time zone as a guide. Furthermore, a list of user information that has paid out in the past, including the relevant time period, is displayed together with the date of payout.

JP 2007-028314 A

By the way, the technique of Patent Document 1 uses the past number of payouts as a criterion for the editor to select a content scene.

However, due to the increase in the processing power of computers and the number of recording devices, etc., in recent years, it is becoming increasingly difficult to transfer original content, including parts other than scenes used for broadcast material, from a material server where the content is archived to an editing terminal. In many cases, the user downloads (pays out) the content, previews the downloaded content, and specifies the scene (content in the content section) to be used for the broadcast material. In such a case, the content itself of the paid-out section is often not necessarily used as broadcast material. Furthermore, there are cases where the content itself of the paid-out section is not used as broadcast material.

Considering such a recent situation, it is not appropriate for the editor to use the number of past payouts as a guideline for selecting content scenes.

Accordingly, it is an object of the present invention to provide a content production system, a content production apparatus, and a content production method in which the guideline for selecting content scenes by an editor matches the recent editing environment of a broadcasting station.

One aspect of the present invention is a content data storage unit storing content data shared as an editing source of broadcast materials, a database in which content sections of the content data, and the importance of the content of the content sections are associated. a broadcast material storage unit in which broadcast materials to be broadcast are registered with the content data as an editing source; a content section on the content data of the broadcast materials registered in the broadcast material storage unit; a history recording unit that records a registration history; an importance calculation unit that calculates the importance of content in a content section on the content data using the registration history; an importance update unit for updating the importance of a content section of content data; a preview display control unit for reproducing a preview of the content data on a terminal; and a content section of the preview being reproduced on the terminal. and an importance information display control unit that displays importance information that visually expresses importance on the timeline of the preview.

According to one aspect of the present invention, a content section of content data shared as an editing source of a broadcast material, a database in which the importance of the content of the content section is associated, and the content data being an editing source, are broadcast. a history recording unit for recording a content section on the content data of a broadcast material registered in a broadcast material storage unit in which the broadcast material is registered, and a registration history of the broadcast material; an importance calculation unit that calculates the importance of content in a content section on data; an importance update unit that updates the importance of the content section of content data in the database using the calculated importance; and the content data a preview display control unit that reproduces the preview on a terminal; and an importance level information display control unit for displaying.

According to one aspect of the present invention, a content data storage unit stores content data shared as an editing source of broadcast materials, and a broadcast material storage unit in which broadcast materials to be broadcast are registered using the content data as an editing source. , wherein a content section on the content data of the broadcast material registered in the broadcast material storage unit and a registration history of the broadcast material are recorded, and the registration history is used. and calculating the importance of the content of the content section on the content data, associating the calculated importance with the importance of the content section of the content data, reproducing the preview of the content data on the terminal, In the content production method, importance information that visually expresses importance associated with a preview content section being reproduced on a terminal is displayed on the preview timeline.

The present invention enables an editor to efficiently select scenes (contents of a predetermined content section) that can be used as broadcast materials from archived content.

FIG. 1 is a diagram for explaining an outline of an embodiment of the present invention. FIG. 2 is a diagram showing an example of the degree of importance of content displayed on the terminal 4. As shown in FIG. FIG. 3 is a diagram showing an example of the degree of importance of content displayed on the terminal 4. As shown in FIG. FIG. 4 is a block diagram of the material server 1. As shown in FIG. FIG. 5 shows an example of data stored in the material file storage unit 11. As shown in FIG. FIG. 6 is a block diagram of the material server 1 configured by a computer system. FIG. 7 is a block diagram of the broadcasting server 1. As shown in FIG. FIG. 8 shows an example of data stored in the broadcast material storage unit 21. As shown in FIG. FIG. 9 is a block diagram of the broadcasting server 2 configured by a computer system. FIG. 10 is a block diagram of the production management server 3. As shown in FIG. FIG. 11 is a diagram showing an example of the importance database 31. As shown in FIG. FIG. 12 is a diagram showing an example of the history database 32. As shown in FIG. FIG. 13 is a block diagram of the production management server 3 constructed by a computer system. FIG. 14 is a block diagram of the terminal 4. As shown in FIG. FIG. 15 is a block diagram of terminal 4 configured by a computer system. FIG. 16 is a block diagram of the production management server 3 in the second embodiment. FIG. 17 is a diagram showing an example of dividing the materials (contents) of the material files stored in the material file storage unit 11 of the material server 1 into a plurality of scenes (cuts). FIG. 18 is a diagram showing an example of the scene database. FIG. 19 is a diagram showing an example in which broadcast material 1 is divided into scene X, scene Y, and scene Z. In FIG. FIG. 20 is a diagram showing an example of dividing broadcast materials 1, 2 and 3 into a plurality of scenes. FIG. 21 is a diagram showing an example of the degree-of-association database 39. As shown in FIG. FIG. 22 is a diagram showing a display example of the terminal 4. As shown in FIG. FIG. 23 is a block diagram of the third embodiment.

An embodiment of the present invention will be described.

<First embodiment>
FIG. 1 is a diagram for explaining an outline of an embodiment of the present invention. 1 is a material server, 2 is a broadcasting server, 3 is a production management server, and 4 is a terminal.

The material server 1 is a server in which content data (material files) used as the source of editing of broadcast materials are archived. The content data is a resource shared by multiple users and can be viewed (previewed) by the terminal 4 . Content data includes video, audio, music, telops, and combinations thereof, including computer graphic images.

The broadcast server 2 is a server in which broadcast materials obtained by editing content data are registered. It should be noted here that even if broadcast material is registered, it is not necessarily broadcast. This is because there are replacement of materials due to the creation of better broadcast materials, postponement of broadcasting of programs that were scheduled to be broadcast due to emergencies, cancellation of broadcasting of programs due to various circumstances, and the like. Therefore, in the present embodiment, registration of broadcast material used for a broadcast program in the broadcast server 2 is distinguished from broadcasting of the broadcast material in which the broadcast material is transmitted from the broadcast server 2 for broadcasting.

The production management server 3 has an importance database 31 . The importance database 31 is a database in which content sections of content data of material files are associated with the importance of the content in the content sections. A content section is a temporal section of content that is temporally continuous. For example, a section every second, a section every cut, or the like. The importance database 31 associates the importance of content with each content section.

The importance of content is an index that indicates how often the content of the associated content section is used as broadcast material, broadcast, or referenced for editing. In particular, the number of times the content in the content section is used for editing as broadcast material and registered in the broadcast server 2 is an important index. Furthermore, the number of times the broadcast material was actually broadcast is also an important indicator. Furthermore, the number of times the content in the content section is referenced for editing broadcast material is also an important index.

In this embodiment, the content of a predetermined content section becomes a broadcast material, the number of times it is registered in the broadcasting server 2 is "X", the number of times the broadcast material is actually broadcast is "Y", and the content of the content section is Assuming that the number of times of reference for editing the broadcast material is "Z", the degree of importance P is calculated by the following formula.

P (importance) = a*X + b*Y + c*Z
Here, a, b, and c are weighting constants for each number of times. The magnitudes of the values of a, b, and c are usually a>b>c. The reason why the value of a is the largest is that even if the broadcast material that has been edited with the editing intention of the editor or the like (user) and registered in the broadcast server 2 is not broadcast due to subsequent circumstances, Since the cancellation of the broadcast is not directly related to the editor's (user's) editing intention, the number of times "X" registered in the broadcasting server 2 that best reflects the editor's (user's) editing intention is emphasized. It is for Next, the reason why the value of b is the second largest is that the content used for the broadcast material that was actually broadcast is important. The reason why the value of c is the smallest is that in the process of producing broadcast material, the contents of various content sections are always referred to, and even if they are referred to, the content of that content section is not broadcast material. This is because it is not always used in practice.

Note that it is not necessary to use all of the registration count "X", the broadcast count "Y", and the reference count "Z" for the calculation of P (importance) described above. At least, only the number of times "X" registered in the broadcasting server 2 that best reflects the editing intention may be used. That is, constants b and c may be set to zero. Furthermore, among the number of registrations "X", the number of broadcasts "Y", and the number of references "Z", only the number of registrations "X" and the number of references "Y" may be used. That is, the constant c may be set to zero. In this case, the number of references does not affect the calculation of importance.

The production management server 3 acquires the registration history and broadcast history of broadcast materials from the broadcast server 2 and the reference history from the terminal 4 in order to calculate the above-described P (importance). Then, P (importance) is calculated from the acquired registration history, broadcast history, and reference history. Then, using the calculated P (importance), the importance of the corresponding content section is updated.

A terminal 4 is a terminal used by a user (for example, an editor). The terminal 4 has a function of previewing content data stored in the material server 1 in order to search for content to be used as broadcast material from the content data stored in the material server 1 . For example, when the content is video, this preview function displays a preview video as shown in FIG. 2 on the display unit. A timeline (time axis) of the content data is displayed below the preview video, and a slide bar is displayed on this timeline. Then, by dragging and sliding the slide bar, it is possible to preview content (video) in an arbitrary content section. The left end of the slide bar corresponds to the start position of the video, and the right end corresponds to the end position.

The terminal 4 acquires the importance of content to be previewed from the production management server 3 . Then, the degree of importance is graphically displayed at the position on the timeline corresponding to the content section, using color shades corresponding to the degree of importance, the height of the rectangle, and the like. For example, as shown in FIG. 2, when a first threshold and a second threshold (first threshold > second threshold) are set and the importance of each content section on the timeline is greater than the first threshold is displayed in red, when the degree of importance is less than the first threshold and greater than the second threshold, it is displayed in yellow, and when it is less than the second threshold, it is displayed in green. Further, as shown in FIG. 3, for example, a first threshold and a second threshold (first threshold>second threshold) are set, and for each content section, similar to the above example, three levels of Display a height bar graph (rectangle) on the timeline. Of course, the numerical importance may be displayed.

By displaying in this way, the user can know which content section of the content data is important as a broadcast material. In particular, in the present embodiment, by placing the greatest importance on the number of times registered in the broadcasting server 2, the degree of importance that best reflects the editor's intention is reflected in the content section.

Next, details of each device will be described.

First, the material server 1 will be explained. FIG. 4 is a block diagram of the material server 1. As shown in FIG.

The material server 1 is a server in which the content data used as the editing source of the broadcast material is archived. and a source file management unit 12 that reads the source file and transmits it to the terminal 4 in response to the request.

As shown in FIG. 5, the material file storage unit 11 stores, for each material file, identification information (material file ID) for identifying the material file, content data (including time code) which is the actual data of the material, and content data. Metadata (data indicating the contents of the material) are stored in association with each other.

The material file management unit 12 transmits the content data (and metadata if necessary) associated with the material file ID requested from the terminal 4 to the terminal 4 via the production management server 3 .

Specifically, the material server 1 described above can be realized by a computer system having a processor that performs various kinds of arithmetic processing. FIG. 6 is a block diagram of the material server 1 configured by a computer system.

As shown in FIG. 6, the material server 1 includes a processor 101, memory (ROM or RAM) 102, storage device (hard disk, semiconductor disk, etc.) 103, input device (keyboard, mouse, touch panel, etc.) 104, display device 105, communication It can be composed of a computer 100 having a device 106 and a material file database 107 .

The material server 1 implements material file management processing by loading a program stored in the storage device 103 into the memory 102 and executing it by the processor 101 . Here, the material file database 107 corresponds to the material file storage section 11 and the material file management process corresponds to the material file management section 12 .

Incidentally, the computer 100 may have the material file database 107 . Alternatively, it may be provided physically outside the computer 100 and connected to the computer 100 via a network such as a LAN.

The broadcasting server 2 will be explained. FIG. 7 is a block diagram of the broadcasting server 1. As shown in FIG.

The broadcast server 2 includes a broadcast material storage unit 21 in which broadcast materials obtained by editing content data are registered, and a broadcast material management unit 22 that manages broadcasting (transmitting) of the broadcast materials.

As shown in FIG. 8, the broadcast material storage unit 21 stores broadcast material identification information (broadcast material ID) for identifying broadcast materials, content data of the broadcast materials, metadata of the broadcast materials, registration histories of the broadcast materials, and It is stored in association with the broadcast history.

Here, the metadata of the broadcast material includes the identification information (material file ID) of the material file that was the source of editing of the broadcast material, and the content section (for example, time code) used as the broadcast material among the contents of the material file. ) and at least.

The registration history of the broadcast material includes the registration date and time of the broadcast material in the broadcast server 2 (the date and time when the broadcast material was stored in the broadcast material storage unit 21), user identification information (user ID) for identifying the user who registered the broadcast material, and the like.

The broadcast history of the broadcast material includes the date and time when the broadcast material was broadcast (transmitted), the name of the program in which the broadcast material was used, and the like.

The broadcast material management unit 22 registers the broadcast material in the broadcast material storage unit 21 and updates the registration history in response to the broadcast material registration request from the terminal 4 . Also, when the broadcast material is broadcast, the broadcast history of the broadcast material is updated.

Further, when a broadcast material is registered or broadcast, the broadcast material management unit 22 obtains the registration history or broadcast history of the registered or broadcast broadcast material, the material file ID of the editing source from the metadata of the broadcast material, and the broadcast material file ID. The content section (for example, time code) used as material is transmitted to the production management server 3 . Note that the material file ID and content section (for example, time code) may be included in the registration history or broadcast history.

Specifically, the above-described broadcasting server 2 can be realized by a computer system having a processor that performs various kinds of arithmetic processing. FIG. 9 is a block diagram of the broadcasting server 2 configured by a computer system.

As shown in FIG. 9, the broadcasting server 2 includes a processor 111, memory (ROM or RAM) 112, storage device (hard disk, semiconductor disk, etc.) 113, input device (keyboard, mouse, touch panel, etc.) 114, display device 115, communication The device 116 can be constituted by a computer 110 having a broadcast material database 117 .

The program stored in the storage device 113 is loaded into the memory 112 of the broadcast server 2 and executed by the processor 111, thereby realizing broadcast material management processing. Here, the broadcast material database 117 corresponds to the broadcast material storage section 21, and the broadcast material management process corresponds to the broadcast material management section 22. FIG.

Incidentally, the computer 110 may have the broadcast material database 117 . Alternatively, it may be provided physically outside the computer 110 and connected to the computer 110 via a network such as a LAN.

The production management server 3 will be explained. FIG. 10 is a block diagram of the production management server 3. As shown in FIG.

The production management server 3 includes an importance database 31 , a history database 32 , a history acquisition unit 33 , an importance calculation unit 34 , an importance update unit 35 and a content reference processing unit 36 .

As shown in FIG. 11, the importance database 31 stores a content section (section indicated by a time code) and its content for each material file (material file ID) stored in the material file storage unit 11 of the material server 1. It is a database in which the importance of sections is associated and stored. FIG. 11 shows an example in which, for the material (content) identified by the material file ID "100", the intervals of the content section are set to 1-second intervals, and the 1-second intervals of the time code are associated with the importance of the section. ing.

As shown in FIG. 12, the history database 32 stores, for each material file (material file ID) stored in the material file storage unit 11 of the material server 1, a content section of the content of the material file, an acquired registration history, A database in which broadcast histories and reference histories are associated and stored. The acquired registration history, broadcast history, and reference history are accumulated. FIG. 12 shows that for the material (content) identified by the material file ID "100", the interval of the content section is 1 second, and the 1-second interval of the time code and the registration history, broadcast history, and reference history of the section are shown. It shows an associated example. It should be noted that the reference history includes the content section in which the user previewed (referred to) the content of the material file on the terminal 4, the previewed (referred to) date and time, and the identification information of the previewed (referred to) user.

The history acquisition unit 33 acquires the registration history or broadcast history from the broadcast server 2 and the material file ID and content section corresponding to the registration history or broadcast history, acquires the reference history from the terminal 4, and adds it to the history database 32. .

The importance calculator 34 calculates the importance of the material (content) file corresponding to the history at the timing of acquiring the registration history, broadcast history, or reference history. First, the importance calculation unit 34 acquires from the history database 32 the registration history, broadcast history, or reference history accumulated in the content section for each content section.

Based on the acquired registration history, broadcast history, or reference history, the importance calculation unit 34 calculates “X” the number of times the broadcast material was registered in the broadcast server 2, “Y” the number of times the broadcast material was actually broadcast, and the content section. Calculate 'Z', the number of times the content has been referenced for editing broadcast material. In principle, one reply is counted as one history. At this time, old histories for which a certain period of time has passed may not be counted. For example, if the date and time of the history is older than three years, the history is not counted. Furthermore, the number of times may be weighted according to the date and time of the history. For example, if the date and time of the history is within one year, 1 time, if the date and time of the history is within 1 to 2 years, 0.7 times, and if the date and time of the history is 2 years or more, 0.5 times. You can calculate. Furthermore, the number of times may be weighted according to the user ID included in the history. For example, since the user identified by the user ID "AAA" is a veteran, the number of times is calculated higher than that of other users. You can calculate.

Next, the importance calculation unit 34 calculates the importance P of the content section by the following formula using the calculated number of times "X", "Y" and "Z".

P (importance) = a*X + b*Y + c*Z
Here, a, b, and c are weighting constants for each number of times, and are set in advance. The values of a, b, and c are usually a>b>c for the reason described above.

The importance calculation unit 34 is a timing for calculating the importance of the material (content) file, but as described above, it is not limited to the timing at which the registration history, broadcast history, or reference history is acquired. , the importance may be calculated for each predetermined period.

The importance update unit 35 updates the importance of the content section in the importance database 31 to the importance of the content section calculated by the importance calculation unit 34 .

In response to a material (content) preview request from the terminal 4, the content reference processing unit 36 reads the content data of the material (content) from the material server 1, and associates it with the material file ID of the read content data. The importance of each content section is read from the importance database 31, and the content data and the importance of each content section are transmitted to the terminal 4. FIG.

Specifically, the production management server 3 described above can be realized by a computer system having a processor that performs various kinds of arithmetic processing. FIG. 13 is a block diagram of the production management server 3 constructed by a computer system.

As shown in FIG. 13, the production management server 3 includes a processor 121, memory (ROM or RAM) 122, storage device (hard disk, semiconductor disk, etc.) 123, input device (keyboard, mouse, touch panel, etc.) 124, display device 125, It can be composed of a computer 120 having a communication device 126 , an importance database 127 and a history database 128 .

In the production management server 3, a program stored in the storage device 123 is loaded into the memory 122 and executed by the processor 121, thereby realizing history acquisition processing, importance calculation processing, importance update processing, and content reference processing. It is a thing. Here, the history acquisition process corresponds to the history acquisition unit 33, the importance calculation process corresponds to the importance calculation unit 34, the importance update process corresponds to the importance update unit 35, and the content reference process corresponds to the content reference process. Corresponds to section 36 . Also, the importance database 127 corresponds to the importance database 31 and the history database 128 corresponds to the history database 32 .

Note that the importance database 31 or the history database 32 may be provided in the computer 110 . Alternatively, it may be provided physically outside the computer 110 and connected to the computer 110 via a network such as a LAN. Furthermore, the importance database 31 and the history database 32 may be configured partially or wholly as one.

Terminal 4 will be described. FIG. 14 is a block diagram of the terminal 4. As shown in FIG.

The terminal 4 includes a display unit 41, an input/output unit 42 as a user interface, a preview display processing unit 43, a slide bar display processing unit 44, an importance display unit 45, a reference history acquisition unit 46, and an editing unit. 47.

The preview display processing unit 43 acquires the content data of the designated material file from the material server 1 via the production management server 3, and previews the content of the content data. When the content data is video, a preview video as shown in FIG. A timeline (time axis) of the content data is displayed below the preview video, and a slide bar is displayed on this timeline. Then, by dragging and sliding the slide bar, it is possible to preview content (video) in an arbitrary content section. The left end of the slide bar corresponds to the start position of the video, and the right end corresponds to the end position.

The slide bar display processing unit 44 displays a slide bar on the timeline below the preview screen. By dragging this slide bar and sliding it on the timeline, the content at the corresponding time can be reproduced.

The importance display unit 45 acquires the importance of each content section of the content to be previewed from the production management server 3 . Then, the degree of importance is graphically displayed at the position on the timeline corresponding to the content section, using color shades corresponding to the degree of importance, the height of the rectangle, and the like. For example, a first threshold and a second threshold (first threshold>second threshold) are set for the importance of the received content section, and the importance is set to the first threshold for each content section on the timeline. If it is larger, it is displayed in red, if the importance is less than the first threshold and is greater than the second threshold, it is displayed in yellow, and if it is less than the second threshold, it is displayed in green. Further, as shown in FIG. 3, for example, a first threshold and a second threshold (first threshold>second threshold) are set, and for each content section, similar to the above example, three levels of Display a height bar graph (rectangle) on the timeline. Of course, the numerical importance may be displayed.

The reference history acquisition unit 46 acquires the reference history (referenced material file ID, referenced content section) of the content section previewed (referenced) by the user by sliding the slide bar on the timeline. Then, the acquired reference history including the user identification information (user ID) of the user who used the terminal 4 is transmitted to the production management server 3 .

When the content section to be used as the broadcast material is determined by operating the slide bar, the editing unit 47 identifies the content section to be used as the broadcast material by, for example, clicking the mouse, and edits the content of the content section as the broadcast material. . Note that the content section is specified by the time code attached to the content data. Then, the broadcast material is registered in the broadcast server 2. - 特許庁At this time, the broadcast material to be registered includes metadata, and the metadata includes the material file ID of the editing source and the content section (for example, time code) used as the broadcast material.

Specifically, the terminal 4 described above can be realized by a computer system having a processor that performs various kinds of arithmetic processing. FIG. 15 is a block diagram of terminal 4 configured by a computer system.

As shown in FIG. 15, the terminal 4 includes a processor 131, memory (ROM or RAM) 132, storage device (hard disk, semiconductor disk, etc.) 133, input device (keyboard, mouse, touch panel, etc.) 134, display device 135, communication device. 136 can be configured by a computer 130 .

In the terminal 4, a program stored in the storage device 133 is loaded into the memory 132 and executed by the processor 131 to perform preview display processing, slide bar display processing, importance display processing, reference history acquisition processing, and edit processing. It is realized. Here, the preview display processing corresponds to the preview display processing unit 43, the slide bar display processing corresponds to the slide bar display processing unit 44, the importance display processing corresponds to the importance display unit 45, and the reference history acquisition process corresponds to It corresponds to the reference history acquisition unit 46 and the editing process corresponds to the editing unit 47 . Also, the display device 135 corresponds to the display unit 41 and the input/output unit 42 corresponds to the input device 134 .

Next, the operation of this embodiment will be described.

The broadcast material management unit 22 of the broadcast server 2 registers the broadcast material in the broadcast material storage unit 21 in response to the broadcast material registration request from the terminal 4, and updates the registration history. Also, when the broadcast material is broadcast, the broadcast history of the broadcast material is updated. The broadcast material management unit 22 then transmits the registration history or broadcast history, and the material file ID and content section corresponding to the registration history or broadcast history to the production management server 3 .

When the history acquisition unit 33 of the production management server 3 acquires the registration history or broadcast history, and the material file ID and content section corresponding to the registration history or broadcast history from the broadcasting server 2, the corresponding material file ID of the history database 32 is obtained. Add the registration history or broadcast history to the content section of . Similarly, when the history acquisition unit 33 acquires the reference history (including the referenced content material file ID, the referenced content section, and the user ID of the referenced user) from the terminal 4, the history acquisition unit 33 obtains the corresponding material file ID of the history database 32. Add a reference history to the content section.

The importance calculation unit 34 of the production management server 3 calculates the importance of the material (content) file corresponding to the history at the timing of acquiring the registration history, broadcast history, or reference history. First, the importance calculation unit 34 acquires from the history database 32 the registration history, broadcast history, or reference history accumulated in the content section for each content section. Then, the importance of each content section of the content specified by the material file ID is calculated by the above-described importance calculation method.

The importance update unit 35 of the production management server 3 updates the importance of the content section in the importance database 31 to the importance of the content section calculated by the importance calculation unit 34 .

On the other hand, when there is a request for viewing a material file from the terminal 4, the content reference processing unit 36 of the production management server 3 reads the content data of the material file specified by the designated material file ID from the material server 1, Send to terminal 4. Furthermore, the content reference processing unit 36 transmits the importance of each content section associated with the designated material file ID to the terminal 4 .

Terminal 4 receives content data and importance. The preview display processing unit 43 previews the content of the acquired content data on the display unit 41 . In addition, the importance display unit 45 graphically displays the importance at a position on the timeline corresponding to the content section, using color gradation, rectangle height, etc., according to the importance of the section.

The user (editor) can reproduce the content at the corresponding time by dragging the slide bar and sliding it on the timeline using the slide bar display processing unit 44 . At this time, the reference history acquisition unit 46 acquires the reference history (referenced material file ID, referenced content section) of the content section previewed (referenced) by the user by sliding the slide bar on the timeline. Then, the acquired reference history including the user identification information (user ID) of the user who used the terminal 4 is transmitted to the production management server 3 .

When a content section to be used as a broadcast material is determined by a user (editor) operating a slide bar, clicking a mouse, or the like, the editing unit 47 determines the content of that section as a broadcast material. Then, the broadcast material (including the content data, the material file ID of the editing source, and the content section (for example, time code) used as the broadcast material) is registered in the broadcast server 2 .

The above operations are repeated.

According to the present embodiment, archived materials (contents) are used to edit broadcast materials, and a series of histories is acquired until the broadcast materials are registered in a broadcasting device for broadcasting or broadcast. , the importance of the material (content) is calculated based on the history. As a result, it is possible to analyze the collective intelligence of multiple users (editors) and automatically present which content section of the material (content) is important, and the user (editor)'s editing Work efficiency can be improved.

In particular, in the present embodiment, since the importance is calculated with emphasis on the registration of the broadcast material in the broadcasting device and whether the broadcast material was actually broadcasted, a production system suitable for the current editing environment is provided. can do.

<Second Embodiment>
A second embodiment will be described.

When editing broadcast materials, it is likely that a plurality of predetermined scenes (cuts) are extracted from one or more materials (contents) and combined to edit one broadcast material. Editing has a certain pattern to some extent. For example, first there is a long cut that makes it easy to understand the situation, and then there is a close-up cut.

Therefore, in the second embodiment, the value is calculated using the probability that a combination of certain scenes (cuts) appears on the broadcast material as the degree of relevance. Then, an example of presenting (recommending) a scene (cut) having a high degree of relevance to the scene (cut) when a specific scene (cut) is selected will be described.

FIG. 16 is a block diagram of the production management server 3 in the second embodiment.

The production management server 3 according to the second embodiment includes a scene division unit 37, a relevance degree calculation unit 38, and a relevance degree database 39 in addition to the first embodiment.

Before describing each part, the division of material (content) into scenes (cuts) will be described.

One material (content) is often composed of multiple scenes (cuts). For example, one material (content) is composed of an indoor scene and an outdoor scene. Each of these scenes (cuts) has a characteristic quantity (for example, brightness, color, angle of view, etc.) peculiar to the scene (cut). Therefore, one material (content) is divided into a plurality of scenes (cuts) by using the feature amount. This scene (cut) division can be done automatically using conventional techniques. Note that division here does not mean physically dividing one content into a plurality of pieces of content, but means finding a break between scenes.

FIG. 17 is a diagram showing an example of dividing the material (content) of the material file stored in the material file storage unit 11 of the material server 1 into a plurality of scenes (cuts). In the example of FIG. 17, the material (content) with material file ID 100 is divided into scene A, scene B, and scene C, and the material (content) with material file ID 101 is divided into scene D, scene E, and scene F. The material (content) with ID 102 is divided into scene G, scene H, and scene I.

The material file storage unit 11 stores, for each material (content) divided into scenes as described above, a scene file in which a scene and a time code of this scene section are associated so that the section of each divided scene can be identified. Equipped with a database. FIG. 18 shows an example of the material (content) of the material file ID 100, where scene A has a time code of 00:00:00-00:05:00 and scene B has a time code of 00:05:00-00:10. :12 and scene C are stored in association with the time code 00:10:13-00:20:00.

In this way, the material file storage unit 11 of the material server 1 stores materials (contents) of material files composed of a plurality of scenes.

Next, the scene dividing section 37 of the production management server 3 will be described.

The scene dividing unit 37 acquires broadcast materials registered in the broadcast material server 2 . Then, the broadcast material is divided into a plurality of scenes in the same manner as the material (content) of the material file is divided into a plurality of scenes. FIG. 19 shows an example in which the scene division unit 37 divides the broadcast material 1 into scene X, scene Y, and scene Z. As shown in FIG.

Furthermore, the scene division unit 37 searches which scene of the materials (contents) of the material files stored in the material file storage unit 11 corresponds to each scene of the divided broadcast material. As described above, the broadcast material has metadata such as the edited material and the time code, and this metadata can be used for searching. However, the time code of each scene of the divided broadcast material does not necessarily match the time code of each scene of the source material (content) to be edited. Therefore, for specifying a scene, the scene of the editing source material (content) containing the median value of the time code indicating the section of the scene specified by the broadcast material is used as the scene to be specified. For example, if scene X of broadcast material 1 in the example of FIG. A scene having 02:00 is retrieved from the scene database of the material file storage unit 11 . In this case, the scene of the material file ID 100 corresponding to scene X is scene A. Similarly, scene Y and scene Z are specified, and each scene of broadcast material 1 is made up of scene A with material file ID 100, scene C with material file ID 100, and scene I with material file ID 102. Identify.

The degree-of-relevance calculation unit 38 calculates, as the degree of relevance of each scene of the broadcast material identified by the scene division unit 37, the probability of scenes appearing in combination in the scene.

For example, assume that there are broadcast material 1, broadcast material 2, and broadcast material 3 as shown in FIG. It is assumed that the scene dividing unit 37 specifies that the broadcast material 1 is composed of the scene A with the material file ID100, the scene C with the material file ID100, and the scene I with the material file ID102. It is also assumed that the scene dividing unit 37 specifies that the broadcast material 2 is composed of scene A with a material file ID of 100, scene E with a material file ID of 101, and scene C with a material file ID of 100. . It is also assumed that the scene dividing unit 37 specifies that the broadcast material 3 is composed of scene A with a material file ID of 100, scene C with a material file ID of 100, and scene D with a material file ID of 101. .

Here, the score of the degree of relevance between a certain scene and another scene is calculated based on the distance between the one scene and the other scene. for example,
If the distance is 1 scene (adjacent) = 10
If the distance is 2 scenes = 5
If the distance is 3 scenes or more = 1
and

Applying the above scores to determine the score of the degree of relevance between scenes of each broadcast material yields the following.

(Broadcast material 1)
・Distance between scene A (material file ID 100) and scene C (material file ID 100) = 1
Relevance S1 (AC) = 10
・Distance between scene A (source file ID 100) and scene I (source file ID 102) = 2
Degree of relevance S1 (AI) = 5
・Distance between scene C (source file ID 100) and scene I (source file ID 102) = 1
Relevance S1 (CI) = 10

(Broadcast material 2)
・Distance between scene A (material file ID 100) and scene E (material file ID 101) = 1
Relevance S2 (AE) = 10
・Distance between scene A (material file ID 100) and scene C (material file ID 100) = 2
Degree of relevance S2 (AC) = 5
・Distance between scene E (source file ID 101) and scene C (source file ID 100) = 1
Relevance S2(CE)=10

(Broadcast material 3)
・Distance between scene A (material file ID 100) and scene C (material file ID 100) = 1
Relevance S3 (AC) = 10
・Distance between scene A (material file ID 100) and scene D (material file ID 101) = 2
Degree of relevance S3 (AD) = 5
・Distance between scene C (material file ID 100) and scene D (material file ID 101) = 1
Relevance S3 (CD) = 10

Next, let the total value of the relevance S between the scenes of each broadcast material mentioned above be the relevance TS.
・Relevance TS (AC)
= relevance S1 (A-C) + relevance S2 (A-C) + relevance S3 (A-C)
= 10 + 5 + 10
= 25
・Relevance TS (AD)
= degree of relevance S3 (AD)
= 5
・Relevance TS (AE)
= Degree of relevance S2 (AE)
= 10
・Relevance TS (AI)
= Degree of relevance S1 (AI)
= 5
・Relevance TS (CI)
= Degree of relevance S1 (CI)
= 10
・Relevance TS (CD)
= Degree of relevance S3 (CD)
= 10
・Relevance TS (CE)
= degree of relevance S2 (CE)
= 10
Other degrees of association TS are zero.

From the above calculation results, scene C has the highest degree of association with scene A (scenes with high probability of appearing together with scene A), followed by scene E, followed by scene D and scene I. It can be seen that they are approximately the same.

The degree-of-relevance calculation unit 38 accumulates the total value of degrees of relevance between scenes calculated in this way in the degree-of-relevance database 39 .

FIG. 21 is a diagram showing an example of the degree-of-association database 39. As shown in FIG. FIG. 21 shows an example in which the scenes A, B, and C of the source file ID 100 are associated with the degrees of relevance TS between the scenes and other scenes. For example, in relation to each scene of the contents of the material file shown in FIG. (AC), the degree of relevance TS (AD) between scene A and scene D, the degree of relevance TS (AE) between scene A and scene E, . . . , and are associated with.

The content reference processing unit 36 responds to a material (content) preview request from the terminal 4 , reads the content data of the material (content) from the material server 1 , and transmits the content data to the terminal 4 . Furthermore, the scene of the content currently displayed on the terminal 4 is specified by operating the slide bar performed on the terminal 4 . Then, a scene highly related to the scene displayed on the terminal 4 is specified from the relatedness database 39 .

For example, as shown in FIG. 22, assuming that scene A with source file ID 100 is displayed on the main screen, among the degrees of relevance of scene A with source file ID 100, the top two degrees of relevance TS (A− C), select the degree of relevance TS (AE). Then, scene C with material file ID 100 and scene E with material file ID 101 are read from the material file storage section 11, and scene C and scene E are displayed beside the main screen. Incidentally, the scenes to be presented are not limited to the top two, and may be one or three or more.

According to the second embodiment, not only is it possible to know which content section of the material (content) is important, but also scenes that are often used together with the scene are presented to the editor. be able to. This makes it possible to improve the efficiency of the editing work of the user (editor).

Although the above-described second embodiment has been described as an example in which it is combined with the first embodiment, it is also possible to implement only the second embodiment (presentation of scenes with a high degree of relevance).

<Third Embodiment>
A third embodiment will be described.

FIG. 23 is a block diagram of the third embodiment.

A BGM (background music) file (BGM file) used for broadcast material is acquired from a BGM server. The edited broadcast material is then registered in the delivery server. The registered broadcast material is associated with program information stored in a program information server that manages information on broadcast programs. The program information of the program information server is associated with the manuscript (program script, etc.) of the manuscript server.

When the broadcast material is registered in the broadcast server, the intermediate processing server extracts the BGM identification information (BGM name and file name) and the identification information of the video material used for the broadcast material from the metadata of the broadcast material. to get Then, the intermediate processing server acquires the text data from the metadata of the material associated with the identification information of the video material from the video material server.

Also, the intermediate processing server acquires text from the program information associated with the broadcast material from the program information server. Similarly, the intermediate processing server acquires the text data of the manuscript associated with the program information from the manuscript server.

The intermediate processing server extracts, from the acquired metadata of the material, the program information and the text data of the manuscript, the text that becomes the keyword of the BGM (background music) used in the broadcast material. This keyword extraction can be performed by text mining using conventional morphological analysis or the like.

The intermediate processing server registers the extracted keyword as a tag in the BGM file corresponding to the BGM identification information.

This allows the user (editor) to search the BGM file using the keyword tagged to the BGM file as a search keyword.

Also, when editing video for a new item, the similarity between various text data (manuscripts, program names, item names, etc.) related to the item and the text data tagged to each BGM file is calculated. , and a function of automatically recommending BGM files in descending order of similarity. Furthermore, machine learning is performed using the text data tagged in the BGM file as teacher data, and when performing video editing work on a new item, various text data related to the item (manuscript, program name, item name, etc.) ) into the machine learning unit, the BGM file can be automatically recommended.

In the third embodiment, since tags suitable for actual operation are added to BGM files, keyword searches become efficient, and BGM selection work can be performed in a short period of time. In addition, since tags are automatically added in daily editing work, the amount of work involved in tagging is small. Furthermore, by acquiring the BGM usage log, it is possible to know the BGM usage history without actually listening to the BGM used in the broadcasted program material.

Although the present invention has been described above with reference to preferred embodiments, it is not necessary to include all the configurations of the embodiments, and not only can they be combined as appropriate, but the present invention is not necessarily limited to the above embodiments. However, it can be modified and implemented in various ways within the scope of its technical ideas.

1 material server 2 broadcasting server 3 production management server 4 terminal

Claims (12)

a content data storage unit storing content data shared as an editing source of broadcast materials;
a database in which the content section of the content data and the importance of the content of the content section are associated;
a broadcast material storage unit in which broadcast materials to be broadcast are registered using the content data as an editing source;
a history recording unit for recording a content section on the content data of the broadcast material registered in the broadcast material storage unit and a registration history of the broadcast material;
an importance calculation unit that calculates the importance of content in a content section on the content data using the registration history;
an importance updating unit that updates the importance of the content section of the content data in the database using the calculated importance;
a preview display control unit that reproduces a preview of the content data on a terminal;
an importance information display control unit for displaying, on the preview timeline, importance information that visually expresses the importance associated with the preview content section being reproduced on the terminal;
content production system. 2. The content production system according to claim 1, wherein said importance update unit calculates said importance so as to increase as the number of registrations obtained from current and past registration histories increases. The history recording unit records a content section on the content data of the broadcast material and a broadcast history of the broadcast material,
3. The content production system according to claim 1, wherein said importance update unit calculates said importance so as to increase as the number of broadcasts obtained from current and past broadcast histories increases. The history recording unit records the reference history displayed as the preview from the content data storage unit,
4. The content production system according to any one of claims 1 to 3, wherein said importance update unit calculates said importance so as to increase as the number of references obtained from current and past reference histories increases. 5. The content production system according to claim 4, wherein the importance update unit calculates the importance so that priority is given in order of the number of times of registration, the number of times of broadcasting, and the number of times of reference. 6. The content production system according to any one of claims 1 to 5, wherein the importance update unit calculates the importance so that the number of times of registration, the number of times of broadcasting, or the number of times of reference with a new history is emphasized. The history recording unit records user identification information identifying a user who created the broadcast material in the broadcast material storage unit,
7. The content production system according to any one of claims 1 to 6, wherein said importance updating unit refers to the importance of a user identified by said user identification information and calculates said importance. The importance information display control unit displays a color reflecting the importance of the content section and a rectangle reflecting the importance of the content section in a portion corresponding to the content section on the timeline of the preview. The content production system according to any one of claims 1 to 7. The content data in the content data storage unit is divided into at least one or more scenes,
A scene division unit that divides the broadcast material registered in the broadcast material storage unit into a plurality of scenes and estimates whether the divided scenes correspond to any scene of the content data stored in the content data storage unit. When,
a relevance calculation unit that calculates the relevance between scenes of the broadcast material;
a relevance database that stores the calculated relevance between scenes in association with each scene of the content data;
A content processing unit for reading from the content data storage unit and displaying, on the terminal, scenes of content data corresponding to a predetermined number of higher degrees of relevance among the degrees of relevance associated with scenes of the content being previewed on the terminal. 9. The content production system according to any one of claims 1 to 8, comprising: a database in which content sections of content data shared as an editing source of broadcast materials and the importance of the content of the content sections are associated;
A history recording unit for recording a content section on the content data of the broadcast material registered in a broadcast material storage unit in which the broadcast material to be broadcast is registered, and a registration history of the broadcast material. When,
an importance calculation unit that calculates the importance of content in a content section on the content data using the registration history;
an importance updating unit that updates the importance of the content section of the content data in the database using the calculated importance;
a preview display control unit that reproduces a preview of the content data on a terminal;
an importance information display control unit for displaying, on the preview timeline, importance information that visually expresses the importance associated with the preview content section being reproduced on the terminal;
content production device. Content data shared as an editing source of the broadcast material is divided into at least one or more scenes,
a scene division unit that divides the broadcast material registered in the broadcast material storage unit into a plurality of scenes and estimates whether the divided scenes correspond to any scene of the content data ;
a relevance calculation unit that calculates the relevance between scenes of the broadcast material;
a relevance database that stores the calculated relevance between scenes in association with each scene of the content data;
11. The content processing unit according to claim 10, further comprising a content processing unit configured to display, on the terminal, scenes of content data corresponding to a predetermined number of higher degrees of relevance among degrees of relevance associated with scenes of the content being previewed on the terminal. content production equipment. Contents of a system having a content data storage section storing content data shared as an editing source of broadcast materials, and a broadcast material storage section in which broadcast materials to be broadcasted using the content data as an editing source are registered. A display method,
recording a content section on the content data of the broadcast material registered in the broadcast material storage unit and a registration history of the broadcast material;
using the registration history to calculate the importance of content in the content section on the content data;
Associating the calculated importance with the importance of the content section of the content data,
playing a preview of the content data on a terminal;
A content production method for displaying, on the timeline of the preview, importance information that visually expresses the importance associated with the content section of the preview being reproduced on the terminal.

Images