JP2004193708A - Video digest generating method, video database generating method, video digest generating apparatus, and video database generating apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a video digest generating apparatus capable of generating a digest in response to each program and improving the utility value of the digest by a user. <P>SOLUTION: The video digest generating apparatus is provided with: a video recording means 11 for recording a video image of a program received from a broadcast station 2 on a storage medium 14; a network connection means 15 for acquiring a digest generating program for generating a digest of a video image of a program from a network 3; a program performance means 12 for performing the acquired digest generating program; and a reproducing means 13 for reproducing the video image of the recorded program on a video display apparatus 4 according to the digest generating program performed by the program performance means. Since the digest generating program is generated by each program, the digest generating program can generate the digest in response to contents of each program. <P>COPYRIGHT: (C)2004,JPO&NCIPI

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a digest generation method and apparatus for generating a digest of a distributed program, and a database generation method and apparatus for generating a database of videos generated by shooting a distributed program or a subject.
[0002]
[Prior art]
In recent years, by recording moving images such as television programs and movies with a digital versatile disc (DVD) recorder or a recording / reproducing device having a built-in hard disk device (HDD), it is possible to view programs without being restricted by broadcast time. It became.
[0003]
Also, taking advantage of the random access characteristic of DVD and HDD devices, access to recorded programs is faster than access to video tapes.
[0004]
Further, as the capacity of the storage medium increases, a long-time program or a large number of programs can be recorded on one storage medium.
[0005]
However, when a long-time program is recorded, it is necessary to spend a long time viewing the recorded program.
[0006]
Therefore, when the time for the user to view cannot be secured sufficiently, it becomes difficult to view all the recorded programs.
[0007]
Therefore, a digest is generated by a method of detecting a scene change at the time of recording and generating a digest based on a representative video (see Patent Document 1) or a method of generating a digest using numerical data at the time of broadcasting (see Patent Document 2). It is possible to check the program contents.
[0008]
Further, if a large number of programs are stored (recorded) by taking advantage of the large capacity, it takes time to check the stored programs and search for a target program or a target scene.
[0009]
Thus, a method has been developed in which a feature amount is extracted at the time of recording and a moving image database is constructed to search for a target program or scene (see Patent Document 3). This makes it possible to detect a target program or scene.
[0010]
[Patent Document 1]
Japanese Patent Application Laid-Open No. 9-284698 (0013)
[Patent Document 2]
JP 2001-119649 A (0032)
[Patent Document 3]
JP-A-11-338876 (0010)
[0011]
[Problems to be solved by the invention]
However, in the digest generated from the representative video, in a program with a low story (for example, a sports program), a program that can grasp the flow of the program to some extent may be generated, but a program with a high story (for example, movie) And drama), it is very difficult to grasp the story (see Patent Document 1). Therefore, such a digest is not necessarily highly useful for the user.
[0012]
Also, when creating a digest using numerical data at the time of broadcasting, it is necessary for the broadcasting station to prepare the numerical data before broadcasting, and to generate a digest that suits individual tastes, There is a limit to the digest generation method using the method (see Patent Document 2). This is because the standard of the numerical data is the standard of the broadcasting station, and is not weighted according to the personal preference. Therefore, the digest created in this manner is not necessarily highly useful for the user.
[0013]
It is also conceivable that the digest program itself is created and then distributed over a network. This allows each individual to select / download a digest having a configuration that suits his / her taste and view it.
[0014]
However, since broadcasted programs and videos have copyrights, there is a problem in freely creating and distributing digests using moving images. There is also a problem that the distribution of the digest program itself imposes a load on the network.
[0015]
In a system that generates a moving image database in real time at the time of recording, for example, a database is constructed by extracting feature amounts of video. However, a wide variety of programs are broadcast, and it is difficult to correspond to all of them. (See Patent Document 3). That is, it is difficult for a user to stably generate a database having high utility value.
[0016]
Further, in order to ensure real-time performance and improve the accuracy of detecting the feature amount, it is necessary to execute a large amount of calculations at high speed, which increases the hardware cost.
[0017]
Accordingly, the present invention provides a video digest generation method capable of generating a digest corresponding to each program and improving the digest utility value of the user, while avoiding the copyright problem and reducing the load on the network. And an image digest generating apparatus.
[0018]
In addition, the present invention generates a database according to each program, stably provides a database having a high utility value for the user, and can efficiently detect scenes and ensure real-time performance. It is an object to provide a database generation method and a video database generation device.
[0019]
In addition, the present invention generates a database corresponding to each video captured and generated, stably provides a database having high utility value to the user, and ensures efficient scene detection and real-time performance. It is an object of the present invention to provide a video database generation method and a video database generation device that can be achieved.
[0020]
[Means for Solving the Problems]
2. The video digest generation method according to claim 1, wherein the video digest of the received program is recorded and a video digest generation method for generating a digest is provided. The receiving step of receiving the video of the program and storing the video of the received program. A recording step of recording on a medium, a program obtaining step of obtaining a digest generation program for generating a digest of the video of the program via a network, and executing the obtained digest generation program to generate a digest of the video of the recorded program Program execution step.
[0021]
8. The video digest generation device according to claim 7, wherein the video digest generation device records a video of a received program and generates a digest, wherein the receiving unit receives the video of the program, and stores the video of the received program. Recording means for recording on a medium, network connection means for obtaining a digest generation program for generating a digest of a video of a program from a network, program execution means for executing the obtained digest generation program, and digest executed by the program execution means Playback means for playing back the video of the program recorded by the recording means in accordance with the generation program.
[0022]
According to the configuration of claim 1 or claim 7, a digest according to the content of each program can be generated by acquiring a digest generation program created for each program from the network.
As a result, the digest utilization value of the user can be improved.
[0023]
In addition, since the digest itself is not obtained from the network, the problem of copyright can be avoided.
[0024]
Further, since the digest generation program is acquired from the network instead of the digest itself, the load on the network can be reduced.
[0025]
In the video digest generation method according to claim 2, the recording step further includes a step of recording time information of a video of the program received in the receiving step on a storage medium, and the program executing step uses the recorded time information. To generate a digest.
[0026]
In the video digest generating apparatus according to the eighth aspect, the recording means records the time information of the video of the program on the storage medium, and the program executing means generates the digest using the recorded time information.
[0027]
According to the configuration of claim 2 or claim 8, by generating a digest using time information, it is possible to reduce the amount of calculation, and to reduce power consumption and real-time processing time. Can be generated.
[0028]
Further, by using the time information, the size of the digest generation program itself can be suppressed, and the network load at the time of obtaining the digest generation program can be further suppressed.
[0029]
In the video digest generating method according to the third aspect, in the program obtaining step, a digest generating program selected from a plurality of different digest generating programs for one program is obtained.
[0030]
The video digest generation apparatus according to claim 9, further comprising: a program selection unit that selects one or a plurality of digest generation programs from a plurality of different digest generation programs for one program, wherein the network connection unit includes a program selection unit. The digest generation program selected by the means is acquired from the network.
[0031]
According to the configuration of claim 3 or claim 9, by selecting a digest generation program that suits the user's preference from among a plurality of digest generation programs, a digest with higher utility can be generated.
[0032]
In the video digest generation method according to a fourth aspect, the digest generation program includes digest explanation information for explaining the program.
[0033]
In the video digest generation device according to the tenth aspect, the digest generation program includes digest explanation information for explaining the program.
[0034]
According to the configuration of claim 4 or claim 10, by embedding the digest explanation information in the digest, it is easier to grasp the contents of the recorded program, and it is possible to generate a digest having a higher utility value for the user.
[0035]
6. The video database generating method according to claim 5, wherein the video of the received program is recorded and the video database is generated by generating a video database. A recording step of recording on a storage medium, a video analysis information acquiring step of acquiring, via a network, video analysis information which is information of a predetermined element included in the video of the program, and a program recorded with the acquired video analysis information. And a database generating step of generating a video database from the video.
[0036]
The video database generating apparatus according to claim 11, wherein the video database generating apparatus records a video of a received program and generates a video database, wherein the receiving means receives the video of the program, and the video database generates the video of the received program. Recording means for recording on a storage medium; network connection means for acquiring, via a network, video analysis information which is information of a predetermined element included in the video of the program; and And a database generating means for generating a video database from
[0037]
According to the fifth or eleventh aspect of the present invention, a database corresponding to each program can be generated by acquiring video analysis information created for each program to be recorded via a network.
As a result, it is possible to stably provide a database having a high use value for the user.
[0038]
In addition, by acquiring video analysis information created for each program to be recorded via a network, the efficiency of scene detection can be increased, and video can be stored in a database while ensuring real-time performance. it can.
[0039]
7. The video database generating method according to claim 6, wherein the video database generating method generates a video database, wherein: a photographing step of photographing a subject to generate a video; and a recording step of recording the generated video on a storage medium. Obtaining a video analysis information, which is information of a predetermined element included in the video, via a network; obtaining a video analysis information; and generating a video database from the obtained video analysis information and the recorded video. Step.
[0040]
13. The video database generation device according to claim 12, wherein the video database generation device generates a video database, and includes a photographing unit that photographs a subject to generate a video, and a recording unit that records the generated video on a storage medium. , Video analysis information that is information of a predetermined element included in the video, network connection means to obtain via a network, from the obtained video analysis information and the generated video, database generation means to generate a video database, Is provided.
[0041]
According to the configuration of claim 6 or claim 12, by acquiring video analysis information created for each video to be recorded via a network, a database corresponding to each video can be generated.
As a result, it is possible to stably provide a database having a high use value for the user.
[0042]
Also, by acquiring video analysis information created for each video to be recorded via a network, it is possible to increase the efficiency of scene detection and to create a database of videos while ensuring real-time performance. it can.
[0043]
BEST MODE FOR CARRYING OUT THE INVENTION
In Embodiments 1 and 2, an example in which a video of a program is broadcast will be described. However, application of the present invention is not limited to broadcasting, and may be performed by another communication method such as multicast communication or unicast communication. It goes without saying that the present invention can be applied to the video of a distributed program.
[0044]
(Embodiment 1)
FIG. 1 is a block diagram of the video digest generation device according to the first embodiment of the present invention.
[0045]
As shown in FIG. 1, the video digest generating apparatus 1 includes a broadcast receiving unit 10, a recording unit 11, a program executing unit 12, a reproducing unit 13, a storage medium 14, a network connecting unit 15, and a program selecting unit 16. Have.
[0046]
Now, the broadcast receiving means 10 receives the video of the program broadcasted by the broadcast station 2. Then, the recording unit 11 records the video of the program received by the broadcast receiving unit 10 on the storage medium 14.
[0047]
Here, the storage medium 14 stores information by an electronic method or a magnetic method, such as a recording medium such as a DVD or a CD (compact disc), a storage device such as an HDD device, or a storage element such as a memory. Things to do are included.
[0048]
The broadcasting station 2 includes, in addition to a terrestrial broadcasting station, video distribution sources such as a broadcasting satellite, a communication satellite, a cable television base station, and a server on a network (for example, the Internet).
[0049]
On the other hand, the program selection means 16 selects a desired digest generation program from a plurality of digest generation programs existing on the network 3.
[0050]
Then, the network connection unit 15 downloads the digest generation program selected by the program selection unit 16 from the network 3.
[0051]
Here, the digest generation program is a program that generates a digest of a video of a program.
[0052]
This digest generation program is created for each broadcasted program, and creates a digest corresponding to each program.
The network 3 is, for example, the Internet.
[0053]
Now, the program execution unit 12 executes the digest generation program downloaded by the network connection unit 15.
[0054]
Then, the reproducing unit 13 generates a digest according to the digest generating program executed by the program executing unit 12 and transmits the digest to the video display device 4.
Then, the video display device 4 displays the digest transmitted by the reproducing unit 13.
[0055]
By the way, programs to be broadcast range from drama to sports broadcasting. However, the digest generation program obtained from the network 3 is a program specialized for a recorded program. In other words, the digest generation program is a program that is created for each recorded program and creates a digest having contents corresponding to each program.
[0056]
Therefore, by executing the digest generation program, a digest suitable for the recorded program can be generated. This is because the digest generation program is provided after the broadcast of the program, so that the digest generation program can be developed according to the program contents.
[0057]
Further, by disclosing the format of the digest generation program, the development of the digest generation program can be performed by other than the broadcasting station.
[0058]
Therefore, it is also possible to develop a plurality of digest generation programs for one program from various viewpoints.
[0059]
Furthermore, since the development and distribution of the digest generation program do not distribute the video itself provided by the broadcasting station, copyright infringement can be avoided.
[0060]
Further, the recording means 11 can record a broadcast program and also record time information.
[0061]
Therefore, when extracting a scene, the digest generation program can easily search for and extract a specific scene by calculating, for example, a relative time from the start time of the program.
[0062]
This makes it possible to reduce complicated operations for scene detection, for example, operations for pattern matching and image feature extraction for image recognition, thereby reducing power consumption and processing time. A digest can be generated in real time. Further, by using the time information, the size of the digest generation program itself can be suppressed, and the network load at the time of downloading the program can be suppressed.
[0063]
Furthermore, the digest generation program can include digest explanation information for explaining the program for which the digest generation program creates the digest.
[0064]
By executing a digest generation program containing such digest explanation information and inserting a program explanation by the program provider at the time of digest generation, interpolation of omitted stories between scenes and explanation of the scene being reproduced can be done. This makes it possible to assist the user who views the digest to understand it. Also, by incorporating the commentary provided by the program provider, the characteristics of the digest to be generated can be obtained, and the user can select the commentary that suits his / her taste.
[0065]
Here, the digest explanation information can be composed of, for example, video, audio, text, graphics, or a combination thereof.
[0066]
(Embodiment 2)
FIG. 2 is a block diagram of a video database generation device according to the second embodiment of the present invention. In FIG. 2, the same parts as those in FIG. 1 are denoted by the same reference numerals, and the description will be appropriately omitted.
[0067]
As shown in FIG. 2, the video database generation device 5 includes a broadcast receiving unit 10, a recording unit 11, a storage medium 14, a network connection unit 15, and a database generation unit 51.
[0068]
Now, the broadcast receiving means 10 receives the video of the program broadcasted by the broadcast station 2. Then, the recording unit 11 records the video of the program received by the broadcast receiving unit 10 on the storage medium 14.
[0069]
On the other hand, the network connection unit 15 downloads video analysis information used for creating a database from the network 3.
[0070]
Then, the network connection unit 15 records the downloaded video analysis information in the storage medium 14.
[0071]
Here, the video analysis information is information of a predetermined element included in the video of the program for which the database is created.
[0072]
The database generation unit 51 reads out the video analysis information from the storage medium 14, analyzes the video of the program received by the broadcast transmission / reception unit 10 based on the read video analysis information, and generates a database.
[0073]
By the way, programs to be broadcast range from dramas to sports broadcasts. However, the video analysis information is information specialized for the program to be recorded. That is, the video analysis information is created for each program and is information corresponding to each program.
[0074]
Therefore, by using the video analysis information, a database suitable for a program to be recorded can be created.
[0075]
Here, the database conversion means that the video of the program is converted into digital data (for example, MPEG-2 or MPEG-4) by the recording means 11 and, at the same time, the tag information indicating the scene information is converted by the database generation means 51. This indicates that the data is recorded on the storage medium 14 together with the digital data.
[0076]
The database format may be a standardized format (for example, MPEG-7) or a format specific to the device.
[0077]
In addition, the information for video analysis, for example, when recording a baseball broadcast, uniform information for each team, information about the stadium where the game is to be performed, the number and defensive position of the participating players, included in the video, such as face and body shape Information of the predetermined element to be executed.
[0078]
The video analysis information is, for example, information necessary for analyzing a scene such as a performer's face, body shape, and voice quality in order to record a drama.
[0079]
Furthermore, when the broadcast time for each scene is known in advance, the scene information can be simplified by using the time information as the video analysis information.
[0080]
Note that the video analysis information may include the program itself for generating the database. That is, the program for generating the database may be downloaded from the network 3.
[0081]
By using video analysis information specialized for a program as described above, the efficiency of scene detection can be increased, and a broadcasted program can be stored in a database while real-time performance is ensured.
[0082]
(Embodiment 3)
FIG. 3 is a block diagram of a video database generation device according to the third embodiment of the present invention. In FIG. 3, the same parts as those in FIG. 1 are denoted by the same reference numerals, and the description will be appropriately omitted.
[0083]
As shown in FIG. 3, the video database generating device 6 includes a photographing unit 60, a recording unit 11, a database generating unit 51, a storage medium 14, and a network connection unit 15.
[0084]
Now, the photographing means 60 photographs a subject and generates an image. Then, the recording unit 11 records the video generated by the imaging unit 60 on the storage medium 14.
[0085]
On the other hand, the network connection unit 15 downloads video analysis information used for creating a database from the network 3.
[0086]
Then, the network connection unit 15 records the downloaded video analysis information in the storage medium 14.
[0087]
Here, the video analysis information is information of a predetermined element included in the video for which the database is created.
[0088]
The database generation unit 51 reads out the video analysis information from the storage medium 14, analyzes the video generated by the imaging unit 60 based on the read video analysis information, and generates a database.
[0089]
Now, images generated by photographing various subjects are various. However, the video analysis information is information specialized for a video generated by shooting (a subject to be shot). That is, the video analysis information is created for each video to be captured (subject to be photographed) and is information corresponding to each video (subject).
[0090]
Therefore, by using the video analysis information, it is possible to create a database suitable for the video to be recorded.
[0091]
Here, the creation of the database means that the video generated by photographing the subject is converted into digital data (for example, MPEG-2 or MPEG-4) by the recording unit 11 and, at the same time, the database is generated by the database generation unit 51. This indicates that tag information indicating information is recorded on the storage medium 14 together with digital data.
[0092]
The database format may be a standardized format (for example, MPEG-7) or a format specific to the device.
[0093]
Also, the information for video analysis, for example, when shooting baseball at the stadium, uniform information for each team, information about the stadium where the game will be played, the number and defensive position of the participating players, such as images such as face and body shape This is information necessary for recognizing information of a predetermined element included therein and a characteristic movement of a player, for example, a pitching action of a pitcher, a batting action of a batter, and the like.
[0094]
Further, the image analysis information is information necessary for analyzing a subject being photographed, such as a characteristic building, scenery, or a shaped object, when photographing for sightseeing.
[0095]
Note that the video analysis information may include the program itself for generating the database. That is, the program for generating the database may be downloaded from the network 3.
[0096]
Further, the network connection unit 15 may acquire the video analysis information by connecting and communicating with, for example, a video analysis information terminal installed at the shooting site, instead of connecting to the network 3.
[0097]
When connecting and communicating with the information terminal for video analysis, the information for video analysis is acquired from the network, if they are considered as a network.
[0098]
Here, for example, information necessary for detecting a sightseeing object in a video can be stored as video analysis information in a video analysis information terminal installed in a sightseeing spot.
[0099]
By using the video analysis information specialized for the video generated by shooting the subject as described above, the efficiency of scene detection can be increased, and the generated video is stored in a database while real-time performance is ensured. can do.
[0100]
【The invention's effect】
According to the first or seventh aspect of the present invention, a digest corresponding to the content of each program can be generated by acquiring a digest generation program created for each program from a network.
As a result, the digest utilization value of the user can be improved.
[0101]
In addition, since the digest itself is not obtained from the network, the problem of copyright can be avoided.
[0102]
Further, since the digest generation program is acquired from the network instead of the digest itself, the load on the network can be reduced.
[0103]
According to the second or eighth aspect of the present invention, the digest is generated using the time information, so that the amount of calculation can be reduced, the power consumption can be reduced, and the processing time can be reduced in real time. Can be generated.
[0104]
Further, by using the time information, the size of the digest generation program itself can be suppressed, and the network load at the time of obtaining the digest generation program can be further suppressed.
[0105]
According to the third or ninth aspect of the present invention, a digest having a higher utility value can be generated by selecting a digest generation program suitable for the user's preference from a plurality of digest generation programs.
[0106]
According to the fourth or tenth aspect of the present invention, by embedding the digest explanation information in the digest, it is easier to grasp the contents of the recorded program, and it is possible to generate a digest having a higher utility value for the user.
[0107]
According to the fifth or eleventh aspect of the present invention, a database corresponding to each program can be generated by acquiring, via a network, video analysis information created for each program to be recorded.
As a result, it is possible to stably provide a database having a high use value for the user.
[0108]
In addition, by acquiring video analysis information created for each program to be recorded via a network, the efficiency of scene detection can be increased, and video can be stored in a database while ensuring real-time performance. it can.
[0109]
According to the sixth or twelfth aspect of the present invention, a database corresponding to each video can be generated by acquiring, via a network, video analysis information created for each video to be recorded.
As a result, it is possible to stably provide a database having a high use value for the user.
[0110]
Also, by acquiring video analysis information created for each video to be recorded via a network, it is possible to increase the efficiency of scene detection and to create a database of videos while ensuring real-time performance. it can.
[Brief description of the drawings]
FIG. 1 is a block diagram of a video digest generation device according to a first embodiment of the present invention.
FIG. 2 is a block diagram of a video database generation device according to a second embodiment of the present invention.
FIG. 3 is a block diagram of a video database generation device according to a third embodiment of the present invention.
[Explanation of symbols]
1 Video digest generator
2 broadcasting stations
3 network
4 Video display device
5, 6 Image database generator
10 Broadcast receiving means
11 Recording means
12 Program execution means
13 Reproduction means
14 Storage media
15 Network connection means
16 Program selection means
51 Database generation means
60 shooting means

Claims (12)

A video digest generation method for recording a video of a received program and generating a digest,
A receiving step of receiving an image of the program,
A recording step of recording the received video of the program on a storage medium,
A program acquisition step of acquiring a digest generation program for generating a digest of the video of the program via a network,
A program executing step of executing the acquired digest generation program to generate the digest of the video of the recorded program. The recording step further includes a step of recording time information of the video of the program received by the receiving step on the storage medium,
2. The video digest generation method according to claim 1, wherein in the program execution step, the digest is generated using the recorded time information. The video digest generation method according to claim 1, wherein in the program obtaining step, the digest generation program selected from a plurality of different digest generation programs for one program is obtained. 4. The video digest generation method according to claim 1, wherein the digest generation program includes digest explanation information for explaining the program. A video database generation method for recording a video of a received program and generating a video database,
A receiving step of receiving an image of the program,
A recording step of recording the received video of the program on a storage medium,
Video analysis information, which is information of a predetermined element included in the video of the program, video analysis information obtaining step of obtaining via a network,
A database generating step of generating the video database from the obtained video analysis information and the recorded video of the program. A video database generation method for generating a video database,
A shooting step of shooting a subject to generate a video,
A recording step of recording the generated video on a storage medium,
Video analysis information, which is information of a predetermined element included in the video, a video analysis information obtaining step of obtaining via a network,
A database generating step of generating the video database from the obtained video analysis information and the recorded video. A video digest generation device that records a video of a received program and generates a digest,
Receiving means for receiving the video of the program,
Recording means for recording the video of the received program on a storage medium,
Network connection means for obtaining a digest generation program for generating a digest of the video of the program from a network;
Program execution means for executing the acquired digest generation program,
A video digest generating device, comprising: reproducing means for reproducing the video of the program recorded by the recording means in accordance with the digest generating program executed by the program executing means. The recording means records time information of the video of the program in the storage medium,
The video digest generating apparatus according to claim 7, wherein the program executing means generates the digest using the recorded time information. Program selection means for selecting one or more digest generation programs from a plurality of different digest generation programs for one program,
9. The video digest generation apparatus according to claim 7, wherein the network connection unit acquires the digest generation program selected by the program selection unit from the network. 10. The video digest generation apparatus according to claim 7, wherein the digest generation program includes digest explanation information for explaining the program. A video database generation device that records a video of a received program and generates a video database,
Receiving means for receiving the video of the program,
Recording means for recording the video of the received program on a storage medium,
Network connection means for acquiring, via a network, video analysis information that is information of a predetermined element included in the video of the program,
A video database generating device for generating the video database from the obtained video analysis information and the video of the recorded program. A video database generation device that generates a video database,
Photographing means for photographing a subject to generate a video,
Recording means for recording the generated video on a storage medium,
Network connection means for acquiring, via a network, video analysis information that is information of a predetermined element included in the video,
A video database generating unit configured to generate the video database from the obtained video analysis information and the generated video.

Images