CN101131850B - Program providing method and program providing apparatus - Google Patents
Program providing method and program providing apparatus Download PDFInfo
- Publication number
- CN101131850B CN101131850B CN2007101422123A CN200710142212A CN101131850B CN 101131850 B CN101131850 B CN 101131850B CN 2007101422123 A CN2007101422123 A CN 2007101422123A CN 200710142212 A CN200710142212 A CN 200710142212A CN 101131850 B CN101131850 B CN 101131850B
- Authority
- CN
- China
- Prior art keywords
- captions
- program
- key word
- abstract fragments
- index
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Classifications
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
- G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
- G11B27/102—Programmed access in sequence to addressed parts of tracks of operating record carriers
- G11B27/105—Programmed access in sequence to addressed parts of tracks of operating record carriers of operating discs
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
- G11B27/02—Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
- G11B27/031—Electronic editing of digitised analogue information signals, e.g. audio or video signals
- G11B27/034—Electronic editing of digitised analogue information signals, e.g. audio or video signals on discs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/765—Interface circuits between an apparatus for recording and another apparatus
- H04N5/775—Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television receiver
- H04N5/7755—Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television receiver the recorder being connected to, or coupled with, the antenna of the television receiver
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/79—Processing of colour television signals in connection with recording
- H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
- H04N9/82—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only
- H04N9/8205—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only involving the multiplexing of an additional signal and the colour video signal
- H04N9/8233—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only involving the multiplexing of an additional signal and the colour video signal the additional signal being a character code signal
Abstract
A program providing method recording a program by video data and audio data in a recording medium and providing the program to a user, including the steps of detecting digest sections representing the contents of the program by video data by analyzing pictures of the video data, detecting keywords whose appearance frequency is high from captions of the program, creating indexes of the program by detecting parts where appearance frequency of the keywords detected in the step of detecting keywords is high from captions of the digest sections, and displaying the indexes.
Description
Technical field
The present invention relates to that program provides method, is used for program and provides the program of method, record is used for program provides the recording medium and the program of the program of method that equipment is provided, they for example can be applied to recording/playback device, this recording/playback device program that replaying user is wanted from the program of huge storage capacity recording medium recording.In the embodiments of the invention, detect the abstract fragments (digest section) of expression programme content by analysis image, and the captions that comprise following key word in the abstract fragments partly are set as index (index), this key word has the high frequency of occurrences that detects in whole captions, thereby accurately and accurately grasps program summary.
Background technology
In the prior art, broadcast the program that provides such as the recording/playback device record television of hdd recorder, and when watching this program more later on, use.Along with the increase of recording capacity in recent years, this recording/playback apparatus can write down many programs.Therefore, in recent years, proposed to improve the method that the user selects the convenience of program by in recording/playback device, creating the thumbnail be used to introduce programme content.
Consider above-mentionedly, propose a kind of among the JP-A-11-184867 by using program lines (speech) that closed caption (closedcaption) provides method according to the index playback program.
In such recording/playback device, just do not grasp program summary if do not watch a details of the program that writes down and store, for example, can in numerous news of record and storage, optionally watch interested news, so, the availability that can expect this class recording/playback device can be further improved.
Yet introducing the problem that program exists by thumbnail in the prior art is to be difficult to accurately and accurately obtain program summary.
Summary of the invention
The program that wish to propose accurately and accurately to grasp program summary provides method, be used for this program provides the program of method, write down this is used for program and provides the recording medium and the program of the program of method that equipment is provided.
According to embodiments of the invention, provide program that method is provided, this method is utilized video data and voice data recorded program and program offered the user in recording medium, may further comprise the steps: utilize video data to represent the abstract fragments of programme content by the image detection of analysis video data; From the captions of program, detect the high key word of the frequency of occurrences; Create program indexing by detecting as the lower part from the captions of abstract fragments, key word detects the frequency of occurrences height of the detected key word of step in the described part; And demonstration index.
In addition, according to embodiments of the invention, provide and be used for the program that program provides method, this method is utilized video data and voice data recorded program and program offered the user in recording medium, may further comprise the steps: utilize video data to represent the abstract fragments of programme content by the image detection of analysis video data; From the captions of program, detect the high key word of the frequency of occurrences; Create program indexing by detecting as the lower part from the captions of abstract fragments, key word detects the frequency of occurrences height of the detected key word of step in the described part; And demonstration index.
In addition, according to embodiments of the invention, provide record to be used for the recording medium that program provides the program of method, this method is utilized video data and voice data recorded program and program offered the user in recording medium, and this program provides method may further comprise the steps: utilize video data to represent the abstract fragments of programme content by the image detection of analysis video data; From the captions of program, detect the high key word of the frequency of occurrences; Create program indexing by detecting as the lower part from the captions of abstract fragments, key word detects the frequency of occurrences height of the detected key word of step in the described part; And demonstration index.
In addition, according to embodiments of the invention, provide program that equipment is provided, this equipment utilization video data and voice data recorded program and program offered the user in recording medium, and comprise with lower member: the abstract fragments detecting unit, its image detection by the analysis video data utilizes video data to represent the abstract fragments of programme content; Keyword detection unit, it detects the high key word of the frequency of occurrences from the captions of program; The index creation unit, it creates program indexing by detecting as the lower part from the captions of abstract fragments, and key word detects the frequency of occurrences height of the detected key word of step in the described part; And the index display unit, it shows index.
Configuration according to an embodiment of the invention can be predicted the captions that distributed the expression programme content in abstract fragments.So, when from captions, detecting the high key word of the frequency of occurrences and from the captions of abstract fragments, detect the high part of the key word frequency of occurrences, index can be created so that accurately introduce program summary and high precision grasp program summary, therefore, can accurately grasp program summary by the demonstration of index.
Description of drawings
Fig. 1 is the process flow diagram that illustrates according to the processing procedure of the CPU (central processing unit) in the hdd recorder of the embodiment of the invention 1;
Fig. 2 is the block diagram that the hdd recorder of the embodiment of the invention 1 is shown;
Fig. 3 is the functional block diagram of the hdd recorder of Fig. 2;
Fig. 4 is the process flow diagram of the processing procedure when CPU (central processing unit) being shown writing down in the hdd recorder of Fig. 2;
Fig. 5 is the synoptic diagram that is used for descriptive abstract;
Fig. 6 illustrates abstract fragments in the processing procedure of Fig. 1 to determine the process flow diagram handled;
Fig. 7 illustrates the process flow diagram that the captions classification in the processing procedure of Fig. 1 is handled;
Fig. 8 illustrates the process flow diagram that the important keyword extraction in the processing procedure of Fig. 1 is handled;
Fig. 9 is the figure that is used to illustrate the example of extracting important key word;
Figure 10 is the figure that determines that each key word is shown;
Figure 11 is that the index that illustrates in the processing procedure of Fig. 1 generates the process flow diagram of handling;
Figure 12 is the figure that is used to illustrate the processing procedure of Figure 11;
Figure 13 is the planimetric map that the demonstration example of index is shown;
Figure 14 is the planimetric map that another demonstration example of index is shown.
Embodiment
Hereinafter, will suitably be described in detail with reference to the attached drawings embodiments of the invention.
[embodiment 1]
(1) configuration of embodiment 1
Fig. 2 is the block diagram that illustrates according to the configuration of the hdd recorder of the embodiment of the invention 1, and Fig. 3 is the functional block diagram of its relevant portion.The program that program that hdd recorder 1 record television broadcasting provides and the Internet provide also offers the user with them.
In hdd recorder 1,4 web page servers that provide 5 obtain the transport stream of video contents to modulator-demodular unit 2 from the Internet under the control of SIO (Serial I/O, serial input and output) controller 3, and it is outputed to SIO controller 3.SIO controller 3 is controlled the operation of modulator-demodular unit 2 under the control of CPU-CPU (central processing unit) 6, and will output to bus (BUS) from the transport stream of modulator-demodular unit 2 outputs.According to the configuration of modulator-demodular unit 2 and SIO controller 3, the program that hdd recorder 1 receiving internet provides.
Broadcast reception unit 10 under the control of CPU (central processing unit) 6 by television broadcasting receiver, video content, and output video data and voice data.
In broadcast reception unit 10, the broadcast wave that the user wants is selected and received to tuner 11 from the various broadcast waves that antenna 12 receives, and according to reception result output intermediate-freuqncy signal.Detuner 13 is handled from the intermediate-freuqncy signal of tuner 11 outputs, and output transport stream.TS demoder 14 will temporarily be stored in the RAM (random access memory) 15 from the transport stream of detuner 13 outputs or from the transport stream of SIO controller 3 via the bus input, and handle this transport stream with playback video data, voice data and teletext broadcasting data.Video data that TS demoder 14 is play to decoding unit 16 output and voice data for monitor or be used to create below the summary that will describe.Video data, voice data and teletext broadcasting data that TS demoder 14 was also play to bus output are to be used for record video content.
Therefore, in hdd recorder 1 (Fig. 3), broadcast reception unit 10 and SIO controller 3 configuration video/audio receiving elements 40, this video/audio receiving element 40 receive from the video content of television broadcasting and from the video content of the Internet.Broadcast reception unit 10 and SIO controller 3 also form captions receiving element 42, and this captions receiving element 42 is by receiving captions from the video content of television broadcasting with from the teletext broadcasting data in the video content of the Internet.
Decoding unit 16 decompresses under the control of CPU (central processing unit) 6 from the video data and the voice data of the video data of bus output and voice data or 10 outputs from the broadcast reception unit.Decoding unit 16 also to output unit 17 output decompressed video data and voice data for supervision, and they are outputed to the summary that bus will be described below being used to create.
Output unit 17 will be mixed with voice data and video data and the voice data relevant with the various information that offer the user from the video data that is used to monitor of decoding unit 16 outputs under the control of CPU (central processing unit) 6, exports this data then.
In output unit 17, mixer (MUX) 21 will be mixed from the voice data of decoding unit 16 outputs and from the voice data that bus is exported exports this data then, therefore, at the audio frequency of playing the result, promptly be used to the various alerting tones or the like that superposeed on the audio frequency of the video content that monitors, and export this voice data.Display controller 22 utilizes from the video data of bus output and generates the video data that is used for the OSD (On Screen Display, screen video control system) relevant with menu etc.Video processing unit 23 will be mixed with the video data of exporting from display controller 22 from the video data of decoding unit 16 outputs exports this data then, therefore, play result's video, promptly be used to the various icons or the like that superposeed on the video of the video content that monitors.
Hard-disk interface (hard disk I/F) 31 will output to bus under the control of CPU (central processing unit) 6 video data, voice data and teletext broadcasting data or the like output to hard disk drive (HDD) 32, and therefore, these data are recorded in the hard disk drive 32.In addition, be stored in data in the hard disk drive 32 under the similar control of CPU (central processing unit) 6 by playback and output to bus.
Integrated circuit board interface (integrated circuit board I/F) the 33rd is placed in storage card 35 in the integrated circuit board slot 34 and the interface between the bus, its various data that will output to bus under the control of CPU (central processing unit) 6 are recorded in the storage card 35, and the various data of record in the storage card 35 are outputed to bus.
U/I control module 36 receives remote signal from telepilot, and it is notified to CPU (central processing unit) 6.
CPU (central processing unit) 6 is controllers of the operation of control hdd recorder 1, and it controls the operation of each unit by guarantee perform region and the executive logging program in ROM (ROM (read-only memory)) 38 in RAM 37.Among the embodiment, the program of CPU (central processing unit) 6 provides by being installed in advance in the hdd recorder 1; Yet in addition, program also is preferred by being recorded in as providing in the recording mediums such as CD, disk, storage card; In addition, program also is preferred by providing from the network download such as the Internet.
Operation according to program, when the user indicates record video content, CPU (central processing unit) 6 utilizes broadcast reception unit 10 to receive the television broadcasting of user's indication, and writes down from video data, voice data and the teletext broadcasting data of 14 outputs of TS demoder in hard disk drive 32.The web page server 5 that CPU (central processing unit) 6 is gone back the calling party indication obtains video content, and after the video data that utilizes TS demoder 14 playback gained video contents, voice data and teletext broadcasting data, these data of record in hard disk drive 32.
When the user indicated the monitoring video content, CPU (central processing unit) 6 was handled in decoding unit 16 after the video data and voice data by 14 playback of TS demoder, from output unit 17 to surveillance equipment 25 output datas.When the user indicates the video content of playback in hard disk drive 32, CPU (central processing unit) 6 in playback from the corresponding video data of hard disk drive 32 and voice data and in decoding unit 16 after these data of decoding, from output unit 17 to surveillance equipment 25 output datas.
In the time of record video content, CPU (central processing unit) 6 is decoded and is obtained data being recorded in video data in the hard disk drive 32 in decoding unit 16, then, analyzes the gained data.CPU (central processing unit) 6 is also utilized pot life Treatment Analysis result after finishing record, and abstract fragments is set, and then, by analysis chart teletext broadcast data abstract fragments is provided with index.In addition, in the indication playback video content according to the user, index is shown with execution index and handles.Abstract fragments is meant the segment of expression programme content in the video.
Fig. 4 is the process flow diagram that the processing procedure of CPU (central processing unit) 6 when record is shown.Behind the start-of-record, CPU (central processing unit) 6 beginning processing procedures continue to step SP2 from step SP1.CPU (central processing unit) 6 judges whether to indicate record to finish, if obtain negative answer, then continues to step SP3 from step SP2.
In step SP3, CPU (central processing unit) 6 is analyzed from the video data of decoding unit 16 outputs, and in next step SP4, Treatment Analysis result calculates and estimates the successional evaluation of estimate of screen then.For example, CPU (central processing unit) 6 is divided into a plurality of zones with screen, and calculates motion vector in each zone to calculate evaluation of estimate.A plurality of motion vectors that scene (scene) detects when changing by this way change, and the value shown in them is much at one when taking same object with same Techniques for Photography.Therefore, evaluation of estimate shows the continuity of the image in the successive frame.
Therefore, in next step SP5, CPU (central processing unit) 6 is compared the evaluation of estimate that obtains in the evaluation of estimate that calculates and the previous frame and is judged successional existence/disappearance with respect to last piece image, and then, if there is continuity, then step SP2 is returned in this processing.On the other hand, if there is not continuity, then should handles to step SP6 and continue, the evaluation of estimate of calculating among the CPU (central processing unit) 6 recording step SP3 is returned step SP2 then.
Each of the video data of decoding in 6 pairs of decoding units 16 of CPU (central processing unit) is determined the processing procedure of frame repeating step SP2-SP3-SP4-SP5-SP6-SP2.Each is being determined in the repetition of frame that if there is not continuity, then evaluation of estimate is registered as characteristic quantity (feature amount), and is writing down when finishing that this is handled from step SP2 and continues with the end process process to SP7.Therefore, CPU (central processing unit) 6 forms the feature extraction unit 41 (Fig. 3) of extracting characteristic quantity.
Fig. 1 illustrates the process flow diagram of the processing procedure of detected characteristics amount as mentioned above.In pot life, carry out processing procedure after CPU (central processing unit) 6 end records.Under the enough situation of the processing power of CPU (central processing unit) 6, it also is preferred that the processing procedure of Fig. 1 is carried out during writing down.
In processing procedure, CPU (central processing unit) 6 continues to step SP12 from step SP11, and the executive summary segment is determined to handle.It is following processing that abstract fragments is determined to handle, and video content is divided into abstract fragments A, B and other segments in this processing, as shown in Figure 5.
Abstract fragments is meant the part of video content, and it represents this video content, and for example, when video content is as shown in Figure 5 news program, and every corresponding abstract fragments of scene SA, SB that the news person of going on the air is introduced the news summary wherein.Hereinafter, the segment from abstract fragments A to abstract fragments B front end is called topic (topic).In the news program, the segment that abstract fragments is got rid of from the topic segment is the segment of broadcasting concrete news video TA, TB therein.
Fig. 6 is shown specifically the process flow diagram that abstract fragments is determined processing.After the CPU (central processing unit) 6 beginning processing procedures, continue to step SP14 from step SP13.CPU (central processing unit) 6 detects the characteristic quantity with maximum distribution from the distribution (distribution) of the characteristic quantity of record and storage.CPU (central processing unit) 6 also is provided with threshold value according to the characteristic quantity that detects, and uses threshold value to determine the characteristic quantity of record and storage.Therefore, CPU (central processing unit) 6 similar segment of detected characteristics amount from the video content that is write down.
Next, CPU (central processing unit) 6 continues to step SP15.Whole playback durations of the segment that CPU (central processing unit) 6 calculation procedure SP14 detect.And in next step SP16, CPU (central processing unit) 6 judges that this playback duration is whether within a certain threshold value.
If obtaining negates answer herein, then CPU (central processing unit) 6 continues to step SP17 from step SP16, and the definite threshold value of segment that will be used for step SP14 changes to a side of the characteristic quantity with maximum distribution.Threshold value after CPU (central processing unit) 6 is also got back to step SP14 and utilized change is determined the characteristic quantity of record and storage.Therefore, the CPU (central processing unit) 6 similar segment of detected characteristics amount from the video content that is write down once more.
On the other hand, when obtaining sure answer among the step SP16, after the segment that CPU (central processing unit) 6 detects in the rapid SP15 with previous step is made as abstract fragments, continue with the end process process to step SP18 from step SP16.
CPU (central processing unit) 6 forms the summary generation unit 43 (Fig. 3) that abstract fragments is set by the processing procedure of execution graph 6.Hard disk drive 32 forms the characteristic information storage unit 44 of recording feature amount, also forms the captions storage unit 45 of utilizing teletext broadcasting data storage caption information.The method that detects abstract fragments is not limited to the situation of the processing of characteristic quantity shown in Figure 6, but can also use several different methods.
Next, CPU (central processing unit) 6 continues to step SP21 (Fig. 1), carries out the captions classification and handles.It is following processing that captions classification is handled, and the captions that provided by the teletext broadcasting data in this processing are divided into the captions in the segment of captions in the abstract fragments and non-abstract fragments.In the present embodiment, by carry out captions in the segment that processing procedure shown in Figure 7 allows captions and non-abstract fragments in the abstract fragments mark (score) different, captions are divided into the segment of abstract fragments and non-abstract fragments.
After the CPU (central processing unit) 6 beginning processing procedures, continue to step SP23, from the captions that the teletext broadcasting data provide, select a sentence, judge then whether selected sentence is included in the abstract fragments from step SP22.If obtain negating answer herein, then CPU (central processing unit) 6 continues to step SP24, and the captions of this sentence are provided with low scoring, continues to step SP25 then.On the other hand, if obtain sure answer herein, then CPU (central processing unit) 6 continues to step SP26 from step SP23, and the captions of this sentence are provided with high scoring, continues to step SP25 then.
In the present embodiment, CPU (central processing unit) 6 is provided with scoring, when shared ratio reduces in whole topic with convenient abstract fragments, compares with the scoring of captions in the segment of non-abstract fragments, and the scoring of captions increases in the abstract fragments.Therefore, even the fragment length of the length of abstract fragments and non-abstract fragments changes by different way, during the important keyword extraction that will describe was in the back handled, important key word also can suitably be detected and can not be omitted.
Particularly, CPU (central processing unit) 6 is made as the scoring of captions in the segment of non-abstract fragments 1 minute, and the number that will form captions character in the segment of non-abstract fragments of a topic is made as the scoring of captions in the abstract fragments divided by the number institute value of corresponding subtitle character in the abstract fragments.
CPU (central processing unit) 6 judges whether processing procedure to have been carried out in all sentences in the captions in next step SP25.If obtaining negates answer herein, then CPU (central processing unit) 6 is returned step SP23 from step SP25, carries out the processing of next.On the other hand, if obtain sure answer herein, then CPU (central processing unit) 6 continues to step SP27 from step SP25, finishes processing procedure.
According to the processing of Fig. 7, CPU (central processing unit) 6 forms captions taxons 47 (Fig. 3), and the captions that this captions taxon provides the teletext broadcasting data are divided into the captions in the segment of captions in the abstract fragments and non-abstract fragments.
Next, CPU (central processing unit) 6 is returned step SP31 (Fig. 1), carries out important keyword extraction and handles.Herein, important keyword extraction processing is the processing of extracting the important key word of indication topic content in each topic.Each key words that 6 pairs of CPU (central processing unit) form captions are provided with scoring, so that high key word of the frequency of occurrences and the key word that belongs to abstract fragments have higher scoring, extract the key word with higher scoring then.
Fig. 8 illustrates the process flow diagram that important keyword extraction is handled.CPU (central processing unit) 6 continues to step SP33 from step SP32 after beginning to handle.CPU (central processing unit) 6 is selected a topic and is obtained the captions of selected topic from the captions that the teletext broadcasting data provide.In next step SP34, CPU (central processing unit) 6 is sheared out key word from the captions that obtain.Should be noted that morphological analysis methods such as (morphological analysis) can be applied to the shearing of key word.
Next, CPU (central processing unit) 6 continues to step SP35, by according to key word the scoring of among the step SP21 each key word being calculated in the scoring phase Calais of captions setting.
As shown in Figure 9, suppose that 24 seconds abstract fragments and 1 minute 24 seconds subsequent segments (hereinafter, being called the back abstract fragments) form the captions of a topic herein.Suppose in addition to detect the key word shown in the underscore by morphological analysis.In the example of Fig. 9, the character number of abstract fragments is 100, and the character number of back abstract fragments is 339, therefore, according to the processing of step SP21 the captions of abstract fragments is provided with 3.4 minutes scoring.
In this example, as shown in figure 10, CPU (central processing unit) 6 is provided with scoring by the number of times that each key word is detected separately to each key word in abstract fragments and back abstract fragments.In the example of Fig. 9 and Figure 10, key word " afternoon " is detected in abstract fragments once, is detected once in the abstract fragments of back, and therefore, it is set as 4.4 minutes scoring (adding 1 fen in 3.4 minutes).Key word " news " only is detected in abstract fragments once, and therefore, it is set as 3.4 minutes scoring.
Next, CPU (central processing unit) 6 continues to step SP36, by the scoring order key word is sorted, and selects the key word of some in proper order and they are made as important key word by scoring.Therefore, in the example of Figure 10, key word " bomb ", " male sex ", " homeless ", " case " and " boy " are detected as important key word.
Then, CPU (central processing unit) 6 continues to step SP38, judges whether to have handled all topics, then, if obtain negative answer herein, then returns step SP33 and handles next topic.On the other hand, if obtain sure answer among the step SP38, then CPU (central processing unit) 6 continues and returns original processing procedure to step SP39.
Therefore, CPU (central processing unit) 6 forms important keyword detection unit 48 (Fig. 3), and this important keyword detection unit detects the important key word of each topic content of indication in each topic.
Next, CPU (central processing unit) 6 continues to step SP41 (Fig. 1), and execution index generates to be handled.Index generates and handles is the processing that generates the index of each topic.CPU (central processing unit) 6 comes to generate index from the captions of the abstract fragments of each topic by using the important key word that detects among the step SP31.
Figure 11 illustrates index to generate the process flow diagram of handling.After the CPU (central processing unit) 6 beginning processing procedures, continue to step SP43, from the captions that the teletext broadcasting data provide, select a topic from step SP42.CPU (central processing unit) 6 is obtained the important key word that detects for selected topic in step SP31.
Next, CPU (central processing unit) 6 continues to step SP44, selects one section sentence from the abstract fragments of selected topic, and detects detected important key word in topic from this section sentence.The scoring addition of the important key word that the scoring that CPU (central processing unit) 6 is also utilized each the important key word that detects among the step SP31 comprises this section sentence, the scoring of calculating the importance of this section of indication.This section sentence is corresponding to the character string of shearing out from the captions of summary according to punctuation mark or the like, so that the user can understand an implication.
Next, CPU (central processing unit) 6 continues to step SP45, judges whether to have handled all sections of selected topic, then, if obtain negative answer herein, then returns step SP44.Therefore, CPU (central processing unit) 6 illustrates the scoring of importance in every section calculating of summary.
In the example of Figure 10, key word " bomb ", " male sex ", " homeless ", " case " and " boy " are detected as important key word, therefore, each section sentence in the corresponding summary obtains the scoring of 0 minute, 45.2 minutes, 19.6 minutes and 8.4 minutes respectively, as shown in figure 12.
That section sentence that CPU (central processing unit) 6 will have the highest scoring is made as the summary index, and in hard disk drive 32 it is noted with the information of specifying corresponding topic and abstract fragments.In next step SP47, CPU (central processing unit) 6 judges whether to have handled all topics, then, if obtain negating answer herein, then continues and handles next topic to step SP43.On the other hand, if obtain sure answer herein, then CPU (central processing unit) 6 continues to step SP48, and returns original processing procedure.After returning original processing procedure, handle from step SP41 and continue, to finish the processing of pot life to step SP51.
Therefore, CPU (central processing unit) 6 forms index generation unit 49 (Fig. 3), and this index generation unit generates the index of each topic according to topic.
When the user indicates the emphasis playback by the video content of designated recorder in hard disk drive 32, the index of CPU (central processing unit) 6 display of video content.
As shown in figure 13, CPU (central processing unit) 6 utilizes rest image to show to be set to the user to indicate the front end frame of abstract fragments of front end of the video content of playback.CPU (central processing unit) 6 also order is presented at the index that detects in each topic of video content.The index that shows rolls to the operation of telepilot according to the user.When playback indicated in the arbitrary index of user by selecting, the topic of the index that relevant user selects was by playback and demonstration.
In this example, shown in Figure 14 as the comparison of Figure 13 preferably shows the thumbnail of the front end frame of each topic in tabulation, and shows index at each thumbnail place, and can be extensive use of various display modes as the mode that shows index.Except utilizing rest image to show the front end frame like this, begin sequential playback and display of video content from front end, and show in the tabulation on a part of display screen that index also is preferred.
Therefore, in the present embodiment, CPU (central processing unit) 6 forms the index management unit 50 (Fig. 3) of management index, also forms the index display unit 51 that shows index with display controller 22 and output unit 17.
(2) operation of embodiment
In the above-mentioned configuration, for 4 programs (Fig. 2) that obtain from the Internet, obtain transport stream from web page server 5 through modulator-demodular unit 2 and SIO controller, this transport stream is divided into video data, voice data and teletext broadcasting data in TS demoder 14 then.This video data, voice data and teletext broadcasting data are recorded in the hard disk drive 32 by bus.On the other hand, for television program, handle the broadcast wave that receives and obtain transport stream in tuner 11, this transport stream is divided into video data, voice data and teletext broadcasting data in TS demoder 14 then.This video data, voice data and teletext broadcasting data are recorded in the hard disk drive 32 by bus.
In hdd recorder 1, when program was recorded in the hard disk drive 32 by this way, video data is the decompressed bus that outputs to then in audio-visual (AV) demoder 19, and analyzed in CPU (central processing unit) 6.According to analysis result, the successional characteristic quantity of indication in the successive frame is detected and be recorded in (Fig. 4) in the hard disk drive 32 with video data and voice data.
Finish in the pot life behind the program recording, the characteristic quantity that is recorded in the hard disk drive 32 is processed, and the abstract fragments detected (Fig. 1, Fig. 5 and Fig. 6) of expression programme content.The abstract fragments of Jian Ceing is a segment of utilizing the programme content in the video data presentation video by this way, therefore, can expect that the captions that distribute comprise the sentence of representing programme content in this segment.In fact, in news program, at first, the announcer explains the summary of news item, then, and by looking like to introduce particular content according to reality report exploded view.Therefore, the announcer is as that part of abstract fragments that is detected as of the summary explanation of this news, and the captions of this segment comprise the sentence of the summary of explaining this news.
Yet when all captions of Display Summary segment, sentence to be shown will be unnecessary, and this makes the summary that is difficult to grasp accurately program.And, when the thumbnail of Display Summary segment, be difficult to grasp program summary exactly, in addition, be difficult to grasp accurately program summary.
But according to various analysis results, the key word that appears in the captions sentence of abstract fragments also partly occurs at non-abstract fragments.In addition, the important key word that appears at non-abstract fragments part that the sentence of full accuracy ground expression programme content comprises in the captions sentence of abstract fragments is maximum.
According to above, in the hdd recorder 1, the important key word that the frequency of occurrences is high is detected from the program captions, and the high part of the important key word frequency of occurrences is detected (Fig. 1) as program indexing to be shown from the captions of abstract fragments.Therefore, in the hdd recorder 1, compared with prior art can show and more accurately and accurately grasp program summary according to index.
More specifically, captions in the program are divided into the captions in the segment of captions in the abstract fragments and non-abstract fragments, captions to abstract fragments one side are provided with higher scoring (Fig. 7), use of the scoring of this score calculation from each key word of program captions detection, then, key word by scoring select progressively predetermined number is made as important key word (Fig. 8).In some program, there is the key word that only partly occurs at non-abstract fragments.If this key word is set as important key word, then be difficult to correctly from abstract fragments, create index.In the hdd recorder 1, in order to select important key word, the captions of abstract fragments one side are provided with higher scoring, therefore, the key word that only appears at non-abstract fragments part is not set as important key word effectively to avoid the mistake setting of index.
Captions are provided with scoring, when shared ratio reduces in whole topic with convenient abstract fragments, compare with the scoring of captions in the segment of non-abstract fragments, the scoring of captions increases in the abstract fragments.Therefore, under the situation that the fragment length of the length of abstract fragments and non-abstract fragments changes by different way, can suitably detect important key word and do not add omission.
Particularly, in the hdd recorder 1, captions are provided with scoring, make the numerical value that the scoring of captions in the abstract fragments becomes captions character in the segment of non-abstract fragments divided by the scoring institute value of captions in the segment of non-abstract fragments number obtains divided by the number of captions character in the abstract fragments.Therefore, even under the situation that the fragment length of the length of abstract fragments and non-abstract fragments changes by different way, also can suitably detect important key word and not add omission by simple process.
In addition, important key word, index are detected respectively from the detected a plurality of abstract fragments of program, and therefore, for example in news program or the like, the summary of each bar news can accurately and accurately be grasped.
(3) advantage of embodiment
According to above-mentioned configuration, detect the abstract fragments of expression programme content by analysis video, and the captions that are included in the abstract fragments of the key word that the detected frequency of occurrences is high in whole captions partly are set to index, thereby accurately and accurately grasp program summary.
In addition, the captions in the program are divided into the captions in the segment of captions in the abstract fragments and non-abstract fragments, and the captions of abstract fragments one side are provided with higher scoring, and by using this scoring that important key word is set.Therefore, only appear at non-abstract fragments key word partly and be not set as important key word effectively to avoid the mistake setting of index.
Captions are provided with scoring, when shared ratio reduces in whole topic with convenient abstract fragments, compare with the scoring of captions in the segment of non-abstract fragments, the scoring of captions increases in the abstract fragments.Therefore, under the situation that the fragment length of the length of abstract fragments and non-abstract fragments changes by different way, can suitably detect important key word and do not add omission, and can create index exactly.
More specifically, captions are provided with scoring, make the numerical value that the scoring of captions in the abstract fragments becomes captions character in the segment of non-abstract fragments divided by the scoring institute value of captions in the segment of non-abstract fragments number obtains divided by the number of captions character in the abstract fragments.Therefore, even under the situation that the fragment length of the length of abstract fragments and non-abstract fragments changes by different way, also can suitably detect important key word and not add omission by simple process.In addition, important key word, index are detected respectively from the detected a plurality of abstract fragments of program, and therefore, for example in news program or the like, the summary of each bar news can accurately and accurately be grasped.
[embodiment 2]
In the foregoing description, the situation that the scoring of captions in the segment of abstract fragments and non-abstract fragments only utilizes the ratio of character number to be provided with has been described, yet, the invention is not restricted to this situation.The method that scoring is set in case of necessity can change differently, for example the captions in the segment of abstract fragments and non-abstract fragments are provided with the situation of scoring according to the ratio of playback duration, perhaps according to the indication of user to the length of abstract fragments establishment, in the segment of abstract fragments and non-abstract fragments, change the situation of the scoring of captions, as shown in Figure 6.
In the foregoing description, described the situation that the thumbnail of the front end frame of front end summary or each topic shows with index, but the invention is not restricted to this.The thumbnail of the front end frame of program is shown it also is preferred with index, only show that in addition index also is preferred.
In the foregoing description, thereby described according to punctuation mark or the like and from the captions of summary, character string clipped to the situation that degree that the user grasps an implication is created index, but the invention is not restricted to this, it also is preferred according to the demand of occasion index length being set in many ways.
In the foregoing description, described the situation of handling the captions of teletext broadcasting data, the invention is not restricted to this, creating captions from the voice data of speech recognition also is preferred with processing caption.
In the foregoing description, having described embodiments of the invention is applied to hdd recorder and video content and is recorded situation with playback, but the invention is not restricted to this, and can be widely applied to personal computer for example and download the situation of news video to individual terminal devices and so on.In this case, can high precision and grasp the summary of each bar news exactly, therefore, can accurately interested news be downloaded to portable terminal device and watch.
In addition, in the above-described embodiments, described embodiments of the invention and be applied to the situation of hdd recorder, but the invention is not restricted to this, and embodiments of the invention can be widely applied to the recording/playback device of the video content that uses various recording mediums.
Embodiments of the invention can be applied to hdd recorder of record and playback video content or the like.
According to embodiments of the invention, can accurately and accurately grasp program summary.
It will be appreciated by those skilled in the art that and to expect various modifications, combination, sub-portfolio and change according to design conditions and other factors as long as within the scope of claims or its equivalent.
The cross reference of related application
The present invention comprise with on August 21st, 2006 to the relevant theme of Japanese patent application JP2006-223752 that Jap.P. office submits, by reference the full content of this application is incorporated into herein.
Claims (7)
1. a program provides method, and described method utilizes video data and voice data recorded program in recording medium also this program to be offered the user, said method comprising the steps of:
By the image of analysis video data, detect and utilize video data to represent the abstract fragments of described programme content;
From the captions of described program, detect the high key word of the frequency of occurrences;
By from the captions of described abstract fragments, detecting the high part of the detected key word frequency of occurrences in described detection key word step, create the index of described program; And
Show described index.
2. the program according to claim 1 provides method,
Wherein said detection key word step may further comprise the steps:
The captions of described program are divided into the captions in the segment of captions in the abstract fragments and non-abstract fragments, and the captions of abstract fragments one side are provided with high scoring;
From described program captions, detect key word, and the scoring by according to each key word each key word being calculated in the scoring phase Calais that is provided with in the described captions classification step; And
The key word of the select progressively predetermined number of the scoring of calculating by described calculating scoring step is provided with key word.
3. the program according to claim 2 provides method,
Wherein said captions classification step is provided with scoring, makes when abstract fragments when shared ratio reduces in whole topic, compares the scoring of captions increase in the abstract fragments with the scoring of captions in the segment of non-abstract fragments.
4. the program according to claim 2 provides method,
Wherein said captions classification step is provided with scoring, makes the numerical value that the scoring of captions in the abstract fragments becomes captions character in the segment of non-abstract fragments divided by the scoring institute value of captions in the segment of non-abstract fragments number obtains divided by the number of captions character in the abstract fragments.
5. the program according to claim 1 provides method,
Wherein said detection abstract fragments step detects a plurality of abstract fragments from a program;
Wherein said detection key word step is according to detected each abstract fragments in the described detection abstract fragments step, detects key word from the segment of this abstract fragments and follow-up non-abstract fragments; And
Wherein said establishment index step is by creating index according to each abstract fragments detected corresponding key word in detecting the key word step.
6. the program according to claim 1 provides method, and is further comprising the steps of:
Reception is to the selection of the index that shows in described demonstration index step; And
From beginning the described program of playback, in described reception selection step, received selection to described index with the corresponding position of following index.
7. a program provides equipment, and described program provides equipment utilization video data and voice data recorded program in recording medium also this program to be offered the user, and described equipment comprises:
The abstract fragments detecting unit, it detects and utilizes video data to represent the abstract fragments of described programme content by the image of analysis video data;
Keyword detection unit, it detects the high key word of the frequency of occurrences from the captions of described program;
The index creation unit, it creates the index of described program by detect the high part of the detected key word frequency of occurrences in described detection key element from the captions of described abstract fragments; And
The index display unit, it shows described index.
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2006223752A JP4835321B2 (en) | 2006-08-21 | 2006-08-21 | Program providing method, program providing method program, recording medium recording program providing method program, and program providing apparatus |
| JP2006-223752 | 2006-08-21 | ||
| JP2006223752 | 2006-08-21 |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101131850A CN101131850A (en) | 2008-02-27 |
| CN101131850B true CN101131850B (en) | 2010-04-21 |
Family
ID=39129079
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2007101422123A Expired - Fee Related CN101131850B (en) | 2006-08-21 | 2007-08-21 | Program providing method and program providing apparatus |
Country Status (3)
| Country | Link |
|---|---|
| US (1) | US20080066104A1 (en) |
| JP (1) | JP4835321B2 (en) |
| CN (1) | CN101131850B (en) |
Families Citing this family (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090222849A1 (en) * | 2008-02-29 | 2009-09-03 | Peters Mark E | Audiovisual Censoring |
| US9305603B2 (en) * | 2010-07-07 | 2016-04-05 | Adobe Systems Incorporated | Method and apparatus for indexing a video stream |
| JP5244877B2 (en) * | 2010-09-15 | 2013-07-24 | 株式会社東芝 | Content processing device |
| JP2012129979A (en) | 2010-11-24 | 2012-07-05 | Jvc Kenwood Corp | Segment creation apparatus, segment creation method and segment creation program |
| JP6223678B2 (en) * | 2012-12-21 | 2017-11-01 | 株式会社東芝 | Electronic device and reproduction control method |
| CN103309993B (en) * | 2013-06-20 | 2016-09-14 | 天脉聚源(北京)传媒科技有限公司 | The extracting method of a kind of key word and device |
| CN103686352A (en) * | 2013-11-15 | 2014-03-26 | 乐视致新电子科技（天津）有限公司 | Smart television media player and subtitle processing method thereof, and smart television |
| CN104837036B (en) * | 2014-03-18 | 2018-04-10 | 腾讯科技（北京）有限公司 | Generate method, server, terminal and the system of video watching focus |
| KR20160057864A (en) * | 2014-11-14 | 2016-05-24 | 삼성전자주식회사 | Electronic apparatus for generating summary contents and methods thereof |
| US10242096B2 (en) | 2016-03-15 | 2019-03-26 | Google Llc | Automated news digest |
| CN106888407B (en) * | 2017-03-28 | 2019-04-02 | 腾讯科技（深圳）有限公司 | A kind of video abstraction generating method and device |
| KR101924634B1 (en) | 2017-06-07 | 2018-12-04 | 네이버 주식회사 | Content providing server, content providing terminal and content providing method |
| CN108259971A (en) * | 2018-01-31 | 2018-07-06 | 百度在线网络技术（北京）有限公司 | Subtitle adding method, device, server and storage medium |
| CN111526413A (en) * | 2020-04-29 | 2020-08-11 | 江苏加信智慧大数据研究院有限公司 | Course video playback system and playback method |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1241780A (en) * | 1998-07-15 | 2000-01-19 | 株式会社日立制作所 | Data recording apparatus |
Family Cites Families (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH1139343A (en) * | 1997-07-17 | 1999-02-12 | Media Rinku Syst:Kk | Video retrieval device |
| US6651253B2 (en) * | 2000-11-16 | 2003-11-18 | Mydtv, Inc. | Interactive system and method for generating metadata for programming events |
| JP2002259720A (en) * | 2001-03-02 | 2002-09-13 | Internatl Business Mach Corp <Ibm> | Contents summarizing system, image summarizing system, user terminal unit, summary image producing method, summary image receiving method, and program |
| US7475416B2 (en) * | 2001-06-13 | 2009-01-06 | Microsoft Corporation | System and methods for searching interactive broadcast data |
| JP4615166B2 (en) * | 2001-07-17 | 2011-01-19 | パイオニア株式会社 | Video information summarizing apparatus, video information summarizing method, and video information summarizing program |
| US7747943B2 (en) * | 2001-09-07 | 2010-06-29 | Microsoft Corporation | Robust anchoring of annotations to content |
| WO2005001715A1 (en) * | 2003-06-30 | 2005-01-06 | Koninklijke Philips Electronics, N.V. | System and method for generating a multimedia summary of multimedia streams |
| JP2006115052A (en) * | 2004-10-13 | 2006-04-27 | Sharp Corp | Content retrieval device and its input device, content retrieval system, content retrieval method, program and recording medium |
| US7555718B2 (en) * | 2004-11-12 | 2009-06-30 | Fuji Xerox Co., Ltd. | System and method for presenting video search results |
| US7801910B2 (en) * | 2005-11-09 | 2010-09-21 | Ramp Holdings, Inc. | Method and apparatus for timed tagging of media content |
| KR100754529B1 (en) * | 2005-11-28 | 2007-09-03 | 삼성전자주식회사 | Device for summarizing movie and method of operating the device |
| US7680853B2 (en) * | 2006-04-10 | 2010-03-16 | Microsoft Corporation | Clickable snippets in audio/video search results |
| US7640272B2 (en) * | 2006-12-07 | 2009-12-29 | Microsoft Corporation | Using automated content analysis for audio/video content consumption |
-
2006
- 2006-08-21 JP JP2006223752A patent/JP4835321B2/en not_active Expired - Fee Related
-
2007
- 2007-08-17 US US11/893,905 patent/US20080066104A1/en not_active Abandoned
- 2007-08-21 CN CN2007101422123A patent/CN101131850B/en not_active Expired - Fee Related
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1241780A (en) * | 1998-07-15 | 2000-01-19 | 株式会社日立制作所 | Data recording apparatus |
Also Published As
| Publication number | Publication date |
|---|---|
| US20080066104A1 (en) | 2008-03-13 |
| JP4835321B2 (en) | 2011-12-14 |
| CN101131850A (en) | 2008-02-27 |
| JP2008047004A (en) | 2008-02-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101131850B (en) | Program providing method and program providing apparatus | |
| CN101202864B (en) | Player for movie contents | |
| US8559683B2 (en) | Electronic apparatus and scene-type display method | |
| CN101179681B (en) | Preference extracting apparatus and preference extracting method | |
| US8503832B2 (en) | Electronic device and facial image display apparatus | |
| CN101112090B (en) | Video content reproduction supporting method, video content reproduction supporting system, and information delivery server | |
| US9497404B2 (en) | Information processing apparatus, method, and program | |
| CN101778233B (en) | Data processing apparatus, data processing method | |
| JP5135024B2 (en) | Apparatus, method, and program for notifying content scene appearance | |
| KR101100191B1 (en) | A multimedia player and the multimedia-data search way using the player | |
| US11803589B2 (en) | Systems, methods, and media for identifying content | |
| CN104105002A (en) | Method and device for showing audio and video files | |
| JP2006319980A (en) | Dynamic image summarizing apparatus, method and program utilizing event | |
| JP2010097249A (en) | Electronic apparatus, content recommendation method, and program | |
| US20040177317A1 (en) | Closed caption navigation | |
| JP2007060626A (en) | Apparatus and method for facilitating program selection, and program selection facilitating program | |
| KR101440168B1 (en) | Method for creating a new summary of an audiovisual document that already includes a summary and reports and a receiver that can implement said method | |
| CN101835018B (en) | Motion picture recording/reproducing apparatus | |
| CN103747366A (en) | A method for displaying the playing process of a HLS media file and a player | |
| CN104349173A (en) | Video repeating method and device | |
| US20080118233A1 (en) | Video player | |
| CN106936830A (en) | A kind of playing method and device of multi-medium data | |
| JP5039020B2 (en) | Electronic device and video content information display method | |
| JP2007294020A (en) | Recording and reproducing method, recording and reproducing device, recording method, recording device, reproducing method, and reproducing device | |
| EP2026482A1 (en) | Method for controlling the playback of a radio program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C17 | Cessation of patent right | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20100421 Termination date: 20130821 |