CN105117414B - The method and device synchronous with action is taken down notes in a kind of video - Google Patents

The method and device synchronous with action is taken down notes in a kind of video Download PDF

Info

Publication number
CN105117414B
CN105117414B CN201510456975.XA CN201510456975A CN105117414B CN 105117414 B CN105117414 B CN 105117414B CN 201510456975 A CN201510456975 A CN 201510456975A CN 105117414 B CN105117414 B CN 105117414B
Authority
CN
China
Prior art keywords
notes
video
initial time
time
personage
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201510456975.XA
Other languages
Chinese (zh)
Other versions
CN105117414A (en
Inventor
朱国君
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
TVM Beijing Education Technology Co Ltd
Original Assignee
TVM Beijing Education Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by TVM Beijing Education Technology Co Ltd filed Critical TVM Beijing Education Technology Co Ltd
Priority to CN201510456975.XA priority Critical patent/CN105117414B/en
Publication of CN105117414A publication Critical patent/CN105117414A/en
Application granted granted Critical
Publication of CN105117414B publication Critical patent/CN105117414B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/74Browsing; Visualisation therefor
    • G06F16/745Browsing; Visualisation therefor the internal structure of a single video sequence
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/78Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/7867Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using information manually generated, e.g. tags, keywords, comments, title and artist information, manually generated time, location and usage information, user ratings

Abstract

The invention discloses the method and device synchronous with action is taken down notes in a kind of video, the notes for adjusting video are synchronous with personage's action of writing in video.This method includes:Start the edit pattern of video according to notes adjustment control instruction;The personage for obtaining the video lifts the initial time that personal letter is write, and the notes initial time of corresponding notes is obtained according to the notes time shaft shown under current edit pattern;Judge that personage lifts the initial time that personal letter is write and whether the notes initial time of corresponding notes is consistent, when inconsistent, the notes initial time that the notes initial time of initial time and corresponding notes that personal letter is write adjusts all notes in the plug-in subtitle structured file of modification class of the video is lifted according to the personage.This method can be synchronous with notes by the action in video, and video editing is efficient, can be that video viewers bring better experience sense.

Description

The method and device synchronous with action is taken down notes in a kind of video
Technical field
The present invention relates to the method and device synchronous with action is taken down notes in network technique field more particularly to a kind of video.
Background technology
With the development of network technology, the Web-based instruction becomes a kind of emerging teaching method, since the Web-based instruction is for learning Raw academic environment and time it is of less demanding, therefore obtain more and more users favor.In current Web-based instruction video, Teacher may write during teaching on blackboard, be read in order to facilitate learner, in addition to video file itself, teaching regards Frequency file is also equipped with its corresponding notes and the plug-in subtitle structured file of class, pre-recorded in such plug-in subtitle structured file There are display time and the reproduction time of video of all kinds of words, you can while playing video, in specified reproduction time Display notes and courseware.Wherein, the display time of courseware and notes is consistent, but due to the decoding capability of player and The influence of other various factors, it is possible that the case where time of video and notes is misaligned when playing, such as in video always Teacher is writing, but there are no take down notes in the courseware impression window of screen.Therefore, it is necessary to one kind capable of adjusting use Notes in the video of the teaching edit methods synchronous with figure action.
Invention content
The present invention, which provides, takes down notes the method and device synchronous with action in a kind of video, notes for adjusting video and regard Personage's action of writing synchronizes in frequency.
The method synchronous with action is taken down notes in a kind of video provided by the invention, including:
Start the edit pattern of video according to notes adjustment control instruction;
The personage for obtaining the video lifts the initial time write of personal letter, and when according to the notes shown under current edit pattern Countershaft obtains the notes initial time of corresponding notes;
Judge that personage lifts the initial time that personal letter is write and whether the notes initial time of corresponding notes is consistent;
When inconsistent, the notes initial time tune of initial time and corresponding notes that personal letter is write is lifted according to the personage The notes initial time of all notes in the plug-in subtitle structured file of modification class of the whole video.
Some advantageous effects of the embodiment of the present invention may include:
The method synchronous with action is taken down notes in video provided by the invention, and hand action of writing is lifted by the personage of identification video, And the notes initial time that initial time and corresponding notes that personal letter is write are lifted according to personage adjusts outside the modification class of the video The notes initial time for hanging all notes in subtitle structured file, to reach personage's action of writing in synchronous notes and video Purpose, this method is simple and easy to do, and video editing is efficient, can solve the problems, such as to act in the prior art it is nonsynchronous with video, Better experience sense is brought for video viewers.
In one embodiment, the personage for obtaining the video lifts the initial time that personal letter is write, including:
The video is played with default broadcasting speed under the edit pattern, while showing the reproduction time of the video Axis, the default broadcasting speed are less than the normal playback speed of the video;
According to user, personage lifts personal letter and writes the pause instruction pause broadcasting institute inputted constantly for the first time in finding the video State video;
The initial time that personal letter is write is lifted using reproduction time of the breakpoint on the reproduction time axis of the video as personage.
In the embodiment, at the time of being write by personage's lift personal letter in user's viewing identification video, and obtained by suspending manually Personage is taken to lift the initial time that personal letter is write, this method is suitable for existing most of video editing pattern and existing video is compiled Volume method have it is very strong can amalgamation.
In one embodiment, the personage for obtaining the video lifts the initial time that personal letter is write, including:
The video is played with default broadcasting speed under the edit pattern, while showing the reproduction time of the video Axis, the default broadcasting speed are less than the normal playback speed of the video;
According to user in finding the video personage lift personal letter write the pause instruction pause inputted constantly play described in regard Frequently;
Image recognition is carried out to N frames before and after breakpoint, obtaining, there is personage to lift the frame image made manually for the first time;The N For pre-set positive integer;
It is corresponding on the reproduction time axis of the video that acquisition is lifted to the frame image made manually for the first time with personage Reproduction time lifts the initial time that personal letter is write as personage.
In the embodiment, provide by image-recognizing method automatic identification video personage lift personal letter write at the time of, On the basis of manual coarse adjustment play position, more accurate personage can be obtained and lift the initial time that personal letter is write, so that after The synchronous effect of continuous notes and action is more preferable.
In one embodiment, the notes that initial time and corresponding notes that personal letter is write are lifted according to the personage rise Time of beginning adjusts the notes initial time of all notes in the plug-in subtitle structured file of modification class of the video, including:
Calculate the time difference that the personage lifts initial time and the notes initial time of corresponding notes that personal letter is write;
It is lifted according to the personage time difference of initial time and the notes initial time of corresponding notes that personal letter is write, adjustment The initial time of all notes of the video.
In one embodiment, described that the initial time and the notes of corresponding notes that personal letter is write are lifted according to the personage The time difference of time beginning, the initial time of all notes of the video is adjusted, including:
If the personage lifts the notes initial time that the initial time that personal letter is write is later than its corresponding notes, regarded by described in The initial time of all notes puts off the time difference backward in the plug-in subtitle structured file of modification class of frequency;
If the personage lifts the notes initial time for initial time notes corresponding earlier than its that personal letter is write, regarded by described in The initial time of all notes shifts to an earlier date the time difference in the plug-in subtitle structured file of modification class of frequency.
In the embodiment, the notes initial time for the corresponding notes of initial time that personal letter is write is lifted by calculating personage Time difference, and by judging that personage lifts the priority for the notes initial time of initial time and corresponding notes that personal letter is write, i.e., It may be implemented according to the time difference while adjustment be when all notes in the plug-in subtitle structured file of modification class of the video of pre-editing The purpose of initial time.
In one embodiment, the notes that initial time and corresponding notes that personal letter is write are lifted according to the personage rise Time of beginning adjusts in the plug-in subtitle structured file of modification class of the video after the notes initial time of all notes, also wraps It includes:
The notes initial time that initial time and corresponding notes that personal letter is write are lifted according to the personage changes the video The plug-in subtitle structured file of class in courseware initial time.
In the embodiment, since the time of courseware and notes is consistent, after the initial time adjustment of notes, The initial time of the Video Courseware can also be adjusted the same time difference.The purpose for realizing the adjustment of courseware time, to save Editorial staff individually adjusts the time spent needed for the courseware time, improves the efficiency of video editing.
The present invention also provides a kind of devices synchronous with action of notes in video, including:
Starting module, the edit pattern for starting video according to notes adjustment control instruction;
Time-obtaining module, the personage for obtaining the video lift the initial time write of personal letter, and according to working as pre-editing The notes time shaft shown under pattern obtains the notes initial time of corresponding notes;
First judgment module, for judge personage that the time-obtaining module obtains lift initial time that personal letter is write with it is right Whether the notes initial time for the notes answered is consistent, if inconsistent, synchronic command is sent to synchronization module;
Synchronization module, for after receiving the synchronic command, hand to be lifted according to the personage that the time-obtaining module obtains The initial time of writing and the notes initial time of corresponding notes adjust the plug-in subtitle structured file of modification class of the video In all notes notes initial time.
In one embodiment, the time-obtaining module includes:
Playing module is regarded for being preset under the edit pattern that the starting module starts described in broadcasting speed broadcasting Frequently, while the reproduction time axis of the video is shown;It is additionally operable to that personage lifts personal letter for the first time in finding the video according to user It writes the pause instruction pause inputted constantly and plays the video, and the first instruction is sent to picture recognition module;Wherein, described pre- If broadcasting speed is less than the normal playback speed of the video;
Picture recognition module, the first instruction for being sent according to the playing module, the video that current hang is played Breakpoint before and after N frames carry out image recognition, obtain have personage lift the frame image made manually for the first time;The N is to set in advance The positive integer set;
Acquisition module, the personage for obtaining the acquisition of described image identification module lift the frame image made manually in institute for the first time State corresponding reproduction time on the reproduction time axis of video, and as personage lift the initial time that personal letter is write be supplied to it is described Synchronization module, while obtaining according to the notes time shaft shown under current edit pattern the corresponding pen of initial time of the writing The notes initial time of note is simultaneously supplied to the synchronization module.
In one embodiment, the synchronization module includes:
Computing module lifts hand for according to the synchronic command, calculating the personage that the time-obtaining module obtains The time difference of the initial time of writing and the notes initial time of corresponding notes, and the calculated time difference is supplied to adjusting Module;
Second judgment module, for judging that the personage that the time-obtaining module obtains lifts whether write in one's own hand the initial time write It is later than the notes initial time of its corresponding notes, if so, the second instruction is sent to adjustment module, otherwise, to adjustment module Send third instruction;
Adjustment module will be by the plug-in subtitle structured file of the modification class of the video for according to the second instruction received In the initial times of all notes put off the time difference that the computing module provides backward;Or instructed according to the third received, The initial time of all notes in the plug-in subtitle structured file of the modification class of the video is shifted to an earlier date to the computing module to provide Time difference.
The device synchronous with action is taken down notes in video provided by the invention, and hand action of writing is lifted by the personage of identification video, And the notes initial time that initial time and corresponding notes that personal letter is write are lifted according to personage adjusts outside the modification class of the video The notes initial time for hanging all notes in subtitle structured file, to reach personage's action of writing in synchronous notes and video Purpose, this method is simple and easy to do, and video editing is efficient, can solve the problems, such as to take down notes in the prior art it is nonsynchronous with video, Better experience sense is brought for video viewers.
Other features and advantages of the present invention will be illustrated in the following description, also, partly becomes from specification It obtains it is clear that understand through the implementation of the invention.The purpose of the present invention and other advantages can be by the explanations write Specifically noted structure is realized and is obtained in book, claims and attached drawing.
Below by drawings and examples, technical scheme of the present invention will be described in further detail.
Description of the drawings
Attached drawing is used to provide further understanding of the present invention, and a part for constitution instruction, the reality with the present invention It applies example to be used to explain the present invention together, not be construed as limiting the invention.In the accompanying drawings:
Fig. 1 is to take down notes the method flow diagram synchronous with action in a kind of video provided in an embodiment of the present invention;
Fig. 2 is that the method flow diagram synchronous with action is taken down notes in a kind of video that the embodiment of the present invention one provides;
Fig. 3 is to take down notes the method flow diagram synchronous with action in a kind of video provided by Embodiment 2 of the present invention;
Fig. 4 is notes and the structure diagram of the synchronous device of action in a kind of video provided in an embodiment of the present invention;
Fig. 5 is notes and the structure diagram of the synchronous device of action in second of video provided in an embodiment of the present invention;
Fig. 6 is notes and the structure diagram of the synchronous device of action in the third video provided in an embodiment of the present invention.
Specific implementation mode
The video of notes can be shown by playing, and need video, notes and the plug-in subtitle structured file of class, this three is three A independent file, video file is consistent with existing video file, mainly encodes the text being packaged together by multiple image Part.The content of notes is the content that personage writes in video.Then have recorded temporal information in the plug-in subtitle structured file of class, this when Between information it is consistent with the temporal information in the time schedule and notes file of video, i.e., the plug-in subtitle structured file of class, which has recorded, regards The frequency time also has recorded the notes time, and under normal circumstances, the notes time should be just right with the writing time of personage in video It answers.
In order to which the personage's action of writing and notes that solve the problems, such as above-mentioned video show that the time does not correspond to, below in conjunction with attached drawing Preferred embodiment of the present invention will be described, it should be understood that preferred embodiment described herein is only used for describing and explaining The present invention is not intended to limit the present invention.
Fig. 1 is to take down notes the method flow diagram synchronous with action, including step in a kind of video provided in an embodiment of the present invention S1-S4:
S1:Start the edit pattern of video according to notes adjustment control instruction;Wherein, notes adjustment control instruction is editor Control instruction input by user;
S2:The personage for obtaining video lifts the initial time write of personal letter, and when according to the notes shown under current edit pattern Countershaft obtains the notes initial time of corresponding notes;
S3:Judge that personage lifts the initial time that personal letter is write and whether the notes initial time of corresponding notes is consistent;
S4:When inconsistent, the notes initial time tune of initial time and corresponding notes that personal letter is write is lifted according to personage The notes initial time of all notes in the plug-in subtitle structured file of modification class of whole video.
The method synchronous with action is taken down notes in video provided in an embodiment of the present invention by identifying that the personage of video lifts personal letter Action is write, and lifts the modification class for the notes initial time adjustment video for writing in one's own hand the initial time and corresponding notes write according to personage The notes initial time of all notes in plug-in subtitle structured file, to reach personage's action of writing in synchronous notes and video Purpose, this method is simple and easy to do, and video editing is efficient, can solve to take down notes in the prior art and video is nonsynchronous asks Topic brings better experience sense for video viewers.
Embodiment one
Fig. 2 is that the method flow diagram synchronous with action, including step are taken down notes in a kind of video that the embodiment of the present invention one provides Rapid S21-S28:
S21:Start the edit pattern of video according to notes adjustment control instruction;
S22:Video is played with default broadcasting speed under edit pattern, while showing the reproduction time axis of video, is preset Broadcasting speed is less than the normal playback speed of video;
S23:According to user in finding video personage for the first time lift personal letter write input constantly pause instruction pause play regard Frequently;
S24:The initial time that personal letter is write is lifted using reproduction time of the breakpoint on the reproduction time axis of video as personage;
S25:Personage's lift personal letter, which is obtained, according to the notes time shaft shown under current edit pattern writes moment corresponding notes Notes initial time;
S26:Judge that personage lifts the initial time that personal letter is write and whether the notes initial time of corresponding notes is consistent, if not Unanimously, then S27 is executed;If consistent, terminate flow;
S27:Calculate the time difference that personage lifts initial time and the notes initial time of corresponding notes that personal letter is write;
S28:It is lifted according to personage the time difference of initial time and the notes initial time of corresponding notes that personal letter is write, adjustment The initial time of all notes of video.
In the embodiment, at the time of being write by personage's lift personal letter in user's viewing identification video, and obtained by suspending manually It takes personage to lift the initial time that personal letter is write, and lifts the notes for the corresponding notes of initial time that personal letter is write by calculating personage The time difference of initial time, the initial time of all notes of video is adjusted according to the time difference, this method is suitable for existing Most of video editing pattern and existing video editing method have it is very strong can amalgamation.
Embodiment two
Fig. 3 is to take down notes the method flow diagram synchronous with action, including step in a kind of video provided by Embodiment 2 of the present invention Rapid S31-S39:
S31:Start the edit pattern of video according to notes adjustment control instruction;
S32:Video is played with default broadcasting speed under edit pattern, while showing the reproduction time axis of video, is preset Broadcasting speed is less than the normal playback speed of video;
S33:According to user, personage lifts personal letter and writes the pause instruction pause broadcasting video inputted constantly in finding video;
S34:Image recognition is carried out to N frames before and after breakpoint, obtaining, there is personage to lift the frame image made manually for the first time;N For pre-set positive integer;
S35:It is corresponding on the reproduction time axis of video that acquisition is lifted to the frame image made manually for the first time with personage Reproduction time lifts the initial time that personal letter is write as personage.
S36:Personage's lift personal letter, which is obtained, according to the notes time shaft shown under current edit pattern writes moment corresponding notes Notes initial time;
S37:Judge that personage lifts the initial time that personal letter is write and whether the notes initial time of corresponding notes is consistent, if not Unanimously, then S38 is executed, if unanimously, terminating flow;
S38:Calculate the time difference that personage lifts initial time and the notes initial time of corresponding notes that personal letter is write;
S39:It is lifted according to personage the time difference of initial time and the notes initial time of corresponding notes that personal letter is write, adjustment The initial time of all notes of video.
In the embodiment, provide by image-recognizing method automatic identification video personage lift personal letter write at the time of, On the basis of manual coarse adjustment play position, more accurate personage can be obtained and lift the initial time that personal letter is write, so that after The synchronous effect of continuous notes and action is more preferable.
Preferably, in one embodiment, step S28/S39 is specifically included:If personage lifts the initial time evening that personal letter is write In the notes initial time of its corresponding notes, then by the starting of all notes in the plug-in subtitle structured file of the modification class of video Time, delay time was poor backward;If personage lifts the notes initial time for initial time notes corresponding earlier than its that personal letter is write, It is then that the initial time equal pre-set time of all notes in the plug-in subtitle structured file of the modification class of video is poor.In the embodiment, The time difference for lifting the notes initial time for the corresponding notes of initial time that personal letter is write by calculating personage, and pass through judgement Personage lifts the priority of the notes initial time of initial time and corresponding notes that personal letter is write, you can same according to the time difference to realize When adjustment when pre-editing video the plug-in subtitle structured file of modification class in all notes initial time purpose.
Since the time of courseware and notes is consistent, it is preferable that further include step after step S4 in above-described embodiment Suddenly:The notes initial time that initial time and corresponding notes that personal letter is write are lifted according to personage changes the plug-in subtitle knot of class of video The initial time of courseware in structure file.It, can also be by the Video Courseware after the initial time adjustment of notes in the embodiment Initial time adjust same time difference, method of adjustment is similar to the method for adjustment of notes initial time noted earlier, with reality The purpose of existing courseware time adjustment, individually adjusts the time spent needed for the courseware time, raising regards to save editorial staff The efficiency of frequency editor.
Corresponding to the method synchronous with action is taken down notes in video provided in an embodiment of the present invention, the embodiment of the present invention also provides The device synchronous with action is taken down notes in a kind of video, as shown in figure 4, the device includes:
Starting module 41, the edit pattern for starting video according to notes adjustment control instruction;
Time-obtaining module 42, the personage for obtaining video under current edit pattern lift the initial time that personal letter is write, And the notes initial time of corresponding notes is obtained according to the notes time shaft shown under current edit pattern;
First judgment module 43, for judge personage that time-obtaining module 42 obtains lift the initial time write of personal letter with it is right Whether the notes initial time for the notes answered is consistent, if inconsistent, synchronic command is sent to synchronization module 44;
Synchronization module 44, the personage for after receiving synchronic command, being obtained according to time-obtaining module 42 lift personal letter and write Initial time and corresponding notes notes initial time adjustment video the plug-in subtitle structured file of modification class in all pens The notes initial time of note.
In one embodiment, as shown in figure 5, time-obtaining module 42 includes:
Playing module 421, for playing video under the edit pattern that starting module 41 starts with default broadcasting speed, together When show the reproduction time axis of video;Be additionally operable to according to user the personage in finding video lift for the first time personal letter write input constantly it is temporary Stop instruction pause plays video, and sends the first instruction to picture recognition module 422;Wherein, it presets broadcasting speed and is less than video Normal playback speed;
Picture recognition module 422, the first instruction for being sent according to playing module 421, regards current hang broadcasting N frames carry out image recognition before and after the breakpoint of frequency, and obtaining, there is personage to lift the frame image made manually for the first time;N is to pre-set Positive integer;
Acquisition module 423, the personage for obtaining the acquisition of picture recognition module 422 lift the frame image made manually and exist for the first time Corresponding reproduction time on the reproduction time axis for the video that playing module 421 is shown, and lift that personal letter is write as personage Time of beginning is supplied to synchronization module 44, while when obtaining the starting write according to the notes time shaft shown under current edit pattern Between corresponding notes notes initial time and be supplied to the first judgment module 43 and synchronization module 44.
In one embodiment, as shown in fig. 6, synchronization module 44 includes:
Computing module 441, the synchronic command for being sent according to the first judgment module 43 calculate time-obtaining module 42 and obtain The personage that takes lifts the time difference of initial time and the notes initial time of corresponding notes that personal letter is write, and by the calculated time Difference is supplied to adjustment module 443;
Second judgment module 442 is for judging that personage that time-obtaining module 42 obtains lifts the initial time write of personal letter The no notes initial time for being later than its corresponding notes, if so, the second instruction is sent to adjustment module 443, otherwise, to adjusting Module 443 sends third instruction;
Adjustment module 443, for according to the second instruction received, by will be in the plug-in subtitle structured file of the modification class of video The initial time of all notes puts off the time difference of the offer of computing module 441 backward;Or instructed according to the third received, it will regard The initial time of all notes shifts to an earlier date the time difference that computing module 441 provides in the plug-in subtitle structured file of modification class of frequency.
The device synchronous with action is taken down notes in video provided in an embodiment of the present invention by identifying that the personage of video lifts personal letter Action is write, and lifts the modification class for the notes initial time adjustment video for writing in one's own hand the initial time and corresponding notes write according to personage The notes initial time of all notes in plug-in subtitle structured file, to reach personage's action of writing in synchronous notes and video Purpose, this method is simple and easy to do, and video editing is efficient, can solve to take down notes in the prior art and video is nonsynchronous asks Topic brings better experience sense for video viewers.
It should be understood by those skilled in the art that, the embodiment of the present invention can be provided as method, system or computer program Product.Therefore, complete hardware embodiment, complete software embodiment or reality combining software and hardware aspects can be used in the present invention Apply the form of example.Moreover, the present invention can be used in one or more wherein include computer usable program code computer The shape for the computer program product implemented in usable storage medium (including but not limited to magnetic disk storage and optical memory etc.) Formula.
The present invention be with reference to according to the method for the embodiment of the present invention, the flow of equipment (system) and computer program product Figure and/or block diagram describe.It should be understood that can be realized by computer program instructions every first-class in flowchart and/or the block diagram The combination of flow and/or box in journey and/or box and flowchart and/or the block diagram.These computer programs can be provided Instruct the processor of all-purpose computer, special purpose computer, Embedded Processor or other programmable data processing devices to produce A raw machine so that the instruction executed by computer or the processor of other programmable data processing devices is generated for real The device for the function of being specified in present one flow of flow chart or one box of multiple flows and/or block diagram or multiple boxes.
These computer program instructions, which may also be stored in, can guide computer or other programmable data processing devices with spy Determine in the computer-readable memory that mode works so that instruction generation stored in the computer readable memory includes referring to Enable the manufacture of device, the command device realize in one flow of flow chart or multiple flows and/or one box of block diagram or The function of being specified in multiple boxes.
These computer program instructions also can be loaded onto a computer or other programmable data processing device so that count Series of operation steps are executed on calculation machine or other programmable devices to generate computer implemented processing, in computer or The instruction executed on other programmable devices is provided for realizing in one flow of flow chart or multiple flows and/or block diagram one The step of function of being specified in a box or multiple boxes.
Obviously, various changes and modifications can be made to the invention without departing from essence of the invention by those skilled in the art God and range.In this way, if these modifications and changes of the present invention belongs to the range of the claims in the present invention and its equivalent technologies Within, then the present invention is also intended to include these modifications and variations.

Claims (6)

1. taking down notes the method synchronous with action in a kind of video, which is characterized in that including:
Start the edit pattern of video according to notes adjustment control instruction;
The personage for obtaining the video lifts the initial time that personal letter is write, and according to the notes time shaft shown under current edit pattern Obtain the notes initial time of corresponding notes;
Judge that personage lifts the initial time that personal letter is write and whether the notes initial time of corresponding notes is consistent;
When inconsistent, the notes initial time that initial time and corresponding notes that personal letter is write are lifted according to the personage adjusts institute State the notes initial time of all notes in the plug-in subtitle structured file of modification class of video;
The personage for obtaining the video lifts the initial time that personal letter is write, including:
The video is played with default broadcasting speed under the edit pattern, while showing the reproduction time axis of the video, The default broadcasting speed is less than the normal playback speed of the video;
According to user, personage lifts personal letter and writes the pause instruction pause broadcasting video inputted constantly in finding the video;
Image recognition is carried out to N frames before and after breakpoint, obtaining, there is personage to lift the frame image made manually for the first time;The N is pre- The positive integer being first arranged;
There is personage to lift a frame image corresponding broadcasting on the reproduction time axis of the video made manually for the first time acquisition Time lifts the initial time that personal letter is write as personage.
2. taking down notes the method synchronous with action in video as described in claim 1, which is characterized in that described according to the personage The notes initial time for the initial time and corresponding notes that lift personal letter is write adjusts the plug-in subtitle structure of modification class of the video The notes initial time of all notes in file, including:
Calculate the time difference that the personage lifts initial time and the notes initial time of corresponding notes that personal letter is write;
It is lifted according to the personage time difference of initial time and the notes initial time of corresponding notes that personal letter is write, described in adjustment The initial time of all notes of video.
3. taking down notes the method synchronous with action in video as claimed in claim 2, which is characterized in that described according to the personage The time difference for the initial time and the notes initial time of corresponding notes that lift personal letter is write, adjust all notes of the video Initial time, including:
If the personage lifts the notes initial time that the initial time that personal letter is write is later than its corresponding notes, by the video The initial time of all notes puts off the time difference backward in the modification plug-in subtitle structured file of class;
If the personage lifts the notes initial time for initial time notes corresponding earlier than its that personal letter is write, by the video The initial time for changing all notes in the plug-in subtitle structured file of class shifts to an earlier date the time difference.
4. taking down notes the method synchronous with action in video as claimed in claim 3, which is characterized in that described according to the personage The notes initial time for the initial time and corresponding notes that lift personal letter is write adjusts the plug-in subtitle structure of modification class of the video After the notes initial time of all notes in file, further include:
The notes initial time that initial time and corresponding notes that personal letter is write are lifted according to the personage changes the class of the video The initial time of courseware in plug-in subtitle structured file.
5. taking down notes the device synchronous with action in a kind of video, which is characterized in that including:
Starting module, the edit pattern for starting video according to notes adjustment control instruction;
Time-obtaining module, the personage for obtaining the video lift the initial time that personal letter is write, and according to current edit pattern The notes time shaft of lower display obtains the notes initial time of corresponding notes;
First judgment module, for judge personage that the time-obtaining module obtains lift initial time that personal letter is write with it is corresponding Whether the notes initial time of notes is consistent, if inconsistent, synchronic command is sent to synchronization module;
Synchronization module, the personage for after receiving the synchronic command, being obtained according to the time-obtaining module lift personal letter and write Initial time and the notes initial times of corresponding notes adjust institute in the plug-in subtitle structured file of modification class of the video There is the notes initial time of notes;
The time-obtaining module includes:
Playing module, for playing the video under the edit pattern that the starting module starts with default broadcasting speed, together When show the reproduction time axis of the video;It is additionally operable to according to user the personage in finding the video and lift to write in one's own hand for the first time write the moment The pause instruction pause of input plays the video, and sends the first instruction to picture recognition module;Wherein, the default broadcasting Speed is less than the normal playback speed of the video;
Picture recognition module, for according to the playing module send first instruction, to current hang play video it is temporary N frames carry out image recognition before and after rest point, and obtaining, there is personage to lift the frame image made manually for the first time;The N is pre-set Positive integer;
Acquisition module, the personage for obtaining the acquisition of described image identification module lift the frame image made manually and are regarded described for the first time Corresponding reproduction time on the reproduction time axis of frequency, and lift the initial time that personal letter is write as personage and be supplied to the synchronization Module, while obtaining according to the notes time shaft shown under current edit pattern the corresponding notes of initial time of the writing Notes initial time is simultaneously supplied to the synchronization module.
6. taking down notes the device synchronous with action in video as claimed in claim 5, which is characterized in that the synchronization module packet It includes:
Computing module, for according to the synchronic command, calculating the personage lift personal letter that the time-obtaining module obtains and writing Initial time and the notes initial time of corresponding notes time difference, and the calculated time difference is supplied to adjusting mould Block;
Second judgment module, for judging that the personage that the time-obtaining module obtains lifts whether the initial time that personal letter is write is later than Otherwise the notes initial time of its corresponding notes, is sent if so, sending the second instruction to adjustment module to adjustment module Third instructs;
Adjustment module, for according to the second instruction received, will own in the plug-in subtitle structured file of the modification class of the video The initial time of notes puts off the time difference that the computing module provides backward;Or instructed according to the third received, it will be described The initial time of all notes shifts to an earlier date the time that the computing module provides in the plug-in subtitle structured file of modification class of video Difference.
CN201510456975.XA 2015-07-29 2015-07-29 The method and device synchronous with action is taken down notes in a kind of video Expired - Fee Related CN105117414B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510456975.XA CN105117414B (en) 2015-07-29 2015-07-29 The method and device synchronous with action is taken down notes in a kind of video

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510456975.XA CN105117414B (en) 2015-07-29 2015-07-29 The method and device synchronous with action is taken down notes in a kind of video

Publications (2)

Publication Number Publication Date
CN105117414A CN105117414A (en) 2015-12-02
CN105117414B true CN105117414B (en) 2018-08-24

Family

ID=54665404

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510456975.XA Expired - Fee Related CN105117414B (en) 2015-07-29 2015-07-29 The method and device synchronous with action is taken down notes in a kind of video

Country Status (1)

Country Link
CN (1) CN105117414B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109145149B (en) * 2018-08-16 2021-05-04 科大讯飞股份有限公司 Information alignment method, device, equipment and readable storage medium
TWI807815B (en) * 2021-05-13 2023-07-01 仁寶電腦工業股份有限公司 Digital note integration system and integration interface and integration method thereof

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1741583A (en) * 2004-08-28 2006-03-01 三星电子株式会社 Be used to coordinate the synchronous equipment and the method for video and captions
CN101461241A (en) * 2006-06-09 2009-06-17 汤姆逊许可公司 System and method for closed captioning
CN103064601A (en) * 2013-01-31 2013-04-24 广东欧珀移动通信有限公司 Method for synchronizing video pictures and subtitles via gesture operation and mobile terminal
CN104104990A (en) * 2014-07-29 2014-10-15 小米科技有限责任公司 Method and device for adjusting subtitles in video

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9071815B2 (en) * 2011-08-31 2015-06-30 Nokia Technologies Oy Method, apparatus and computer program product for subtitle synchronization in multimedia content

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1741583A (en) * 2004-08-28 2006-03-01 三星电子株式会社 Be used to coordinate the synchronous equipment and the method for video and captions
CN101461241A (en) * 2006-06-09 2009-06-17 汤姆逊许可公司 System and method for closed captioning
CN103064601A (en) * 2013-01-31 2013-04-24 广东欧珀移动通信有限公司 Method for synchronizing video pictures and subtitles via gesture operation and mobile terminal
CN104104990A (en) * 2014-07-29 2014-10-15 小米科技有限责任公司 Method and device for adjusting subtitles in video

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
如何调整电影外挂字幕时间轴_百度经验;瞳之翼V;《https://jingyan.baidu.com/article/b24f6c822780b886bfe5daba.html》;20150215;正文第一页第一段 *

Also Published As

Publication number Publication date
CN105117414A (en) 2015-12-02

Similar Documents

Publication Publication Date Title
US8244104B2 (en) System for creating content using content project data
US7697787B2 (en) Dynamic replacement of the face of an actor in a video movie
TW200514442A (en) Recording medium, reproduction device, recording method, program, and reproduction method
KR20160010507A (en) Method and apparatus for processing video images
CN105142029B (en) The editing system and its clipping method of a kind of interdynamic video
MXPA05007922A (en) Recording medium, reproduction device, recording method, program, and reproduction method.
KR101166225B1 (en) Multimedia playing system and method for playing the multimedia using the system
TW200514057A (en) Storage medium including text-based caption information, reproducing apparatus and reproducing method thereof
CN102842326A (en) Video-audio and picture-text synchronous playing method
MY149352A (en) Storage medium storing interactive graphics stream activated in response to user's command, and reproducing apparatus and method for reproducing from the same
EP1729173A3 (en) System for generating synchronized add-on information
CN105117414B (en) The method and device synchronous with action is taken down notes in a kind of video
CN106231222A (en) Based on many code streams can be mutual teaching video file form and storing and playing method
CN103281595A (en) Method of information publishing internet of things terminal multi-screen combination display
CN104853239A (en) Audio and video synchronous playback control method and system
CN106507171A (en) Multi-medium play method and multimedia player
GB201210098D0 (en) Reproduction apparatus
KR20070026249A (en) System, nethod, computer program for data reproducing
TW200511277A (en) Recording medium, recording method, reproduction apparatus and method, and computer-readable program
EP2234391A3 (en) Recording medium, playback apparatus and method, recording method, and computer-readable program
KR20070098362A (en) Apparatus and method for synthesizing a background music to a moving image
TW200608789A (en) Motion menu generation method and system
US10834298B1 (en) Selective audio visual synchronization for multiple displays
CN104244065B (en) A kind of method and device of captions processing
JP2013126184A (en) Content playback device, control method therefor, control program, and content display control device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20180824

Termination date: 20210729