CN106210841A - A kind of audio video synchronization player method, device - Google Patents
A kind of audio video synchronization player method, device Download PDFInfo
- Publication number
- CN106210841A CN106210841A CN201610528603.8A CN201610528603A CN106210841A CN 106210841 A CN106210841 A CN 106210841A CN 201610528603 A CN201610528603 A CN 201610528603A CN 106210841 A CN106210841 A CN 106210841A
- Authority
- CN
- China
- Prior art keywords
- video
- lantern slide
- synchronization
- timestamp
- unit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 30
- 238000000638 solvent extraction Methods 0.000 claims description 24
- 230000011218 segmentation Effects 0.000 claims description 22
- 230000001360 synchronised effect Effects 0.000 claims description 16
- 230000000694 effects Effects 0.000 abstract description 15
- 238000012549 training Methods 0.000 abstract description 3
- 238000010586 diagram Methods 0.000 description 11
- 230000004044 response Effects 0.000 description 8
- 238000006243 chemical reaction Methods 0.000 description 4
- 238000001514 detection method Methods 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- VYZAMTAEIAYCRO-UHFFFAOYSA-N Chromium Chemical compound [Cr] VYZAMTAEIAYCRO-UHFFFAOYSA-N 0.000 description 2
- 230000003044 adaptive effect Effects 0.000 description 2
- 230000006837 decompression Effects 0.000 description 2
- 238000005206 flow analysis Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000004091 panning Methods 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000009466 transformation Effects 0.000 description 2
- 241000278713 Theora Species 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 210000004556 brain Anatomy 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
- H04N21/462—Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47205—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses audio video synchronization player method and device, method is: editor's video, uploads the lantern slide of correspondence；Synchronizing described lantern slide, described synchronization includes synchronizing the playable file in lantern slide according to the timestamp in described video；Generating slides preview on described timestamp, described preview includes embedding the lantern slide of corresponding with lantern slide for the key frame on timestamp subject name；Complete video and lantern slide synchronizes.System includes, resource interface, lock unit, preview unit and output unit.Present invention achieves the mutual of video, lantern slide and subtitle file and synchronize, making user very clear to content (video and lantern slide) to be watched, it is achieved that unique corresponding relation.Especially for scenes such as educational training, common course are live, the effect of user's teaching is obviously improved, and reduces the flow of terminal.
Description
Technical field
The present invention relates to multimedia information technique field, particularly to a kind of audio video synchronization player method, device.
Background technology
Lantern slide, is a kind of by word, picture etc., makes plus some specially good effect Dynamic Announce effects, it is to utilize
A kind of PPT formatted file that the PowerPoint of Microsoft makes.Such as, put giving a lecture when and see to user
A kind of picture that both pictures and texts are excellent, be used for more direct, illustrate viewpoint intuitively.
The broadcast mode of Internet video is divided into live and two kinds of broadcast modes of program request.Net cast refers to sending out along with event
Raw, development process, synchronizes to make and broadcast video, and making and the broadcast of video occur simultaneously；And video request program refer to according to
The demand at family plays the video completed, and making and the broadcast non-concurrent of video occur.
Live audio-visual and graph text information or point is watched when user logs in Ncast recording and broadcasting system server by IE browser
When broadcasting video record information, it is impossible to the content in the viewing lantern slide of synchronization and the content in video.Even if it addition, it can be seen that
Lantern slide, user still cannot synchronize to watch video and lantern slide, and Consumer's Experience is poor.Also having a kind of situation, user sees online
After having seen the Internet video of long period, catching sight of this video is not the video oneself liked or want, and that has downloaded regards
Frequency is all useless, need to switch other Internet videos and re-start download online and broadcasting.Owing to the capacity of video file is relatively big,
When the video particularly play is HD video, the substantial amounts of flow of terminal under above-mentioned scene, can be expended.User cannot obtain in real time
Slide content on material time stamp, it is impossible to the content that the very first time is understood and obtains in video or lantern slide, particularly
For the scenes such as educational training, common course be live, the weak effect of user's teaching, and take the substantial amounts of flow of terminal.
Summary of the invention
The technical problem to be solved in the present invention is, the mutual and synchronization of video, lantern slide and subtitle file.
Solve above-mentioned technical problem, the invention provides a kind of audio video synchronization player method, comprise the steps,
Editor's video, uploads the lantern slide of correspondence；
Synchronizing described lantern slide, described synchronization includes the playable file in lantern slide according in described video
Timestamp synchronize；
Generating slides preview on described timestamp, described preview includes in the key frame on timestamp and lantern slide
The lantern slide of corresponding subject name embeds；
Complete video and lantern slide synchronizes.
Audio video synchronization player method, further comprises captioning synchronization,
The time point selecting subtitle segment to start from video, carries out scene partitioning by described video,
According to scene partitioning typing captions, and preserve to different scenes,
Progress according to video playback is synchronized to the captions in scene, and preserves to video.
Further, according to the snoop results of mouse event, captions shown, hide or editor.
Further, captions are generated corresponding SRT subtitling format, and download interface is provided.
Further, when completing video and lantern slide synchronization, if completing the synchronization of a lantern slide, then on this lantern slide
Generate correspondence markings；If synchronizing, then pointed out by display plug-in unit on corresponding lantern slide.
Further, described video is by uploading local recording or online mode acquisition.
Method further comprises:
Monitor mouse mouse event on described video, generate segmentation plug-in unit；
The page size of described video is proportionally scaled by described segmentation plug-in unit with the display size of lantern slide；
If drag segmentation plug-in unit to the right, then lantern slide proportionally reduces, and video proportionally expands；
If drag segmentation plug-in unit to the left side, then lantern slide proportionally expands, and video proportionally reduces；
If dragging the scope of segmentation plug-in unit beyond threshold value, then lantern slide according to picture-in-picture models show in described video or
Person's video is to show in described lantern slide according to picture-in-picture mode after 1/8 scaling of former ratio.
Method further comprises:
If there is mouse event on timestamp, lantern slide corresponding on the timestamp that the most described mouse event occurs amplifies aobvious
Showing, other lantern slide gradually reduces；
And when occurring above-mentioned lantern slide to amplify display event, described video switches to this timestamp and commences play out.
A kind of audio video synchronization playing device is additionally provided based on the invention described above, including:
Resource interface, edits video, uploads the lantern slide of correspondence；
Lock unit, synchronizes described lantern slide, described synchronization include by the playable file in lantern slide according to
Timestamp in described video synchronizes；
Preview unit, generates slides preview on described timestamp, and described preview includes the key frame on timestamp
The lantern slide of subject name corresponding with lantern slide embeds；
Output unit, completes video and lantern slide synchronizes.
Further, resource interface is also in order to be connected with third party's api interface, in order to obtain video.
Beneficial effects of the present invention:
1) video synchronization method of the present invention, includes editor's video, uploads the lantern slide of correspondence；Issue video or
Carry out live before, video and lantern slide are carried out pretreatment, described lantern slide are synchronized, described synchronization includes lantern slide
In playable file synchronize according to the timestamp in described video；It is right to make to have in each timestamp of video
Playable file in the lantern slide answered.Generating slides preview on described timestamp, described preview includes on timestamp
The lantern slide of key frame subject name corresponding with lantern slide embed；Take into account the length in lantern slide and subject
The setting claimed, is embedded into the principal name in lantern slide in the key frame on timestamp, allows user to content to be watched
(video and lantern slide) is very clear, it is achieved that unique corresponding relation.
2) video synchronization device in the present invention, at resource interface, it is thus achieved that substantial amounts of video content information, and uploads and regard
Frequently content is to corresponding slide content, and slide content includes all playable files.At lock unit, synchronized timestamp and
Playable file in lantern slide, word, picture, specially good effect Dynamic Announce.In preview unit, by lantern slide corresponding for subject name
It is embedded in the key frame on timestamp, thus user is when watching video or lantern slide, it is possible to understand wherein the most corresponding
Relation, Consumer's Experience is good, and for scenes such as educational training, common course are live, the effect of user's teaching is obviously improved, and
Reduce the flow of terminal.
Accompanying drawing explanation
Fig. 1 is the audio video synchronization player method schematic flow sheet in one embodiment of the invention.
Fig. 2 is captioning synchronization method flow schematic diagram.
Fig. 3 is the simultaneously operating schematic diagram that the mouse in the further preferred embodiments in Fig. 1 monitors that event is corresponding.
Fig. 4 is the further operation chart in Fig. 3.
Fig. 5 is the audio video synchronization playing device structural representation in one embodiment of the invention.
Fig. 6 (a)-Fig. 6 (e) is different operating effect schematic diagram in audio video synchronization playing device.
Detailed description of the invention
For making the object, technical solutions and advantages of the present invention clearer, below in conjunction with specific embodiment, and reference
Accompanying drawing, the present invention is described in more detail.
Fig. 1 is the audio video synchronization player method schematic flow sheet in one embodiment of the invention.
Audio video synchronization player method in the present embodiment, it is characterised in that comprise the steps,
Step S100 edits video, uploads the lantern slide of correspondence；The PowerPoint utilizing Microsoft makes
PPT formatted file uploads the lantern slide of correspondence.Skilled person can understand, described editor's video includes but not limited to, depending on
The recording of frequency, the copy editor of video, the denoising of video, the format conversion of video, the compatibility etc. of video.
In certain embodiments, described by HTML5 technical editor's video.
In certain embodiments, by browser Chrome, Firefox, Internet Explorer, Safari etc.
Upload the lantern slide of correspondence.
Described lantern slide is synchronized by step S101, and described synchronization includes the playable file in lantern slide according to institute
The timestamp stated in video synchronizes；Described playable file includes but not limited to, word, picture, and specially good effect Dynamic Announce is imitated
Fruit etc..
In certain embodiments, described synchronization is: synchronize the title of the title in lantern slide and video.
In certain embodiments, described synchronization is: synchronize the broadcast format of lantern slide.
In certain embodiments, described synchronization is: synchronizes the issue of lantern slide, share address.
In certain embodiments, the timestamp in described video carries out synchronization and includes but not limited to, stabs for random time
The synchronization of upper video.
In certain embodiments, described synchronization is: synchronize the content in each lantern slide of lantern slide and video time
Content on stamp.
In certain embodiments, described synchronization also includes, the conversion of lantern slide described in simultaneous display or upload rate and
Progress.
In certain embodiments, described video is by uploading local recording or online mode acquisition.
In certain embodiments, described video in order at Windows, Mac OS, Linux, Windows Phone,
Play on the arbitrarily platform such as Android, iOS.
In certain embodiments, described video also in order to, by FLASH control play FLASH file.
In certain embodiments, when described lantern slide is synchronized, also include sync id, in order to represent magic lantern
The state that sheet is the most synchronized.
In certain embodiments, when described lantern slide is synchronized, also include the mark synchronized, unreal in order to represent
The corresponding page number of lamp sheet synchronizes.
In certain embodiments, when described lantern slide is synchronized, show the page number of described lantern slide.
Step S102 generates slides preview on described timestamp, described preview include by the key frame on timestamp with
In lantern slide, the lantern slide of corresponding subject name embeds；Generate slides preview on described timestamp to refer to, at timestamp
On show the preview screen of lantern slide accordingly, the preview screen of lantern slide is the playable file in described lantern slide.
In certain embodiments, slides preview, according to the key frame on a stamp, left and right reduces successively.
In certain embodiments, described key frame includes but not limited to, the sectional drawing in corresponding lantern slide.
In certain embodiments, in described lantern slide, corresponding subject name refers to the title mated with video main body；Or
As subject name during every lantern slide of switching.
In certain embodiments, described key frame includes but not limited to, according to the broadcasting content of video, carries out redirecting thing
Part, handoff scenario event, important content explanation event, critical events, trigger event, non-trigger events etc..
In certain embodiments, the key frame of described video passes through User Defined.
In certain embodiments, the key frame of described video is defined by key frame detection algorithm.
In certain embodiments, described video also includes that video synchronous time stabs.
In certain embodiments, described video also includes, video playback rate controlled plug-in unit, during in order to control video playback
Speed: strengthen, reduce, 2 times of broadcastings, many times of broadcastings.
In certain embodiments, described video also includes, volume button.
In certain embodiments, described video also includes, broadcast button.
Step S103 completes video and lantern slide synchronizes.
In certain embodiments, when completing video and lantern slide synchronization, if completing the synchronization of a lantern slide, then unreal at this
Correspondence markings is generated on lamp sheet；If synchronizing, then pointed out by display plug-in unit on corresponding lantern slide.
In certain embodiments, when completing video and lantern slide synchronization, described video and lantern slide are according to show media
Resolution, carries out self adaptation frequency dividing display.
In certain embodiments, the synchronized timestamp of described lantern slide carries out simultaneous display with timestamp in video.
In the present embodiment, generating slides preview on described timestamp, described preview includes the key on timestamp
The lantern slide of frame subject name corresponding with lantern slide embeds；Take into account setting of the length in lantern slide and subject name
Fixed, the principal name in lantern slide is embedded in the key frame on timestamp, allow user to content to be watched (video and
Lantern slide) very clear, it is achieved that unique corresponding relation.
Fig. 2 is captioning synchronization method flow schematic diagram.
Audio video synchronization player method in the present embodiment, including step:
Step S100 edits video, uploads the lantern slide of correspondence；
Described lantern slide is synchronized by step S101, and described synchronization includes the playable file in lantern slide according to institute
The timestamp stated in video synchronizes；
Step S102 generates slides preview on described timestamp, described preview include by the key frame on timestamp with
In lantern slide, the lantern slide of corresponding subject name embeds；
Step S103 completes video and lantern slide synchronizes；
Preferably, following captioning synchronization step is also included:
Step S200 selects the time point that subtitle segment starts from video, and described video carries out scene partitioning, described field
Scape divides and includes but not limited to, carries out scene partitioning according to the broadcasting content of video, carries out scene partitioning according to the theme of video,
Carry out scene partitioning according to the key frame in video, carry out scene partitioning etc. according to the duration of video.As shown in Fig. 6 (c),
It it is the effect schematic diagram of captioning synchronization.
In certain embodiments, carry out scene partitioning according to the broadcasting content of video, due in scene target motion or
The impact of the operation (such as zoom, panning) of video camera itself, a camera lens only can not represent well with a width key frame
The content of this camera lens, often need to be with a few width key frames.
In certain embodiments, when carrying out scene partitioning according to the theme of video, use optical flow analysis algorithm.
In certain embodiments, when carrying out scene partitioning according to the key frame in video, by substantial amounts of decompression operation,
Such as Huffman decoding, DPCM decoding, DCT inverse transformation and motion compensation etc..
In certain embodiments, when carrying out scene partitioning according to the key frame in video, detect mpeg compressed video stream, in
The DC coefficient of existing discrete cosine transform and motion vector extract key frame.
Step S201 is according to scene partitioning typing captions, and preserves to different scenes, and described scene is according to set
Mode clusters, and includes but not limited to theme, content, love knot, unit etc..Preserve to different fields after captions are edited
Jing Zhong.
The captions that step S202 is synchronized in scene according to the progress of video playback, and preserve to video.
Preferably, according to the snoop results of mouse event, captions shown, hide or editor.Described mouse thing
Part includes but not limited to, the slip of mouse-click, double mouse click, mouse right click, mouse right click, mouse, mouse roller, mouse drag
Dynamic, mouse is chosen, mouse graph choice box etc..
In certain embodiments, if detection obtains mouse roller event, then hide or display captions；More enter one, if
Mouse roller event is from top to bottom, then corresponding hiding operates；If mark roller event is from bottom to up, then corresponding display operation；
If detection obtains mouse-click event, then corresponding editor's caption operation.
Preferably, captions are generated corresponding SRT subtitling format, and download interface is provided.SRT subtitling format includes,
Sequence number, time shaft, caption content.Described download interface includes but not limited to, by the locally-downloaded interface of browser.
By the captioning synchronization method in the present embodiment, in video the content in captions and lantern slide is carried out same
Step, realizes intelligent mutual with user, and provides captions download interface, go for no playing program.Further
Ground, described captioning synchronization can carry out Intelligent Matching with Tong Bu lantern slide, it is achieved video, captions, the synchronization of lantern slide three.
Fig. 3 is the simultaneously operating schematic diagram that the mouse in the further preferred embodiments in Fig. 1 monitors that event is corresponding.
In the present embodiment, also include the further of mouse event is monitored:
Step S301 monitors mouse mouse event on described video, generates segmentation plug-in unit；According to corresponding mouse thing
Part, carries out operation response, generates segmentation plug-in unit.
Split plug-in unit described in step S302 the page size of described video proportionally to be contracted with the display size of lantern slide
Put；
If step S303 drags segmentation plug-in unit to the right, then lantern slide proportionally reduces, and video proportionally expands；Point
Screen automated response, such as, it is main that user needs to watch video, consults lantern slide for auxiliary.
If step S304 drags segmentation plug-in unit to the left side, then lantern slide proportionally expands, and video proportionally reduces；Point
Screen automated response, such as, it is auxiliary that user consults lantern slide, and viewing video is auxiliary.
If step S305 drags the scope of segmentation plug-in unit beyond threshold value, then lantern slide according to picture-in-picture models show described
In video or video is to show in described lantern slide according to picture-in-picture mode after the 1/8 of former ratio scaling.If dragging segmentation
The scope of plug-in unit exceeds threshold value, refers to beyond the automated response process described in described step S303 or step S304.As
Shown in Fig. 6 (e), it is as a example by user side, lantern slide and the effect schematic diagram of video self adaptive pantographic.
In certain embodiments, described lantern slide can scale and diminish to removal.
In certain embodiments, the ratio of described video scaling is former ratio 1/8, and carries out picture-in-picture mode at lantern slide
In show.
Fig. 4 is the further operation chart in Fig. 3.
In the present embodiment, including the further snoop procedure to mouse event:
Step S400 monitors mouse event；
If there is mouse event, magic lantern corresponding on the timestamp that the most described mouse event occurs on step S401 timestamp
Sheet amplifies display, and other lantern slide gradually reduces；As shown in Fig. 6 (d), being as a example by user side, lantern slide synchronizes the effect of conversion
Really schematic diagram.
In certain embodiments, corresponding lantern slide increases the resolution of lantern slide when amplifying display.
In certain embodiments, other lantern slide reduces the resolution of lantern slide when gradually reducing
In certain embodiments, when other lantern slide gradually reduces, lantern slide is carried out Fuzzy processing or out of focus.
When step S402 occurs above-mentioned lantern slide to amplify display event, described video switches to this timestamp and starts to broadcast
Put.By the timestamp in lantern slide Switch Video, and then adjust the playing progress rate of video.
By above-mentioned operation, it is possible to realize the lantern slide control to video playback, it is achieved that and the mutual behaviour between video
Make.
Fig. 5 is the audio video synchronization playing device structural representation in one embodiment of the invention.
A kind of audio video synchronization playing device in the present embodiment, including:
Resource interface 1, edits video, uploads the lantern slide of correspondence；As shown in Fig. 6 (a), it it is the lantern slide uploading correspondence
Effect schematic diagram.
In certain embodiments, resource interface is also in order to be connected with third party's api interface, in order to obtain video.
Described third party's api interface includes but not limited to, third party's video distribution platform, net cast platform etc..
In certain embodiments, resource interface 1 includes but not limited to the mode of this locality or network upload.
In certain embodiments, resource interface 1 is in order to batch upload.
In certain embodiments, resource interface 1 supports the video lattice such as MP4, m3u8, OGA, WEBM, THEORA, FLV, F4V
Formula is play.
In certain embodiments, resource interface 1 supports that Flash plays m3u8 file, and AES-128 decoding is play.
In certain embodiments, resource interface 1 supports broadcast address AMF, AJAX, JOSNP type requests.
Lock unit 2, synchronizes described lantern slide, described synchronization include by the playable file in lantern slide according to
Timestamp in described video synchronizes；As shown in Fig. 6 (b), it it is the effect signal of the lantern slide synchronizing correspondence in video
Figure.
In certain embodiments, described lock unit 2 by the playable file in lantern slide according in described video time
Between stamp synchronize after, it is possible to carry out cross-terminal broadcasting.
In certain embodiments, terminal is suitable for PC end and plays, also adaptive iPad, iPhone, Android phone, flat board electricity
The mobile terminals such as brain.
Preferably, lock unit 2 also includes following captioning synchronization step:
Step S200 selects the time point that subtitle segment starts from video, and described video carries out scene partitioning, described field
Scape divides and includes but not limited to, carries out scene partitioning according to the broadcasting content of video, carries out scene partitioning according to the theme of video,
Carry out scene partitioning according to the key frame in video, carry out scene partitioning etc. according to the duration of video.As shown in Fig. 6 (c),
It it is the effect schematic diagram of captioning synchronization.
In certain embodiments, carry out scene partitioning according to the broadcasting content of video, due in scene target motion or
The impact of the operation (such as zoom, panning) of video camera itself, a camera lens only can not represent well with a width key frame
The content of this camera lens, often need to be with a few width key frames.
In certain embodiments, when carrying out scene partitioning according to the theme of video, use optical flow analysis algorithm.
In certain embodiments, when carrying out scene partitioning according to the key frame in video, by substantial amounts of decompression operation,
Such as Huffman decoding, DPCM decoding, DCT inverse transformation and motion compensation etc..
In certain embodiments, when carrying out scene partitioning according to the key frame in video, detect mpeg compressed video stream, in
The DC coefficient of existing discrete cosine transform and motion vector extract key frame.
Step S201 is according to scene partitioning typing captions, and preserves to different scenes, and described scene is according to set
Mode clusters, and includes but not limited to theme, content, love knot, unit etc..Preserve to different fields after captions are edited
Jing Zhong.
The captions that step S202 is synchronized in scene according to the progress of video playback, and preserve to video.
Preferably, lock unit 2 also includes, the further monitoring to mouse event:
Step S301 monitors mouse mouse event on described video, generates segmentation plug-in unit；According to corresponding mouse thing
Part, carries out operation response, generates segmentation plug-in unit.
Split plug-in unit described in step S302 the page size of described video proportionally to be contracted with the display size of lantern slide
Put；
If step S303 drags segmentation plug-in unit to the right, then lantern slide proportionally reduces, and video proportionally expands；Point
Screen automated response, such as, it is main that user needs to watch video, consults lantern slide for auxiliary.
If step S304 drags segmentation plug-in unit to the left side, then lantern slide proportionally expands, and video proportionally reduces；Point
Screen automated response, such as, it is auxiliary that user consults lantern slide, and viewing video is auxiliary.
If step S305 drags the scope of segmentation plug-in unit beyond threshold value, then lantern slide according to picture-in-picture models show described
In video or video is to show in described lantern slide according to picture-in-picture mode after the 1/8 of former ratio scaling.If dragging segmentation
The scope of plug-in unit exceeds threshold value, refers to beyond the automated response process described in described step S303 or step S304.
Preferably, lock unit 2 also includes,
Step S400 monitors mouse event；
If there is mouse event, magic lantern corresponding on the timestamp that the most described mouse event occurs on step S401 timestamp
Sheet amplifies display, and other lantern slide gradually reduces；As shown in Fig. 6 (d), being as a example by user side, lantern slide synchronizes the effect of conversion
Really schematic diagram.
In certain embodiments, corresponding lantern slide increases the resolution of lantern slide when amplifying display.
In certain embodiments, other lantern slide reduces the resolution of lantern slide when gradually reducing
In certain embodiments, when other lantern slide gradually reduces, lantern slide is carried out Fuzzy processing or out of focus.
When step S402 occurs above-mentioned lantern slide to amplify display event, described video switches to this timestamp and starts to broadcast
Put.By the timestamp in lantern slide Switch Video, and then adjust the playing progress rate of video.
In certain embodiments, described lantern slide can scale and diminish to removal.
In certain embodiments, the ratio of described video scaling is former ratio 1/8, and carries out picture-in-picture mode at lantern slide
In show.
Preview unit 4, generates slides preview on described timestamp, and described preview includes the key frame on timestamp
The lantern slide of subject name corresponding with lantern slide embeds；
In certain embodiments, preview unit 4 in order to by slides preview according to stamp on a key frame, left and right successively
Reduce.
In certain embodiments, described in preview unit 4, key frame includes but not limited to, the sectional drawing in corresponding lantern slide.
In certain embodiments, in the lamp sheet of preview unit 4, corresponding subject name refers to the title mated with video main body；
Or as subject name during every lantern slide of switching.
In certain embodiments, the described key frame of preview unit 4 includes but not limited to, according to the broadcasting content of video,
Carry out the event that redirects, handoff scenario event, important content explanation event, critical events, trigger event, non-trigger events etc..
Output unit 3, completes video and lantern slide synchronizes.
In certain embodiments, described output unit 3 completes video and lantern slide synchronizes, middle support PC end or mobile terminal
Multisystem is multi-platform.Described PC end includes but not limited to that Windows, MacOS, Linux etc., described mobile terminal include but not limited to
Android, iOS, Windows Phone etc..
In certain embodiments, output unit 3 completes video and lantern slide synchronizes, and may be used to many browser-safes, IE6/
7/8/9/10、Chrome、Firefox、Safari、Opera。
Those of ordinary skill in the field it is understood that more than, described be only the present invention specific embodiment, and
Be not used in the restriction present invention, all within the spirit and principles in the present invention, any modification, equivalent substitution and improvement etc. done, all
Within protection scope of the present invention should being included in.
Claims (10)
1. an audio video synchronization player method, it is characterised in that comprise the steps,
Editor's video, uploads the lantern slide of correspondence；
Described lantern slide is synchronized, described synchronization include by the playable file in lantern slide according in described video time
Between stab and synchronize；
Generating slides preview on described timestamp, described preview includes the key frame on timestamp corresponding with lantern slide
The lantern slide of subject name embeds；
Complete video and lantern slide synchronizes.
Audio video synchronization player method the most according to claim 1, it is characterised in that further comprise captioning synchronization,
The time point selecting subtitle segment to start from video, carries out scene partitioning by described video,
According to scene partitioning typing captions, and preserve to different scenes,
Progress according to video playback is synchronized to the captions in scene, and preserves to video.
Audio video synchronization player method the most according to claim 2, it is characterised in that according to the snoop results of mouse event,
Captions are shown, hides or editor.
Audio video synchronization player method the most according to claim 3, it is characterised in that captions are generated corresponding SRT captions
Form, and download interface is provided.
Audio video synchronization player method the most according to claim 1, it is characterised in that when completing video and lantern slide synchronization,
If completing the synchronization of a lantern slide, then on this lantern slide, generate correspondence markings；If synchronizing, then at corresponding magic lantern
Pointed out by display plug-in unit on sheet.
Audio video synchronization player method the most according to claim 1, it is characterised in that described video is by uploading local recording
Or online mode obtains.
7. according to the audio video synchronization player method described in any one of claim 1-6, it is characterised in that further comprise:
Monitor mouse mouse event on described video, generate segmentation plug-in unit；
The page size of described video is proportionally scaled by described segmentation plug-in unit with the display size of lantern slide；
If drag segmentation plug-in unit to the right, then lantern slide proportionally reduces, and video proportionally expands；
If drag segmentation plug-in unit to the left side, then lantern slide proportionally expands, and video proportionally reduces；
If the scope dragging segmentation plug-in unit exceeds threshold value, then lantern slide or regards according to picture-in-picture models show in described video
Frequency is to show in described lantern slide according to picture-in-picture mode after 1/8 scaling of former ratio.
Audio video synchronization player method the most according to claim 7, it is characterised in that further comprise:
If there is mouse event on timestamp, lantern slide corresponding on the timestamp that the most described mouse event occurs amplifies display,
Other lantern slide gradually reduces；
And when occurring above-mentioned lantern slide to amplify display event, described video switches to this timestamp and commences play out.
9. an audio video synchronization playing device, it is characterised in that including:
Resource interface, edits video, uploads the lantern slide of correspondence；
Lock unit, synchronizes described lantern slide, and described synchronization includes the playable file in lantern slide according to described
Timestamp in video synchronizes；
Preview unit, generates slides preview on described timestamp, and described preview includes the key frame on timestamp with unreal
In lamp sheet, the lantern slide of corresponding subject name embeds；
Output unit, completes video and lantern slide synchronizes.
Audio video synchronization playing device the most according to claim 9, it is characterised in that resource interface also in order to third party
Api interface connects, in order to obtain video.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610528603.8A CN106210841A (en) | 2016-07-06 | 2016-07-06 | A kind of audio video synchronization player method, device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610528603.8A CN106210841A (en) | 2016-07-06 | 2016-07-06 | A kind of audio video synchronization player method, device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106210841A true CN106210841A (en) | 2016-12-07 |
Family
ID=57464584
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610528603.8A Pending CN106210841A (en) | 2016-07-06 | 2016-07-06 | A kind of audio video synchronization player method, device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106210841A (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106534973A (en) * | 2016-12-15 | 2017-03-22 | 有米科技股份有限公司 | Mobile web platform-based automatic video image playing method |
| CN107257498A (en) * | 2017-07-06 | 2017-10-17 | 福建天泉教育科技有限公司 | A kind of live method and system |
| WO2018120821A1 (en) * | 2016-12-26 | 2018-07-05 | 北京奇虎科技有限公司 | Method and device for producing presentation |
| CN109413483A (en) * | 2018-11-29 | 2019-03-01 | 北京字节跳动网络技术有限公司 | Method for previewing, device, equipment and the medium of live content |
| CN109525901A (en) * | 2018-11-27 | 2019-03-26 | Oppo广东移动通信有限公司 | Method for processing video frequency, device, electronic equipment and computer-readable medium |
| CN109977381A (en) * | 2019-03-04 | 2019-07-05 | 安徽戴特教育科技有限公司 | A kind of h5 interactive resources access editor and broadcasting tool based on Office Addin |
| CN110830679A (en) * | 2019-11-26 | 2020-02-21 | 深圳奇迹智慧网络有限公司 | Synchronous display method for intelligent street lamp display screen, intelligent gateway and intelligent street lamp system |
| CN111263173A (en) * | 2020-01-09 | 2020-06-09 | 安徽文香信息技术有限公司 | Data resource adding method and device |
| CN113747258A (en) * | 2020-05-29 | 2021-12-03 | 华中科技大学 | Online course video abstract generation system and method |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2001065378A1 (en) * | 2000-02-28 | 2001-09-07 | Presenter.Com | On-demand presentation graphical user interface |
| US20030211447A1 (en) * | 2001-11-01 | 2003-11-13 | Telecommunications Research Associates | Computerized learning system |
| US6701014B1 (en) * | 2000-06-14 | 2004-03-02 | International Business Machines Corporation | Method and apparatus for matching slides in video |
| US20050229107A1 (en) * | 1998-09-09 | 2005-10-13 | Ricoh Company, Ltd. | Paper-based interface for multimedia information |
| US7330875B1 (en) * | 1999-06-15 | 2008-02-12 | Microsoft Corporation | System and method for recording a presentation for on-demand viewing over a computer network |
| CN103974074A (en) * | 2014-04-21 | 2014-08-06 | 西安电子科技大学宁波信息技术研究院 | Education video and lantern slide synchronization method |
-
2016
- 2016-07-06 CN CN201610528603.8A patent/CN106210841A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050229107A1 (en) * | 1998-09-09 | 2005-10-13 | Ricoh Company, Ltd. | Paper-based interface for multimedia information |
| US7330875B1 (en) * | 1999-06-15 | 2008-02-12 | Microsoft Corporation | System and method for recording a presentation for on-demand viewing over a computer network |
| WO2001065378A1 (en) * | 2000-02-28 | 2001-09-07 | Presenter.Com | On-demand presentation graphical user interface |
| US6701014B1 (en) * | 2000-06-14 | 2004-03-02 | International Business Machines Corporation | Method and apparatus for matching slides in video |
| US20030211447A1 (en) * | 2001-11-01 | 2003-11-13 | Telecommunications Research Associates | Computerized learning system |
| CN103974074A (en) * | 2014-04-21 | 2014-08-06 | 西安电子科技大学宁波信息技术研究院 | Education video and lantern slide synchronization method |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106534973B (en) * | 2016-12-15 | 2018-07-17 | 有米科技股份有限公司 | A method of video image is played automatically on web platforms based on moving |
| CN106534973A (en) * | 2016-12-15 | 2017-03-22 | 有米科技股份有限公司 | Mobile web platform-based automatic video image playing method |
| WO2018120821A1 (en) * | 2016-12-26 | 2018-07-05 | 北京奇虎科技有限公司 | Method and device for producing presentation |
| CN107257498A (en) * | 2017-07-06 | 2017-10-17 | 福建天泉教育科技有限公司 | A kind of live method and system |
| US11601630B2 (en) | 2018-11-27 | 2023-03-07 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Video processing method, electronic device, and non-transitory computer-readable medium |
| CN109525901A (en) * | 2018-11-27 | 2019-03-26 | Oppo广东移动通信有限公司 | Method for processing video frequency, device, electronic equipment and computer-readable medium |
| CN109413483A (en) * | 2018-11-29 | 2019-03-01 | 北京字节跳动网络技术有限公司 | Method for previewing, device, equipment and the medium of live content |
| CN109413483B (en) * | 2018-11-29 | 2020-01-14 | 北京字节跳动网络技术有限公司 | Live content preview method, device, equipment and medium |
| CN109977381A (en) * | 2019-03-04 | 2019-07-05 | 安徽戴特教育科技有限公司 | A kind of h5 interactive resources access editor and broadcasting tool based on Office Addin |
| CN110830679A (en) * | 2019-11-26 | 2020-02-21 | 深圳奇迹智慧网络有限公司 | Synchronous display method for intelligent street lamp display screen, intelligent gateway and intelligent street lamp system |
| CN111263173A (en) * | 2020-01-09 | 2020-06-09 | 安徽文香信息技术有限公司 | Data resource adding method and device |
| CN111263173B (en) * | 2020-01-09 | 2021-10-19 | 安徽文香信息技术有限公司 | Data resource adding method and device |
| CN113747258A (en) * | 2020-05-29 | 2021-12-03 | 华中科技大学 | Online course video abstract generation system and method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106210841A (en) | A kind of audio video synchronization player method, device | |
| US20230119262A1 (en) | System and Method of Controlling Equipment Based on Data Transferred In-Band in Video via Optically Encoded Images | |
| US9514783B2 (en) | Video editing with connected high-resolution video camera and video cloud server | |
| US10028021B2 (en) | Method and device for encoding a captured screenshot and controlling program content switching based on the captured screenshot | |
| TWI571868B (en) | Method and apparatus for sequencing content | |
| US20100169906A1 (en) | User-Annotated Video Markup | |
| KR20140004194A (en) | Method and device for view switching | |
| JP2008078997A (en) | Information processor and method, program, and recording medium | |
| JP2015170904A (en) | Image processor, image processing method and image processing system | |
| US11234026B2 (en) | Methods and apparatus for responding to inoperative commands | |
| CN105704399A (en) | Playing method and system for multi-picture television program | |
| US11671675B2 (en) | Augmentation of audio/video content with enhanced interactive content | |
| WO2022098608A1 (en) | Systems and methods for versatile video recording | |
| CN103635938B (en) | For processing the method for video streaming data, streaming client in streaming client | |
| KR20140106161A (en) | Method and apparatus for contents play | |
| US20150289032A1 (en) | Main and immersive video coordination system and method | |
| US20170289599A1 (en) | Live broadcast delaying method and apparatus | |
| US9560103B2 (en) | Custom video content | |
| KR101906396B1 (en) | Method, device and non-trnasitory computer-readable recording media for supporting relay broadcasting | |
| CN107852523B (en) | Method, terminal and equipment for synchronizing media rendering between terminals | |
| EP3136394A1 (en) | A method for selecting a language for a playback of video, corresponding apparatus and non-transitory program storage device | |
| US10893331B1 (en) | Subtitle processing for devices with limited memory | |
| KR101197225B1 (en) | Electronic program guide information inserting and extracting apparatus and method | |
| KR101827967B1 (en) | Server and Service for Providing Video Content | |
| KR101403969B1 (en) | How to recognize the point of the subtitles of the video playback time code is lost |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20161207 |
|
| RJ01 | Rejection of invention patent application after publication |