CN106162293B - A kind of method and device of video sound and image synchronization - Google Patents
A kind of method and device of video sound and image synchronization Download PDFInfo
- Publication number
- CN106162293B CN106162293B CN201510195494.8A CN201510195494A CN106162293B CN 106162293 B CN106162293 B CN 106162293B CN 201510195494 A CN201510195494 A CN 201510195494A CN 106162293 B CN106162293 B CN 106162293B
- Authority
- CN
- China
- Prior art keywords
- sound
- video
- audio
- image
- time section
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
- H04N21/4424—Monitoring of the internal components or processes of the client device, e.g. CPU or memory load, processing speed, timer, counter or percentage of the hard disk space used
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Databases & Information Systems (AREA)
- Television Signal Processing For Recording (AREA)
Abstract
The invention discloses the method and devices of a kind of video sound and image synchronization to save the working time, improve working efficiency to reduce the workload in sound and image synchronization operating process.Method includes: the sound time section divided according to the play time of currently playing sound and in advance, detects sound time section belonging to play time；Transfer with sound time section associated key frame of video in advance, and show in the sound playing process of the sound time section of audio the image of key frame of video.The program to show corresponding image automatically while sound plays, when there is the sound situation not corresponding with image in order, it can be directly adjusted on the track of audio, it goes to play the corresponding audio file of clicked image without clicking image one by one, simplify operating process, and the synchro edit process for sound and image has saved the time, improves editorial efficiency.
Description
Technical field
The present invention relates to Internet technical field, in particular to a kind of method and device of video sound and image synchronization.
Background technique
With the development of science and technology, the information data of the multimedia forms such as video is more and more abundant, and its back-end data
The workload of editor is also increasing, especially in the industries such as time-bounded very strong news, for the essence of video data editing
Parasexuality and editorial efficiency require very high.During video data editing, video sound and image synchronize be to have to locate
The problem of reason, and in prior art solutions, since the audio file in editing system is usually to open once after load
Begin to play, and the time of the image extracted in video and the time of audio not automatic aligning, therefore played automatically
When, the sound of broadcasting and the image of display are frequently not to belong to section at the same time；And when synchronizing editor, only work as volume
Volume personnel click image just and can trigger the audio in the corresponding period, need editorial staff that audio-video is divided into one section one section in this way
After being checked one by one, just can find nonsynchronous position and it is edited, operate sufficiently complex and working efficiency it is low,
Operating time is long.
Summary of the invention
The present invention provides the method and device of a kind of video sound and image synchronization, grasps to reduce sound and image synchronization
Workload during work saves the working time, improves working efficiency.
According to a first aspect of the embodiments of the present invention, the method for a kind of video sound and image synchronization is provided, comprising:
After receiving synchro edit instruction, play time of the currently playing sound in audio being played on is detected；
According to the sound time section divided in advance in the play time and the audio, detects the play time and exist
Sound time section belonging in the audio；
Transfer with the associated key frame of video in advance of the sound time section in the audio, and in the audio
The image of the key frame of video is shown in the sound playing process of the sound time section.
In one embodiment, described according to the sound time area divided in advance in the play time and the audio
Section, detect the play time in the audio belonging to sound time section before, comprising:
Key frame of video is extracted from video corresponding with the audio, and corresponding each key frame of video of storage is in institute
Image temporal section belonging to stating when being played in video；
According to each key frame of video in the video belonging to image temporal section, when by the broadcasting of the audio
Between be divided into multiple sound time sections so that multiple sound time sections and multiple described image time sections are one by one
It is corresponding；
By the sound time section for corresponding to each described image time section and correspond to each described image time section
It is stored after key frame of video association.
In one embodiment, described to transfer that associated video closes in advance with the sound time section in the audio
Key frame, and show in the sound playing process of the sound time section of the audio image of the key frame of video,
Include:
Detect the play time in the audio belonging to sound time section when, transfer in the audio
The sound time section associated key frame of video in advance；
The image of the key frame of video is shown in the display interface that the audio plays.
In one embodiment, described to transfer that associated video closes in advance with the sound time section in the audio
Key frame, and show in the sound playing process of the sound time section of the audio key frame of video image it
Afterwards, further includes:
Sound time section belonging to the currently playing sound of audio described in real-time detection whether with current display image institute
The image temporal section of category matches；
Image temporal section belonging to the sound time section belonging to currently playing sound and current display image is not
When matching, transfer with the associated key frame of video in advance of sound time section belonging to currently playing sound, and in the sound
The image of the key frame of video is shown in the display interface that frequency plays；
Image temporal section belonging to the sound time section belonging to currently playing sound and current display image
Timing continues to show current display image in the display interface that the audio plays.
In one embodiment, described to transfer that associated video closes in advance with the sound time section in the audio
Key frame, and in the sound playing process of the sound time section of the audio key frame of video described in simultaneous display figure
As after, further includes:
When currently playing sound and current display image occur asynchronous, to sound belonging to currently playing sound
The initial time or/and intermission node of time section are adjusted.
According to a second aspect of the embodiments of the present invention, the device of a kind of video sound and image synchronization is also provided, comprising:
First detection module detects currently playing sound in sound being played on after receiving synchro edit instruction
Play time in frequency；
Second detection module, for according to the sound time section divided in advance in the play time and the audio,
Detect play time sound time section affiliated in the audio；
Simultaneous display module, for transferring and the associated Video Key in advance of the sound time section in the audio
Frame, and show in the sound playing process of the sound time section of the audio image of the key frame of video.
In one embodiment, described device further include:
Key-frame extraction module, for extracting key frame of video, and corresponding storage from video corresponding with the audio
Image temporal section belonging to when each key frame of video plays in the video；
Sound time section partition module, when for according to each key frame of video image affiliated in the video
Between section, by the play time of the audio be divided into multiple sound time sections so that multiple sound time sections
It is corresponded with multiple described image time sections；
Associated storage module, for that will correspond to the sound time section of each described image time section and correspond to each institute
It is stored after stating the key frame of video association of image temporal section.
In one embodiment, the simultaneous display module includes:
Key frame transfers submodule, for the sound time area belonging to detecting the play time in the audio
Duan Shi is transferred and the associated key frame of video in advance of the sound time section in the audio；
Simultaneous display submodule, for showing the figure of the key frame of video in the display interface that the audio plays
Picture.
In one embodiment, described device further include:
Real-time detection module, whether sound time section belonging to the sound currently playing for audio described in real-time detection
It is matched with image temporal section belonging to current display image；
First display module, for belonging to the sound time section belonging to currently playing sound and current display image
Image temporal section when mismatching, transfer that associated video closes in advance with sound time section belonging to currently playing sound
Key frame, and the image of the key frame of video is shown in the display interface that the audio plays；
Second display module, for belonging to the sound time section belonging to currently playing sound and current display image
Image temporal section matching when, continue in the display interface that the audio plays show currently show image.
In one embodiment, described device further include:
Module is adjusted, for when currently playing sound and current display image occur asynchronous, to currently playing
The initial time of sound time section or/and intermission node belonging to sound are adjusted.
Technical solution provided in an embodiment of the present invention can produce it is following the utility model has the advantages that receive synchro edit instruction after, inspection
Survey play time of the currently playing sound in audio being played on；It is drawn in advance according in the play time and the audio
The sound time section divided detects play time sound time section affiliated in the audio；It transfers and the sound
The sound time section associated key frame of video, and the sound of the sound time section in the audio in advance in frequency
The image of the key frame of video is shown in sound playing process.The program is by the sound of the image of the key frame of video of extraction and broadcasting
The sound time section of frequency is associated, so that showing corresponding image automatically while sound plays, sound occurs in order
When the sound situation not corresponding with image, it can directly be adjusted on the track of audio, be gone without clicking image one by one
The corresponding audio file of clicked image is played, operating process is simplified, and is the synchro edit process saving of sound and image
Time, improve editorial efficiency.
Other features and advantages of the present invention will be illustrated in the following description, also, partly becomes from specification
It obtains it is clear that understand through the implementation of the invention.The objectives and other advantages of the invention can be by written explanation
Specifically noted structure is achieved and obtained in book, claims and attached drawing.
Below by drawings and examples, technical scheme of the present invention will be described in further detail.
Detailed description of the invention
Attached drawing is used to provide further understanding of the present invention, and constitutes part of specification, with reality of the invention
It applies example to be used to explain the present invention together, not be construed as limiting the invention.
In the accompanying drawings:
Fig. 1 is the process of the method for a kind of present invention video sound shown according to an exemplary embodiment and image synchronization
Figure；
Fig. 2 is the stream of the method for the present invention another video sound shown according to an exemplary embodiment and image synchronization
Cheng Tu；
Fig. 3 is step S30 in the method for present invention video sound shown according to an exemplary embodiment and image synchronization
Embodiment flow chart；
Fig. 4 is the stream of the method for the present invention another video sound shown according to an exemplary embodiment and image synchronization
Cheng Tu；
Fig. 5 is the stream of the method for the present invention another video sound shown according to an exemplary embodiment and image synchronization
Cheng Tu；
Fig. 6 is the frame of the device of a kind of present invention video sound shown according to an exemplary embodiment and image synchronization
Figure；
Fig. 7 is the frame of the device of the present invention another video sound shown according to an exemplary embodiment and image synchronization
Figure；
Fig. 8 is simultaneous display in present invention video sound shown according to an exemplary embodiment and the device of image synchronization
The block diagram of module 63；
Fig. 9 is the frame of the device of the present invention another video sound shown according to an exemplary embodiment and image synchronization
Figure；
Figure 10 is the device of the present invention another video sound shown according to an exemplary embodiment and image synchronization
Block diagram.
Specific embodiment
Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings, it should be understood that preferred reality described herein
Apply example only for the purpose of illustrating and explaining the present invention and is not intended to limit the present invention.
The embodiment of the present disclosure provides the method for a kind of video sound and image synchronization, for reducing sound and image synchronization
Workload in operating process saves the working time, improves working efficiency.As shown in Figure 1, the method comprising the steps of S10-S30:
In step slo, after receiving synchro edit instruction, currently playing sound is detected in audio being played on
Play time.That is, then initially receiving synchro edit instruction when audio starts loaded and starts to play, examining at this time
Survey specific play time of the currently playing sound of the audio in present video.
In step S20, according to the sound time section divided in advance in the play time and the audio, institute is detected
State play time sound time section affiliated in the audio.Detect that the audio is currently playing in step slo
After specific play time of the sound in present video, judge the play time in the audio belonging to sound when
Between section that is, the play time belongs to after which of described audio sound time section is determined can use this
Simultaneous display after sound time section is matched currently playing sound with image.Wherein the sound time section is in institute
State and divided in advance in audio, and the sound time section after dividing in advance be with belonging to the key frame of video that extracts in video
Image temporal section it is one-to-one.
In step s 30, transfer with the associated key frame of video in advance of the sound time section in the audio, and
The image of the key frame of video is shown in the sound playing process of the sound time section of the audio.Wherein, institute
It is associated in advance for stating the key frame of video extracted in the sound time section and video in audio, therefore in the audio
The sound time section sound play when, the image for showing key frame of video associated with it automatically can be set.
In one embodiment, as shown in figure 3, the step S30 can include:
Step S301, detect the play time in the audio belonging to sound time section when, transfer with
The sound time section in the audio associated key frame of video in advance；That is, when the sound in the audio
Between the key frame of video that extracts in section and video be associated in advance, therefore in the sound time section of the audio
When sound plays, the preparatory associated key frame of video is found first, and it is taken out from database, shown later
On the interface that the audio plays, in order to editorial staff check compare the sound and image whether simultaneously match.
Step S302, the image of the key frame of video is shown in the display interface that the audio plays.Described image
It is shown in same display interface with the track of the sound, and the two is preferably formed as a mutual corresponding display relationship, than
Such as, described image is shown to the either above or below of currently playing sound time section in the track of the audio, is formed
One corresponding relationship, in order to editorial staff check compare the sound and image whether simultaneously match.
In one embodiment, as shown in Fig. 2, further including step S40-S60 before the step S20 of this method:
In step s 40, key frame of video, and corresponding each view of storage are extracted from video corresponding with the audio
Image temporal section belonging to when frequency key frame plays in the video.That is, needing to carry out the synchronous view of audiovideo
Key frame of video is extracted in frequency, and each key frame of video respectively corresponds an image temporal section in the video, it will
The time section information and the key frame of video store in the database together, in order to be transferred when needed.
In step s 50, the image temporal section belonging to according to each key frame of video in the video, will be described
The play time of audio be divided into multiple sound time sections so that multiple sound time sections and multiple described images
Time section corresponds.That is, extracting key frame of video and broadcasting it in the video with each key frame of video
It, at this time will be in the corresponding sound time section of each image temporal section after the corresponding storage of image temporal section belonging to when putting
Also it marks off and one by one, after multiple sound time sections and multiple described image time sections are corresponded, as long as
The sound for playing audio, the image of the key frame of video of the affiliated sound time section of the sound will be taken out show
Show.
In step S60, by the sound time section for corresponding to each described image time section and correspond to each figure
It is stored after being associated with as the key frame of video of time section.By the described image of the time section information and the key frame of video
Time section is corresponding to be stored in the database, in order to transfer and show its corresponding image automatically when sound plays.
In one embodiment, as shown in figure 4, further including step S70-S90 after the step S30 of this method:
In step S70, sound time section belonging to the currently playing sound of audio described in real-time detection whether with work as
The matching of image temporal section belonging to preceding display image；That is, during audio plays, the sound of current sound time section
After sound finishes, since the image of the associated key frame of video of a upper sound time section is currently shown,
The image that will currently show is needed to be changed to the corresponding image of sound time section of currently playing sound in real time, it is therefore desirable to real
Shi Jinhang detect sound time section belonging to the currently playing sound of the audio whether with figure belonging to current display image
As time section matching, in order to replace the image currently shown in real time.
In step S80, figure belonging to the sound time section belonging to currently playing sound and current display image
When being mismatched as time section, transfer and the associated Video Key in advance of sound time section belonging to currently playing sound
Frame, and the image of the key frame of video is shown in the display interface that the audio plays；Belonging to currently playing sound
Sound time section and current display image belonging to image temporal section when mismatching, the image for needing currently to show is real
When be changed to the corresponding image of sound time section of currently playing sound, therefore, it is necessary to cancel the display of present image, and incite somebody to action
Image corresponding with the sound time section of currently playing sound takes out carry out real-time display.
In step S90, figure belonging to the sound time section belonging to currently playing sound and current display image
When as time section matching, continue to show current display image in the display interface that the audio plays.And currently playing
Sound belonging to sound time section when being matched with image temporal section belonging to current display image, when illustrating current sound
Between section sound broadcasting not yet finish, continue play and show present image.
In one embodiment, as shown in figure 5, further including step S100 after the step S30 of this method:
In the step s 100, when currently playing sound and current display image occur asynchronous, to currently playing
The initial time of sound time section or/and intermission node belonging to sound are adjusted.
That is, when editorial staff has found that currently playing sound and current display image occur asynchronous, for example, currently
The sound of broadcasting be not shown in image speech personage speech or its speech not with speech personage the shape of the mouth as one speaks it is same
Step, at this time, it may be necessary to adjust the initial time or/and intermission node of the current sound time section of the audio, Ye Ji
Above-mentioned timing node is adjusted on the track currently shown, sound and image synchronization matching play after adjustment, and due to only
Timing node is adjusted, the corresponding relationship between sound and image simultaneously has not been changed, therefore is playing modification time node
When the sound time section of audio later, or understand the image of the corresponding key frame of video of simultaneous display, simultaneously
It will not influence to be adjusted subsequent synchronized relation.
The above method provided in an embodiment of the present invention detects currently playing sound just after receiving synchro edit instruction
Play time in the audio of broadcasting；According to the sound time section divided in advance in the play time and the audio,
Detect play time sound time section affiliated in the audio；It transfers and the sound time in the audio
Section associated key frame of video in advance, and institute is shown in the sound playing process of the sound time section of the audio
State the image of key frame of video.The program by the image of the key frame of video of extraction and the sound time section of the audio of broadcasting into
Row association, so that showing corresponding image automatically while sound plays, there are sound feelings not corresponding with image in order
It when condition, can be directly adjusted on the track of audio, go the clicked image of broadcasting corresponding without clicking image one by one
Audio file, simplify operating process, and the synchro edit process for sound and image has saved the time, improve editor's effect
Rate.
The method of corresponding video sound and image synchronization provided in an embodiment of the present invention, the present invention also provides video sound with
The device of image synchronization, as shown in fig. 6, the device can include:
First detection module 61 detects currently playing sound being played on after receiving synchro edit instruction
Play time in audio；
Second detection module 62, for according to the sound time area divided in advance in the play time and the audio
Section detects play time sound time section affiliated in the audio；
Simultaneous display module 63, for transferring, associated video is closed in advance with the sound time section in the audio
Key frame, and show in the sound playing process of the sound time section of the audio image of the key frame of video.
In one embodiment, as shown in fig. 7, described device further include:
Key-frame extraction module 64, for extracting key frame of video from video corresponding with the audio, and correspondence is deposited
Image temporal section belonging to storing up when each key frame of video plays in the video；
Sound time section partition module 65, for the image affiliated in the video according to each key frame of video
Time section, by the play time of the audio be divided into multiple sound time sections so that multiple sound time areas
Section is corresponded with multiple described image time sections；
Associated storage module 66, for that will correspond to the sound time section of each described image time section and correspond to each
It is stored after the key frame of video association of described image time section.
In one embodiment, as shown in figure 8, the simultaneous display module 63 includes:
Key frame transfers submodule 631, for detect the play time in the audio belonging to sound when
Between section when, transfer and the associated key frame of video in advance of the sound time section in the audio；
Simultaneous display submodule 632, for showing the key frame of video in the display interface that the audio plays
Image.
In one embodiment, as shown in figure 9, described device further include:
Real-time detection module 67, sound time section belonging to the sound currently playing for audio described in real-time detection are
It is no to be matched with image temporal section belonging to current display image；
First display module 68, for the sound time section belonging to currently playing sound and current display image institute
When the image temporal section of category mismatches, transfer and the associated video in advance of sound time section belonging to currently playing sound
Key frame, and the image of the key frame of video is shown in the display interface that the audio plays；
Second display module 69, for the sound time section belonging to currently playing sound and current display image institute
When the image temporal section matching of category, continue to show current display image in the display interface that the audio plays.
In one embodiment, as shown in Figure 10, described device further include:
Module 70 is adjusted, for when currently playing sound and current display image occur asynchronous, to currently playing
Sound belonging to sound time section initial time or/and intermission node be adjusted.
It should be understood by those skilled in the art that, the embodiment of the present invention can provide as method, system or computer program
Product.Therefore, complete hardware embodiment, complete software embodiment or reality combining software and hardware aspects can be used in the present invention
Apply the form of example.Moreover, it wherein includes the computer of computer usable program code that the present invention, which can be used in one or more,
The shape for the computer program product implemented in usable storage medium (including but not limited to magnetic disk storage and optical memory etc.)
Formula.
The present invention be referring to according to the method for the embodiment of the present invention, the process of equipment (system) and computer program product
Figure and/or block diagram describe.It should be understood that every one stream in flowchart and/or the block diagram can be realized by computer program instructions
The combination of process and/or box in journey and/or box and flowchart and/or the block diagram.It can provide these computer programs
Instruct the processor of general purpose computer, special purpose computer, Embedded Processor or other programmable data processing devices to produce
A raw machine, so that being generated by the instruction that computer or the processor of other programmable data processing devices execute for real
The device for the function of being specified in present one or more flows of the flowchart and/or one or more blocks of the block diagram.
These computer program instructions, which may also be stored in, is able to guide computer or other programmable data processing devices with spy
Determine in the computer-readable memory that mode works, so that it includes referring to that instruction stored in the computer readable memory, which generates,
Enable the manufacture of device, the command device realize in one box of one or more flows of the flowchart and/or block diagram or
The function of being specified in multiple boxes.
These computer program instructions also can be loaded onto a computer or other programmable data processing device, so that counting
Series of operation steps are executed on calculation machine or other programmable devices to generate computer implemented processing, thus in computer or
The instruction executed on other programmable devices is provided for realizing in one or more flows of the flowchart and/or block diagram one
The step of function of being specified in a box or multiple boxes.
Obviously, various changes and modifications can be made to the invention without departing from essence of the invention by those skilled in the art
Mind and range.In this way, if these modifications and changes of the present invention belongs to the range of the claims in the present invention and its equivalent technologies
Within, then the present invention is also intended to include these modifications and variations.
Claims (6)
1. a kind of method of video sound and image synchronization characterized by comprising
After receiving synchro edit instruction, play time of the currently playing sound in audio being played on is detected；
According to the sound time section divided in advance in the play time and the audio, the play time is detected described
Sound time section belonging in audio；
Transfer with the associated key frame of video in advance of the sound time section in the audio, and described in the audio
The image of the key frame of video is shown in the sound playing process of sound time section；
When currently playing sound and current display image occur asynchronous, to sound time belonging to currently playing sound
The initial time or/and intermission node of section are adjusted.
2. the method as described in claim 1, which is characterized in that described to be drawn in advance according in the play time and the audio
Point sound time section, detect the play time in the audio belonging to sound time section before, comprising:
Key frame of video is extracted from video corresponding with the audio, and corresponding each key frame of video of storage is in the view
Image temporal section belonging to when being played in frequency；
According to each key frame of video image temporal section affiliated in the video, the play time of the audio is drawn
It is divided into multiple sound time sections, so that multiple sound time sections and multiple described image time sections correspond；
By the sound time section for corresponding to each described image time section and the video for corresponding to each described image time section
It is stored after key frame association.
3. method according to claim 2, which is characterized in that described to transfer and the sound time section in the audio
Preparatory associated key frame of video, and the view is shown in the sound playing process of the sound time section of the audio
The image of frequency key frame, comprising:
Detect the play time in the audio belonging to sound time section when, transfer and the institute in the audio
State sound time section associated key frame of video in advance；
The image of the key frame of video is shown in the display interface that the audio plays.
4. a kind of device of video sound and image synchronization characterized by comprising
First detection module detects currently playing sound in audio being played on after receiving synchro edit instruction
Play time；
Second detection module, for according to the sound time section divided in advance in the play time and the audio, detection
Play time sound time section affiliated in the audio；
Simultaneous display module, for transfer with the associated key frame of video in advance of the sound time section in the audio,
And the image of the key frame of video is shown in the sound playing process of the sound time section of the audio；
Module is adjusted, for when currently playing sound and current display image occur asynchronous, to currently playing sound
The initial time or/and intermission node of affiliated sound time section are adjusted.
5. device as claimed in claim 4, which is characterized in that described device further include:
Key-frame extraction module, for extracting key frame of video, and corresponding each institute of storage from video corresponding with the audio
Image temporal section belonging to stating when key frame of video plays in the video；
Sound time section partition module, for the image temporal area affiliated in the video according to each key frame of video
Section, the play time of the audio is divided into multiple sound time sections so that multiple sound time sections with it is multiple
Described image time section corresponds；
Associated storage module, for that will correspond to the sound time section of each described image time section and correspond to each figure
It is stored after being associated with as the key frame of video of time section.
6. device as claimed in claim 5, which is characterized in that the simultaneous display module includes:
Key frame transfers submodule, for the sound time section belonging to detecting the play time in the audio
When, it transfers and the associated key frame of video in advance of the sound time section in the audio；
Simultaneous display submodule, for showing the image of the key frame of video in the display interface that the audio plays.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510195494.8A CN106162293B (en) | 2015-04-22 | 2015-04-22 | A kind of method and device of video sound and image synchronization |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510195494.8A CN106162293B (en) | 2015-04-22 | 2015-04-22 | A kind of method and device of video sound and image synchronization |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106162293A CN106162293A (en) | 2016-11-23 |
| CN106162293B true CN106162293B (en) | 2019-11-08 |
Family
ID=57346946
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510195494.8A Expired - Fee Related CN106162293B (en) | 2015-04-22 | 2015-04-22 | A kind of method and device of video sound and image synchronization |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106162293B (en) |
Families Citing this family (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107895581A (en) * | 2017-11-16 | 2018-04-10 | 福建弧聚网络科技有限公司 | The method and device that a kind of image is combined with audio |
| CN108616768B (en) * | 2018-05-02 | 2021-10-15 | 腾讯科技（上海）有限公司 | Synchronous playing method and device of multimedia resources, storage position and electronic device |
| CN109862384A (en) * | 2019-03-13 | 2019-06-07 | 北京河马能量体育科技有限公司 | A kind of audio-video automatic synchronous method and synchronization system |
| CN110035326A (en) * | 2019-04-04 | 2019-07-19 | 北京字节跳动网络技术有限公司 | Subtitle generation, the video retrieval method based on subtitle, device and electronic equipment |
| CN112653916B (en) * | 2019-10-10 | 2023-08-29 | 腾讯科技（深圳）有限公司 | Method and equipment for synchronously optimizing audio and video |
| CN111953921B (en) * | 2020-08-14 | 2022-03-11 | 杭州视洞科技有限公司 | Display and interaction method for rounded lane |
| CN112990173B (en) * | 2021-02-04 | 2023-10-27 | 上海哔哩哔哩科技有限公司 | Reading processing method, device and system |
| CN113225596B (en) * | 2021-04-28 | 2022-11-01 | 百度在线网络技术（北京）有限公司 | Video processing method and device, electronic equipment and storage medium |
| CN113316012B (en) * | 2021-05-26 | 2022-03-11 | 深圳市沃特沃德信息有限公司 | Audio and video frame synchronization method and device based on ink screen equipment and computer equipment |
| CN113435294B (en) * | 2021-06-23 | 2023-05-23 | 中国矿业大学(北京) | Coal-rock interface positioning and identifying method based on image and sound fusion |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103546662A (en) * | 2013-09-23 | 2014-01-29 | 浙江工业大学 | Audio and video synchronizing method in network monitoring system |
| CN103686337A (en) * | 2013-12-30 | 2014-03-26 | 深圳Tcl新技术有限公司 | Transmitting method and system of video image data |
| CN104104987A (en) * | 2014-07-29 | 2014-10-15 | 小米科技有限责任公司 | Method and device for synchronizing picture and sound in video playing |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2008311831A (en) * | 2007-06-13 | 2008-12-25 | Panasonic Corp | Moving image communication equipment, moving image communication system, and semiconductor integrated circuit for moving image communication |
| US8736700B2 (en) * | 2010-09-30 | 2014-05-27 | Apple Inc. | Techniques for synchronizing audio and video data in an image signal processing system |
-
2015
- 2015-04-22 CN CN201510195494.8A patent/CN106162293B/en not_active Expired - Fee Related
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103546662A (en) * | 2013-09-23 | 2014-01-29 | 浙江工业大学 | Audio and video synchronizing method in network monitoring system |
| CN103686337A (en) * | 2013-12-30 | 2014-03-26 | 深圳Tcl新技术有限公司 | Transmitting method and system of video image data |
| CN104104987A (en) * | 2014-07-29 | 2014-10-15 | 小米科技有限责任公司 | Method and device for synchronizing picture and sound in video playing |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106162293A (en) | 2016-11-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106162293B (en) | A kind of method and device of video sound and image synchronization | |
| US8810728B2 (en) | Method and apparatus for synchronizing audio and video streams | |
| US8223269B2 (en) | Closed caption production device, method and program for synthesizing video, sound and text | |
| CN107277594B (en) | Method and device for synchronizing video and audio with bullet screen | |
| US9794451B2 (en) | Cloud server, control equipment and method for audio and video synchronization | |
| Petkovic et al. | Multi-modal extraction of highlights from TV formula 1 programs | |
| CN106792145A (en) | A kind of method and apparatus of the automatic overlapping text of audio frequency and video | |
| CN106131669B (en) | A kind of method and device merging video | |
| CN105898500A (en) | Network video play method and device | |
| CN103208298A (en) | Video shooting method and system | |
| CN102075803B (en) | Method for synchronously playing video and audio | |
| CN111954064B (en) | Audio and video synchronization method and device | |
| CN205961300U (en) | Intelligent interactive flat plate | |
| KR20180133893A (en) | Media environment-oriented content distribution platform | |
| CN103873804B (en) | Video replay time axis and content synchronous control method for embedded NVR | |
| CN105721796A (en) | Device and method for automatically generating video captions | |
| US20200374422A1 (en) | System and method of synchronizing video and audio clips with audio data | |
| CN106162323A (en) | A kind of video data handling procedure and device | |
| US20140047309A1 (en) | Apparatus and method for synchronizing content with data | |
| CN104185032B (en) | A kind of video frequency identifying method and system | |
| CA2972051C (en) | Use of program-schedule text and closed-captioning text to facilitate selection of a portion of a media-program recording | |
| CN108966027A (en) | A kind of audio video synchronization back method and device | |
| US8145031B2 (en) | Recording apparatus | |
| CN112218142A (en) | Method and device for separating voice from video with subtitles, storage medium and electronic equipment | |
| CN102857747B (en) | Method and device for local recoding |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right |
Denomination of invention: A method and device for video sound and image synchronization Effective date of registration: 20210104 Granted publication date: 20191108 Pledgee: Inner Mongolia Huipu Energy Co.,Ltd. Pledgor: WUXI TVMINING MEDIA SCIENCE & TECHNOLOGY Co.,Ltd. Registration number: Y2020990001517 |
|
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20191108 Termination date: 20210422 |