CN105828100A - Audio and video files simultaneous playing method, device and system - Google Patents

Audio and video files simultaneous playing method, device and system Download PDF

Info

Publication number
CN105828100A
CN105828100A CN201610162806.XA CN201610162806A CN105828100A CN 105828100 A CN105828100 A CN 105828100A CN 201610162806 A CN201610162806 A CN 201610162806A CN 105828100 A CN105828100 A CN 105828100A
Authority
CN
China
Prior art keywords
audio file
speech data
timestamp
file
video file
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201610162806.XA
Other languages
Chinese (zh)
Inventor
王若韬
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
LeTV Information Technology Beijing Co Ltd
Original Assignee
LeTV Information Technology Beijing Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by LeTV Information Technology Beijing Co Ltd filed Critical LeTV Information Technology Beijing Co Ltd
Priority to CN201610162806.XA priority Critical patent/CN105828100A/en
Publication of CN105828100A publication Critical patent/CN105828100A/en
Pending legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/233—Processing of audio elementary streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/237—Communication with additional data server

Abstract

The present invention discloses an audio and video files simultaneous playing method, device and system. The method comprises the steps of synchronously obtaining the voice data inputted by a user during a video file playing process, taking the point-in-time of a video file corresponding to the input beginning time as a timestamp, and together saving the timestamp and the voice data as an audio file; sending the audio file to a network server; when the video file is played again, obtaining the audio file from the network server; when the video file is played to the point-in-time identified by the timestamp, playing the voice data while playing the video file continuously. According to the audio and video files simultaneous playing method, device and system provided by the present invention, the voice data synchronously recorded when the user watches the video file is obtained as the audio file, so that when playing the video file again, a subsequent user can listen to the voice comment content of the previous user, and the network video playing functions are enriched.

Description

The methods, devices and systems that a kind of audio-video document is play simultaneously
Technical field
The present invention relates to multimedia control field, particularly relate to the methods, devices and systems that a kind of audio-video document is play simultaneously.
Background technology
Along with the most progressive of video display arts and the continuous lifting of people's social activity hope, Internet video is no longer limited to the medium of propagation information, gradually develops into people and expresses viewpoint, expresses the bridge of emotion；And the important tool promoting this transformation to complete is exactly video barrage system.Existing barrage system, text reviews user inputted carries out record according to the reproduction time of video file during input, and when this video file is played again, it is illustrated on the video playback page with the form of roll titles, these comments are the most humorous, other users, after viewing video content, browse the barrage that other users issue, more add enjoyment.
Existing barrage technology is only applied to the synchronization of text reviews and plays, then cannot carry out Tong Bu broadcasting for voice remark with video, if i.e. user wants to listen certain section of voice remark, can only realize by suspending the video instantly play, operating cumbersome, user experience is the highest.
Summary of the invention
In view of this, the purpose of the embodiment of the present invention is to propose the methods, devices and systems that a kind of audio-video document is play simultaneously, can be applicable in the terminals such as mobile phone, panel computer, computer, TV, onboard system.
The method that a kind of audio-video document based on above-mentioned purpose present invention offer is play simultaneously, is applied to terminal, including:
During playing video file, synchronize to obtain the speech data of user's input, the time point of described video file corresponding for the initial time inputting described speech data is saved as audio file as timestamp together with described speech data；
Described audio file is sent to the webserver；
Receive the playing request of described video file, synchronize to obtain described audio file from the webserver；
When described video file plays the time point to described timestamp mark, while continuing to play described video file, play described speech data.
Optionally, described when the time point that the broadcasting of described video file identifies to described timestamp, while the continuation described video file of broadcasting, play described speech data, including:
Extract the timestamp in described audio file；
Described timestamp is added as the labelling playing speech data the reproduction time axle of described video file；
When the playing progress rate of video file reaches described timestamp, play the speech data in audio file belonging to this timestamp.
Optionally, described when the time point that the broadcasting of described video file identifies to described timestamp, while the continuation described video file of broadcasting, play described speech data, including:
Extract the timestamp in described audio file；
According to timestamp order from front to back, described audio file is ranked up；
According to the order of audio file after sequence, judge whether the playing progress rate of video file reaches the time point of the timestamp labelling of described audio file successively；If reaching, play the speech data in audio file belonging to described timestamp.
Optionally, described audio file also includes the user name of founder, the playing request of the described video file of described reception, synchronizes to obtain described audio file from the webserver, including:
Described playing request comprises the user name of some audio file founder；
The audio file created by the user that described user name is corresponding is obtained from server.
Optionally, described when again playing described video file, after the webserver obtains described audio file, including:
Timestamp according to described audio file and the length of speech data, search the sound clip that described speech data is corresponding in the track of described video file；
According to the acoustic situations of described sound clip, described speech data is adjusted.
Optionally, the described acoustic situations according to described sound clip, described speech data is adjusted, including:
Calculate average volume and the average volume of described speech data of described sound clip；
Judge that whether the difference of the average volume of described sound clip and the average volume of described speech data is more than the adjustment threshold value preset；If so, the volume of described audio file is adjusted, until described difference is less than or equal to described adjustment threshold value.
Optionally, described video file presets the important plot time period；Described when again playing described video file, after the webserver obtains described audio file, including:
Timestamp according to described audio file and the length of speech data, it is judged that whether described speech data was in the described important plot time period；If so, change the timestamp of described audio file, make described speech data be in outside the described important plot time period.
Optionally, the described timestamp according to described audio file and the length of speech data, it is judged that whether described speech data was in the described important plot time period, including:
Obtain initial time A of described speech datasWith termination time Ae；
Obtain initial time B of described important plot time periodsWith termination time Be；
Judge whether to meet: AsIt is in interval (Bs, Be), or AeIt is in interval (Bs, Be), or AsLess than or equal to BsAnd AeMore than or equal to Be；If so, judge that described speech data was in the described important plot time period；
The timestamp of the described audio file of described change, makes described speech data be in outside the described important plot time period, including:
Judge (Ae+AsThe result of)/2 and (Be+BsThe magnitude relationship of the result of)/2；
If (Ae+AsThe result of)/2 is less than or equal to (Be+BsThe result of)/2, move forward A by described timestampe-Bs；
If (Ae+AsThe result of)/2 is more than or equal to (Be+BsThe result of)/2, will move B after described timestampe-As。
Optionally, described when described video file play to described timestamp mark time point time, play described audio file, including:
Obtain volume and adjust instruction, adjust instruction according to described volume and the volume of described voice data is adjusted.
The present invention also provides for the device that a kind of audio-video document is play simultaneously, including:
Audio file acquiring unit, for during playing video file, synchronizes to obtain the speech data of user's input, and together with described speech data, corresponding for the input initial time time point at described video file is saved as audio file as timestamp；
First network unit, for sending described audio file to the webserver；When being additionally operable to need to play described audio file with described video file, obtain described audio file from the webserver simultaneously；
Audio file broadcast unit, when the time point play to described timestamp mark when described video file, plays described speech data while continuing to play described video file.
Optionally, described audio file broadcast unit is for extracting the timestamp in described audio file；Described timestamp is added as the labelling playing speech data the reproduction time axle of described video file；When the playing progress rate of video file reaches described timestamp, play the speech data in audio file belonging to this timestamp.
Optionally, described audio file broadcast unit is for extracting the timestamp in described audio file；According to timestamp order from front to back, described audio file is ranked up；According to the order of audio file after sequence, judge whether the playing progress rate of video file reaches the time point of the timestamp labelling of described audio file successively；If reaching, play the speech data in audio file belonging to described timestamp.
Optionally, described first network unit obtains request for sending the audio file comprising user name to the webserver；Receive what the webserver returned, the user that these user names are corresponding the audio file created.
Optionally, described terminal also includes:
First volume processing unit, for the timestamp according to described audio file and the length of speech data, searches the sound clip that described speech data is corresponding in the track of described video file；It is additionally operable to the acoustic situations according to described sound clip, described speech data is adjusted.
Optionally, described first volume processing unit is additionally operable to calculate the average volume of described sound clip and the average volume of described speech data；Judge that whether the difference of the average volume of described sound clip and the average volume of described speech data is more than the adjustment threshold value preset；If so, the volume of described audio file is adjusted, until described difference is less than or equal to described adjustment threshold value.
Optionally, described video file presets the important plot time period；Terminal also includes:
First important plot processing unit, for the timestamp according to described audio file and the length of speech data, it is judged that whether described speech data was in the described important plot time period；If so, change the timestamp of described audio file, make described speech data be in outside the described important plot time period.
Optionally, described first important plot processing unit is for obtaining initial time A of described speech datasWith termination time Ae；Obtain initial time B of described important plot time periodsWith termination time Be；Judge whether to meet: AsIt is in interval (Bs, Be), or AeIt is in interval (Bs, Be), or AsLess than or equal to BsAnd AeMore than or equal to Be；If so, judge that described speech data was in the described important plot time period；
Described first important plot processing unit is additionally operable to judge (Ae+AsThe result of)/2 and (Be+BsThe magnitude relationship of the result of)/2；If (Ae+AsThe result of)/2 is less than or equal to (Be+BsThe result of)/2, move forward A by described timestampe-Bs；If (Ae+AsThe result of)/2 is more than (Be+BsThe result of)/2, will move B after described timestampe-As。
Optionally, described terminal also includes:
Volume adjustment unit, is used for obtaining volume and adjusts instruction, adjust instruction according to described volume and be adjusted the volume of described voice data.
The present invention also provides for a kind of method that audio-video document is play simultaneously, is applied to the webserver, including:
Receive the audio file sent by terminal；Described audio file includes that user synchronizes the speech data of input and input initial time timestamp of corresponding time point in the video file that terminal is being play of described speech data during playing video file；
Set up described audio file and the association of described video file；
When described video file is played again, search the described audio file associated with described video file, described audio file is sent to the user playing described video file.
Optionally, described video file is preset with linked list at the webserver；The described association setting up described audio file and described video file, including:
The title of described audio file is added to the linked list of described video file.
Optionally, described audio file also includes the user name of founder, and the audio frequency title in described linked list is grouped according to described user name；The described audio frequency title by described audio file is added to described linked list, including:
The user name of described audio file founder is searched in described linked list；
If finding described user name, the title of described audio file is added to the packet of described user name；If not finding, setting up the new packet of described user name, the title of described audio file is added to described new packet；
When described video file is played again, search the audio file that associates with video file, transmission to playing the user of described video file, including:
Obtain the audio file the comprising user name acquisition request that terminal sends；
Searching described user name in the linked list of described video file, the audio file in described user name correspondence being grouped sends to described terminal.
Optionally, after the described association setting up described audio file and described video file, including:
Timestamp according to described audio file and the length of speech data, search the sound clip that described speech data is corresponding in the track of described video file；
According to the acoustic situations of described sound clip, described speech data is adjusted.
Optionally, the described acoustic situations according to described sound clip, described speech data is adjusted, including:
Calculate average volume and the average volume of described speech data of described sound clip；
Judge that whether the difference of the average volume of described sound clip and the average volume of described speech data is more than the adjustment threshold value preset；The most then the volume of described audio file is adjusted, until described difference is less than or equal to described adjustment threshold value.
Optionally, described video file presets the important plot time period；Described set up described audio file and after the association of video file that described terminal is currently played, including:
Timestamp according to described audio file and the length of speech data, it is judged that whether described speech data was in the described important plot time period；If so, change the timestamp of described audio file, make described speech data be in outside the described important plot time period.
Optionally, the described timestamp according to described audio file and the length of speech data, it is judged that whether described speech data was in the described important plot time period, including:
Obtain initial time A of described speech datasWith termination time Ae；
Obtain initial time B of described important plot time periodsWith termination time Be；
Judge whether to meet: AsIt is in interval (Bs, Be), or AeIt is in interval (Bs, Be), or AsLess than or equal to BsAnd AeMore than or equal to Be；If so, judge that described speech data was in the described important plot time period；
The timestamp of the described audio file of described change, makes described speech data be in outside the described important plot time period, including:
Judge (Ae+AsThe result of)/2 and (Be+BsThe magnitude relationship of the result of)/2；
If (Ae+AsThe result of)/2 is less than or equal to (Be+BsThe result of)/2, move forward A by described timestampe-Bs；
If (Ae+AsThe result of)/2 is more than (Be+BsThe result of)/2, will move B after described timestampe-As。
The present invention also provides for the device that a kind of audio-video document is play simultaneously, including:
Second NE, for receiving the audio file sent by terminal；Described audio file includes that user synchronizes the speech data of input and input initial time timestamp of corresponding time point in the video file that terminal is being play of described speech data during playing video file；
Associative cell, for setting up described audio file and the association of described video file；Being additionally operable to described video file when being again played, search described audio file associate with this video file, the described audio file transmission that described second NE is used for finding is to the user playing described video file.
Optionally, described video file is preset with linked list at the webserver；Described associative cell is for adding the title of described audio file to the linked list of described video file.
Optionally, described audio file also includes the user name of founder, and the audio frequency title in described linked list is grouped according to described user name；Described associative cell is additionally operable to search the user name of described audio file founder in described linked list；If finding described user name, the title of described audio file is added to the packet of described user name；If not finding, setting up the new packet of described user name, the audio frequency title of described audio file is added to described new packet；
The audio file comprising user name that described second NE sends for obtaining terminal obtains request；Described associative cell is for searching described user name in the linked list of described video file, and described second NE audio file in described user name correspondence being grouped sends to described terminal.
Optionally, also include:
Second volume processing unit, for the timestamp according to described audio file and the length of speech data, searches the sound clip that described speech data is corresponding in the track of described video file；It is additionally operable to the acoustic situations according to described sound clip, described speech data is adjusted.
Optionally, described second volume processing unit is for calculating average volume and the average volume of described speech data of described sound clip；Judge that whether the difference of the average volume of described sound clip and the average volume of described speech data is more than the adjustment threshold value preset；The most then the volume of described audio file is adjusted, until described difference is less than or equal to described adjustment threshold value.
Optionally, described video file presets the important plot time period；The webserver also includes:
Second important plot processing unit, for the timestamp according to described audio file and the length of speech data, it is judged that whether described speech data was in the described important plot time period；If so, change the timestamp of described audio file, make described speech data be in outside the described important plot time period.
Optionally, described second important plot processing unit is for obtaining initial time A of described speech datasWith termination time Ae；Obtain initial time B of described important plot time periodsWith termination time Be；Judge whether to meet: AsIt is in interval (Bs, Be), or AeIt is in interval (Bs, Be), or AsLess than or equal to BsAnd AeMore than or equal to Be；If so, judge that described speech data was in the described important plot time period；
Described second important plot processing unit is additionally operable to judge (Ae+AsThe result of)/2 and (Be+BsThe magnitude relationship of the result of)/2；If (Ae+AsThe result of)/2 is less than or equal to (Be+BsThe result of)/2, move forward A by described timestampe-Bs；If (Ae+AsThe result of)/2 is more than (Be+BsThe result of)/2, will move B after described timestampe-As。
The present invention also provides for the system that a kind of audio-video document is play simultaneously, including the webserver described in any one in the terminal described in any one in above-described embodiment and above-described embodiment.
As can be seen from above, the present invention provide a kind of audio-video document play simultaneously method, device, system, by obtain user watch video file time synchronous recording speech data as audio file, when making subsequent user again play this video file can uppick simultaneously in the voice remark content of front user, enrich the function that Internet video is play.
Accompanying drawing explanation
The schematic flow sheet of one embodiment of the method that Fig. 1 plays for a kind of audio-video document that the present invention provides simultaneously；
The schematic flow sheet of the alternative embodiment of the method that Fig. 2 plays for a kind of audio-video document that the present invention provides simultaneously；
The schematic flow sheet of the alternative embodiment of the method that Fig. 3 plays for a kind of audio-video document that the present invention provides simultaneously；
The schematic flow sheet of the alternative embodiment of the method that Fig. 4 plays for a kind of audio-video document that the present invention provides simultaneously；
The schematic flow sheet of the alternative embodiment of the method that Fig. 5 plays for a kind of audio-video document that the present invention provides simultaneously；
The schematic flow sheet of the alternative embodiment of the method that Fig. 6 plays for a kind of audio-video document that the present invention provides simultaneously；
The schematic flow sheet of the alternative embodiment of the method that Fig. 7 plays for a kind of audio-video document that the present invention provides simultaneously；
The block diagram of the embodiment of the device that Fig. 8 plays for a kind of audio-video document that the present invention provides simultaneously；
The schematic flow sheet of another embodiment of the method that Fig. 9 plays for a kind of audio-video document that the present invention provides simultaneously；
The schematic flow sheet of the alternative embodiment of the method that Figure 10 plays for a kind of audio-video document that the present invention provides simultaneously；
The schematic flow sheet of the alternative embodiment of the method that Figure 11 plays for a kind of audio-video document that the present invention provides simultaneously；
The block diagram of another embodiment of the device that Figure 12 plays for a kind of audio-video document that the present invention provides simultaneously.
Detailed description of the invention
For making the purpose of the embodiment of the present invention, technical scheme and advantage clearer, below in conjunction with specific embodiment, and referring to the drawings, the present invention is described in more detail.
The schematic flow sheet of one embodiment of the method that Fig. 1 plays for a kind of audio-video document that the present invention provides simultaneously.As it can be seen, the embodiment being applied to terminal of method that the audio-video document that the present invention provides is play simultaneously, including:
S10, during playing video file, synchronizes to obtain the speech data of user's input, and together with described speech data, corresponding for the input initial time time point at described video file is saved as audio file as timestamp.
Above-mentioned " synchronizing to obtain " refers to, user is when playing video file, instant recording inputs speech data, such as, when user watches film after a certain plot of making laughs, it is desirable to deliver some comments, then (concrete triggering method can determine the most separately can to trigger recording process, dedicated trigger case is such as set, or in video playback page input certain gestures etc.；Recording process is similar to existing voice data recording process, repeats no more), record one section of speech data comprising voice remark.
S11, sends described audio file to the webserver.
Described transmission process can perform after single audio frequency documenting completes during user continues playing video file, it is also possible to all audio frequency file consolidation recorded during user plays after video file finishes this video file is uploaded；The former possesses preferably real-time, and unnecessary bandwidth resources can be utilized, do not interfere with user and play other video files, the latter is then the user's design being insufficient for downlink video transmission and voice uplink for the network bandwidth, after playing a video file, after needing to wait all audio frequency files passe that user records during playing this video file, just can obtain enough network bandwidths and play next video file.Above two specific embodiment comprehensively can use according to the definition (code check etc.) of the network bandwidth of user's reality and institute's playing video file.
S12, receives the playing request of described video file, synchronizes to obtain described audio file from the webserver.
S13, when described video file plays the time point to described timestamp mark, plays described speech data while continuing to play described video file.
The present embodiment achieves user and preserves voice remark in real time during viewing video file, and when this video file is played again, the user of viewing can listen to the voice remark recorded front user.Sound is joined in video file broadcasting as a kind of new comment carrier.
The schematic flow sheet of the alternative embodiment of the method that Fig. 2 plays for a kind of audio-video document that the present invention provides simultaneously.As it can be seen, in an alternate embodiment of the invention, step S13, when described video file plays the time point to described timestamp mark, while continuing to play described video file, play described speech data, including:
S20, extracts the timestamp in described audio file.
S21, adds the reproduction time axle of described video file using described timestamp as the labelling playing speech data.In alternative embodiments, described audio file has multiple, after the timestamp of an audio file keys in the reproduction time axle of video file, the time shaft at video playback interface is labeled by visible labelling, user by visible labelling it can be seen that video playback is to playing speech data during where.
S22, when the playing progress rate of video file reaches described timestamp, plays the speech data in audio file belonging to this timestamp.
This gives the concrete player method of a kind of speech data, when video file plays beginning (or before starting, during i.e. video file carries out pre-cache or plays advertisement), the speech data play will be needed to arrange on the reproduction time axle of video file in advance, when video file is play to these timestamps, call corresponding speech data and perform to play.
The schematic flow sheet of the alternative embodiment of the method that Fig. 3 plays for a kind of audio-video document that the present invention provides simultaneously.As it can be seen, in another optional embodiment, step S13, when described video file plays the time point to described timestamp mark, while continuing to play described video file, play described speech data, including:
S30, extracts the timestamp in described audio file.
S31, is ranked up described audio file according to timestamp order from front to back.
S32, according to the order of audio file after sequence, judges whether the playing progress rate of video file reaches the time point of the timestamp labelling of described audio file successively；If reaching, play the speech data in audio file belonging to described timestamp.
The present embodiment is different from an embodiment, the most in advance timestamp is added in the time shaft of video file, but by audio file is sorted in advance, and by the currently playing progress of video file the most successively with sequence after audio file timestamp contrast, as long as reaching the timestamp of a certain audio file, then play this audio file, and continue to contrast with next audio file.Such method judges and sequence owing to needing extra resource to perform, in promptness slightly not as good as on the scheme of an embodiment, if but during video playback, download to new audio file, then after the reduced time stabs, new audio file can be inserted directly in audio file sequence, the most flexible compared with previous embodiment.
S12 in an alternate embodiment of the invention, receives the playing request of described video file, synchronizes to obtain described audio file from the webserver, including:
Described playing request comprises the user name of some audio file founder.
S40, sends the audio file comprising user name and obtains request to the webserver.
S41, receives what the webserver returned, the user that these user names are corresponding the audio file created.
Present embodiments providing a kind of method, i.e. when downloading audio file, need selected part audio file to be downloaded and play according to user, wherein, the user name chosen can be one, it is also possible to is multiple.It is different from the barrage file of text, the datarams of audio file is bigger, simultaneously because multiple users can be for same video file recording audio, therefore the quantity of audio file is the most, the network bandwidth to be taken when downloading is the biggest, and the screening therefore using some modes to carry out audio file is the most necessary.
The schematic flow sheet of the alternative embodiment of the method that Fig. 4 plays for a kind of audio-video document that the present invention provides simultaneously.As it can be seen, in one embodiment, S12, when again playing described video file, after the webserver obtains described audio file, including:
S50, according to timestamp and the length of speech data of described audio file, searches the sound clip that described speech data is corresponding in the track of described video file.
S51, according to the acoustic situations of described sound clip, is adjusted described speech data.Owing to the volume of the speech data of user's recording has randomness, cause user not hear in order to avoid speech data and its correspondence sound clip in video file mutually cover, therefore pre-adjust before playing speech data.
The schematic flow sheet of the alternative embodiment of the method that Fig. 5 plays for a kind of audio-video document that the present invention provides simultaneously.As it can be seen, in another optional embodiment, S51, according to the acoustic situations of described sound clip, described speech data is adjusted, including:
S60, calculates average volume and the average volume of described speech data of described sound clip.
S61, it is judged that whether the difference of the average volume of described sound clip and the average volume of described speech data is more than the adjustment threshold value preset；If so, step S62 is gone to, if it is not, do not change.
S62, is adjusted the volume of described speech data, until described difference is less than or equal to described adjustment threshold value.
Described adjustment threshold value determines according to the average volume of described sound clip, such as, is set to 0.1 to 0.5 times of described sound clip average volume；Optionally, adjust threshold value and be set to 0.2 times of described sound clip average volume.Every time when performing the set-up procedure of S60-S62, recalculate adjustment threshold value according to the average volume of object sound clip, reduce the gap between speech data volume and sound clip volume.
The present embodiment is using the average volume of video file sound clip as judgment basis, the volume of excessive or too small voice data is adjusted, making it near the volume of described sound clip, to avoid in the two, a certain item volume is excessive covers another, the problem that user cannot differentiate.
The schematic flow sheet of the alternative embodiment of the method that Fig. 6 plays for a kind of audio-video document that the present invention provides simultaneously.As it can be seen, in an alternate embodiment of the invention, described video file presets the important plot time period；S12, when again playing described video file, after the webserver obtains described audio file, including:
S70, according to timestamp and the length of speech data of described audio file, it is judged that whether described speech data was in the described important plot time period；If so, step S71 is gone to, if it is not, do not change.
S71, changes the timestamp of described audio file, makes described speech data be in outside the described important plot time period.
The above-mentioned important plot time period refers to some fragments that in video file, the story of a play or opera is the most excellent, and in these fragments, user wants to merely watch video, and is not intended to hear other sound, and therefore audio files should be avoided playing in these fragments simultaneously.The determination mode of described important plot time period, can by point about video file track in the special interval of volume be determined (such as using the window of one fixed width as judging region, being moved by this windowsill track, this window is the average volume of track in calculation window；When described average volume reaches default threshold value, then it is labeled as the starting point of an important plot time period, until after average volume is less than the threshold value preset, being then labeled as the terminating point of this important plot time period.), it is also possible to by manually presetting.
The schematic flow sheet of the alternative embodiment of the method that Fig. 7 plays for a kind of audio-video document that the present invention provides simultaneously.As it can be seen, in another optional embodiment, S70, according to timestamp and the length of speech data of described audio file, it is judged that whether described speech data was in the described important plot time period, including:
S80, obtains initial time A of described speech datasWith termination time Ae；Obtain initial time Bs of described important plot time period and terminate time Be.
S82, it may be judged whether meet: AsIt is in interval (Bs, Be), or AeIt is in interval (Bs, Be), or AsLess than or equal to BsAnd AeMore than or equal to Be；If so, judge that described speech data was in the described important plot time period.As long as i.e. judging partially overlapping with arbitrary important plot time period of speech data, then judge that described speech data was in the described important plot time period.
S71, changes the timestamp of described audio file, makes described speech data be in outside the described important plot time period, including:
S83, it is judged that (Ae+AsThe result of)/2 and (Be+BsThe magnitude relationship of the result of)/2.
S84, if (Ae+AsThe result of)/2 is less than or equal to (Be+BsThe result of)/2, move forward A by described timestampe-Bs。
S85, if (Ae+AsThe result of)/2 is more than (Be+BsThe result of)/2, will move B after described timestampe-As。
Step S83-S85, by judging relation before and after speech data and the important plot time period occurring to overlap, by timestamp corresponding for speech data to speech data closer to plot one side shifting, until speech data no longer overlaps with the important plot time period.
In an alternate embodiment of the invention, S13, when described video file plays the time point to described timestamp mark, while continuing to play described video file, play described speech data, including:
S90, obtains volume and adjusts instruction, adjusts instruction according to described volume and is adjusted the volume of described voice data.Described volume adjusts instruction and is directly sent by user, indicates the order that the volume to audio file is adjusted.
The function that the present embodiment is realized is, when user thinks that the volume of audio file is excessive, can manually regulate the volume of audio file so that it is suitable video file volume.In some optional embodiments, described adjust instruction according to described volume the volume of described audio file is adjusted, refer to that the volume of all audio frequency file currently loaded this video file unifies adjustment；In the optional embodiment of other, when volume video file being detected changes, to the volume of described audio file according to the change multiple of described video file volume, synchronous change.
The block diagram of the embodiment of the device that Fig. 8 plays for a kind of audio-video document that the present invention provides simultaneously.As it can be seen, another embodiment of the present invention includes the device that a kind of audio-video document is play simultaneously, including:
Audio file acquiring unit 100, for during playing video file, synchronizes to obtain the speech data of user's input, and together with described speech data, corresponding for the input initial time time point at described video file is saved as audio file as timestamp.Described audio file acquiring unit 100 includes the acquisition unit (such as mike) for directly obtaining speech samples, starts and obtain the operating portion (such as button, touch screen or other control parts) of function for gathering user operation and obtain the process portion of speech data for processing speech samples.
First network unit 101, for sending described audio file to the webserver；When being additionally operable to again play described video file, obtain described audio file from the webserver.Described first network unit 101 includes Wi-Fi module.
Audio file broadcast unit 102, when the time point play to described timestamp mark when described video file, plays described speech data while continuing to play described video file.
Described device in the present embodiment is the terminals such as the mobile phone for playing video file, panel computer, computer, TV, onboard system.
It should be noted that, in the embodiment of the present invention, the statement of all uses " first " and " second " is for the parameter of entity or the non-equal distinguishing two same names non-equal, visible " first " " second " is only for the convenience of statement, should not be construed as the restriction to the embodiment of the present invention, this is illustrated by subsequent embodiment the most one by one.
In an alternate embodiment of the invention, described audio file broadcast unit 102 is for extracting the timestamp in described audio file；Described timestamp is added as the labelling playing speech data the reproduction time axle of described video file；When the playing progress rate of video file reaches described timestamp, play the speech data in audio file belonging to this timestamp.
In an alternate embodiment of the invention, described audio file broadcast unit 102 is for extracting the timestamp in described audio file；According to timestamp order from front to back, described audio file is ranked up；According to the order of audio file after sequence, judge whether the playing progress rate of video file reaches the time point of the timestamp labelling of described audio file successively；If reaching, play the speech data in audio file belonging to described timestamp.
In an alternate embodiment of the invention, described first network unit 101 obtains request for sending the audio file comprising user name to the webserver；It is additionally operable to receive what the webserver returned, the user that these user names are corresponding the audio file created.
In an alternate embodiment of the invention, described device also includes:
First volume processing unit 103, for the timestamp according to described audio file and the length of speech data, searches the sound clip that described speech data is corresponding in the track of described video file；It is additionally operable to the acoustic situations according to described sound clip, described speech data is adjusted.
In an alternate embodiment of the invention, described first volume processing unit 103 is additionally operable to calculate the average volume of described sound clip and the average volume of described speech data；Judge that whether the difference of the average volume of described sound clip and the average volume of described speech data is more than the adjustment threshold value preset；If so, the volume of described audio file is adjusted, until described difference is less than or equal to described adjustment threshold value.
In an alternate embodiment of the invention, described video file presets the important plot time period；Described terminal also includes:
First important plot processing unit 104, for the timestamp according to described audio file and the length of speech data, it is judged that whether described speech data was in the described important plot time period；If so, change the timestamp of described audio file, make described speech data be in outside the described important plot time period.
In an alternate embodiment of the invention, described first important plot processing unit 104 is for obtaining initial time A of described speech datasWith termination time Ae；Obtain initial time B of described important plot time periodsWith termination time Be；Judge whether to meet: AsIt is in interval (Bs, Be), or AeIt is in interval (Bs, Be), or AsLess than or equal to BsAnd AeMore than or equal to Be；If so, judge that described speech data was in the described important plot time period.
Described first important plot processing unit 104 is additionally operable to judge (Ae+AsThe result of)/2 and (Be+BsThe magnitude relationship of the result of)/2；If (Ae+AsThe result of)/2 is less than or equal to (Be+BsThe result of)/2, move forward A by described timestampe-Bs；If (Ae+AsThe result of)/2 is more than (Be+BsThe result of)/2, will move Be-As after described timestamp.
In an alternate embodiment of the invention, described device also includes:
Volume adjustment unit 105, is used for obtaining volume and adjusts instruction, adjust instruction according to described volume and be adjusted the volume of described audio file.
The schematic flow sheet of another embodiment of the method that Fig. 9 plays for a kind of audio-video document that the present invention provides simultaneously.As it can be seen, the embodiment being applied to the webserver of method that the audio-video document that the present invention provides is play simultaneously, including:
S110, receives the audio file sent by terminal；Timestamp that described audio file comprises its input initial time corresponding time point in the described video file that terminal is currently played of mark and user synchronize the speech data of input during playing described video file.
S111, sets up described audio file and the association of described video file.
S112, when described video file is played again, searches the described audio file associated with this video file, sends to the user playing described video file.
The schematic flow sheet of the alternative embodiment of the method that Figure 10 plays for a kind of audio-video document that the present invention provides simultaneously.As it can be seen, in an alternate embodiment of the invention, described video file is preset with linked list at the webserver；Step S111, sets up described audio file and the association of video file that described terminal is currently played, including:
S120, adds the title of described audio file to the linked list of described video file.
It should be noted that the linked list in the present embodiment only represents a genus, i.e. can pass through this linked list, find the audio file that video file is corresponding, the concrete form for linked list is not limited；For example, it may be use form to list incidence relation, it is also possible to be the audio file of single video file and association thereof to be saved in identical file jointly press from both sides inferior.
The schematic flow sheet of the alternative embodiment of the method that Figure 11 plays for a kind of audio-video document that the present invention provides simultaneously.As it can be seen, in an alternate embodiment of the invention, described audio file also includes the user name of founder, and the audio frequency title in described linked list is grouped according to described user name；Step S120, adds the audio frequency title of described audio file to described linked list, including:
S130, searches the user name of described audio file founder in described linked list；If finding, going to step S131, if not finding, going to step S132.
S131, adds the title of described audio file to the packet of described user name.
S132, sets up the new packet of described user name, the audio frequency title of described audio file is added to described new packet.
Step S112, when video file is played again, searches the audio file that associates with video file, transmission to playing the user of described video file, including:
S133, obtains the audio file the comprising user name acquisition request that terminal sends.
S134, searches described user name in the linked list of described video file, and the audio file in described user name correspondence being grouped sends to described terminal.
In an alternate embodiment of the invention, S111, after setting up the association of described audio file and described video file, including:
S140, according to timestamp and the length of speech data of described audio file, searches the sound clip that described speech data is corresponding in the track of described video file.
S141, according to the acoustic situations of described sound clip, is adjusted described speech data.
In an alternate embodiment of the invention, S141, according to the acoustic situations of described sound clip, described speech data is adjusted, including:
S150, calculates average volume and the average volume of described speech data of described sound clip.
S151, it is judged that whether the difference of the average volume of described sound clip and the average volume of described speech data is more than the adjustment threshold value preset；The most then the volume of described audio file is adjusted, until described difference is less than or equal to described adjustment threshold value.
In an alternate embodiment of the invention, described video file presets the important plot time period；S111, after setting up the association of described audio file and described video file, including:
S160, according to timestamp and the length of speech data of described audio file, it is judged that whether described speech data was in the described important plot time period；If so, step S161 is gone to.
S161, changes the timestamp of described audio file, makes described speech data be in outside the described important plot time period.
In an alternate embodiment of the invention, S160, according to timestamp and the length of speech data of described audio file, it is judged that whether described speech data was in the described important plot time period, including:
S170, obtains initial time A of described speech datasWith termination time Ae。
S171, obtains initial time B of described important plot time periodsWith termination time Be。
S172, it may be judged whether meet: AsIt is in interval (Bs, Be), or AeIt is in interval (Bs, Be), or AsLess than or equal to BsAnd AeMore than or equal to Be；If so, judge that described speech data was in the described important plot time period.
S161, changes the timestamp of described audio file, makes described speech data be in outside the described important plot time period, including:
S173, it is judged that (Ae+AsThe result of)/2 and (Be+BsThe magnitude relationship of the result of)/2.
S174, if (Ae+AsThe result of)/2 is less than or equal to (Be+BsThe result of)/2, move forward A by described timestampe-Bs。
S175, if (Ae+AsThe result of)/2 is more than (Be+BsThe result of)/2, will move B after described timestampe-As。
The block diagram of the embodiment of the device that Figure 12 plays for a kind of audio-video document that the present invention provides simultaneously.As it can be seen, another embodiment of the present invention includes the device that a kind of audio-video document is play simultaneously, including:
Second NE 180, for receiving the audio file sent by terminal；Timestamp that described audio file comprises its input initial time corresponding time point in the described video file that terminal is currently played of mark and user synchronize the speech data of input during playing described video file.
Associative cell 181, for setting up described audio file and the association of described video file；Being additionally operable to described video file when being again played, search the described audio file associated with this video file, transmission is to the user playing described video file.
Described device in the present embodiment is for for providing the servers such as the video server of network side Video service function, Website server.
In an alternate embodiment of the invention, described video file is preset with linked list at the webserver；Described associative cell 181 is for adding the title of described audio file to the linked list of described video file.
In an alternate embodiment of the invention, described audio file also includes the user name of founder, and the audio frequency title in described linked list is grouped according to described user name；Described associative cell 181 is additionally operable to search the user name of described audio file founder in described linked list；If finding described user name, the title of described audio file is added to the packet of described user name；If not finding, setting up the new packet of described user name, the audio frequency title of described audio file is added to described new packet.
The audio file comprising user name that described second NE 180 sends for obtaining terminal obtains request；Described associative cell 181 is for searching described user name in the linked list of described video file, and described second NE 180 audio file in described user name correspondence being grouped sends to described terminal.
In an alternate embodiment of the invention, described device also includes:
Second volume processing unit 182, for the timestamp according to described audio file and the length of speech data, searches the sound clip that described speech data is corresponding in the track of described video file；According to the acoustic situations of described sound clip, described speech data is adjusted.
In an alternate embodiment of the invention, described second volume processing unit 182 is for calculating average volume and the average volume of described speech data of described sound clip；Judge that whether the difference of the average volume of described sound clip and the average volume of described speech data is more than the adjustment threshold value preset；The most then the volume of described audio file is adjusted, until described difference is less than or equal to described adjustment threshold value.
In an alternate embodiment of the invention, described video file presets the important plot time period；The webserver also includes:
Second important plot processing unit 183, for the timestamp according to described audio file and the length of speech data, it is judged that whether described speech data was in the described important plot time period；If so, change the timestamp of described audio file, make described speech data be in outside the described important plot time period.
In an alternate embodiment of the invention, described second important plot processing unit 183 is for obtaining initial time A of described speech datasWith termination time Ae；Obtain initial time B of described important plot time periodsWith termination time Be；Judge whether to meet: AsIt is in interval (Bs, Be), or AeIt is in interval (Bs, Be), or AsLess than or equal to BsAnd AeMore than or equal to Be；If so, judge that described speech data was in the described important plot time period.
Described second important plot processing unit 183 is additionally operable to judge (Ae+AsThe result of)/2 and (Be+BsThe magnitude relationship of the result of)/2；If (Ae+AsThe result of)/2 is less than or equal to (Be+BsThe result of)/2, move forward A by described timestampe-Bs；If (Ae+AsThe result of)/2 is more than (Be+BsThe result of)/2, will move B after described timestampe-As。
As can be seen from above, the methods, devices and systems that a kind of audio-video document that the present invention provides is play simultaneously, by obtain user watch video file time synchronous recording speech data as audio file, when making subsequent user again play this video file can uppick simultaneously in the voice remark content of front user, enrich the function that Internet video is play.
Those of ordinary skill in the field are it is understood that the discussion of any of the above embodiment is exemplary only, it is not intended that hint the scope of the present disclosure (including claim) is limited to these examples；Under the thinking of the present invention, can also be combined between technical characteristic in above example or different embodiment, step can realize with random order, and there is other change of many of the different aspect of the present invention as above, for they not offers in details simple and clear.
It addition, for simplifying explanation and discussing, and in order to obscure the invention, can illustrate in the accompanying drawing provided or can not illustrate and integrated circuit (IC) chip and the known power supply/grounding connection of other parts.In addition, device can be shown in block diagram form, to avoid obscuring the invention, and this have also contemplated that following facts, the i.e. details about the embodiment of these block diagram arrangements is (that is, in the range of these details should be completely in the understanding of those skilled in the art) of the platform depending highly on and will implementing the present invention.Elaborating that detail is (such as, circuit) to describe the exemplary embodiment of the present invention in the case of, it will be apparent to those skilled in the art that can in the case of there is no these details or these details change in the case of implement the present invention.Therefore, these descriptions are considered as illustrative and not restrictive.
Although invention has been described to have been incorporated with the specific embodiment of the present invention, but according to description above, these embodiments a lot of replace, amendment and modification will be apparent from for those of ordinary skills.Such as, other memory architecture (such as, dynamic ram (DRAM)) can use discussed embodiment.
Embodiments of the invention are intended to all such replacement, amendment and the modification fallen within the broad range of claims.Therefore, all within the spirit and principles in the present invention, any omission of being made, amendment, equivalent, improvement etc., should be included within the scope of the present invention.

Claims (31)

1. the method that audio-video document is play simultaneously, is applied to terminal, it is characterised in that including:
During playing video file, synchronize to obtain the speech data of user's input, the time point of described video file corresponding for the initial time inputting described speech data is saved as audio file as timestamp together with described speech data；
Described audio file is sent to the webserver；
Receive the playing request of described video file, synchronize to obtain described audio file from the webserver；
When described video file plays the time point to described timestamp mark, while continuing to play described video file, play described speech data.
Method the most according to claim 1, it is characterised in that described when the time point that the broadcasting of described video file identifies to described timestamp, plays described speech data while the continuation described video file of broadcasting, including:
Extract the timestamp in described audio file；
Described timestamp is added as the labelling playing speech data the reproduction time axle of described video file；
When the playing progress rate of video file reaches described timestamp, play the speech data in audio file belonging to this timestamp.
Method the most according to claim 1, it is characterised in that described when the time point that the broadcasting of described video file identifies to described timestamp, plays described speech data while the continuation described video file of broadcasting, including:
Extract the timestamp in described audio file；
According to timestamp order from front to back, described audio file is ranked up；
According to the order of audio file after sequence, judge whether the playing progress rate of video file reaches the time point of the timestamp labelling of described audio file successively；If reaching, play the speech data in audio file belonging to described timestamp.
Method the most according to claim 1, it is characterised in that described audio file also includes the user name of founder；The playing request of the described video file of described reception, synchronizes to obtain described audio file from the webserver, including:
Described playing request comprises the user name of some audio file founder；
The audio file created by the user that described user name is corresponding is obtained from server.
Method the most according to claim 1, it is characterised in that the playing request of the described video file of described reception, after the webserver obtains described audio file, including:
Timestamp according to described audio file and the length of speech data, search the sound clip that described speech data is corresponding in the track of described video file；
According to the acoustic situations of described sound clip, described speech data is adjusted.
Method the most according to claim 5, it is characterised in that the described acoustic situations according to described sound clip, is adjusted described speech data, including:
Calculate average volume and the average volume of described speech data of described sound clip；
Judge that whether the difference of the average volume of described sound clip and the average volume of described speech data is more than the adjustment threshold value preset；If more than the adjustment threshold value preset, the volume of described audio file being adjusted, until described difference is less than or equal to described adjustment threshold value.
Method the most according to claim 1, it is characterised in that described video file presets the important plot time period；The playing request of the described video file of described reception, after the webserver obtains described audio file, including:
Timestamp according to described audio file and the length of speech data, it is judged that whether described speech data was in the described important plot time period；If being in the described important plot time period, changing the timestamp of described audio file, making described speech data be in outside the described important plot time period.
Method the most according to claim 7, it is characterised in that the described timestamp according to described audio file and the length of speech data, it is judged that whether described speech data was in the described important plot time period, including:
Obtain initial time A of described speech datasWith termination time Ae；
Obtain initial time B of described important plot time periodsWith termination time Be；
Judge whether to meet: AsIt is in interval (Bs, Be), or AeIt is in interval (Bs, Be), or AsLess than or equal to BsAnd AeMore than or equal to Be；If meeting, determine that described speech data was in the described important plot time period；
The timestamp of the described audio file of described change, makes described speech data be in outside the described important plot time period, including:
Judge (Ae+AsThe result of)/2 and (Be+BsThe magnitude relationship of the result of)/2；
If (Ae+AsThe result of)/2 is less than or equal to (Be+BsThe result of)/2, move forward A by described timestampe-Bs；
If (Ae+AsThe result of)/2 is more than (Be+BsThe result of)/2, will move B after described timestampe-As。
9. the device that an audio-video document is play simultaneously, it is characterised in that including:
Audio file acquiring unit, for during playing video file, synchronize to obtain the speech data of user's input, the time point of described video file corresponding for the initial time inputting described speech data is saved as audio file as timestamp together with described speech data；
First network unit, for sending described audio file to the webserver；After being additionally operable to receive the playing request of described video file, synchronize to obtain described audio file from the webserver；
Audio file broadcast unit, when the time point play to described timestamp mark when described video file, plays described speech data while continuing to play described video file.
Device the most according to claim 9, it is characterised in that described audio file broadcast unit is for extracting the timestamp in described audio file；Described timestamp is added as the labelling playing speech data the reproduction time axle of described video file；When the playing progress rate of video file reaches described timestamp, play the speech data in audio file belonging to this timestamp.
11. devices according to claim 9, it is characterised in that described audio file broadcast unit is for extracting the timestamp in described audio file；According to timestamp order from front to back, described audio file is ranked up；According to the order of audio file after sequence, judge whether the playing progress rate of video file reaches the time point of the timestamp labelling of described audio file successively；If reaching, play the speech data in audio file belonging to described timestamp.
12. devices according to claim 9, it is characterised in that described audio file also includes the user name of founder, comprises the user name of some audio file founder in described playing request；Described first network unit for obtaining the audio file created by the user that described user name is corresponding from server.
13. devices according to claim 9, it is characterised in that also include:
First volume processing unit, for the timestamp according to described audio file and the length of speech data, searches the sound clip that described speech data is corresponding in the track of described video file；It is additionally operable to the acoustic situations according to described sound clip, described speech data is adjusted.
14. devices according to claim 13, it is characterised in that described first volume processing unit is additionally operable to calculate the average volume of described sound clip and the average volume of described speech data；Judge that whether the difference of the average volume of described sound clip and the average volume of described speech data is more than the adjustment threshold value preset；If more than the adjustment threshold value preset, the volume of described audio file being adjusted, until described difference is less than or equal to described adjustment threshold value.
15. devices according to claim 9, it is characterised in that described video file presets the important plot time period；Terminal also includes:
First important plot processing unit, for the timestamp according to described audio file and the length of speech data, it is judged that whether described speech data was in the described important plot time period；If being in the described important plot time period, changing the timestamp of described audio file, making described speech data be in outside the described important plot time period.
16. devices according to claim 15, it is characterised in that described first important plot processing unit is for obtaining initial time A of described speech datasWith termination time Ae；Obtain initial time B of described important plot time periodsWith termination time Be；Judge whether to meet: AsIt is in interval (Bs, Be), or AeIt is in interval (Bs, Be), or AsLess than or equal to BsAnd AeMore than or equal to Be；If meeting, it is determined that described speech data was in the described important plot time period；
Described first important plot processing unit is additionally operable to judge (Ae+AsThe result of)/2 and (Be+BsThe magnitude relationship of the result of)/2；If (Ae+AsThe result of)/2 is less than or equal to (Be+BsThe result of)/2, move forward A by described timestampe-Bs；If (Ae+AsThe result of)/2 is more than (Be+BsThe result of)/2, will move B after described timestampe-As。
The method that 17. 1 kinds of audio-video documents are play simultaneously, is applied to the webserver, it is characterised in that including:
Receive the audio file sent by terminal；Described audio file includes that user synchronizes the speech data of input and input initial time timestamp of corresponding time point in the video file that terminal is being play of described speech data during playing video file；
Set up described audio file and the association of described video file；
When described video file is played again, search the described audio file associated with described video file, described audio file is sent to the user playing described video file.
18. methods according to claim 17, it is characterised in that described video file is preset with linked list at the webserver；The described association setting up described audio file and described video file, including:
The title of described audio file is added to the linked list of described video file.
19. methods according to claim 18, it is characterised in that described audio file also includes the user name of founder, the audio frequency title in described linked list is grouped according to described user name；The described audio frequency title by described audio file is added to described linked list, including:
The user name of described audio file founder is searched in described linked list；
If finding described user name, the title of described audio file is added to the packet of described user name；If not finding, setting up the new packet of described user name, the title of described audio file is added to described new packet；
When described video file is played again, search the audio file that associates with video file, transmission to playing the user of described video file, including:
Obtain the audio file the comprising user name acquisition request that terminal sends；
Searching described user name in the linked list of described video file, the audio file in described user name correspondence being grouped sends to described terminal.
20. methods according to claim 17, it is characterised in that after the described association setting up described audio file and described video file, including:
Timestamp according to described audio file and the length of speech data, search the sound clip that described speech data is corresponding in the track of described video file；
According to the acoustic situations of described sound clip, described speech data is adjusted.
21. methods according to claim 20, it is characterised in that the described acoustic situations according to described sound clip, are adjusted described speech data, including:
Calculate average volume and the average volume of described speech data of described sound clip；
Judge that whether the difference of the average volume of described sound clip and the average volume of described speech data is more than the adjustment threshold value preset；The most then the volume of described audio file is adjusted, until described difference is less than or equal to described adjustment threshold value.
22. methods according to claim 17, it is characterised in that described video file presets the important plot time period；Described set up described audio file and after the association of video file that described terminal is currently played, including:
Timestamp according to described audio file and the length of speech data, it is judged that whether described speech data was in the described important plot time period；If so, change the timestamp of described audio file, make described speech data be in outside the described important plot time period.
23. methods according to claim 22, it is characterised in that the described timestamp according to described audio file and the length of speech data, it is judged that whether described speech data was in the described important plot time period, including:
Obtain initial time A of described speech datasWith termination time Ae；
Obtain initial time B of described important plot time periodsWith termination time Be；
Judge whether to meet: AsIt is in interval (Bs, Be), or AeIt is in interval (Bs, Be), or AsLess than or equal to BsAnd AeMore than or equal to Be；If so, judge that described speech data is in described important feelings
The timestamp of the described audio file of described change, makes described speech data be in outside the described important plot time period, including:
Judge (Ae+AsThe result of)/2 and (Be+BsThe magnitude relationship of the result of)/2；
If (Ae+AsThe result of)/2 is less than or equal to (Be+BsThe result of)/2, move forward A by described timestampe-Bs；
If (Ae+AsThe result of)/2 is more than (Be+BsThe result of)/2, will move B after described timestampe-As。
The device that 24. 1 kinds of audio-video documents are play simultaneously, it is characterised in that including:
Second NE, for receiving the audio file sent by terminal；Described audio file includes that user synchronizes the speech data of input and input initial time timestamp of corresponding time point in the video file that terminal is being play of described speech data during playing video file；
Associative cell, for setting up described audio file and the association of described video file；Being additionally operable to described video file when being again played, search described audio file associate with this video file, the described audio file transmission that described second NE is used for finding is to the user playing described video file.
25. devices according to claim 24, it is characterised in that described video file is preset with linked list at the webserver；Described associative cell is for adding the title of described audio file to the linked list of described video file.
26. devices according to claim 25, it is characterised in that described audio file also includes the user name of founder, the audio frequency title in described linked list is grouped according to described user name；Described associative cell is additionally operable to search the user name of described audio file founder in described linked list；If finding described user name, the title of described audio file is added to the packet of described user name；If not finding, setting up the new packet of described user name, the audio frequency title of described audio file is added to described new packet；
The audio file comprising user name that described second NE sends for obtaining terminal obtains request；Described associative cell is for searching described user name in the linked list of described video file, and described second NE audio file in described user name correspondence being grouped sends to described terminal.
27. devices according to claim 24, it is characterised in that also include:
Second volume processing unit, for the timestamp according to described audio file and the length of speech data, searches the sound clip that described speech data is corresponding in the track of described video file；It is additionally operable to the acoustic situations according to described sound clip, described speech data is adjusted.
28. devices according to claim 27, it is characterised in that described second volume processing unit is for calculating average volume and the average volume of described speech data of described sound clip；Judge that whether the difference of the average volume of described sound clip and the average volume of described speech data is more than the adjustment threshold value preset；The most then the volume of described audio file is adjusted, until described difference is less than or equal to described adjustment threshold value.
29. devices according to claim 24, it is characterised in that described video file presets the important plot time period；The webserver also includes:
Second important plot processing unit, for the timestamp according to described audio file and the length of speech data, it is judged that whether described speech data was in the described important plot time period；If so, change the timestamp of described audio file, make described speech data be in outside the described important plot time period.
30. devices according to claim 29, it is characterised in that described second important plot processing unit is for obtaining initial time A of described speech datasWith termination time Ae；Obtain initial time B of described important plot time periodsWith termination time Be；Judge whether to meet: AsIt is in interval (Bs, Be), or AeIt is in interval (Bs, Be), or AsLess than BsAnd AeMore than Be；If so, judge that described speech data was in the described important plot time period；
Described second important plot processing unit is additionally operable to judge (Ae+AsThe result of)/2 and (Be+BsThe magnitude relationship of the result of)/2；If (Ae+AsThe result of)/2 is less than (Be+BsThe result of)/2, move forward A by described timestampe-Bs；If (Ae+AsThe result of)/2 is more than (Be+BsThe result of)/2, will move B after described timestampe-As。
The system that 31. 1 kinds of audio-video documents are play simultaneously, it is characterised in that include the device described in claim 9-16 any one and the device described in claim 24-30 any one.
CN201610162806.XA 2016-03-21 2016-03-21 Audio and video files simultaneous playing method, device and system Pending CN105828100A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610162806.XA CN105828100A (en) 2016-03-21 2016-03-21 Audio and video files simultaneous playing method, device and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610162806.XA CN105828100A (en) 2016-03-21 2016-03-21 Audio and video files simultaneous playing method, device and system

Publications (1)

Publication Number Publication Date
CN105828100A true CN105828100A (en) 2016-08-03

Family

ID=56524898

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610162806.XA Pending CN105828100A (en) 2016-03-21 2016-03-21 Audio and video files simultaneous playing method, device and system

Country Status (1)

Country Link
CN (1) CN105828100A (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106412622A (en) * 2016-11-14 2017-02-15 百度在线网络技术（北京）有限公司 Method and apparatus for displaying barrage information during video content playing process
CN107277594A (en) * 2017-07-06 2017-10-20 广州华多网络科技有限公司 A kind of video and audio and barrage synchronous method and device
CN107404599A (en) * 2017-07-17 2017-11-28 歌尔股份有限公司 Audio, video data synchronous method, apparatus and system
CN107613400A (en) * 2017-09-21 2018-01-19 北京奇艺世纪科技有限公司 A kind of implementation method and device of voice barrage
CN108966002A (en) * 2018-08-20 2018-12-07 上海理工大学 A kind of device and method using micro- expression adjustment volume
CN109348281A (en) * 2018-11-08 2019-02-15 北京微播视界科技有限公司 Method for processing video frequency, device, computer equipment and storage medium
WO2019037566A1 (en) * 2017-08-23 2019-02-28 腾讯科技（深圳）有限公司 Information display method and apparatus, device, and computer-readable storage medium
CN110017848A (en) * 2019-04-11 2019-07-16 北京三快在线科技有限公司 Phonetic navigation method, device, electronic equipment and storage medium
CN110166801A (en) * 2019-04-25 2019-08-23 腾讯科技（深圳）有限公司 Processing method, device and the storage medium of media file
CN110971976A (en) * 2019-11-22 2020-04-07 中国联合网络通信集团有限公司 Audio and video file analysis method and device

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102394090A (en) * 2003-02-21 2012-03-28 松下电器产业株式会社 Reording medium, playback device, recording method, playback method, and computer program
US20120321271A1 (en) * 2011-06-20 2012-12-20 Microsoft Corporation Providing video presentation commentary
CN104125491A (en) * 2014-07-07 2014-10-29 乐视网信息技术（北京）股份有限公司 Audio comment information generating method and device and audio comment playing method and device
CN104618806A (en) * 2014-03-17 2015-05-13 腾讯科技（北京）有限公司 Method, device and system for acquiring comment information of video

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102394090A (en) * 2003-02-21 2012-03-28 松下电器产业株式会社 Reording medium, playback device, recording method, playback method, and computer program
US20120321271A1 (en) * 2011-06-20 2012-12-20 Microsoft Corporation Providing video presentation commentary
CN104618806A (en) * 2014-03-17 2015-05-13 腾讯科技（北京）有限公司 Method, device and system for acquiring comment information of video
CN104125491A (en) * 2014-07-07 2014-10-29 乐视网信息技术（北京）股份有限公司 Audio comment information generating method and device and audio comment playing method and device

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106412622A (en) * 2016-11-14 2017-02-15 百度在线网络技术（北京）有限公司 Method and apparatus for displaying barrage information during video content playing process
CN107277594B (en) * 2017-07-06 2020-04-28 广州华多网络科技有限公司 Method and device for synchronizing video and audio with bullet screen
CN107277594A (en) * 2017-07-06 2017-10-20 广州华多网络科技有限公司 A kind of video and audio and barrage synchronous method and device
CN107404599A (en) * 2017-07-17 2017-11-28 歌尔股份有限公司 Audio, video data synchronous method, apparatus and system
CN107404599B (en) * 2017-07-17 2020-05-19 歌尔股份有限公司 Audio and video data synchronization method, device and system
CN109428908B (en) * 2017-08-23 2021-06-01 腾讯科技（深圳）有限公司 Information display method, device and equipment
WO2019037566A1 (en) * 2017-08-23 2019-02-28 腾讯科技（深圳）有限公司 Information display method and apparatus, device, and computer-readable storage medium
CN109428908A (en) * 2017-08-23 2019-03-05 腾讯科技（深圳）有限公司 Information display method, device and equipment
CN107613400A (en) * 2017-09-21 2018-01-19 北京奇艺世纪科技有限公司 A kind of implementation method and device of voice barrage
CN107613400B (en) * 2017-09-21 2021-03-26 北京奇艺世纪科技有限公司 Method and device for realizing voice barrage
CN108966002A (en) * 2018-08-20 2018-12-07 上海理工大学 A kind of device and method using micro- expression adjustment volume
CN108966002B (en) * 2018-08-20 2020-11-03 上海理工大学 Device and method for adjusting volume by using micro expression
CN109348281A (en) * 2018-11-08 2019-02-15 北京微播视界科技有限公司 Method for processing video frequency, device, computer equipment and storage medium
CN110017848B (en) * 2019-04-11 2020-09-29 北京三快在线科技有限公司 Voice navigation method and device, electronic equipment and storage medium
CN110017848A (en) * 2019-04-11 2019-07-16 北京三快在线科技有限公司 Phonetic navigation method, device, electronic equipment and storage medium
CN110166801A (en) * 2019-04-25 2019-08-23 腾讯科技（深圳）有限公司 Processing method, device and the storage medium of media file
CN110971976A (en) * 2019-11-22 2020-04-07 中国联合网络通信集团有限公司 Audio and video file analysis method and device

Similar Documents

Publication Publication Date Title
CN105828100A (en) Audio and video files simultaneous playing method, device and system
US10996921B2 (en) Audio file processing to reduce latencies in play start times for cloud served audio files
CN103957227B (en) For transmitting digital content to the method and apparatus of cell phone from personal computer
US8417180B2 (en) Methods and systems for mixing media with communications
KR101977072B1 (en) Method for displaying text associated with audio file and electronic device
US8634944B2 (en) Auto-station tuning
CN102016997B (en) Electronic devices and methods that insert addressable chapter marks relative to advertising content in video streams
CN105120304A (en) Information display method, device and system
CN105828220A (en) Method and device of adding audio file in video file
KR102545837B1 (en) Display arraratus, background music providing method thereof and background music providing system
CN104125229B (en) The player method of Streaming Media and playing device
KR100903070B1 (en) Apparatus and method for displaying data
US9609398B2 (en) Content and posted-information time-series link method, and information processing terminal
CN103281566B (en) A kind of method and device of video switching
CN104731938A (en) Video searching method and device
US9859871B2 (en) Radio to tune multiple stations simultaneously and select programming segments
KR102099776B1 (en) Apparatus and method for creating clip video, and server for providing preview video
KR20090024016A (en) Apparatus for monitoring the music broadcast using the music recognition and method thereof
KR20160117933A (en) Display apparatus for performing a search and Method for controlling display apparatus thereof
CN101583092A (en) Data reproduction device and data reproduction method
WO2014097048A1 (en) System and method for generating a second screen experience using video subtitle data
US11445245B2 (en) Synchronized combinations of captured real-time media content with played-back digital content
US20140064695A1 (en) Apparatus and method for controlling a video
JP4938384B2 (en) Moving image data distribution system, moving image data providing method, moving image data distribution program, moving image data providing program, and computer-readable recording medium on which those programs are recorded
JP4846674B2 (en) Still image extraction apparatus and still image extraction program

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20160803

WD01 Invention patent application deemed withdrawn after publication