CN108024121A - Voice barrage synchronous method and system - Google Patents
Voice barrage synchronous method and system Download PDFInfo
- Publication number
- CN108024121A CN108024121A CN201711145376.1A CN201711145376A CN108024121A CN 108024121 A CN108024121 A CN 108024121A CN 201711145376 A CN201711145376 A CN 201711145376A CN 108024121 A CN108024121 A CN 108024121A
- Authority
- CN
- China
- Prior art keywords
- audio
- voice
- barrage
- voice data
- video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/233—Processing of audio elementary streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/845—Structuring of content, e.g. decomposing content into time segments
- H04N21/8455—Structuring of content, e.g. decomposing content into time segments involving pointers to the content, e.g. pointers to the I-frames of the video stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/845—Structuring of content, e.g. decomposing content into time segments
- H04N21/8456—Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
- H04L51/04—Real-time or near real-time messaging, e.g. instant messaging [IM]
- H04L51/046—Interoperability with other network applications or services
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
- H04M1/7243—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
- H04M1/7243—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
- H04M1/72433—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages for voice messaging, e.g. dictaphones
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72448—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
- H04M1/72454—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions according to context-related or environment-related conditions
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The embodiment of the present invention provides a kind of voice barrage synchronous method and system, is applied to the audio/video information that is being played in the electric terminal and server being in communication with each other, including the audio frequency apparatus of electric terminal collection and is sent to the server；Server obtains corresponding voice data according to audio/video information and judges whether the size of data of the voice data is more than preset value, if more than voice data then is divided into the subdata bag of multiple preset lengths and is preserved；Server according to the corresponding time relationship of multiple subdata bags and voice data by multiple subdata bags send successively to audio frequency apparatus by make the audio frequency apparatus in a manner of barrage by subdata bag simultaneous display in the audio and video played.The embodiment of the present invention can be avoided effectively during audio and video playing, due to voice data it is excessive caused by voice barrage loaded slow, poor synchronization the problem of.
Description
Technical field
The present invention relates to wireless communication technology field, in particular to a kind of voice barrage synchronous method and system.
Background technology
For preloading can only be passed through when handling the audio stream of big section for audio in existing wechat small routine and H5
Mode improve user experience, but since audio stream is excessive, cause user to take substantial amounts of use when downloading big section audio stream
Family flow and waste longer audio download time, being directed to voice barrage user experience can be very bad.In addition, pin at this stage
Voice packet to big section is that audio barrage poor synchronization, example are caused by way of downloading to cell-phone customer terminal in advance and playing again
Such as, the mode that TV scene real-time synchronization audio barrages are not suitable for downloading big audio stream in advance is shaken based on wechat.
The content of the invention
In view of this, the present invention provides a kind of voice barrage synchronous method and device, can effectively solve the problem that the above problem.
Present pre-ferred embodiments provide a kind of voice barrage synchronous method, applied to the electric terminal kimonos being in communication with each other
Business device, the described method includes：
The electric terminal gathers the audio/video information played in audio frequency apparatus and is sent to the server；
The server obtains corresponding voice data according to the audio/video information and judges the voice data
Whether size of data is more than preset value, if more than the voice data then is divided into the subdata bag of multiple preset lengths simultaneously
Preserve；
The server is according to the corresponding time relationship of multiple subdata bags and the voice data by multiple subnumbers
Sent successively to the audio frequency apparatus according to bag to make the audio frequency apparatus that the subdata bag simultaneous display exist in a manner of barrage
In the audio and video played.
In the selection of present pre-ferred embodiments, the step of corresponding voice data is obtained according to the audio/video information
Suddenly include：
Broadcasting content, collection of drama mark and current play time according to being included in the audio/video information create index；
The index is compared with the audio, video data that prestores, and corresponding voice number is obtained according to comparison result
According to.
In the selection of present pre-ferred embodiments, the method further includes：
The electric terminal or the server are by each subdata bag shown with barrage and the audio frequency apparatus
The audio, video data of broadcasting, which corresponds to, to be preserved to local file；Or
Each subdata bag is corresponded to the correspondence position added to the audio, video data that prestores by the server
And preserve.
In the selection of present pre-ferred embodiments, the electric terminal gathers the audio and video played in audio frequency apparatus
The step of information, includes：
The audio/video information that response audio/video information acquisition instructions are being played with gathering in audio frequency apparatus, wherein, it is described
Audio/video information includes playing content, collection of drama mark and current play time.
In the selection of present pre-ferred embodiments, the response audio/video information acquisition instructions include implemented below side
Formula：
The electric terminal vibrating state of itself is detected, and judges that when the vibrating state meets preset value sound need to be carried out
Video information gathers；Or
The screen pressure value in the electric terminal is detected, and judges that need to carry out sound regards when the pressure value meets preset value
Frequency information gathering.
In the selection of present pre-ferred embodiments, the audio/video information can be that audio-frequency information or audio and video playing are drawn
Face.
Present pre-ferred embodiments also provide a kind of voice barrage synchronous method, are applied to and electric terminal communication link
The server connect, the described method includes：
Receive the audio/video information played in the audio frequency apparatus of the electric terminal collection；
According to the audio/video information obtain corresponding voice data and judge the voice data size of data whether
More than preset value, if more than the voice data then is divided into the subdata bag of multiple preset lengths and is preserved；
Multiple subdata bags are sent successively based on the subdata bag and the correspondence of the time of the voice data
To the audio frequency apparatus by make the audio frequency apparatus in a manner of barrage by the subdata bag simultaneous display in the sound played
In video.
Present pre-ferred embodiments also provide a kind of voice barrage synchronization system, and the voice barrage synchronization system includes electricity
Sub- terminal, audio frequency apparatus and server, the server communicate to connect respectively with the electric terminal and audio frequency apparatus, the electricity
Sub- terminal and audio frequency apparatus communication connection；
The electric terminal is used to gather the audio/video information played in the audio frequency apparatus and is sent to the clothes
Business device；
The server is used to obtain corresponding voice data according to the audio/video information and judges the voice number
According to size of data whether be more than preset value, if more than the voice data to be then divided into the subdatas of multiple preset lengths
Wrap and preserve；And
The server is according to the corresponding time relationship of multiple subdata bags and the voice data by multiple subnumbers
Sent successively to the audio frequency apparatus according to bag to make the audio frequency apparatus that the subdata bag simultaneous display exist in a manner of barrage
In the audio and video played.
In the selection of present pre-ferred embodiments, the server includes：
Information receiving module, the audio and video letter played in the audio frequency apparatus for receiving electric terminal collection
Breath；
Judgment module, for obtaining corresponding voice data according to the audio/video information and judging the voice data
Whether size of data is more than preset value, if more than the voice data then is divided into the subdata bag of multiple preset lengths simultaneously
Preserve；
Voice synchronization module, will be the plurality of for the correspondence based on the subdata bag and the voice data time
Subdata bag is sent to the audio frequency apparatus to make the audio frequency apparatus synchronously show the subdata bag in a manner of barrage successively
Show in the audio and video played.
In the selection of present pre-ferred embodiments, the judgment module includes：
Index creation unit, for according to included in the audio/video information broadcasting content, collection of drama identify and currently broadcast
Put time establishment index；
Voice acquisition unit, for the index to be compared with the audio, video data that prestores, and is obtained according to comparison result
Take corresponding voice data.
Compared with prior art, a kind of voice barrage synchronous method provided by the invention and system, wherein, the voice barrage
Synchronous method can be avoided during audio and video playing, due to language by the way of splitting to larger voice data
Voice barrage caused by sound data are excessive loaded the problem of slow, poor synchronization.Meanwhile it can ensure the loading of barrage voice data
Synchronism under the premise of, reduce the real-time download of voice data, effectively improve user experience.
Brief description of the drawings
In order to illustrate the technical solution of the embodiments of the present invention more clearly, below will be to needed in the embodiment attached
Figure is briefly described, it will be appreciated that the following drawings illustrate only certain embodiments of the present invention, therefore be not construed as pair
The restriction of scope, for those of ordinary skill in the art, without creative efforts, can also be according to this
A little attached drawings obtain other relevant attached drawings.
Fig. 1 is the interaction scenarios schematic diagram of voice barrage synchronization system provided in an embodiment of the present invention.
Fig. 2 is the frame structure schematic diagram of the server shown in Fig. 1.
Fig. 3 is the flow diagram of voice barrage synchronous method provided in an embodiment of the present invention.
Fig. 4 is the sub-process schematic diagram of voice barrage synchronous method provided in an embodiment of the present invention.
Fig. 5 is another flow diagram of voice barrage synchronous method provided in an embodiment of the present invention.
Fig. 6 is the frame structure schematic diagram of voice barrage sychronisation provided in an embodiment of the present invention.
Fig. 7 is the frame structure schematic diagram of the judgment module shown in Fig. 6.
Icon：10- electric terminals；20- servers；100- voice barrage sychronisations；110- information receiving modules；120-
Judgment module；121- index creation units；122- voice acquisition units；130- voice synchronization modules；200- memories；300- is deposited
Store up controller；400- processors；30- audio frequency apparatuses.
Embodiment
To make the purpose, technical scheme and advantage of the embodiment of the present invention clearer, below in conjunction with the embodiment of the present invention
In attached drawing, the technical solution in the embodiment of the present invention is clearly and completely described, it is clear that described embodiment is
Part of the embodiment of the present invention, instead of all the embodiments.The present invention implementation being usually described and illustrated herein in the accompanying drawings
The component of example can be arranged and designed with a variety of configurations.
Therefore, below the detailed description of the embodiment of the present invention to providing in the accompanying drawings be not intended to limit it is claimed
The scope of the present invention, but be merely representative of the present invention selected embodiment.Based on the embodiments of the present invention, this area is common
Technical staff's all other embodiments obtained without creative efforts, belong to the model that the present invention protects
Enclose.
It should be noted that：Similar label and letter represents similar terms in following attached drawing, therefore, once a certain Xiang Yi
It is defined, then it further need not be defined and explained in subsequent attached drawing in a attached drawing.
As shown in Figure 1, be the interaction scenarios schematic diagram of voice barrage synchronization system provided in an embodiment of the present invention, wherein,
The interaction scenarios include electric terminal 10, server 20 and audio frequency apparatus 30, and the electric terminal 10, server 20 and audio are set
Standby 30 connect each other by network service.
Specifically, the electric terminal 10 is concurrent for gathering the audio/video information played in the audio frequency apparatus 30
The server 20 is given, the server 20 is used to obtain corresponding voice data according to the audio/video information and sentences
Whether the size of data of the disconnected voice data is more than preset value, if more than the voice data then is divided into multiple default length
The subdata bag of degree simultaneously preserves；And the server 20 is according to the time pair of multiple subdata bags and the voice data
It should be related to and send multiple subdata bags to the audio frequency apparatus 30 to make the audio frequency apparatus 30 in a manner of barrage by institute successively
Subdata bag simultaneous display is stated in the audio and video played.
Alternatively, as shown in Fig. 2, the server 20 includes voice barrage sychronisation 100, memory 200, storage control
Device 300 and processor 400 processed.Wherein, the memory 200, storage control 300,400 each element of processor are mutual
Directly or indirectly it is electrically connected, to realize the transmission of data or interaction.It is for example, logical by one or more between these elements
Interrogate bus or signal wire is realized and is electrically connected.The voice barrage sychronisation 100 include it is at least one can be with software or firmware
Form be stored in the memory 200 or be solidificated in software function module in the operating system of the electric terminal 10.
The processor 400 accesses the memory 200 under the control of the storage control 300, for performing the storage
The executable module stored in device 200, such as the software function module included by the voice barrage sychronisation 100 and calculating
Machine program etc..In addition, the server 20 can include barrage server 20, video server 20, application server 20 etc..
Alternatively, the electric terminal 10 may be, but not limited to, smart mobile phone, IPAD, computer, server 20 etc..Institute
State audio frequency apparatus 30 and may be, but not limited to, mobile phone, TV, MP4 etc..In addition, according to the actual requirements, the audio frequency apparatus 30 is also
It can be integrally formed with the electric terminal 10.
It should be appreciated that the structure shown in Fig. 2 is only to illustrate.The server 20 can have it is more more than shown in Fig. 2 or
Less component, or there is the configuration different from shown in Fig. 2.Wherein, each component shown in Fig. 2 can by software, hardware or
Its combination of person is realized.
As shown in figure 3, it is a kind of flow diagram for voice barrage synchronous method that present pre-ferred embodiments provide.Institute
Predicate sound barrage synchronous method is applied to the electric terminal 10 and server 20 that are in communication with each other connection shown in Fig. 1.Lower combination
The idiographic flow and step of the voice barrage synchronous method is described in detail in Fig. 3.
Step S110, the electric terminal 10 gather the audio/video information played in audio frequency apparatus 30 and are sent to institute
State server 20.
Specifically, the audio/video information can include, but are not limited to play content, collection of drama mark and current play time
Deng the mode that the electric terminal 10 gathers the audio/video information played in the audio frequency apparatus 30 can be：Pass through sound
Answer audio/video information acquisition instructions to realize to gather the audio/video information played in the audio frequency apparatus 30.Alternatively, institute
It can be audio-frequency information, video image information etc. to state audio/video information, and the present embodiment is not particularly limited herein.
Further, the implementation of the response audio/video information acquisition instructions includes：Detect the electric terminal 10
The vibrating state of itself, and judgement need to carry out audio/video information collection when the vibrating state meets preset value；Or detection institute
The screen pressure value in electric terminal 10 is stated, and judgement need to carry out audio/video information collection when the pressure value meets preset value.
For example, by taking wechat is shaken in mobile phone as an example, when needing to show barrage information in the audio and video played,
User, which can start, shakes function, and rocks mobile phone, the vibrating state of the application program detection mobile phone itself in the mobile phone, and
When vibrating state meets threshold value, start audio/video information acquisition function.Wherein, the threshold value can rock duration, frequency etc..
Step S120, the server 20 obtain corresponding voice data according to the audio/video information and judge to be somebody's turn to do
Whether the size of data of voice data is more than preset value, if more than the voice data then is divided into multiple preset lengths
Subdata bag simultaneously preserves.
In the present embodiment, the voice data can be the voice document prerecorded, such as star's voice or by
Voice document that user is recorded and uploaded by mobile phone terminal etc. in real time in watching process etc..Here, according to audio, video data
When searching corresponding voice document, one can be carried out by the source file and the audio, video data that prestores of the audio/video information received
One compares, searches or the audio/video information is handled to obtain corresponding index file progress keyword lookup.Example
Such as, as shown in figure 4, for it is provided in this embodiment searched according to index file when the index generation step, specifically such as
Under.
Sub-step S121, according to the broadcasting content, collection of drama mark and current play time included in the audio/video information
Create index；
Sub-step S122, the index is compared with the audio, video data that prestores, and according to comparison result acquisition and its
Corresponding voice data.
Herein, it should be noted that the sound that the index can receive the transmission of electric terminal 10 in the server 20 regards
After frequency information, by the server 20 itself generation or the electric terminal 10 is after the audio/video information is collected
Directly generate, so as to improve the search efficiency in message transmission rate and voice data search procedure.
Further, after the server 20 finds corresponding voice data, in order to reduce voice downloading rate and
Network load etc., improves voice barrage and the synchronism of audio and video played, need to be to the voice data that finds into line number
Judge according to size, if the voice data size exceedes preset value, need to split the voice data, form multiple default length
The subdata bag of degree.For example, when the size of voice data is more than 20M, then the voice data is divided into the son of multiple 45K sizes
Data packet.It is assumed that the size of the voice data is 20M, then user only needs to download the voice subdata bag of 900K or so and broadcasts
Put, greatly improve the synchronism between voice barrage and playing audio-video, avoid since the load time is long and
Cause voice barrage content and the nonsynchronous problem of video content.
Step S130, the server 20 is according to the corresponding time relationship of multiple subdata bags and the voice data
Multiple subdata bags are sent to the audio frequency apparatus 30 to make the audio frequency apparatus 30 in a manner of barrage by the subnumber successively
According to bag simultaneous display in the audio and video played.
In the present embodiment, when ready-portioned multiple subdata bags are sent to audio frequency apparatus 30 and carry out simultaneous display,
It is ensured that the transmission order of each subdata bag, ensures both synchronisms and the continuity of voice data.Here, original can be based on
The time sequencing of voice data determines the transmission order of each subdata bag, and the audio/video information based on reception and is playing
Relation between the time of the consumption such as audio and video and data transfer, processing is ensured between voice barrage and the audio and video played
Synchronism.
For example, identify collection of drama mark and accurate video playback time (second can be accurate to) being shaken by wechat,
Server 20 can the current current speech barrage in units of minute and next of the acquisition such as passage time offset and collection of drama mark
The voice barrage of minute, then current voice data is directly targeted to by number of seconds etc., so as to reach real-time synchronization voice barrage
Effect, greatly improve user experience.
Step S140, the electric terminal 10 or the server 20 are by each subdata bag shown with barrage and institute
State the audio, video data played in audio frequency apparatus 30 and correspond to preservation to local file；Or the server 20 is by each son
Data packet corresponds to the correspondence position added to the audio, video data that prestores and preservation.
Wherein, by carrying out corresponding to preservation the voice barrage and audio and video of simultaneous display, enable to be used to see herein
When seeing the audio and video, situation when initially watching the audio and video is understood, especially when the voice barrage is that user oneself records
And upload, effectively improve the viewing experience of user.
As shown in figure 5, it is a kind of flow diagram for voice barrage synchronous method that present pre-ferred embodiments provide.Institute
Predicate sound barrage synchronous method is applied to the server 20 shown in Fig. 1.Lower combination Fig. 5 is to the voice barrage synchronous method
Idiographic flow and step are described in detail.
Step S210, receives the audio/video information that is being played in the audio frequency apparatus 30 that the electric terminal 10 gathers and right
The audio/video information is handled to obtain target detection.
Step S220, obtains corresponding voice data according to the audio/video information and judges the data of the voice data
Whether size is more than preset value, if more than the voice data then is divided into the subdata bag of multiple preset lengths and is preserved.
Step S230, based on the correspondence of the subdata bag and the time of the voice data by the plurality of subdata
Bag is sent to the audio frequency apparatus 30 to make the audio frequency apparatus 30 in a manner of barrage by the subdata bag simultaneous display successively
In the audio and video played.
Wherein, the method in the present embodiment has identical technical characteristic with the method in a upper embodiment, refers to
The description in embodiment is stated, details are not described herein for the present embodiment.
Further, as shown in fig. 6, the voice barrage sychronisation applied to the server 20 provided for this example
100 frame structure schematic diagram, wherein, which includes information receiving module 110, judgment module 120
With voice synchronization module 130.
Described information receiving module 110, is playing in the audio frequency apparatus 30 gathered for receiving the electric terminal 10
Audio/video information.In the present embodiment, the description as described in described information receiving module 110 is specifically referred to as shown in Fig. 3
The detailed description of step S110, that is, the step S110 can be performed by described information receiving module 110.
The judgment module 120, for obtaining corresponding voice data according to the audio/video information and judging the language
Whether the size of data of sound data is more than preset value, if more than the voice data to be then divided into the sons of multiple preset lengths
Data packet simultaneously preserves.In the present embodiment, the step of description as described in the judgment module 120 is specifically referred to as shown in Fig. 3
The detailed description of S120, that is, the step S120 can be performed by the judgment module 120.Alternatively, as shown in fig. 7, institute
Stating judgment module 120 includes index creation unit 121 and voice acquisition unit 122.
The index creation unit 121, for according to included in the audio/video information broadcasting content, collection of drama mark and
Current play time creates index.In the present embodiment, the description as described in the index creation unit 121 is specifically referred to Fig. 4
Shown in step S121 detailed description, that is, the step S121 can be performed by the index creation unit 121.
The voice acquisition unit 122, for the index to be compared with the audio, video data that prestores, and according to comparison
As a result corresponding voice data is obtained.In the present embodiment, the description as described in the voice acquisition unit 122 specifically refers to
To the detailed description of the step S122 shown in Fig. 4, that is, the step S122 can be held by the voice acquisition unit 122
OK.
The voice synchronization module 130, for the correspondence based on the subdata bag Yu the voice data time
The plurality of subdata bag is sent to the audio frequency apparatus 30 to make the audio frequency apparatus 30 in a manner of barrage by the son successively
Packet synchronisation is shown in the audio and video played.In the present embodiment, the description as described in the voice synchronization module 130 has
Body refers to the detailed description to the step S130 shown in Fig. 3, that is, the step S130 can be by the voice synchronization mould
Block 130 performs.
In conclusion a kind of voice barrage synchronous method provided by the invention and system, wherein, the voice barrage synchronization side
Method can be avoided during audio and video playing, due to voice data by the way of splitting to larger voice data
Voice barrage caused by excessive loaded the problem of slow, poor synchronization.Meanwhile it can ensure the synchronization of barrage voice data loading
Under the premise of property, reduce the real-time download of voice data, effectively improve user experience.
In the description of the present invention, term " setting ", " connected ", " connection " should be interpreted broadly, for example, it may be fixed
Connect or be detachably connected, or be integrally connected；Can mechanically connect or be electrically connected；Can be direct
It is connected, can also be indirectly connected by intermediary, can be the connection inside two elements.For the ordinary skill of this area
For personnel, the concrete meaning of above-mentioned term in the present invention can be understood with concrete condition.
In several embodiments that the embodiment of the present invention is provided, it should be understood that disclosed apparatus and method, also may be used
To realize by other means.Apparatus and method embodiment described above is only schematical, for example, the stream in attached drawing
Journey figure and block diagram show that the device of default quantity embodiment, method and computer program product may be real according to the present invention
Existing architectural framework, function and operation.At this point, each square frame in flow chart or block diagram can represent module, a journey
A part for sequence section or code.A part for the module, program segment or code includes one or default quantity is used for realization
Defined logic function.
It should also be noted that at some as in the implementation replaced, the function of being marked in square frame can also be with difference
The order marked in attached drawing occurs.For example, two continuous square frames can essentially perform substantially in parallel, they are sometimes
It can also perform in the opposite order, this is depending on involved function.It is also noted that in block diagram and/or flow chart
The combination of each square frame and the square frame in block diagram and/or flow chart, can use the dedicated of function as defined in performing or action
Hardware based system is realized, or can be realized with the combination of specialized hardware and computer instruction.
The foregoing is only a preferred embodiment of the present invention, is not intended to limit the invention, for the skill of this area
For art personnel, the invention may be variously modified and varied.Within the spirit and principles of the invention, that is made any repaiies
Change, equivalent substitution, improvement etc., should all be included in the protection scope of the present invention.
Claims (10)
- A kind of 1. voice barrage synchronous method, applied to the electric terminal and server being in communication with each other, it is characterised in that the side Method includes：The electric terminal gathers the audio/video information played in audio frequency apparatus and is sent to the server；The server obtains corresponding voice data according to the audio/video information and judges the data of the voice data Whether size is more than preset value, if more than the voice data then is divided into the subdata bag of multiple preset lengths and is preserved；The server is according to the corresponding time relationship of multiple subdata bags and the voice data by multiple subdata bags Send successively to the audio frequency apparatus by make the audio frequency apparatus in a manner of barrage by the subdata bag simultaneous display In the audio and video of broadcasting.
- 2. voice barrage synchronous method according to claim 1, it is characterised in that according to audio/video information acquisition and its The step of corresponding voice data, includes：Broadcasting content, collection of drama mark and current play time according to being included in the audio/video information create index；The index is compared with the audio, video data that prestores, and corresponding voice data is obtained according to comparison result.
- 3. voice barrage synchronous method according to claim 2, it is characterised in that the method further includes：The electric terminal or the server are by each subdata bag shown with barrage with being played in the audio frequency apparatus Audio, video data correspond to and preserve to local file；OrEach subdata bag is corresponded to correspondence position and the guarantor added to the audio, video data that prestores by the server Deposit.
- 4. voice barrage synchronous method according to claim 1, it is characterised in that the electric terminal gathers audio frequency apparatus In playing audio/video information the step of include：The audio/video information that response audio/video information acquisition instructions are being played with gathering in audio frequency apparatus, wherein, the sound regards Frequency information includes playing content, collection of drama mark and current play time.
- 5. voice barrage synchronous method according to claim 4, it is characterised in that the response audio/video information collection refers to Order includes implementations below：The electric terminal vibrating state of itself is detected, and judges that when the vibrating state meets preset value audio and video need to be carried out Information gathering；OrThe screen pressure value in the electric terminal is detected, and judgement need to carry out audio and video letter when the pressure value meets preset value Breath collection.
- 6. voice barrage synchronous method according to claim 1, it is characterised in that the audio/video information can be audio Information or audio and video playing picture.
- 7. a kind of voice barrage synchronous method, is applied to the server with electric terminal communication connection, it is characterised in that institute The method of stating includes：Receive the audio/video information played in the audio frequency apparatus of the electric terminal collection；Corresponding voice data is obtained according to the audio/video information and judges whether the size of data of the voice data is more than Preset value, if more than the voice data then is divided into the subdata bag of multiple preset lengths and is preserved；Correspondence based on the subdata bag and the time of the voice data sends multiple subdata bags to institute successively State audio frequency apparatus by make the audio frequency apparatus in a manner of barrage by the subdata bag simultaneous display in the audio and video played In.
- 8. a kind of voice barrage synchronization system, it is characterised in that the voice barrage synchronization system includes electric terminal, audio is set Standby and server, the server communicate to connect respectively with the electric terminal and audio frequency apparatus, the electric terminal and described Audio frequency apparatus communicates to connect；The electric terminal is used to gather the audio/video information played in the audio frequency apparatus and is sent to the server；The server is used to obtain corresponding voice data according to the audio/video information and judges the voice data Whether size of data is more than preset value, if more than the voice data then is divided into the subdata bag of multiple preset lengths simultaneously Preserve；AndThe server is according to the corresponding time relationship of multiple subdata bags and the voice data by multiple subdata bags Send successively to the audio frequency apparatus by make the audio frequency apparatus in a manner of barrage by the subdata bag simultaneous display In the audio and video of broadcasting.
- 9. voice barrage synchronization system according to claim 8, it is characterised in that the server includes memory, deposits Storage controller, processor and voice barrage sychronisation, the voice barrage sychronisation include：Information receiving module, the audio/video information played in the audio frequency apparatus for receiving electric terminal collection；Judgment module, for obtaining corresponding voice data according to the audio/video information and judging the data of the voice data Whether size is more than preset value, if more than the voice data then is divided into the subdata bag of multiple preset lengths and is preserved；Voice synchronization module, for based on the correspondence of the subdata bag and the voice data time by the plurality of subnumber Sent successively to the audio frequency apparatus according to bag to make the audio frequency apparatus that the subdata bag simultaneous display exist in a manner of barrage In the audio and video played.
- 10. voice barrage synchronization system according to claim 9, it is characterised in that the judgment module includes：Index creation unit, for according to included in the audio/video information broadcasting content, collection of drama mark and it is currently playing when Between create index；Voice acquisition unit, for the index to be compared with the audio, video data that prestores, and obtained according to comparison result and Its corresponding voice data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711145376.1A CN108024121B (en) | 2017-11-17 | 2017-11-17 | Voice barrage synchronization method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711145376.1A CN108024121B (en) | 2017-11-17 | 2017-11-17 | Voice barrage synchronization method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108024121A true CN108024121A (en) | 2018-05-11 |
| CN108024121B CN108024121B (en) | 2020-02-07 |
Family
ID=62079810
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711145376.1A Active CN108024121B (en) | 2017-11-17 | 2017-11-17 | Voice barrage synchronization method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108024121B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111026558A (en) * | 2019-11-25 | 2020-04-17 | 上海哔哩哔哩科技有限公司 | Bullet screen processing method and system based on WeChat applet |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102937972A (en) * | 2012-10-15 | 2013-02-20 | 上海外教社信息技术有限公司 | Audiovisual subtitle making system and method |
| US20140270680A1 (en) * | 2013-03-15 | 2014-09-18 | JBF Interlude 2009 LTD - ISRAEL | System and Method for Synchronization of Selectably Presentable Media Streams |
| CN104822093A (en) * | 2015-04-13 | 2015-08-05 | 腾讯科技（北京）有限公司 | Comment issuing method and device thereof |
| CN104994401A (en) * | 2015-07-03 | 2015-10-21 | 王春晖 | Barrage processing method, device and system |
| CN105657482A (en) * | 2016-03-28 | 2016-06-08 | 广州华多网络科技有限公司 | Voice barrage realization method and device |
| US9602858B1 (en) * | 2013-01-28 | 2017-03-21 | Agile Sports Technologies, Inc. | Method and system for synchronizing multiple data feeds associated with a sporting event |
| CN106878805A (en) * | 2017-02-06 | 2017-06-20 | 广东小天才科技有限公司 | Mixed language subtitle file generation method and device |
| CN107105324A (en) * | 2017-03-31 | 2017-08-29 | 武汉斗鱼网络科技有限公司 | A kind of method and client of protection barrage information |
| CN107277594A (en) * | 2017-07-06 | 2017-10-20 | 广州华多网络科技有限公司 | A kind of video and audio and barrage synchronous method and device |
-
2017
- 2017-11-17 CN CN201711145376.1A patent/CN108024121B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102937972A (en) * | 2012-10-15 | 2013-02-20 | 上海外教社信息技术有限公司 | Audiovisual subtitle making system and method |
| US9602858B1 (en) * | 2013-01-28 | 2017-03-21 | Agile Sports Technologies, Inc. | Method and system for synchronizing multiple data feeds associated with a sporting event |
| US20140270680A1 (en) * | 2013-03-15 | 2014-09-18 | JBF Interlude 2009 LTD - ISRAEL | System and Method for Synchronization of Selectably Presentable Media Streams |
| CN104822093A (en) * | 2015-04-13 | 2015-08-05 | 腾讯科技（北京）有限公司 | Comment issuing method and device thereof |
| CN104994401A (en) * | 2015-07-03 | 2015-10-21 | 王春晖 | Barrage processing method, device and system |
| CN105657482A (en) * | 2016-03-28 | 2016-06-08 | 广州华多网络科技有限公司 | Voice barrage realization method and device |
| CN106878805A (en) * | 2017-02-06 | 2017-06-20 | 广东小天才科技有限公司 | Mixed language subtitle file generation method and device |
| CN107105324A (en) * | 2017-03-31 | 2017-08-29 | 武汉斗鱼网络科技有限公司 | A kind of method and client of protection barrage information |
| CN107277594A (en) * | 2017-07-06 | 2017-10-20 | 广州华多网络科技有限公司 | A kind of video and audio and barrage synchronous method and device |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111026558A (en) * | 2019-11-25 | 2020-04-17 | 上海哔哩哔哩科技有限公司 | Bullet screen processing method and system based on WeChat applet |
| US11711333B2 (en) | 2019-11-25 | 2023-07-25 | Shanghai Bilibili Technology Co., Ltd. | Bullet comment processing method and system based on WeChat applet |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108024121B (en) | 2020-02-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106162235B (en) | For the method and apparatus of Switch Video stream | |
| US10123066B2 (en) | Media playback method, apparatus, and system | |
| CN107071503A (en) | The method of net cast, device and live connect streaming server | |
| CN109168026A (en) | Instant video display methods, device, terminal device and storage medium | |
| EP2901372A2 (en) | Using digital fingerprints to associate data with a work | |
| CN104717542B (en) | A kind of synchronizing information acquisition methods, the apparatus and system of smart television | |
| CN106488291A (en) | The method and apparatus of simultaneous display file in net cast | |
| CN104185040A (en) | Application synchronization method, application server and terminal | |
| CN103596063B (en) | Terminal, television, multi-screen interaction system and method for setting screen capture parameters | |
| CN106921865A (en) | Method for processing video frequency and device | |
| CN110267093A (en) | Live video pushing method and device, storage medium, terminal and live mirror | |
| CN110234015A (en) | Live broadcast control method and device, storage medium and terminal | |
| US9338508B2 (en) | Preserving a consumption context for a user session | |
| CN105227987B (en) | synchronous playing method and system | |
| KR20200077176A (en) | Apparatus and method for recommending keyword related to video | |
| CN109963106B (en) | Video image processing method and device, storage medium and terminal | |
| CN106559699A (en) | A kind of multi-screen interaction method of IPTV, server and system | |
| CN114866827A (en) | Audio and video synchronization detection method and device, storage medium and electronic equipment | |
| CN106791903A (en) | Live processing system, unit and method | |
| CN108024121A (en) | Voice barrage synchronous method and system | |
| CN103826158B (en) | A kind of network direct broadcasting apparatus and method | |
| CN104639976A (en) | Method for synchronizing programs of set top box and mobile terminal, set top box and mobile terminal | |
| US9485458B2 (en) | Data processing method and device | |
| CN107995538B (en) | Video annotation method and system | |
| CN110351577A (en) | Live information processing method and processing device, storage medium, electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |