CN109327724B - Audio and video synchronous playing method and device - Google Patents
Audio and video synchronous playing method and device Download PDFInfo
- Publication number
- CN109327724B CN109327724B CN201710648648.3A CN201710648648A CN109327724B CN 109327724 B CN109327724 B CN 109327724B CN 201710648648 A CN201710648648 A CN 201710648648A CN 109327724 B CN109327724 B CN 109327724B
- Authority
- CN
- China
- Prior art keywords
- audio
- data frame
- video data
- playing
- video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/439—Processing of audio elementary streams
- H04N21/4394—Processing of audio elementary streams involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
Abstract
The invention provides an audio and video synchronous playing method and device, wherein the audio and video synchronous playing method comprises the step of acquiring t which is used for canceling silence of an audio and video data sending end0At the moment, muting is that the audio and video data sending end stops sending audio data frames; according to t0At the moment, the playing time length corresponding to the cached video data frame in the video buffer area is determined to determine t0The delay playing time of the audio data frame received at the moment; and synchronously playing the video data frames and the audio data frames. In the audio and video synchronous playing method provided by the invention, the audio and video data sending end cancels silence, and the audio and video data playing end controls the delayed playing of the received audio data frame after receiving the audio data frame sent by the audio and video data sending end, thereby achieving the effect of audio and video synchronous playing. The problem of the audio and video synchronization effect that audio and video data broadcast end appears when the audio and video data send end appears the condition of sending silence among the prior art is solved.
Description
Technical Field
The embodiment of the invention relates to the technical field of audio and video data processing, in particular to an audio and video synchronous playing method and device.
Background
In the audio and video playing process, such as video chat or video conference, the synchronous playing of the audio and the video can improve the audio and video experience of the user.
In the prior art, when an audio/video data sending end is in a mute state, a player receives an audio data packet and a video data packet and acquires an audio data frame and a video data frame, the audio data frame and the video data frame are respectively cached and decrypted according to a certain frame number proportion, and then the audio data frame and the video data frame cached according to the proportion are played by the player end, so that synchronous playing of the audio data frame and the video data frame is realized. For example, the playing time of each audio data frame is 20 milliseconds, the playing time of each video data frame is 40 milliseconds, when the audio data sending end buffers the audio data frames (50 frames) with the playing time of 1 second, the video data frames (25 frames) with the playing time of 1 second are also buffered, the audio data frames and the corresponding video data frames are buffered according to the frame number ratio of 2:1 and sent to the audio data playing end according to the same frame number ratio, and then played by the audio data playing end according to the same frame number ratio.
However, the effect of implementing audio and video synchronization by using the prior art is not good.
Disclosure of Invention
The embodiment of the invention provides an audio and video synchronization playing method and device, and aims to solve the problem that the effect of realizing audio and video synchronization by using the prior art is poor.
The execution main body of the embodiment of the invention is an audio and video data playing end, and one aspect of the embodiment of the invention provides an audio and video synchronous playing method, which comprises the following steps:
t for acquiring mute cancellation of audio and video data sending end0At the moment, the mute is that the audio and video data sending end stops sending audio data frames;
according to the above-mentioned t0At the moment, the playing time length corresponding to the cached video data frame in the video buffer area is determined to determine the t0The delay playing time of the audio data frame received at the moment;
and synchronously playing the video data frame and the audio data frame.
Optionally, said is according to t0At the moment, the playing time length corresponding to the cached video data frame in the video buffer area is determined to determine the t0The time delay playing time of the audio data frame received at the moment comprises the following steps:
determining the above t0The time length corresponding to the buffered video data frame in the video buffer at the moment is t0And the delayed playing time of the audio data frame received at the moment.
Optionally, said is according to t0At the moment, the playing time length corresponding to the cached video data frame in the video buffer area is determinedt0The time delay playing time of the audio data frame received at the moment comprises the following steps:
acquiring the transmission time of the audio data frame;
determining the above t0The sum of the time length corresponding to the buffered video data frame in the video buffer and the transmission time of the audio data frame at the moment is t0And the delayed playing time of the audio data frame received at the moment.
Optionally, the sending end for obtaining audio and video data cancels t of silence0The time of day includes:
t above0Before the moment, the audio data frame cannot be received; t above0And at the moment, the audio data frame begins to be received.
Optionally, the sending end for obtaining audio and video data cancels t of silence0The time of day includes:
determining the t according to a mute cancellation instruction sent by the audio and video data sending end0The time of day.
Optionally, the synchronously playing the video data frame and the audio data frame includes:
respectively caching the video data frames and the audio data frames corresponding to the video data frames by taking the playing time of X milliseconds as a caching unit, wherein X is a positive number;
and synchronously playing the video data frame of each cache unit and the audio data frame corresponding to the video data frame in sequence.
A second aspect of the embodiments of the present invention provides an audio and video synchronous playing device, including:
the device comprises an acquisition module, a delay module and a playing module;
the acquisition module is used for acquiring t for canceling silence at the audio and video data sending end0At the moment, the mute is that the audio and video data sending end stops sending audio data frames;
the delay module is used for according to the t0At the moment, the playing time length corresponding to the cached video data frame in the video buffer area is determined to determine the t0The delay playing time of the audio data frame received at the moment;
the playing module is used for synchronously playing the video data frame and the audio data frame.
Optionally, the delay module includes: a determination unit;
the determination unit is configured to determine the t0The time length corresponding to the buffered video data frame in the video buffer at the moment is t0And the delayed playing time of the audio data frame received at the moment.
Optionally, the delay module includes: a determining unit and an acquiring unit;
the acquisition unit is used for acquiring the transmission time of the audio data frame;
the determination unit is configured to determine the t0The sum of the time length corresponding to the buffered video data frame in the video buffer and the transmission time of the audio data frame at the moment is t0And the delayed playing time of the audio data frame received at the moment.
Optionally, the playing module includes: a cache unit and a synchronization unit;
the buffer unit is used for respectively buffering the video data frames and the audio data frames corresponding to the video data frames by taking the playing time of X milliseconds as a buffer unit, wherein X is a positive number;
the synchronization unit is configured to sequentially and synchronously play the video data frame and the audio data frame corresponding to the video data frame of each buffer unit.
The audio and video synchronous playing method and device provided by the embodiment, wherein the audio and video synchronous playing method comprises the step of acquiring t which is used for canceling silence at an audio and video data sending end0At the moment, the mute is that the audio and video data sending end stops sending audio data frames; according to the above-mentioned t0At the moment, the playing time length corresponding to the cached video data frame in the video buffer area is determined to determine the t0The delay playing time of the audio data frame received at the moment; synchronously playing the video data frame and the audioAnd (4) data frame. In the audio and video synchronous playing method provided by the embodiment of the invention, the audio and video data sending end cancels silence, and after the audio and video data playing end receives the audio data frame sent by the audio and video data sending end, the received audio data frame is controlled to be played in a delayed manner, and the delayed time length is the playing time length corresponding to the played video data frame buffered in the video buffer area when the audio and video data sending end cancels silence, so that the effect of audio and video synchronous playing is achieved. The problem of the audio and video synchronization effect that audio and video data broadcast end appears when the audio and video data send end appears the condition of sending silence among the prior art is solved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, a brief description will be given below of the drawings required for the embodiments or the technical solutions in the prior art, and it is obvious that the drawings in the following description are some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
Fig. 1 is a schematic flow chart of a first embodiment of a method and a device for synchronously playing audio and video in the present invention;
fig. 2 is a schematic diagram of a first principle of an audio and video synchronous playing method and device according to a first embodiment of the present invention;
fig. 3 is a schematic flow chart of a second embodiment of the audio and video synchronous playing method and device of the present invention;
fig. 4 is a schematic diagram illustrating a principle of a second embodiment of the audio and video synchronous playing method and apparatus according to the present invention;
fig. 5 is a schematic structural diagram of a first embodiment of the audio and video synchronous playing method and device of the present invention;
fig. 6 is a schematic structural diagram of a second embodiment of the audio and video synchronous playing method and device of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The terms "first," "second," "third" and/or "fourth," etc. in the description and claims of the invention and in the above-described drawings, if any, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are, for example, capable of operation in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
In the method for realizing audio and video synchronization in the prior art, when a sending mute state occurs at an audio and video data sending end (namely, only video data is sent to the audio and video data playing end, and audio data is not sent to the audio and video data playing end), the audio and video data playing end has the problem of poor audio and video synchronization effect.
In the audio and video synchronous playing method provided by the embodiment of the invention, the audio and video data sending end cancels silence, and after the audio and video data playing end receives the audio data frame sent by the audio and video data sending end, the received audio data frame is controlled to be played in a delayed manner, and when the audio and video data sending end cancels silence, the video buffer area buffers playing time corresponding to the played video data frame, so that the audio and video data playing end achieves the effect of audio and video synchronous playing. The problem of the audio and video synchronization effect that audio and video data broadcast end appears when the audio and video data send end appears the condition of sending silence among the prior art is solved.
The present invention provides the following detailed description of the technical solution of the present invention with specific examples. The following several specific embodiments may be combined with each other, and details of the same or similar concepts or processes may not be repeated in some embodiments.
Fig. 1 is a schematic flowchart of a first embodiment of the audio and video synchronous playing method and device of the present invention, and fig. 2 is a schematic diagram of a principle of the first embodiment of the audio and video synchronous playing method and device of the present invention. Referring to fig. 1, an execution main body of the embodiment is an audio and video data playing end, and the audio and video synchronous playing method provided by the embodiment includes the following contents.
Step 101: t for acquiring mute cancellation of audio and video data sending end0And at the moment, the mute is that the audio and video data sending end stops sending audio data frames.
Step 102: according to the t0At the moment, the playing duration corresponding to the cached video data frame in the video buffer area is determined, and the t is determined0And the delayed playing time of the audio data frame received at the moment.
Step 103: and synchronously playing the video data frame and the audio data frame.
Specifically, referring to fig. 2, the video buffer area and the audio buffer area of the audio/video data playing end are at t1Before the moment, the data is synchronously buffered and synchronously played. The playing speed of the audio data frame and the playing speed of the video data frame are respectively fixed, so that the frame number of the audio data frame and the frame number of the video data frame respectively correspond to the respective playing duration.
t1At the time, the video data frame and the audio data frame are synchronously played to T1Time of day, i.e. t1The playing time of the video buffer area and the audio buffer area which are cached but not played at the moment is X milliseconds. At this time (i.e. t)1Moment), the sending end of the audio and video data is muted, the audio buffer area of the audio and video data playing end cannot receive the audio data, and the video buffer area of the audio and video data playing end still normally receives and buffers the video data frame.
Until t after S ms0Time, audio-visualThe audio data sending end cancels the mute, the audio buffer area of the audio and video data playing end continues to buffer the audio data frame, and the buffered video data frame is played to T millisecond after S millisecond in the mute process0The time of day. If so, playing t by the audio and video data playing end0The audio data frame a buffered at any moment can cause the audio data frame a and the video data frame b to be played simultaneously, so that the audio data frame and the video data frame are played asynchronously.
In the audio/video playing synchronization method provided by this embodiment, t for canceling silence at the audio/video data sending end0At the moment, t is determined according to the playing time corresponding to the buffered video data frame in the video buffer area0The implementation manner of the delay playing time of the audio data frame received at the moment is as follows: determining the t0The time length (i.e. Y milliseconds in fig. 2) corresponding to the buffered video data frame in the video buffer at the moment is the time t0And the delayed playing time of the audio data frame received at the moment. In Y milliseconds, the audio and video data playing end only plays the video data frames; then, the video data frame a' in the video buffer and the audio data frame a in the audio buffer are synchronously played. Furthermore, in the audio and video synchronous playing method provided by this embodiment, when the audio and video data sending end generates silence, the audio and video data playing end can still achieve the effect of audio and video synchronous playing.
In the audio and video synchronous playing method provided by this embodiment, the audio and video data sending end cancels silence, and the audio and video data playing end receives the audio data frame sent by the audio and video data sending end and then controls the received audio data frame to be played in a delayed manner, where the delay time is the playing time corresponding to the playing video data frame buffered in the video buffer area when the audio and video data sending end cancels silence, so that the audio and video data playing end achieves the effect of audio and video synchronous playing. The problem of the audio and video synchronization effect that audio and video data broadcast end appears when the audio and video data send end appears the condition of sending silence among the prior art is solved.
Fig. 3 is a schematic flowchart of a second embodiment of the audio and video synchronous playing method and apparatus of the present invention, and fig. 4 is a schematic diagram of a principle of the second embodiment of the audio and video synchronous playing method and apparatus of the present invention. The embodiment is performed on the basis of the first embodiment, and referring to fig. 3, the audio and video synchronous playing method provided by the embodiment includes the following contents.
Step 201: according to the t0The audio data frame cannot be received before the time, t0The audio data frame is received from the moment, and t for canceling silence of the audio and video data sending end is determined0And at the moment, the mute is that the audio and video data sending end stops sending audio data frames.
Specifically, the step provides a t for acquiring audio and video data and canceling silence at a sending end0The implementation mode of the time is that the audio and video data playing end plays audio and video data according to t0The audio data frame is not received before the time instant t0The audio data frame is received from the moment, and t for canceling silence of the audio and video data sending end is determined0The time of day.
Optionally, t for canceling silence at another sending end for acquiring audio and video data0The audio and video data playing end can also determine the t according to the mute cancellation indication sent by the audio and video data sending end0The time of day.
Step 202: and acquiring the transmission time of the audio data frame.
Step 203: determining the t0The sum of the time length corresponding to the buffered video data frame in the video buffer area at the moment and the transmission time of the audio data frame is t0And the delayed playing time of the audio data frame received at the moment.
Specifically, it takes a certain time for the audio data frame or the video data frame to be transmitted from the audio/video data transmitting terminal to the audio/video time playing terminal. Specifically, referring to fig. 4 (where fig. 4 is implemented on the basis of fig. 2), if a certain time required for an audio data frame or a video data frame to be transmitted from an audio/video data transmitting end to an audio/video time playing end is L milliseconds, t is t milliseconds0At the moment, the sending end of the audio and video data cancels silence, t2Time of dayAnd the audio data frame is cached to the audio and video data playing end.
T0At the moment, the video data frame cached in the mute process of the audio and video data playing end is played to T after S milliseconds0The time of day. If the audio and video data playing end plays t2The audio data frame a buffered at any moment can cause the audio data frame a and the video data frame b to be played simultaneously, so that the audio data frame and the video data frame are played asynchronously.
In the audio/video playing synchronization method provided by this embodiment, t for canceling silence at the audio/video data sending end0At the moment, t is determined according to the sum (Y' millisecond in FIG. 4) of the playing time (Y millisecond in FIG. 4) corresponding to the buffered video data frame in the video buffer and the transmission time (L millisecond in FIG. 4) of the audio data frame0And the delayed playing time of the audio data frame received at the moment. In Y' milliseconds, the audio and video data playing end only plays video data frames; then, the video data frame a' in the video buffer and the audio data frame a in the audio buffer are synchronously played. Furthermore, the audio and video synchronous playing method provided by the embodiment can still achieve the effect of audio and video synchronous playing when the audio and video data sending end is muted.
Step 204: and respectively caching the video data frames and the audio data frames corresponding to the video data frames by taking the playing time of X milliseconds as a caching unit, wherein X is a positive number.
Step 205: and synchronously playing the video data frame of each cache unit and the audio data frame corresponding to the video data frame in sequence.
Optionally, in the audio/video playing synchronization method provided in this embodiment, when the audio/video data is cached, every time a video data frame with a playing time of X milliseconds is cached, an audio data frame with the same playing time is cached at the same time, and the playing time of X milliseconds may be selected to correspond to one cache unit, and when a video data frame and/or an audio data frame of at least one cache unit is cached in a cache region of the audio/video data playing end, the cached video data frame and/or audio data frame starts to be played.
In-sequence synchronizationBuffer area t of playing audio and video data playing end2And the video data frame of each cache unit and the audio data frame corresponding to the video data frame after the moment, so that the effect of synchronously playing the audio and video data is achieved.
Optionally, before the audio/video data playing end plays the video data frame and/or the audio data frame in the buffer area, the audio/video data playing end decodes the video data frame and/or the audio data frame.
Optionally, the audio/video data playing end receives the audio data packet and/or the video data packet sent by the audio/video data sending end, and needs to frame the audio data packet and/or the video data packet respectively first, and then buffer the audio data packet and/or the video data packet in the buffer area respectively.
In the audio and video playing synchronization method provided by this embodiment, on the basis of the first embodiment, when determining the delay playing time of the audio data frame after the muting cancellation, the audio and video data playing end further considers the data transmission time required for the audio data frame or the video data frame to be transmitted from the audio and video data transmitting end to the audio and video time playing end, so as to further improve the effect of achieving the audio and video synchronous playing. The problem of the audio and video synchronization effect that audio and video data broadcast end appears when the audio and video data send end appears the condition of sending silence among the prior art is solved.
Fig. 5 is a schematic structural diagram of a first embodiment of the audio and video synchronous playing method and device of the present invention. Referring to fig. 5, the audio/video synchronous playing device provided in this embodiment includes: the device comprises an acquisition module 11, a delay module 12 and a playing module 13.
The obtaining module 11 is configured to obtain t for canceling silence at the audio/video data sending end0And at the moment, the mute is that the audio and video data sending end stops sending audio data frames.
The delay module 12 is configured to delay the time according to the t0At the moment, the playing duration corresponding to the cached video data frame in the video buffer area is determined, and the t is determined0And the delayed playing time of the audio data frame received at the moment.
The delay module 12 includes: a determination unit 122, theA determination unit 122 for determining the t0The time length corresponding to the cached video data frame in the video buffer area at the moment is t0And the delayed playing time of the audio data frame received at the moment.
The playing module 13 is configured to play the video data frames and the audio data frames synchronously.
The audio and video synchronous playing device provided in fig. 5 can be used to implement the audio and video synchronous playing method in the first embodiment, and specific implementation processes and technical effects of each module in the device are not described again.
Fig. 6 is a schematic structural diagram of a second embodiment of the audio and video synchronous playing method and device of the present invention. Referring to fig. 6, fig. 6 is implemented on the basis of fig. 5, and the audio/video synchronous playing device provided by the present embodiment includes the following contents.
The delay module 12 further includes an obtaining unit 121, where the obtaining unit 121 is configured to obtain a transmission time of the audio data frame; the determining unit 122 is further configured to determine the t0The sum of the time length corresponding to the buffered video data frame in the video buffer area at the moment and the transmission time of the audio data frame is t0And the delayed playing time of the audio data frame received at the moment.
The playing module 13 includes: a buffer unit 131 and a synchronization unit 132.
The buffer unit 131 is configured to buffer the video data frames and the audio data frames corresponding to the video data frames respectively by using a play duration of X milliseconds as a buffer unit, where X is a positive number.
The synchronization unit 132 is configured to sequentially and synchronously play the video data frame and the audio data frame corresponding to the video data frame of each buffer unit.
The audio and video synchronous playing device provided in fig. 6 can be used to implement the audio and video synchronous playing method in the second embodiment, and specific implementation processes and technical effects of each module in the device are not described again.
Those of ordinary skill in the art will understand that: all or a portion of the steps of implementing the above-described method embodiments may be performed by hardware associated with program instructions. The program may be stored in a computer-readable storage medium. When executed, the program performs steps comprising the method embodiments described above; and the aforementioned storage medium includes: various media that can store program codes, such as ROM, RAM, magnetic or optical disks.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention.
Claims (6)
1. An audio and video synchronous playing method is characterized by comprising the following steps:
t for acquiring mute cancellation of audio and video data sending end0At the moment, the mute refers to the stop of sending the audio data frame by the audio and video data sending end;
according to the t0At the moment, the playing duration corresponding to the buffered video data frame in the video buffer area and the transmission time of the audio data frame are determined, and the t is determined0The delay playing time of the audio data frame received at the moment;
synchronously playing the video data frame and the audio data frame;
according to the t0At the moment, the playing duration corresponding to the buffered video data frame in the video buffer area and the transmission time of the audio data frame are determined, and the t is determined0The time delay playing time of the audio data frame received at the moment comprises the following steps: acquiring the transmission time of the audio data frame; determining the t0The sum of the playing time corresponding to the buffered video data frame in the video buffer area at the moment and the transmission time of the audio data frame is t0Received at a moment of timeAnd the delayed playing time of the audio data frame.
2. The method according to claim 1, wherein t for canceling silence is obtained at the audio/video data obtaining sending end0The time of day includes:
according to the t0The audio data frame cannot be received before the time, t0The audio data frame is received from the moment, and t for canceling silence of the audio and video data sending end is determined0The time of day.
3. The method according to claim 1, wherein t for canceling silence is obtained at the audio/video data obtaining sending end0The time of day, still include:
determining the t according to a mute cancellation instruction sent by the audio and video data sending end0The time of day.
4. The method of claim 1, wherein said synchronously playing the video data frames and the audio data frames comprises:
respectively caching the video data frames and the audio data frames corresponding to the video data frames by taking the playing time of X milliseconds as a caching unit, wherein X is a positive number;
and synchronously playing the video data frame of each cache unit and the audio data frame corresponding to the video data frame in sequence.
5. An audio and video synchronous playing device is characterized by comprising:
the device comprises an acquisition module, a delay module and a playing module;
the acquisition module is used for acquiring t for canceling silence of the audio and video data sending end0At the moment, the mute refers to the stop of sending the audio data frame by the audio and video data sending end;
the delay module is used for according to the t0At the moment, the playing duration corresponding to the buffered video data frame in the video buffer area and the playing duration of the audio data frameA transmission time, determining the t0The delay playing time of the audio data frame received at the moment;
the playing module is used for synchronously playing the video data frame and the audio data frame;
the delay module includes: a determining unit and an acquiring unit;
the acquisition unit is used for acquiring the transmission time of the audio data frame;
the determination unit is used for determining the t0The sum of the playing time corresponding to the buffered video data frame in the video buffer area at the moment and the transmission time of the audio data frame is t0And the delayed playing time of the audio data frame received at the moment.
6. The apparatus of claim 5, wherein the playback module comprises: a cache unit and a synchronization unit;
the buffer unit is used for respectively buffering the video data frame and the audio data frame corresponding to the video data frame by taking the playing time of X milliseconds as a buffer unit, wherein X is a positive number;
the synchronization unit is used for synchronously playing the video data frame of each cache unit and the audio data frame corresponding to the video data frame in sequence.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710648648.3A CN109327724B (en) | 2017-08-01 | 2017-08-01 | Audio and video synchronous playing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710648648.3A CN109327724B (en) | 2017-08-01 | 2017-08-01 | Audio and video synchronous playing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109327724A CN109327724A (en) | 2019-02-12 |
| CN109327724B true CN109327724B (en) | 2021-08-31 |
Family
ID=65245308
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710648648.3A Active CN109327724B (en) | 2017-08-01 | 2017-08-01 | Audio and video synchronous playing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109327724B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114827696B (en) * | 2021-01-29 | 2023-06-27 | 华为技术有限公司 | Method for synchronously playing audio and video data of cross-equipment and electronic equipment |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102075767A (en) * | 2010-11-29 | 2011-05-25 | 大连捷成实业发展有限公司 | Video and audio automatic synchronization processing method |
| CN103167342A (en) * | 2013-03-29 | 2013-06-19 | 天脉聚源(北京)传媒科技有限公司 | Audio and video synchronous processing device and method |
| CN103237191A (en) * | 2013-04-16 | 2013-08-07 | 成都飞视美视频技术有限公司 | Method for synchronously pushing audios and videos in video conference |
| CN103327364A (en) * | 2013-06-08 | 2013-09-25 | 广东欧珀移动通信有限公司 | Wireless transmission method and device for audio and video playing |
| CN103905881A (en) * | 2014-03-13 | 2014-07-02 | 北京奇艺世纪科技有限公司 | Video data and audio data synchronized playing method and device and equipment |
| CN104618786A (en) * | 2014-12-22 | 2015-05-13 | 深圳市腾讯计算机系统有限公司 | Audio/video synchronization method and device |
| CN105744334A (en) * | 2016-02-18 | 2016-07-06 | 海信集团有限公司 | Method and equipment for audio and video synchronization and synchronous playing |
| CN106686438A (en) * | 2016-12-29 | 2017-05-17 | 北京奇艺世纪科技有限公司 | Cross-device audio/image synchronous playing method, equipment and system |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7274862B2 (en) * | 2001-09-27 | 2007-09-25 | Sony Corporation | Information processing apparatus |
| US7280133B2 (en) * | 2002-06-21 | 2007-10-09 | Koninklijke Philips Electronics, N.V. | System and method for queuing and presenting audio messages |
| EP1879346A1 (en) * | 2006-07-14 | 2008-01-16 | Sony Service Centre (Europe) N.V. | System and method of audio/video streaming |
| TWI338508B (en) * | 2006-12-20 | 2011-03-01 | Ind Tech Res Inst | Method and apparatus for audio/video synchronization |
| CN102075728B (en) * | 2011-01-18 | 2015-08-12 | 中兴通讯股份有限公司 | The method and system of a kind of shared audio frequency and/or video |
| CN104639955B (en) * | 2015-03-09 | 2017-10-27 | 德科仕通信(上海)有限公司 | The method for detecting MPEG2 TS VBR code stream quality problems |
| CN105657579A (en) * | 2015-10-29 | 2016-06-08 | 乐视致新电子科技（天津）有限公司 | Live broadcast audio switching method, stream media server and client |
| CN105516090B (en) * | 2015-11-27 | 2019-01-22 | 刘军 | Media playing method, equipment and music lesson system |
-
2017
- 2017-08-01 CN CN201710648648.3A patent/CN109327724B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102075767A (en) * | 2010-11-29 | 2011-05-25 | 大连捷成实业发展有限公司 | Video and audio automatic synchronization processing method |
| CN103167342A (en) * | 2013-03-29 | 2013-06-19 | 天脉聚源(北京)传媒科技有限公司 | Audio and video synchronous processing device and method |
| CN103237191A (en) * | 2013-04-16 | 2013-08-07 | 成都飞视美视频技术有限公司 | Method for synchronously pushing audios and videos in video conference |
| CN103327364A (en) * | 2013-06-08 | 2013-09-25 | 广东欧珀移动通信有限公司 | Wireless transmission method and device for audio and video playing |
| CN103905881A (en) * | 2014-03-13 | 2014-07-02 | 北京奇艺世纪科技有限公司 | Video data and audio data synchronized playing method and device and equipment |
| CN104618786A (en) * | 2014-12-22 | 2015-05-13 | 深圳市腾讯计算机系统有限公司 | Audio/video synchronization method and device |
| CN105744334A (en) * | 2016-02-18 | 2016-07-06 | 海信集团有限公司 | Method and equipment for audio and video synchronization and synchronous playing |
| CN106686438A (en) * | 2016-12-29 | 2017-05-17 | 北京奇艺世纪科技有限公司 | Cross-device audio/image synchronous playing method, equipment and system |
Non-Patent Citations (1)
| Title |
|---|
| Internet上连续媒体的同步技术研究;吴炜;《中国博士学位论文全文数据库》;20070415;全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109327724A (en) | 2019-02-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107566918B (en) | A kind of low delay under video distribution scene takes the neutrel extraction of root | |
| US10020023B2 (en) | Method, apparatus and system for playing audio synchronously | |
| US8160112B2 (en) | Buffering a media stream | |
| US9008321B2 (en) | Audio processing | |
| RU2423009C1 (en) | Method and device to measure synchronisation of talk spurts reproduction within sentence without impact at audibility | |
| JP4782973B2 (en) | Audio and video signal synchronization | |
| RU2507707C2 (en) | Method and apparatus for controlling video and audio data reproduction | |
| CN107517400B (en) | Streaming media playing method and streaming media player | |
| CN113286184B (en) | Lip synchronization method for respectively playing audio and video on different devices | |
| CN103795950A (en) | Television audio signal processing device | |
| US20110010625A1 (en) | Method for Manually Optimizing Jitter, Delay and Synch Levels in Audio-Video Transmission | |
| CN107592430B (en) | Echo cancellation method and terminal equipment | |
| CN110634511B (en) | Audio data processing method and device | |
| CN109379619A (en) | Sound draws synchronous method and device | |
| CN110113621A (en) | Playing method and device, storage medium, the electronic device of media information | |
| CN109327724B (en) | Audio and video synchronous playing method and device | |
| CN112423074B (en) | Audio and video synchronization processing method and device, electronic equipment and storage medium | |
| CN113162812A (en) | Voice processing method, live broadcast voice playing method, device, equipment and system | |
| CN108668167B (en) | Video restoration method and device | |
| US9571425B2 (en) | Method and apparatus for voice communication based on voice activity detection | |
| CN106331847B (en) | Audio and video playing method and apparatus | |
| JP2015012557A (en) | Video audio processor, video audio processing system, video audio synchronization method, and program | |
| CN101335796B (en) | Decoding scheduling method and device | |
| US20120009892A1 (en) | Wireless communication system and method for adjusting used depth of buffer unit in wireless communication system | |
| KR20230129406A (en) | Adjust arc audio playback speed |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |