CN109361945A - The meeting audiovisual system and its control method of a kind of quick transmission and synchronization - Google Patents
The meeting audiovisual system and its control method of a kind of quick transmission and synchronization Download PDFInfo
- Publication number
- CN109361945A CN109361945A CN201811212429.1A CN201811212429A CN109361945A CN 109361945 A CN109361945 A CN 109361945A CN 201811212429 A CN201811212429 A CN 201811212429A CN 109361945 A CN109361945 A CN 109361945A
- Authority
- CN
- China
- Prior art keywords
- module
- audio
- video
- receiving end
- frequency information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000005540 biological transmission Effects 0.000 title claims abstract description 36
- 238000000034 method Methods 0.000 title claims abstract description 32
- 238000012545 processing Methods 0.000 claims abstract description 68
- 238000009877 rendering Methods 0.000 claims abstract description 52
- 230000001360 synchronised effect Effects 0.000 claims abstract description 49
- 238000012795 verification Methods 0.000 claims abstract description 45
- 230000000977 initiatory effect Effects 0.000 claims abstract description 42
- 230000008569 process Effects 0.000 claims abstract description 9
- 238000005070 sampling Methods 0.000 claims description 22
- 230000000737 periodic effect Effects 0.000 claims description 2
- 238000005516 engineering process Methods 0.000 abstract description 9
- 238000010586 diagram Methods 0.000 description 8
- 230000000694 effects Effects 0.000 description 7
- 230000006835 compression Effects 0.000 description 5
- 238000007906 compression Methods 0.000 description 5
- 230000008901 benefit Effects 0.000 description 3
- 238000011161 development Methods 0.000 description 3
- 238000012360 testing method Methods 0.000 description 3
- 238000009825 accumulation Methods 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 230000011664 signaling Effects 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 238000007792 addition Methods 0.000 description 1
- 230000003321 amplification Effects 0.000 description 1
- 230000002045 lasting effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 230000000630 rising effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/40—Support for services or applications
- H04L65/403—Arrangements for multi-party communication, e.g. for conferences
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/439—Processing of audio elementary streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The present invention relates to Streaming Media control technology fields, it specifically discloses a kind of quickly transmission and synchronous meeting audiovisual system is applied to C/S computer architecture, the C/S computer architecture includes shielding initiating terminal, Streaming Media forwarding server-side and at least one same screen together to receive terminal, which includes that acquisition module, coding module, network plug-flow module, timestamp verification module, verification period timing module, at least one receiving end decoder module, at least one receiving end video/audio synchronous processing module and at least one receiving end render processing module；The invention also discloses a kind of control method of meeting audiovisual system quickly transmitted and synchronized, including S1-S5, S1, acquisition information gives the coding module；S2, coded treatment；S3, timestamp label；S4, decoding process；S5, rendering display and rendering play.The present invention improves video transmission rate and video playing fluency, keeps video more synchronous with the broadcasting of audio.
Description
Technical field
The present invention relates to Streaming Media control technology fields, and in particular to a kind of meeting audiovisual system quickly transmitted and synchronized
And its control method.
Background technique
As audio and video technology and network communication technology are more and more mature, demand of the office meeting informationization to video also day
Benefit is promoted, and becomes an important component in entire conference service system.And TV news are as in office meeting
Pith, all kinds of large-scale or mini-sessions often can all use HD video playing function, and to TV news
Quality requirement is higher and higher.
It is universal with 2K HD video (1920*1080 resolution ratio) and 2K high definition resolution display, to the view of meeting
System is listened to realize that the video effect of high definition visual experience provides effective basic guarantee.But due to 2K HD video source
(1920*1080 resolution ratio) video pixel data amount is excessively huge, in transmission process, transmission rate of the network to HD video
Low, the fluency of HD video is low.Due to consideration that sound card and the time interval for grabbing screen acquisition, the time of network transmission in system
The decoding time of consumption and receiving end consumption etc. factor, be easy to causeing system, video lags after running for a period of time
The timestamp accumulation of audio is excessive.
Summary of the invention
In view of this, it is necessary to for above-mentioned problem, propose it is a kind of quickly transmit and synchronous meeting audiovisual system and
Its control method, the transmission of video occurred when carrying out transmission HD video with the meeting audiovisual system solved in above-mentioned background technique
The problem and meeting audiovisual system video and audio that rate is low, playing fluency is poor play nonsynchronous problem.
To achieve the above object, the present invention takes technical solution below:
The meeting audiovisual system of a kind of quick transmission and synchronization is applied to C/S computer architecture, the C/S computer architecture packet
It includes screen initiating terminal, Streaming Media forwarding server-side and at least one same screen together and receives terminal, which includes
One acquisition module, a coding module, a network plug-flow module, timestamp verification module, a verification period timing module, at least
One receiving end decoder module, at least one receiving end video/audio synchronous processing module and at least one receiving end rendering processing
Module；The acquisition module, coding module and network plug-flow module are mounted on in screen initiating terminal；It is each to be received eventually with screen
End is mounted at a receiving end decoder module, a receiving end video/audio synchronous processing module and a receiving end rendering
Manage module；The timestamp verification module and verification period timing module are mounted in Streaming Media forwarding server-side；
The acquisition module is used to acquire the video information and audio-frequency information with screen initiating terminal, and will be collected
Video information and audio-frequency information send the coding module to；
The coding module is for carrying out coded treatment for the video information and audio-frequency information that receive, and by coded treatment
Video information and audio-frequency information afterwards sends the network plug-flow module to；
The network plug-flow module be used for after coding video information and audio-frequency information carry out timestamp label, and by band
The video information of video time stamp and audio-frequency information with audio time stamp forward server-side to be pushed to again by the Streaming Media
Each receiving end decoder module；
The verification period timing module is used to check and/or adjust the time cycle in the verification period timing module
Value, and verification and/or time cycle value adjusted are supplied to the timestamp and check module；
The timestamp verification module is for recording current time stamp, and the calculating video time stamp and audio time
The difference of stamp, and the difference is compared judgement with current time stamp；
The receiving end decoder module is used to for the video information received and audio-frequency information being decoded processing, and will solution
The video pixel data and audio sampling data obtained after code sends the receiving end rendering processing module to；
The receiving end video/audio synchronous processing module is used to check module to video time stamp according to the timestamp
With the judgement of audio time stamp, to synchronize processing to video and audio；
The video pixel data that the receiving end rendering processing module is used to obtain after decoding carries out rendering and shows, and
The audio sampling data obtained after decoding is subjected to rendering broadcasting.
Further, the acquisition module includes screen capture submodule and sound DAQ submodule；Coding module includes
Video encoding module and audio coding module；Receiving end decoder module includes video decoding sub-module and audio decoder submodule；
The screen capture submodule is used to acquire the video information with screen initiating terminal, and by collected video
Information sends the coding module to；
The sound DAQ submodule is used to acquire the audio-frequency information with screen initiating terminal, and by collected audio
Information sends the coding module to；
The video encoding module is for carrying out coded treatment for the video information that receive, and by the view after coded treatment
Frequency information sends the network plug-flow module to；
The audio coding module is for carrying out coded treatment for the audio-frequency information that receive, and by the sound after coded treatment
Frequency information sends the network plug-flow module to；
The video decoding sub-module is used to for the video information received being decoded processing, and the view that decoding is obtained
Frequency pixel data sends the receiving end rendering processing module to；
The audio decoder submodule is used to the audio-frequency information received being decoded processing, and will obtain after decoding
Audio sampling data sends the receiving end rendering processing module to.
Further, the video encoding module carries out at coding the video information received using X264 encoder
Reason；Video information after the video encoding module coded treatment is H.264 video code flow.
Further, the audio coding module carries out coded treatment to the audio-frequency information received using AAC encoder；
The audio coding module coding treated audio-frequency information is AAC audio code stream.
Further, the network plug-flow module uses multicast or unicast mode to each receiving end decoder module
It is pushed.
Further, the time cycle value in the verification period timing module is provided by shielding initiating terminal together.
Further, the time cycle value in the verification period timing module is five seconds.
A kind of control method of the meeting audiovisual system of quick transmission and synchronization be applied to quickly transmission as described above and
Synchronous meeting audiovisual system, the control method the following steps are included:
S1, the acquisition module acquire the video information and audio-frequency information with screen initiating terminal, and will be collected
Video information and audio-frequency information send the coding module to；
The video information received and audio-frequency information are carried out coded treatment by S2, the coding module, and by coded treatment
Video information and audio-frequency information afterwards sends the network plug-flow module to；
S3, the network plug-flow module to after coding video information and audio-frequency information carry out timestamp label, and by band
The video information of video time stamp and audio-frequency information with audio time stamp forward server-side to be pushed to again by the Streaming Media
Each receiving end decoder module；
The video information received and audio-frequency information are decoded processing by S4, the receiving end decoder module, and will solution
The video pixel data and audio sampling data obtained after code sends the receiving end rendering processing module to；
The video pixel data obtained after decoding is carried out rendering and shown by S5, the receiving end rendering processing module, and
The audio sampling data obtained after decoding is subjected to rendering broadcasting.
Further, which further includes following steps after S5:
S6, the network plug-flow module judge it is described with screen initiating terminal and it is each with screen receive terminal whether with screen at
Function executes S7 if same shield successfully, if unsuccessfully terminating entire control process with screen；
Time cycle value checked and/or adjusted is supplied to the time by S7, the verification period timing module
Stamp verification module；
The timestamp verification module carries out period acquisition institute according to the time cycle value checked and/or adjusted
State video time stamp and audio time stamp；
S8, the timestamp verification module calculate the video time stamp and audio time that the network plug-flow module receives
The time difference of stamp, and judge whether the time difference is less than current time stamp or 80ms, S9 is executed if being judged as YES, if sentencing
Break as otherwise without synchronizing processing to video and audio；
S9, the receiving end video/audio synchronous processing module synchronize processing to video and audio.
The invention has the benefit that
One kind of the invention is quickly transmitted and synchronous meeting audiovisual system, by being compiled by H.264 coding techniques and AAC
The combination of code technology, high degree solve in traditional meeting to 2K HD video (1920*1080 resolution ratio) transmission aspect
Fluency, while used video-audio synchronization method combines " slave " synchronisation control means, ensure that entire video frequency co-screen
Synchronous effect stability, and improve the user experience that HD video information in meeting is shown, be user in a meeting
Experience high definition even super clear video frequency co-screen effect and visual impact sense.In terms of video/audio transmission, the present invention uses group
Broadcast mode and carry out network transmission, thus be simple and efficient in transmission process, transmission rate it is fast, can accomplish that being less than the ultralow of 40ms prolongs
When, it is suitble to the real-time streaming media application scenarios of this type.It is more accurate that the present invention allows same screen reception terminal to carry out again
" principal and subordinate " video and audio synchronously control because clock reference referenced by sound card hardware with video video card broadcasting reference clock
Be it is different, present invention employs on the basis of audio axis, preliminary sound is realized to the synchronous method of audio axis by video
Audio video synchronization effect；Inter-media synchronization is the time relationship between audio stream and video flowing to be kept, according to its time difference into
One process of Mobile state adjustment because the present invention be using " principal and subordinate " video frequency co-screen technology, by originating end as host side,
He is used as from generator terminal receiving end, so the video and audio that can only lag behind host side from generator terminal plays.Show through test result if
Time difference limits in a certain range, and video and audio media can be thought in synchronous regime.When audio lags behind video
Time difference when within 80ms, the audiovisual of people is the variation of imperceptible audio-visual synchronization quality, at this time it is considered that
It is in synchronous regime.In conclusion being designed in audio-visual synchronization maximum time difference is limited to 80ms, therefore it can be concluded that under
The judgement of column condition abandons video frame and then accelerates video if audio time stamp is greater than video time stamp plus 80ms
It has been shown that, otherwise normal output video frame display plays.
Detailed description of the invention
Fig. 1 is a kind of structural schematic diagram for the meeting audiovisual system that one kind of the invention is quickly transmitted and synchronized；
Fig. 2 is another structural schematic diagram for the meeting audiovisual system that one kind of the invention is quickly transmitted and synchronized；
Fig. 3 is a kind of workflow of the control method for the meeting audiovisual system that one kind of the invention is quickly transmitted and synchronized
Figure；
Fig. 4 is another workflow of the control method for the meeting audiovisual system that one kind of the invention is quickly transmitted and synchronized
Cheng Tu；
Fig. 5 is that network plug-flow module of the present invention realizes the workflow schematic diagram with screen；
Fig. 6 is the workflow schematic diagram of " principal and subordinate " video and audio synchronisation control means of the present invention；
Fig. 7 is the workflow schematic diagram that verification period timing module of the present invention checks time cycle value；
Fig. 8 is that video/audio synchronous processing module in receiving end of the present invention realizes the synchronous workflow of video/audio
Schematic diagram；
Fig. 9 is the schematic illustration that the present invention carries out that Video Rendering is shown using the cross-platform multimedia development library SDL；
Figure 10 is the structural schematic diagram of C/S computer architecture of the present invention；
Description of symbols:
With screen initiating terminal --- 1；Streaming Media forwards server-side --- and 2；Terminal is received with screen --- 3；Acquire mould
Block --- 11；Coding module --- 12；Network plug-flow module --- 13；Timestamp checks module --- and 21；Check period timing
Module --- 22；Receiving end decoder module --- 31；Receiving end video/audio synchronous processing module --- 32；At the rendering of receiving end
Manage module --- 33；Screen capture submodule --- 111；Sound DAQ submodule --- 112；Video encoding module --- 121；
Audio coding module --- 122；Video decoding sub-module --- 311；Audio decoder submodule --- 312.
Specific embodiment
To make the object, technical solutions and advantages of the present invention clearer, below in conjunction with the embodiment of the present invention, to this hair
Bright technical solution work further clearly and completely describes.It should be noted that described embodiment is only the present invention one
Section Example, instead of all the embodiments.Based on the embodiments of the present invention, those of ordinary skill in the art are not doing
Every other embodiment obtained under the premise of creative work out, shall fall within the protection scope of the present invention.
It is to be appreciated that the orientation or positional relationship of the instructions such as term " on ", "lower", "front", "rear", "left", "right"
To be based on the orientation or positional relationship shown in the drawings, be merely for convenience of description of the present invention and simplification of the description, rather than indicate or
It implies that signified device or element must have a particular orientation, be constructed and operated in a specific orientation, therefore should not be understood as
Limitation of the present invention.
Embodiment 1
As shown in Figure 1, a kind of meeting audiovisual system quickly transmitted and synchronized is applied to C/S computer architecture, C/S meter
Calculating rack structure includes shielding initiating terminal 1, Streaming Media forwarding server-side 2 and at least one same screen together to receive terminal 3, the meeting
Audiovisual system includes an acquisition module 11, a coding module 12, a network plug-flow module 13, timestamp verification module 21, one
Check period timing module 22, at least one receiving end decoder module 31, at least one receiving end video/audio synchronization process mould
Block 32 and at least one receiving end render processing module 33；The acquisition module 11, coding module 12 and network plug-flow module 13
It is mounted on in screen initiating terminal 1；Each same screen reception terminal 3 is mounted on a receiving end decoder module 31, one and connects
Receiving end video/audio synchronous processing module 32 and a receiving end render processing module 33；The timestamp verification module 21 and core
Period timing module 22 is mounted in Streaming Media forwarding server-side 2；
The acquisition module 11 is used to acquire the video information and audio-frequency information with screen initiating terminal 1, and will acquisition
To video information and audio-frequency information send the coding module 12 to；
The coding module 12 is used to the video information and audio-frequency information that receive carrying out coded treatment, and will be at coding
Video information and audio-frequency information after reason send the network plug-flow module 13 to；
The network plug-flow module 13 is used for the video information and audio-frequency information progress timestamp label after coding, and will
Video information with video time stamp and the audio-frequency information with audio time stamp are pushed again by Streaming Media forwarding server-side 2
To each receiving end decoder module 31；
The verification period timing module 22 is used to check and/or adjust the time in the verification period timing module 22
Periodic quantity, and verification and/or time cycle value adjusted are supplied to the timestamp and check module 21；
When the timestamp verification module 21 is for recording current time stamp, and calculating the video time stamp and audio
Between the difference stabbed, and the difference is compared judgement with current time stamp；
The receiving end decoder module 31 is used to for the video information received and audio-frequency information being decoded processing, and will
The video pixel data and audio sampling data obtained after decoding sends the receiving end rendering processing module 33 to；
When the receiving end video/audio synchronous processing module 32 is used to check module 21 to video according to the timestamp
Between stamp and audio time stamp judgement, to synchronize processing to video and audio；
The video pixel data that the receiving end rendering processing module 33 is used to obtain after decoding carries out rendering and shows, with
And the audio sampling data obtained after decoding is subjected to rendering broadcasting.
As shown in Fig. 2, the acquisition module 11 includes screen capture submodule 111 and sound DAQ submodule 112；Coding
Module 12 includes video encoding module 121 and audio coding module 122；Receiving end decoder module 31 includes video decoding sub-module
311 and audio decoder submodule 312；
The screen capture submodule 111 is used to acquire the video information with screen initiating terminal 1 to described with screen hair
It plays the picture that terminal 1 is shown and carries out capture screenshotss to obtain video information, and collected video information sent to described
Coding module 12；
The sound DAQ submodule 112 is used to acquire the audio-frequency information with screen initiating terminal 1 to described with screen hair
It plays the audio that terminal 1 plays to be acquired to obtain audio-frequency information, and sends collected audio-frequency information to the coding
Module 12；
The video encoding module 121 is used to the video information received carrying out coded treatment, and will be after coded treatment
Video information send the network plug-flow module 13 to；
The audio coding module 122 is used to the audio-frequency information received carrying out coded treatment, and will be after coded treatment
Audio-frequency information send the network plug-flow module 13 to；
The video decoding sub-module 311 is used to the video information received being decoded processing, and decoding is obtained
Video pixel data send receiving end rendering processing module 33 to；
The audio decoder submodule 312 is used to for the audio-frequency information received being decoded processing, and will obtain after decoding
To audio sampling data send receiving end rendering processing module 33 to；
The video encoding module 121 carries out coded treatment to the video information received using X264 encoder；It is described
Video information after 121 coded treatment of video encoding module is H.264 video code flow；
The audio coding module 122 carries out coded treatment to the audio-frequency information received using AAC encoder；The sound
Audio-frequency information after 122 coded treatment of frequency coding module is AAC audio code stream；
The network plug-flow module 13 is carried out using multicast or unicast mode to each receiving end decoder module 31
Push；
Time cycle value in the verification period timing module 22 is provided by shielding initiating terminal 1 together；
Time cycle value in the verification period timing module 22 is five seconds.
As shown in Figure 1, Figure 3, a kind of control method of the meeting audiovisual system of quick transmission and synchronization is applied to institute as above
State it is quick transmit and synchronous meeting audiovisual system, the control method the following steps are included:
S1, the acquisition module 11 acquires the video information and audio-frequency information with screen initiating terminal 1, and will collect
Video information and audio-frequency information send the coding module 12 to；
The video information received and audio-frequency information are carried out coded treatment by S2, the coding module 12, and will be at coding
Video information and audio-frequency information after reason send the network plug-flow module 13 to；
S3, it is described 13 pairs of network plug-flow module coding after video information and audio-frequency information carry out timestamp label, and will
Video information with video time stamp and the audio-frequency information with audio time stamp are pushed again by Streaming Media forwarding server-side 2
To each receiving end decoder module 31；
The video information received and audio-frequency information are decoded processing by S4, the receiving end decoder module 31, and will
The video pixel data and audio sampling data obtained after decoding sends the receiving end rendering processing module 33 to；
The video pixel data obtained after decoding is carried out rendering and shown by S5, the receiving end rendering processing module 33, with
And the audio sampling data obtained after decoding is subjected to rendering broadcasting.
Embodiment 2
Embodiment 2 is advanced optimizing for embodiment 1；
As Figure 1 and Figure 4, a kind of control method of the meeting audiovisual system of quick transmission and synchronization includes the following steps:
S1, the acquisition module 11 acquires the video information and audio-frequency information with screen initiating terminal 1, and will collect
Video information and audio-frequency information send the coding module 12 to；
The video information received and audio-frequency information are carried out coded treatment by S2, the coding module 12, and will be at coding
Video information and audio-frequency information after reason send the network plug-flow module 13 to；
S3, it is described 13 pairs of network plug-flow module coding after video information and audio-frequency information carry out timestamp label, and will
Video information with video time stamp and the audio-frequency information with audio time stamp are pushed again by Streaming Media forwarding server-side 2
To each receiving end decoder module 31；
The video information received and audio-frequency information are decoded processing by S4, the receiving end decoder module 31, and will
The video pixel data and audio sampling data obtained after decoding sends the receiving end rendering processing module 33 to；
The video pixel data obtained after decoding is carried out rendering and shown by S5, the receiving end rendering processing module 33, with
And the audio sampling data obtained after decoding is subjected to rendering broadcasting；
Whether S6, the network plug-flow module 13 judge the same screen initiating terminal 1 and each same screen reception terminal 3 with screen
Success executes S7 if same shield successfully, if unsuccessfully terminating entire control process with screen；
S7, when time cycle value checked and/or adjusted is supplied to described by the verification period timing module 22
Between stamp verification module 21；
The timestamp verification module 21 carries out period acquisition according to the time cycle value checked and/or adjusted
The video time stamp and audio time stamp；
S8, the timestamp verification module 21 calculate video time stamp and audio that the network plug-flow module 13 receives
The time difference of timestamp, and judge whether the time difference is less than current time stamp or 80ms, S9 is executed if being judged as YES,
If being judged as otherwise without synchronizing processing to video and audio；
S9, the receiving end video/audio synchronous processing module 32 synchronize processing to video and audio.
Embodiment 3
Embodiment 3 is advanced optimizing for embodiment 1；
As shown in Figure 1, Figure 2, shown in Fig. 3, Fig. 6, Fig. 7, the meeting audiovisual system of a kind of quick transmission and synchronization uses C/S software
Design pattern carries out framework and exploitation, which includes with screen initiating terminal 1 (also referred to as " plug-flow end "), Streaming Media
It forwards server-side 2 and receives terminal 3 with screen；
Wherein, following functions module is contained with screen initiating terminal 1:
1, screen capture submodule 111, for carrying out capture screenshotss, acquisition view to the picture with screen initiating terminal 1
Frequency initial data is transmitted to video encoding module 121；What screen capture submodule 111 was responsible for acquisition is the video original of YUV420 format
Then the video original data of YUV420 format is put into video pixel queue by beginning data, X264 coding module is waited to take video
Pixel data carries out X264 coding；
2, sound DAQ submodule 112 acquires sound for being acquired to the audio broadcasting with screen initiating terminal 1
Frequency initial data is transmitted to audio coding module 122；Sound DAQ submodule plays the audio with screen initiating terminal 1 and carries out
Acquisition is responsible for the audio raw data of acquisition PCM format, the audio raw data of PCM format is then put into audio sample team
Column wait AAC coding module that audio sampling data is taken to carry out AAC coding；
3, video encoding module 121, for using X264 encoder to the YUV image data with screen initiating terminal 1
It is encoded, forms H.264 video code flow；For video encoding module 121 when video pixel queue has data, module can be to acquisition
To YUV420 video pixel data take out, by calling X264 encoder interfaces program to carry out compressed encoding, formed
H.264 video code flow；
4, audio coding module 122, for it is described with screen initiating terminal 1 PCM audio data using AAC encoder into
Row coding, forms AAC audio code stream；When audio sample queue has data, audio coding module 122 is to collected PCM lattice
The audio raw data of formula takes out, and carries out compression volume by the AAC encoder interfaces program inside faac open source audio repository
Code forms AAC audio code stream；
5, network plug-flow module 13, for the video code flow and audio code stream collected with screen initiating terminal 1
It carries out accurately timestamp to calculate label and be transferred to the Streaming Media forwarding server-side by signalling path, then uses multicast
Or unicast mode carries out plug-flow to Streaming Media forwarding server-side；Network plug-flow module 13 mainly includes both sides function:
First aspect is to carry out timestamp to the encoded video code flow with screen initiating terminal 1 and audio code stream
The processing of RTP marking package can first pass through the coding module 12 after audio-video is collected and handle, and audio-video is being encoded place
Just entry time stamp checks the module of module 21 after reason, as shown in Figure 5；A time zero is remembered when first frame reaches, so
It is calculated afterwards according to timestamp of the frame period timestamp of acquisition to following each frame: frameTimeStamp=
LastFrameTimeStamp+frameDuration (wherein frameTimeStamp is current time stamp,
LastFrameTimeStamp is the timestamp of previous frame, and frameDuration is frame period timestamp).Then it is initiated with screen
Terminal 1 start cycle timer service in 5 seconds, when timer reaches timing in 5 seconds, program can actively pass through signalling path to
Streaming Media forwards server-side 2 to send frameTimeStamp time stamp data, is connected to the Streaming Media forwarding service of time stamp data
FrameTimeStamp time stamp data can be transmitted to other additions immediately and receive terminal 3 with the same screen of screen by end 2, it is therefore an objective to be
It is whether synchronous with same screen originating end by using being periodically detected within 5 seconds all with screen and receiving 3 current states of terminal, if finding stagnant
Afterwards in same screen initiating terminal 1, then allows and carry out more accurate " principal and subordinate " video and audio synchronously control again with screen reception terminal 3.Its
" principal and subordinate " video and audio synchronisation control means is realized as shown in Fig. 6 in attached drawing, and with the flow chart of screen initiating terminal 1 as in attached drawing
Shown in Fig. 7；
Second aspect is to carry out plug-flow to Streaming Media forwarding server-side 2 using multicast or unicast mode.Generally in meeting
Same screen receive 3 negligible amounts of terminal in the case where, default use unicast mode.When meeting reaches one with screen terminal quantity
When fixed quantity (such as 50 to 200), video and audio can be forwarded by being switched to multicast pattern with initiating terminal 1 is shielded
Flow media data packet, can save the expense of bandwidth in this way, to guarantee bandwidth efficient transmission and real-time transmission.
The Streaming Media forwarding server-side 2 is used to be forwarded to the video and audio media data received the same screen that meeting is added
Receive terminal 3.
As shown in Figure 1, Figure 2, described to contain following functions module with screen reception terminal 3 shown in Fig. 3, Fig. 9:
1, video decoding sub-module 311 is then transferred into view for being decoded to the H.264 video code flow received
Frequency rendering module is handled；When receiving the H.264 video data packet that network transmission comes, program is directly video data
Packet is put into video decoding queue；H.264 video compression data is decoded into when queue there are data, then through X264 decoder
The video pixel data of YUV420 format is then placed in Video Rendering queue；
2, audio decoder submodule 122 is then transferred into audio for being decoded to the AAC audio code stream received
Rendering module is handled；When receiving the AAC packets of audio data that network transmission comes, program directly puts packets of audio data
Enter audio decoder queue；AAC audio compression data is decoded into PCM format when queue there are data, then through AAC decoder
Audio sampling data is then placed in audio render-ahead queue；
3, receiving end video/audio synchronous processing module 32, for being synchronized to the rigid timestamp come out the progress video and audio that unpacks
Processing；
4, receiving end Video Rendering display module is shown for carrying out rendering to the video pixel data just decoded；
Video Rendering is carried out using the cross-platform multimedia development library SDL to the video pixel data for just decoding the YUV420 format come to show
Show；The process that Video Rendering is shown are as follows: create window, SDL renderer and texture first, by update video pictures texture come
The picture of refresh display, in the process, SDL constantly can copy decoded good video image prime number by renderer
According to finally showing video pictures glibly, as shown in figure 9；
5, receiving end audio renders playing module, for carrying out rendering broadcasting to the audio sampling data just decoded；
It is rendered to the PCM audio sample data come just are decoded using the cross-platform multimedia development library SDL, it is then defeated by sound card
It plays out.
The receiving end rendering processing module 33 includes that receiving end Video Rendering display module and the rendering of receiving end audio are broadcast
Amplification module.
As shown in Figure 1, Figure 2, shown in Fig. 3, Fig. 5, the present invention is described further:
It needs to carry out step 1 and step 2 in Fig. 5 before carrying out video frequency co-screen broadcasting to set to multiple with screen reception terminal 3
Binding ID is set, and then it is smooth to ensure that multiple same screen reception terminals 3 communicate in same meeting.Then when same screen initiating terminal 1 is sent out
When rising with screen, then step 3 and step 4 are carried out, picture acquisition and sound card audio collection are carried out to screen respectively.Then the 5th is carried out
Step and step 6, carry out coding compression to the video/audio of acquisition.And then take step 7, compressed data by unicast or
Person's multicasting technology is transferred to network, is transmitted to other by server and receives terminal 3 with screen.Finally, executing step 8 and the 9th
Video compression data, is decoded as video and audio initial data and is shown and played by step.
As shown in Figure 1, Figure 2, shown in Fig. 3, Figure 10, entire meeting HD video with no paper at all needs the network rack disposed with screen technology
Composition turns with multiple with screen reception terminal 3 and Streaming Media with screen initiating terminal 1 (also referred to as " plug-flow end ") as seen from Figure 10
Hair server-side, which is all in together in the same lan network, carries out communication and data transmission.
As shown in Figure 1, Figure 2, shown in Fig. 3, Fig. 7, Fig. 8, the audio sampling frequency that the present invention uses is 44100HZ, a frame AAC
Audio data has 1024 sample sampled points, therefore can calculate:
The corresponding sample number/sample frequency of audio frame play time=mono- AAC frame of one frame
So a frame AAC play time=1024*1000/44100=23.22 milliseconds and design the video sampling rate used
For 25fps, therefore can calculate:
Presentation of video frames time=1000/25fps of one frame
So frame video playback time=40 millisecond
The lasting play time that each frame data can be obtained by calculating data above is handed over by the time point of time shaft
Fork playing audio-video data is as shown in the table to generate synchronous effect:
But due to real system situation, time reference that sound card plays and the time reference of video playing be it is corresponding not on
, if the situation in table is that point is insecure in actual verification on the basis of time shaft 0.Because referenced by sound card hardware
Clock reference is different with the clock of the broadcasting reference of video video card, therefore present design is used using audio axis as base
Standard realizes preliminary audio-visual synchronization effect to the synchronous method of audio axis by video.
Therefore, inter-media synchronization is the time relationship between audio stream and video flowing to be kept, according to its time difference into
One process of Mobile state adjustment.Because this system be using " principal and subordinate " video frequency co-screen technology, by originating end as host side,
He is used as from generator terminal receiving end, so the video and audio that can only lag behind host side from generator terminal plays.The present invention has carried out a series of
Reliability test, test result show if the time difference limitation in a certain range, can think video and audio media be place
In synchronous regime.When audio lags behind time difference of video when within 80ms, the audiovisual of people is imperceptible sound view
The variation of frequency synchronizing quality is may be considered at this time in synchronous regime.In conclusion when being designed in audio-visual synchronization maximum
Between difference be limited to 80ms.
Therefore it can be concluded that following condition judges, if audio time stamp is greater than video time stamp plus 80ms,
It abandons video frame and then accelerates video and show, otherwise normal output video frame display plays.Fig. 8 in its program flow diagram such as attached drawing
It is shown；
The meeting audiovisual system further includes at least one timestamp lag feedback module, each all to pacify with screen reception terminal 3
Equipped with a timestamp lag feedback module；Timestamp lag feedback module is used to timestamp hysteretic state information feeding back to stream
Media forward the timestamp of server-side 2 to check module 21；
Due to consideration that sound card and the time interval for grabbing screen acquisition in system, the time loss of network transmission, and with screen
The decoding time consumption of terminal 3 etc. factor is received, system video lagging audio after running for a period of time can be easy to cause
Timestamp accumulation is excessive.Therefore, the present invention further uses " principal and subordinate " video-audio synchronization method, with screen initiating terminal 1 every five
Period second sends a frameTimeStamp timestamp to server, and server is transmitted at once is added each of video frequency co-screen
Terminal 3 is received with screen, it is then each to receive terminal 3 according to frameTimeStamp (frameTimeStamp < 80 millisecond) with screen
Priority processing video and audio is synchronous, and the same screen excessively lagged receives terminal 3 and can be responded by timestamp lag feedback module and flowed
Media forward server-side 2, wait regulation next time server to do and preferentially issue processing, as shown in Fig. 7 and Fig. 8 in attached drawing.
Compared with prior art, the present invention mainly uses X264 Video Codec and AAC audio codec pair
HD video carries out encoding and decoding, and is transmitted using udp protocol, which is simple and efficient in transmission process, transmission rate
Fastly, biggish delay effect will not can be generated as Transmission Control Protocol.Meeting local area network of the current system in gigabit switch
Interior, the terminal quantity that can initiate HD video simultaneously with screen is up to 200.
The embodiments described above only express several embodiments of the present invention, and the description thereof is more specific and detailed, but simultaneously
Limitations on the scope of the patent of the present invention therefore cannot be interpreted as.It should be pointed out that for those of ordinary skill in the art
For, without departing from the inventive concept of the premise, various modifications and improvements can be made, these belong to guarantor of the invention
Protect range.Therefore, the scope of protection of the patent of the invention shall be subject to the appended claims.
Claims (9)
1. a kind of meeting audiovisual system quickly transmitted and synchronized, which is characterized in that the meeting audiovisual system is calculated applied to C/S
Rack structure, the C/S computer architecture include together shield initiating terminal (1), a Streaming Media forwarding server-side (2) and at least one together
Screen receives terminal (3), which includes an acquisition module (11), a coding module (12), a network plug-flow module
(13), a timestamp verification module (21), one verification period timing module (22), at least one receiving end decoder module (31),
At least one receiving end video/audio synchronous processing module (32) and at least one receiving end rendering processing module (33)；It is described to adopt
Collection module (11), coding module (12) and network plug-flow module (13) are mounted on in screen initiating terminal (1)；It is each to be connect with screen
Receive terminal (3) be mounted on a receiving end decoder module (31), a receiving end video/audio synchronous processing module (32) and
One receiving end renders processing module (33)；Timestamp verification module (21) and verification period timing module (22) are respectively mounted
In in Streaming Media forwarding server-side (2)；
The acquisition module (11) is used to acquire the video information and audio-frequency information with screen initiating terminal (1), and will acquisition
To video information and audio-frequency information send the coding module (12) to；
The coding module (12) is for carrying out coded treatment for the video information and audio-frequency information that receive, and by coded treatment
Video information and audio-frequency information afterwards sends the network plug-flow module (13) to；
The network plug-flow module (13) be used for after coding video information and audio-frequency information carry out timestamp label, and by band
The video information of video time stamp and audio-frequency information with audio time stamp are pushed again by Streaming Media forwarding server-side (2)
To each receiving end decoder module (31)；
Verification period timing module (22) is used to check and/or adjust the time in verification period timing module (22)
Periodic quantity, and verification and/or time cycle value adjusted are supplied to timestamp verification module (21)；
Timestamp verification module (21) is for recording current time stamp, and the calculating video time stamp and audio time
The difference of stamp, and the difference is compared judgement with current time stamp；
The receiving end decoder module (31) is used to for the video information received and audio-frequency information being decoded processing, and will solution
The video pixel data and audio sampling data obtained after code sends receiving end rendering processing module (33) to；
When the receiving end video/audio synchronous processing module (32) is used to check module (21) to video according to the timestamp
Between stamp and audio time stamp judgement, to synchronize processing to video and audio；
The video pixel data that receiving end rendering processing module (33) is used to obtain after decoding carries out rendering and shows, and
The audio sampling data obtained after decoding is subjected to rendering broadcasting.
2. speed transmission according to claim 1 and synchronous meeting audiovisual system, which is characterized in that the acquisition module
It (11) include screen capture submodule (111) and sound DAQ submodule (112)；Coding module (12) includes video encoding module
(121) and audio coding module (122)；Receiving end decoder module (31) includes video decoding sub-module (311) and audio decoder
Submodule (312)；
The screen capture submodule (111) is used to acquire the video information with screen initiating terminal (1), and will be collected
Video information sends the coding module (12) to；
The sound DAQ submodule (112) is used to acquire the audio-frequency information with screen initiating terminal (1), and will be collected
Audio-frequency information sends the coding module (12) to；
The video encoding module (121) is used to the video information received carrying out coded treatment, and will be after coded treatment
Video information sends the network plug-flow module (13) to；
The audio coding module (122) is used to the audio-frequency information received carrying out coded treatment, and will be after coded treatment
Audio-frequency information sends the network plug-flow module (13) to；
The video decoding sub-module (311) is used to for the video information received being decoded processing, and decoding is obtained
Video pixel data sends receiving end rendering processing module (33) to；
The audio decoder submodule (312) is used to the audio-frequency information received being decoded processing, and will obtain after decoding
Audio sampling data send receiving end rendering processing module (33) to.
3. speed transmission according to claim 2 and synchronous meeting audiovisual system, which is characterized in that the Video coding mould
Block (121) carries out coded treatment to the video information received using X264 encoder；Video encoding module (121) coding
Video information that treated is H.264 video code flow.
4. speed transmission according to claim 2 and synchronous meeting audiovisual system, which is characterized in that the audio coding mould
Block (122) carries out coded treatment to the audio-frequency information received using AAC encoder；Audio coding module (122) coding
Treated, and audio-frequency information is AAC audio code stream.
5. speed transmission according to claim 1 and synchronous meeting audiovisual system, which is characterized in that the network plug-flow mould
Block (13) is pushed using multicast or unicast mode to each receiving end decoder module (31).
6. speed transmission according to claim 1 and synchronous meeting audiovisual system, which is characterized in that the verification period is fixed
When module (22) in time cycle value provided by shielding initiating terminal (1) together.
7. speed transmission according to claim 1 and synchronous meeting audiovisual system, which is characterized in that the verification period is fixed
When module (22) in time cycle value be five seconds.
8. a kind of control method for the meeting audiovisual system quickly transmitted and synchronized, which is characterized in that be applied to such as claim
1-7 it is any it is described it is quick transmit and synchronous meeting audiovisual system, the control method the following steps are included:
S1, acquisition module (11) the acquisition video information and audio-frequency information with screen initiating terminal (1), and will collect
Video information and audio-frequency information send the coding module (12) to；
The video information received and audio-frequency information are carried out coded treatment by S2, the coding module (12), and by coded treatment
Video information and audio-frequency information afterwards sends the network plug-flow module (13) to；
S3, the network plug-flow module (13) to after coding video information and audio-frequency information carry out timestamp label, and by band
The video information of video time stamp and audio-frequency information with audio time stamp are pushed again by Streaming Media forwarding server-side (2)
To each receiving end decoder module (31)；
The video information received and audio-frequency information are decoded processing by S4, the receiving end decoder module (31), and will solution
The video pixel data and audio sampling data obtained after code sends receiving end rendering processing module (33) to；
The video pixel data obtained after decoding is carried out rendering and shown by S5, receiving end rendering processing module (33), and
The audio sampling data obtained after decoding is subjected to rendering broadcasting.
9. the control method of the meeting audiovisual system of quick transmission according to claim 8 and synchronization, which is characterized in that should
Control method further includes following steps after S5:
S6, the network plug-flow module (13) judge whether same screen initiating terminal (1) and each same screen reception terminal (3) are same
Shield successfully, execute S7 if same shield successfully, if unsuccessfully terminating entire control process with screen；
Time cycle value checked and/or adjusted is supplied to the time by S7, the verification period timing module (22)
Stamp verification module (21)；
Timestamp verification module (21) according to the time cycle value of time cycle value checked and/or adjusted into
The row period acquires the video time stamp and audio time stamp；
S8, timestamp verification module (21) calculate video time stamp and audio that the network plug-flow module (13) receives
The time difference of timestamp, and judge whether the time difference is less than current time stamp or 80ms, S9 is executed if being judged as YES,
If being judged as otherwise without synchronizing processing to video and audio；
S9, the receiving end video/audio synchronous processing module (32) synchronize processing to video and audio.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811212429.1A CN109361945A (en) | 2018-10-18 | 2018-10-18 | The meeting audiovisual system and its control method of a kind of quick transmission and synchronization |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811212429.1A CN109361945A (en) | 2018-10-18 | 2018-10-18 | The meeting audiovisual system and its control method of a kind of quick transmission and synchronization |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109361945A true CN109361945A (en) | 2019-02-19 |
Family
ID=65345672
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811212429.1A Pending CN109361945A (en) | 2018-10-18 | 2018-10-18 | The meeting audiovisual system and its control method of a kind of quick transmission and synchronization |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109361945A (en) |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110062268A (en) * | 2019-04-19 | 2019-07-26 | 北京那镁克科技有限公司 | A kind of audio-video sends and receives processing method and processing device with what screen played |
| CN110312162A (en) * | 2019-06-27 | 2019-10-08 | 北京字节跳动网络技术有限公司 | Selected stage treatment method, device, electronic equipment and readable medium |
| CN110351592A (en) * | 2019-07-17 | 2019-10-18 | 深圳市蓝鲸数据科技有限公司 | Animation rendering method, device, computer equipment and storage medium |
| CN111147801A (en) * | 2019-12-31 | 2020-05-12 | 视联动力信息技术股份有限公司 | Video data processing method and device for video networking terminal |
| CN111258526A (en) * | 2020-05-06 | 2020-06-09 | 上海幻电信息科技有限公司 | Screen projection method and system |
| CN111327869A (en) * | 2020-03-27 | 2020-06-23 | 随锐科技集团股份有限公司 | Video conference system |
| CN111510759A (en) * | 2020-03-17 | 2020-08-07 | 视联动力信息技术股份有限公司 | Video display method, device and readable storage medium |
| CN112433689A (en) * | 2020-11-11 | 2021-03-02 | 深圳市先智物联科技有限公司 | Data transmission method and device for same-screen device, same-screen device and medium |
| CN112492358A (en) * | 2020-11-18 | 2021-03-12 | 深圳市斯博科技有限公司 | Screen projection method and device, computer equipment and storage medium |
| WO2021142998A1 (en) * | 2020-01-19 | 2021-07-22 | 深圳市朗强科技有限公司 | Data sending method and apparatus, data receiving method and apparatus, system, device, and computer storage medium |
| CN113965788A (en) * | 2021-10-22 | 2022-01-21 | 上海大风实验室设备有限公司 | Teaching same-screen interaction system in local area network |
| CN114286149A (en) * | 2021-12-31 | 2022-04-05 | 广东博华超高清创新中心有限公司 | Method and system for synchronously rendering audio and video across equipment and system |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2008061010A (en) * | 2006-08-31 | 2008-03-13 | Toshiba Corp | Video and audio transmitter |
| CN103414957A (en) * | 2013-07-30 | 2013-11-27 | 广东工业大学 | Method and device for synchronization of audio data and video data |
| CN104683823A (en) * | 2013-11-29 | 2015-06-03 | 红板凳科技股份有限公司 | Multi-screen linked audio and video synchronizing system |
| US20150271772A1 (en) * | 2014-03-24 | 2015-09-24 | Imagination Technologies Limited | High Definition Timing Synchronisation Function |
| CN105429983A (en) * | 2015-11-27 | 2016-03-23 | 刘军 | Media data acquisition method, media terminal and music teaching system |
| CN105656616A (en) * | 2014-12-03 | 2016-06-08 | 中国移动通信集团公司 | Inter-multi-device data synchronization method and device, transmitting end and receiving end |
| CN106330912A (en) * | 2016-08-25 | 2017-01-11 | 北京智能管家科技有限公司 | Video live broadcasting and two-way communication fusion system and method |
-
2018
- 2018-10-18 CN CN201811212429.1A patent/CN109361945A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2008061010A (en) * | 2006-08-31 | 2008-03-13 | Toshiba Corp | Video and audio transmitter |
| CN103414957A (en) * | 2013-07-30 | 2013-11-27 | 广东工业大学 | Method and device for synchronization of audio data and video data |
| CN104683823A (en) * | 2013-11-29 | 2015-06-03 | 红板凳科技股份有限公司 | Multi-screen linked audio and video synchronizing system |
| US20150271772A1 (en) * | 2014-03-24 | 2015-09-24 | Imagination Technologies Limited | High Definition Timing Synchronisation Function |
| CN105656616A (en) * | 2014-12-03 | 2016-06-08 | 中国移动通信集团公司 | Inter-multi-device data synchronization method and device, transmitting end and receiving end |
| CN105429983A (en) * | 2015-11-27 | 2016-03-23 | 刘军 | Media data acquisition method, media terminal and music teaching system |
| CN106330912A (en) * | 2016-08-25 | 2017-01-11 | 北京智能管家科技有限公司 | Video live broadcasting and two-way communication fusion system and method |
Cited By (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110062268A (en) * | 2019-04-19 | 2019-07-26 | 北京那镁克科技有限公司 | A kind of audio-video sends and receives processing method and processing device with what screen played |
| CN110312162A (en) * | 2019-06-27 | 2019-10-08 | 北京字节跳动网络技术有限公司 | Selected stage treatment method, device, electronic equipment and readable medium |
| CN110351592A (en) * | 2019-07-17 | 2019-10-18 | 深圳市蓝鲸数据科技有限公司 | Animation rendering method, device, computer equipment and storage medium |
| CN110351592B (en) * | 2019-07-17 | 2021-09-10 | 深圳市蓝鲸数据科技有限公司 | Animation presentation method and device, computer equipment and storage medium |
| CN111147801A (en) * | 2019-12-31 | 2020-05-12 | 视联动力信息技术股份有限公司 | Video data processing method and device for video networking terminal |
| WO2021142998A1 (en) * | 2020-01-19 | 2021-07-22 | 深圳市朗强科技有限公司 | Data sending method and apparatus, data receiving method and apparatus, system, device, and computer storage medium |
| CN111510759A (en) * | 2020-03-17 | 2020-08-07 | 视联动力信息技术股份有限公司 | Video display method, device and readable storage medium |
| CN111510759B (en) * | 2020-03-17 | 2023-10-13 | 视联动力信息技术股份有限公司 | Video display method, device and readable storage medium |
| CN111327869A (en) * | 2020-03-27 | 2020-06-23 | 随锐科技集团股份有限公司 | Video conference system |
| US11589102B2 (en) | 2020-05-06 | 2023-02-21 | Shanghai Hode Information Technology Co., Ltd. | Screen projection method and system |
| CN111258526A (en) * | 2020-05-06 | 2020-06-09 | 上海幻电信息科技有限公司 | Screen projection method and system |
| CN111258526B (en) * | 2020-05-06 | 2020-08-28 | 上海幻电信息科技有限公司 | Screen projection method and system |
| CN112433689A (en) * | 2020-11-11 | 2021-03-02 | 深圳市先智物联科技有限公司 | Data transmission method and device for same-screen device, same-screen device and medium |
| CN112433689B (en) * | 2020-11-11 | 2024-05-28 | 深圳市先智物联科技有限公司 | Data transmission method and device for same screen device, same screen device and medium |
| CN112492358A (en) * | 2020-11-18 | 2021-03-12 | 深圳市斯博科技有限公司 | Screen projection method and device, computer equipment and storage medium |
| CN113965788A (en) * | 2021-10-22 | 2022-01-21 | 上海大风实验室设备有限公司 | Teaching same-screen interaction system in local area network |
| CN113965788B (en) * | 2021-10-22 | 2024-06-14 | 上海大风实验室设备有限公司 | Teaching same-screen interaction system in local area network |
| CN114286149A (en) * | 2021-12-31 | 2022-04-05 | 广东博华超高清创新中心有限公司 | Method and system for synchronously rendering audio and video across equipment and system |
| CN114286149B (en) * | 2021-12-31 | 2023-07-07 | 广东博华超高清创新中心有限公司 | Audio and video synchronous rendering method and system of cross-equipment and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109361945A (en) | The meeting audiovisual system and its control method of a kind of quick transmission and synchronization | |
| US8473997B2 (en) | Channel changing method, apparatus, and system | |
| CN101889422B (en) | Method and system for synchronizing the output of terminals | |
| JP6317872B2 (en) | Decoder for synchronizing the rendering of content received over different networks and method therefor | |
| CN105704580B (en) | A kind of video transmission method | |
| EP2728830B1 (en) | Method and system for synchronizing audio and video streams in media relay conferencing | |
| CN107566918B (en) | A kind of low delay under video distribution scene takes the neutrel extraction of root | |
| EP2534833A1 (en) | Method for synchronized content playback | |
| CN110602522B (en) | Multi-path real-time live webRTC stream synthesis method | |
| KR101640148B1 (en) | Device and method for synchronizing an interactive mark to streaming content | |
| KR100606785B1 (en) | Synchronization method of video and iamge data in system for providing remote multimedia service through network | |
| CN101568028B (en) | Mobile terminal and method for cooperatively broadcasting mobile broadcasting television between mobile terminals | |
| CN102752669A (en) | Transfer processing method and system for multi-channel real-time streaming media file and receiving device | |
| CN112291498B (en) | Audio and video data transmission method and device and storage medium | |
| CN202759552U (en) | Multi-terminal video synchronous playing system based on IP network | |
| CN112954433B (en) | Video processing method, device, electronic equipment and storage medium | |
| CN108494792A (en) | A kind of flash player plays the converting system and its working method of hls video flowings | |
| CN110300338A (en) | A method of it is switched fast and plays group broadcasting video frequency | |
| Tang et al. | Audio and video mixing method to enhance WebRTC | |
| CN113194278A (en) | Conference control method and device and computer readable storage medium | |
| CN105959786A (en) | Audio and video playing method and device | |
| CN101540871B (en) | Method and terminal for synchronously recording sounds and images of opposite ends based on circuit domain video telephone | |
| CN108712407A (en) | A kind of audio/video live broadcasting method and its system based on browser | |
| CN106790030A (en) | Multi-screen collaboration audio transmission service end, client, system and its processing method | |
| CN103269448A (en) | Method for achieving synchronization of audio and video on the basis of RTP/RTCP feedback early-warning algorithm |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB03 | Change of inventor or designer information |
Inventor after: Zhao Dingjin Inventor after: Zhu Zhenghui Inventor after: Zhang Changhua Inventor before: Zhao Dingjin Inventor before: Zhu Zhenghui Inventor before: Zhang Changhua Inventor before: Ming De |
|
| CB03 | Change of inventor or designer information | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190219 |
|
| RJ01 | Rejection of invention patent application after publication |