CN1540954A - Method for controlling flux of audio and video flow transferred in IP video meeting system - Google Patents
Method for controlling flux of audio and video flow transferred in IP video meeting system Download PDFInfo
- Publication number
- CN1540954A CN1540954A CNA2003101119999A CN200310111999A CN1540954A CN 1540954 A CN1540954 A CN 1540954A CN A2003101119999 A CNA2003101119999 A CN A2003101119999A CN 200310111999 A CN200310111999 A CN 200310111999A CN 1540954 A CN1540954 A CN 1540954A
- Authority
- CN
- China
- Prior art keywords
- video
- data
- transmission
- thread
- video data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The video meeting system includes servers and clients with communication relation being built already. The method includes: building three parallel connections in different divisions of work for communications between servers and clients: one for transferring video data, one for transferring audio data, and another one for transferring control information. When network bandwidth is insufficiency, based on principle of preferential guaranteeing transmission of audio data and reasonable quitting transmission of video data, connections of transferring audio data and transferring video data are adjusted. 'Reasonable quitting' means number of video frame in video data queue is limited. The invention guarantees transmission of audio data effectively in case of network bandwidth is insufficiency.
Description
Technical field
The present invention relates to computer multi-media system, relate in particular to the IP video conferencing system.
Background technology
Along with the information age is stepped in the whole world, people are right, and the requirement of separating affairs, exchange message develops into by Internet (internet) from paper, pen, books, voice etc., adopts multiple mode more accurate, fast, express galore.Under the promotion of social demand, Multimedia Computer Technology combines with the communication technology, develops into a kind of new multimedia communication technology gradually.
Face-to-face talk is the mankind's the abundantest a kind of modes that express thoughts, and people can give full play to eyes, expression and action and play up language.For business, the be beyond expression thing of the convincing and appeal of chart, file, data form and so on of plain old telephone talk.When enterprise or group need hold a meeting, often run into the situation that its each relevant personnel can't concentrate.Produced the demand of utilizing the communication medium holding video conference thus.So-called video conference utilizes communication line that two or more meeting rooms are coupled together exactly, propagates a kind of audio frequency, the Image Communication means of conferencing information with TV mode.The principal character of video conference is to transmit the image etc. of participant's image, sound and meeting material chart and correlate in real time, and the participant who holds the different location can see shadow on hearing the news, as being sitting in meeting in same the meeting room.
Present video conferencing system mostly adopts the analog form images, since occupied bandwidth, apparatus expensive, and upgrading inconvenience so running cost is very high, is difficult to popularize.
The progress of digital video and Audiotechnica has caused the revolution of computer and network, and has opened up new field for the application of computer system.The progress of express network technology, distributed proccessing, multimedia messages treatment technology, multimedia workstation technology etc. is that the development of distributed multimedia system is laid a good foundation.
On the other hand, be based Internet with the ICP/IP protocol, be network size or number of users are all increasing rapidly.Many units have all constructed the in-house network (Intranet) of oneself, exchange to realize internal with external data.But along with the development of IP network, simple data exchange and can't meet consumers' demand, and people wish to realize to integrate the interaction of the multimedia formula of audio frequency, video, data.
Existing video conferencing system based on IP network is general to adopt an interface channel to transmit various information flows, and only channel is controlled, and do not distinguish audio frequency, the difference of signal flows such as video or control signal.So, audio-frequency information, video information and control information meeting interact, when running into information channel and anomaly such as bandwidth deficiency occurs and take place, not only the big vision signal of the dedicated bandwidth of standing can't normal transmission, also can bring disaster to effective transmission of audio-frequency information, thereby cause the paralysis of whole video conference system.
Summary of the invention
The technical problem to be solved in the present invention is to avoid above-mentioned the deficiencies in the prior art part, and propose a kind of video information and audio-frequency information to be transmitted respectively, and can guarantee that the network bandwidth is not enough the time, whole video conferencing system based on IP network can also be carried out the audio frequency and video flow control methods that effective information transmits.
The technical scheme that the present invention solves the problems of the technologies described above employing is, the flow control methods of audio/video flow transmission in a kind of IP video conferencing system is proposed, described video conferencing system comprises server and the client computer that establishes a communications link mutually, described method comprises: set up three parallel runnings for the communication between described server and the client computer but divide the work different connections, first connects the transmission of being responsible for video data, second connects the transmission of being responsible for voice data, and the 3rd connects the transmission of being responsible for control information; When the network bandwidth is not enough, abide by the preferential transmission of voice data, the rule of rationally abandoning the transmission of video data of guaranteeing and come being responsible for regulating connection and being connected of responsible audio data transmission of video Data Transmission, the described video data of rationally abandoning is meant the video frame number that limits in the video data formation in the transmission course of video data.
The connection of described responsible video Data Transmission is carried out in accordance with udp protocol, and the connection of described responsible audio data transmission is carried out in accordance with udp protocol, and the connection of described responsible control information transmission is abideed by Transmission Control Protocol and carried out.
The concrete control method of the video frame number in the formation of described qualification video data comprises step: 1.. judging whether transmit queue is empty, is then: withdraw from, otherwise: change next step; 2.. from queue heads read when last frame data after send buffer memory, calculate the length of current video data formation; 3.. judging whether queue length surpasses the upper limit, is then: end the video acquisition encoding process, change next step, otherwise: start the video acquisition encoding process, change next step; 4.. send the data that are in the transmission buffer memory; 5.. after the resource that release transmission buffer memory takies, return step and 1. begin next circulation.
Compare with prior art, use the flow control methods of audio/video flow transmission in the IP video conferencing system of the present invention, can guarantee that the whole video conference system can also carry out effective information transmission when the network bandwidth is not enough.
Description of drawings
Fig. 1 is the described video conferencing system overall structure of a inventive method schematic diagram.
Fig. 2 is the described server workflow of a inventive method schematic diagram.
Fig. 3 is the described client works schematic flow sheet of the inventive method.
Fig. 4 is the schematic flow sheet of the frame of video counting method in the formation of the described qualification video data of the inventive method.
Embodiment
Below in conjunction with accompanying drawing most preferred embodiment of the present invention is described in further detail.
As shown in Figure 1, video conferencing system is formed and comprised: server and client computer, the configuration of described server is adopted: central processing unit: Intel P4 1.4GHz, internal memory: 256M, network interface card: 10/100M self adaptation, operating system: Windows 2000Server.The configuration of described client computer is adopted: central processing unit: Intel PIII 800MHz, internal memory: 256M, network interface card: 10/100M self adaptation, camera: BOSER, capture card: OSPREY 200, Mike: LABTEC, operating system: Windows 2000Professional.
Described video conferencing system comprises server and the client computer that establishes a communications link mutually, the inventive method comprises: set up three parallel runnings for the communication between described server and the client computer but divide the work different connections, first connects the transmission of being responsible for video data, second connects the transmission of being responsible for voice data, and the 3rd connects the transmission of being responsible for control information; When the network bandwidth is not enough, abide by the preferential transmission of voice data, the rule of rationally abandoning the transmission of video data of guaranteeing and come being responsible for regulating connection and being connected of responsible audio data transmission of video Data Transmission, the described video data of rationally abandoning is meant the video frame number that limits in the video data formation in the transmission course of video data.
As shown in Figure 2, after the server main thread starts, earlier each data structure is carried out initialization, and set up three connections, control connection is set to listening state, and after the message that the client computer request of sending connects, main thread starts audio interface transmitting-receiving line sending journey and video reception sends thread.These three thread parallel operations are withdrawed from connection up to client computer afterwards, and main thread is ended this two threads.After audio interface transmitting-receiving line sending journey or video reception send thread and receive data, just put into a buffer memory, and start and play thread, the broadcast thread is ended automatically when the data playback in the buffer memory finishes after, in buffer memory, again data are arranged after, be activated again.
As shown in Figure 3, the client computer main thread connects with server after starting, and each data of initialization start following each sub-thread:
1) local video collection, coding thread: gather local image, and the view data that collects is encoded.Data behind the coding are put into the transmission buffer memory, and start video data transmitting line sending journey transmission data.
2) local audio collection, coding, transmission thread: gather local sound, and the voice data that collects is encoded, send data then.Because amount of audio data is little, so these several functions all are placed in the thread.
3) video data transmitting line sending journey: the data that video is sent in the buffer memory send.
4) video data receiving thread: receiving video data, put into far-end video cache district, start video decode then, play thread.
5) video decode, broadcast thread: video data encoder is decoded, and playing image.
6) audio frequency receives, decodes, plays thread: receive voice data, put into the far-end audio buffer area, the encode audio data are decoded then, and play sound.Because amount of audio data is little, so these several functions all are placed in the thread.
Video is sent in the video data transmitting line sending journey and finishes.Directly do not start this thread after system's operation, but start video acquisition coding thread earlier.After video acquisition coding thread collects local image, deposits data in the video transmit queue through coding, restart video data transmitting line sending journey.Afterwards, video data transmitting line sending journey and the parallel running together of other threads are ended when the video transmit queue is sky automatically.In said process, can relate to the operation of----video transmit queue, share conflict, use " critical zone " variable to lock respectively to the front and back of video transmit queue operation and release grants asylum at these two threads for preventing to shared data.As shown in Figure 4, send thread and send the length of checking the video data formation behind the frame data, it is the frame number of the medium video data to be sent of formation, make decision then:, just video data that just collected and the process coding can be added the video data formation if video data frame numbers to be sent such as this moment also do not reach set upper limit; Otherwise the semaphore of control of video capturing and coding thread is arranged to no signal condition, and video acquisition and coding have just stopped like this, after queue length is reduced to below the upper limit, restart the capturing and coding thread.The higher limit of video data frame number records according to experiment, selects for use 20 proper.
When data arrived, system did not directly receive data, but the pointer of current this socket is sent to receiving thread as the parameter of message.Receiving thread receives data and it is deposited in the shared buffer memory formation, starts decoding then and plays the video image that thread shows far-end.If block and when making receiving course be forced to stop, can not influencing main thread or transmission and wait other thread when network precepitates into like this.
Above preferred embodiment is intended to clearly demonstrate design of the present invention and technical scheme, that is: in the IP video conferencing system, adopt different passages to transmit to audio-frequency information and video information, and when the network bandwidth is not enough, preferentially guarantee audio transmission, the restriction video transmission.The present invention's enforcement is not limited to the various embodiments described above.Any based on design of the present invention and technical scheme, and need not creative work, the simple deduction or replace carried out all belong to the present invention's enforcement.
Claims (10)
1, the flow control methods of audio/video flow transmission in a kind of IP video conferencing system, described video conferencing system comprises server and the client computer that establishes a communications link mutually, it is characterized in that, described method comprises: set up three parallel runnings for the communication between described server and the client computer but divide the work different connections, first connects the transmission of being responsible for video data, second connects the transmission of being responsible for voice data, and the 3rd connects the transmission of being responsible for control information; When the network bandwidth is not enough, abide by the preferential transmission of voice data, the rule of rationally abandoning the transmission of video data of guaranteeing and come being responsible for regulating connection and being connected of responsible audio data transmission of video Data Transmission, the described video data of rationally abandoning is meant the video frame number that limits in the video data formation in the transmission course of video data.
2, flow control methods as claimed in claim 1, it is characterized in that: after the workflow of described server comprises the steps: that the server main thread starts, main thread carries out initialization to each data structure earlier, and set up described first, second and be connected with the 3rd, control connection is set to listening state, after the message that the client computer request of sending connects, start audio interface transmitting-receiving line sending journey and video reception and send thread; These three thread parallel operations are withdrawed from connection up to client computer afterwards, and main thread is ended this two threads; After audio interface transmitting-receiving line sending journey or video reception send thread and receive data, just put into one to buffer memory, and start the broadcast thread, after the data playback in the buffer memory finishes, play thread and end automatically, in buffer memory, there are data to deposit in again, play thread and be activated again.
3, flow control methods as claimed in claim 1 is characterized in that: the workflow of described client computer connects with server after comprising the steps: that main thread starts, and each data of initialization start each sub-thread; Described each sub-thread comprises: local video collection, coding thread, and local audio collection, coding, transmission thread, video data transmitting line sending journey, the video data receiving thread, video decode, broadcast thread, audio frequency receives, decodes, plays thread.
4, flow control methods as claimed in claim 3 is characterized in that: share conflict for preventing, in local video collection, coding thread and/or video data transmitting line sending journey to the front and back of video transmit queue operation respectively with locking and release grants asylum.
5, flow control methods as claimed in claim 1 is characterized in that: first of described responsible video Data Transmission connects abides by udp protocol.
6, the described flow control methods of claim 1 is characterized in that: udp protocol is abideed by in second connection of described responsible audio data transmission.
7, flow control methods as claimed in claim 1 is characterized in that: Transmission Control Protocol is abideed by in the 3rd connection of described responsible control information transmission.
8, flow control methods as claimed in claim 1 is characterized in that: the video frame number in the formation of described qualification video data comprises the steps:
1.. judge that whether video data sends formation is empty, is then to withdraw from, otherwise changes next step;
2.. read to deposit from queue heads and send buffer memory, calculate the length of current video data formation when last frame data;
3.. judge whether queue length surpasses the upper limit, is then to end the video acquisition encoding process, changes next step, otherwise starts the video acquisition encoding process, changes next step;
4.. send the data that are in the transmission buffer memory;
5.. after discharging transmission buffer memory occupation space, return step and 1. begin new round circulation.
9, flow control methods as claimed in claim 8 is characterized in that: described step 1. in, when transmit queue when not being empty, comprised also that before changeing next step video data is sent formation adds latching operation; Correspondingly described step 2. in, when reading from queue heads unlocking operation is carried out in video data transmission formation when last frame data also comprise after sending buffer memory.
10, flow control methods as claimed in claim 8 is characterized in that: described step 2. in, from queue heads read when last frame data deposit send buffer memory after, also comprise the operation of the first frame data of deletion video data formation.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNA2003101119999A CN1540954A (en) | 2003-10-30 | 2003-10-30 | Method for controlling flux of audio and video flow transferred in IP video meeting system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNA2003101119999A CN1540954A (en) | 2003-10-30 | 2003-10-30 | Method for controlling flux of audio and video flow transferred in IP video meeting system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN1540954A true CN1540954A (en) | 2004-10-27 |
Family
ID=34336335
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNA2003101119999A Pending CN1540954A (en) | 2003-10-30 | 2003-10-30 | Method for controlling flux of audio and video flow transferred in IP video meeting system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN1540954A (en) |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN100426747C (en) * | 2006-01-25 | 2008-10-15 | 华为技术有限公司 | Method for loading file to net element |
| CN102244773A (en) * | 2011-06-21 | 2011-11-16 | 浙江万里学院 | Real-time video streaming transmission method based on narrow variable-bandwidth network |
| CN102364937A (en) * | 2011-11-21 | 2012-02-29 | 苏州阔地网络科技有限公司 | Audio and video transmission control method of network conference and system thereof |
| CN102364936A (en) * | 2011-11-21 | 2012-02-29 | 苏州阔地网络科技有限公司 | Audio and video transmission method and system for network conference |
| US8341684B2 (en) | 2008-08-29 | 2012-12-25 | Huawei Device Co., Ltd. | Method and device for transmitting data |
| CN103873826A (en) * | 2014-03-06 | 2014-06-18 | 浙江宇视科技有限公司 | Media stream sending control method and device |
| CN105635636A (en) * | 2015-12-30 | 2016-06-01 | 随锐科技股份有限公司 | Video conference system and method for realizing transmission control of video image |
| WO2016206391A1 (en) * | 2015-06-26 | 2016-12-29 | 中兴通讯股份有限公司 | Method and system for controlling network traffic of video conference |
| CN110781034A (en) * | 2019-10-29 | 2020-02-11 | 成都中航信虹科技股份有限公司 | Distributed supervision method and system |
| CN112752057A (en) * | 2019-10-30 | 2021-05-04 | 中兴通讯股份有限公司 | Auxiliary stream processing method and device for video conference |
| CN113315943A (en) * | 2021-04-15 | 2021-08-27 | 安徽斯百德信息技术有限公司 | Conference information transmission method, system, computer equipment and storage medium |
| CN113380280A (en) * | 2018-12-29 | 2021-09-10 | 百度在线网络技术（北京）有限公司 | Data processing method, device and storage medium |
| CN113992637A (en) * | 2021-09-10 | 2022-01-28 | 广州极飞科技股份有限公司 | Audio and video data receiving method, device, equipment, system and storage medium |
| CN114553616A (en) * | 2022-01-12 | 2022-05-27 | 广州市迪士普音响科技有限公司 | Audio transmission method, device and system of conference unit and terminal equipment |
| WO2024058831A1 (en) * | 2022-09-15 | 2024-03-21 | Google Llc | Dynamic participant device management for hosting a teleconference |
-
2003
- 2003-10-30 CN CNA2003101119999A patent/CN1540954A/en active Pending
Cited By (21)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN100426747C (en) * | 2006-01-25 | 2008-10-15 | 华为技术有限公司 | Method for loading file to net element |
| US8341684B2 (en) | 2008-08-29 | 2012-12-25 | Huawei Device Co., Ltd. | Method and device for transmitting data |
| CN102244773A (en) * | 2011-06-21 | 2011-11-16 | 浙江万里学院 | Real-time video streaming transmission method based on narrow variable-bandwidth network |
| CN102364937A (en) * | 2011-11-21 | 2012-02-29 | 苏州阔地网络科技有限公司 | Audio and video transmission control method of network conference and system thereof |
| CN102364936A (en) * | 2011-11-21 | 2012-02-29 | 苏州阔地网络科技有限公司 | Audio and video transmission method and system for network conference |
| CN103873826B (en) * | 2014-03-06 | 2017-08-15 | 浙江宇视科技有限公司 | Media stream control method and device |
| CN103873826A (en) * | 2014-03-06 | 2014-06-18 | 浙江宇视科技有限公司 | Media stream sending control method and device |
| WO2016206391A1 (en) * | 2015-06-26 | 2016-12-29 | 中兴通讯股份有限公司 | Method and system for controlling network traffic of video conference |
| CN106331578A (en) * | 2015-06-26 | 2017-01-11 | 中兴通讯股份有限公司 | Video conference network flow control method and system |
| CN105635636B (en) * | 2015-12-30 | 2019-05-03 | 随锐科技股份有限公司 | A kind of video conferencing system and its method for realizing transmission of video images control |
| CN105635636A (en) * | 2015-12-30 | 2016-06-01 | 随锐科技股份有限公司 | Video conference system and method for realizing transmission control of video image |
| CN113380280A (en) * | 2018-12-29 | 2021-09-10 | 百度在线网络技术（北京）有限公司 | Data processing method, device and storage medium |
| CN110781034A (en) * | 2019-10-29 | 2020-02-11 | 成都中航信虹科技股份有限公司 | Distributed supervision method and system |
| CN110781034B (en) * | 2019-10-29 | 2022-11-29 | 成都中航信虹科技股份有限公司 | Distributed supervision method and system |
| CN112752057A (en) * | 2019-10-30 | 2021-05-04 | 中兴通讯股份有限公司 | Auxiliary stream processing method and device for video conference |
| CN113315943A (en) * | 2021-04-15 | 2021-08-27 | 安徽斯百德信息技术有限公司 | Conference information transmission method, system, computer equipment and storage medium |
| CN113992637A (en) * | 2021-09-10 | 2022-01-28 | 广州极飞科技股份有限公司 | Audio and video data receiving method, device, equipment, system and storage medium |
| CN113992637B (en) * | 2021-09-10 | 2024-04-09 | 广州极飞科技股份有限公司 | Audio and video data receiving method, device, equipment, system and storage medium |
| CN114553616A (en) * | 2022-01-12 | 2022-05-27 | 广州市迪士普音响科技有限公司 | Audio transmission method, device and system of conference unit and terminal equipment |
| CN114553616B (en) * | 2022-01-12 | 2023-11-24 | 广州市迪士普音响科技有限公司 | Audio transmission method, device and system of conference unit and terminal equipment |
| WO2024058831A1 (en) * | 2022-09-15 | 2024-03-21 | Google Llc | Dynamic participant device management for hosting a teleconference |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7373379B2 (en) | Media role management in a video conferencing network | |
| CN100433826C (en) | Method and system for recording videoconference data | |
| DE69837887T2 (en) | DIVISIONABLE, NETWORKED MULTIMEDIA SYSTEMS AND APPLICATIONS | |
| CN1540954A (en) | Method for controlling flux of audio and video flow transferred in IP video meeting system | |
| CN113099155B (en) | Video conference system suitable for multiple scenes | |
| CN105376516A (en) | Mobile video conference system and implementing method thereof | |
| US20060222155A1 (en) | Internet-Enabled Conferencing System and Method Accommodating PSTN and IP Traffic | |
| JP2002524004A (en) | Communication management system for telephones based on computer networks. | |
| CN101090329A (en) | Intelligent audio limit method, system and node | |
| CN101090328A (en) | Associating independent multimedia sources into a conference call | |
| CN101090475A (en) | Conference layout control and control protocol | |
| CN1421099A (en) | Videoconference recording | |
| CN101789956A (en) | System and method for realizing digital family remote communication service | |
| CN109743524B (en) | Data processing method of video network and video network system | |
| CN101083752A (en) | Method for displaying meeting place name of video conference and video terminal | |
| CN102348096A (en) | Multi-party video telephone conference system | |
| CN109714316B (en) | Audio mixing processing method of video network and video network system | |
| WO2003063485A1 (en) | Videoconferencing service system, videoconferencing service operating method and service center | |
| CN1232119C (en) | Time prompting method in TV conference service | |
| CN113259690A (en) | Inter-network system audio and video real-time online collaboration system and method | |
| CN101662641A (en) | Method for viewing monitoring images by video session terminal | |
| CN113676691A (en) | Intelligent video conference system and method | |
| CN110502649A (en) | A kind of classification method and device of multimedia service | |
| CN1525757A (en) | A video telephone system | |
| Chen et al. | Research on key technologies and development trend of Video Conference System |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |