CN100473149C - A video conference image processing system - Google Patents

A video conference image processing system Download PDF

Info

Publication number
CN100473149C
CN100473149C CN 200610162376 CN200610162376A CN100473149C CN 100473149 C CN100473149 C CN 100473149C CN 200610162376 CN200610162376 CN 200610162376 CN 200610162376 A CN200610162376 A CN 200610162376A CN 100473149 C CN100473149 C CN 100473149C
Authority
CN
China
Prior art keywords
unit
image
selector
processing unit
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN 200610162376
Other languages
Chinese (zh)
Other versions
CN1972431A (en
Inventor
庞科
董欣
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Vimicro Corp
Original Assignee
Vimicro Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vimicro Corp filed Critical Vimicro Corp
Priority to CN 200610162376 priority Critical patent/CN100473149C/en
Publication of CN1972431A publication Critical patent/CN1972431A/en
Application granted granted Critical
Publication of CN100473149C publication Critical patent/CN100473149C/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Telephonic Communication Services (AREA)

Abstract

This invention discloses one visual frequency image process system, which comprises cameral head, display screen and transmission network and image process unit, visual code unit, visual decode unit, first and second central data process unit, wherein, image data send and receive are divided into two paths for process to reduce system load to make image information more clear to improve system process data speed and system efficiency.

Description

A kind of video conference image processing system
Technical field
The present invention relates to the video conferencing system technology, be specifically related to a kind of video conference image processing system.
Background technology
Along with the development of technology, the utilization of video conferencing system is more and more frequent, and it is not limited by the region, has satisfied people's communication demand.Video conference is divided according to traffic criteria, mainly comprises data conferencing and audio/video conference.Wherein, data conferencing is made up of text chat, electronic whiteboard, document sharing and screen broadcasting etc., and audio/video conference is made up of audio frequency and video part, user list, text chat, electronic whiteboard, document sharing and screen broadcasting etc.For audio/video conference, for the ease of watching and operating, during interface layout, often audio frequency and video part interface, user list and text chat are put on the same interface, form the main interface of video conference, other modules such as electronic whiteboard, document sharing and screen broadcasting are then formed another interface separately.
Local point with conference participation is example, is made as the Party A, and its other side is field, arbitrary strange land point, is made as the Party B.As shown in Figure 1, be the video conference image processing system structure chart of Party A in the prior art, it comprises camera 111, graphics processing unit 112, video coding/decoding unit 113, central data processing unit 114, transmission network 115, display screen 116.
Camera 111 is gathered Party A's view data, gives graphics processing unit 112 with the gained image data transmission.
Graphics processing unit 112, Party A's view data that camera 111 is gathered is done further optimization, and the Party A's image data transmission after will optimizing gives video coding/decoding unit 113, and its optimization process comprises: white balance, gamma (gamma) processing, noise processed, saturation processing, edge strengthening etc.; Party B's view data of reception 113 inputs through video coding/decoding unit sends display screen 116 to.
Video coding/decoding unit 113 after the Party A's view data after graphics processing unit 112 optimized is carried out compressed encoding, is transferred to central data processing unit 114; Party B's compressing image data through 114 transmission of central data processing unit is decompressed, give graphics processing unit 112 the Party B's image data transmission that decompresses.
Central data processing unit 114, is encrypted, scrambling the packing of Party A's view data of compressed encoding as required according to host-host protocol, form the data flow of agreement prescribed form, as, USB (USB) data flow sends to transmission network 115 with Party A's packet after treatment; According to host-host protocol, will unpack by Party B's packet that transmission network 115 receives, be decrypted as required, Data Stream Processing such as descrambling, obtain Party B's compressing image data after, be transferred to video coding/decoding unit 113.
Transmission network 115 receives Party A's packet of central data processing unit 114 inputs, and is transferred to the Party B; Send Party B's packet to central data processing unit 114.
Display screen 116 receives the view data that graphics processing unit 112 transmits, and image is shown on the main interface of video conference.
During practice, on the one hand, camera 111 is with the Party A's view data that collects, be transferred to display screen 116 by graphics processing unit 112, display screen 116 demonstrates Party A field dot image, and simultaneously, graphics processing unit 112 carries out compressed encoding for video coding/decoding unit 113 Party A's image data transmission, behind central data processing unit 114, send transmission network 115 to, send to the Party B at last; On the other hand, receive the packet that the Party B sends,, Party B field dot image is presented on the display screen 116 through central data processing unit 114, video coding/decoding unit 113 and graphics processing unit 112 from transmission network 115.
In the prior art, the single pass data coding/decoding of this employing, image processing and central data are handled, and the load of whole video conference system is increased greatly, cause image hysteresis, system effectiveness and quality to reduce.
Summary of the invention
In view of this, main purpose of the present invention is to provide a kind of video conference image processing system, can reduce the load of system, improves system effectiveness.
For achieving the above object, technical scheme of the present invention is achieved in that
The invention discloses a kind of video conference image processing system, comprise camera, display screen and transmission network, it is characterized in that, this system also comprises graphics processing unit, video encoding unit, video decoding unit, first, second central data processing unit, first, second image zoom unit;
Described camera, the view data that is used to gather local point;
Described graphics processing unit is done further optimization to the local view data of camera collection, and the image data transmission after will optimizing is given first image zoom unit and the video encoding unit;
Described video encoding unit carries out compressed encoding to the local view data after the optimization of graphics processing unit output, and is transferred to the first central data processing unit;
The described first central data processing unit, to the local compressing image data packing of input, carry out Data Stream Processing after, send to transmission network;
Described transmission network, receive the packet of the first central data processing unit, be transferred to meeting field, the arbitrary strange land point that participates in video conference, simultaneously, send the image data packets that participates in arbitrary strange land meeting field point of video conference to second central data processing unit;
The described second central data processing unit receives meeting field, the arbitrary strange land point data bag that transmission network is imported, and carries out Data Stream Processing, obtains the compressing image data of arbitrary strange land meeting field point, and is transferred to video decoding unit;
Described video decoding unit after the compressing image data of arbitrary strange land meeting field point of second central data processing unit output decompressed, is transferred to the second image zoom unit;
Described display screen, this locality that will transmit through first, second image zoom unit and the image of arbitrary strange land meeting field point are shown in main interface simultaneously;
The described first image zoom unit according to the size of default, carries out being transferred to display screen behind the convergent-divergent to the local view data after the optimization of graphics processing unit output;
The described second image zoom unit according to the size of default, carries out input panel behind the convergent-divergent to the view data of video decoding unit output.
The main interface that described display screen shows comprises from display screen and main display, is used for showing respectively carrying out the scaled images data by first unit for scaling, the output of the second image zoom unit.
The main interface that described display screen shows also comprises interface, user list and the text chat of audio frequency and video part.
Before described first, second image zoom unit first, second selector can be set respectively;
Described first selector, link to each other with graphics processing unit with video decoding unit, give the first image zoom unit with the view data of arbitrary strange land meeting field point of video decoding unit transmission or the local image data transmission of graphics processing unit transmission according to the first selector value of setting;
Described second selector, link to each other with graphics processing unit with video decoding unit, give the second image zoom unit with the view data of arbitrary strange land meeting field point of video decoding unit transmission or the local image data transmission of graphics processing unit transmission according to the second selector value of setting.
In described first, second image zoom unit first, second selector can be set respectively;
Described first selector, link to each other with graphics processing unit with video decoding unit, give the first image zoom unit with the view data of arbitrary strange land meeting field point of video decoding unit transmission or the local image data transmission of graphics processing unit transmission according to the first selector value of setting;
Described second selector, link to each other with graphics processing unit with video decoding unit, give the second image zoom unit with the view data of arbitrary strange land meeting field point of video decoding unit transmission or the local image data transmission of graphics processing unit transmission according to the second selector value of setting.
When the value of setting of described first, second selector is 1, first selector is imported the first image zoom unit with the local view data that graphics processing unit transmits, and second selector is imported the second image zoom unit with the view data of arbitrary strange land meeting field point that video decoding unit transmits; When the value of setting of described first, second selector is 0, first selector is imported the first image zoom unit with the view data of arbitrary strange land meeting field point that video decoding unit transmits, and second selector is imported the second image zoom unit with the local view data that graphics processing unit transmits.
By technical scheme of the present invention as seen, a kind of video conference image processing system provided by the invention is with the transmission and the parallel processing of reception branch two paths of image.Like this, reduced the load of system, made that image information is more clear to link up, and, the speed and the system effectiveness of system handles data improved greatly.
Description of drawings
Fig. 1 is the structural representation of prior art video conference image processing system;
Fig. 2 is the structural representation of a preferred embodiment of video conference image processing system of the present invention;
Fig. 3 is the structural representation of another preferred embodiment of video conference image processing system of the present invention.
Embodiment
Below in conjunction with drawings and the specific embodiments the present invention is described in further detail again.
Equally, putting with the local field of conference participation is example, is made as the Party A, and the other side is field, arbitrary strange land point, is made as the Party B.As shown in Figure 2, structural representation for the preferred embodiment of video conference image processing system of Party A among the present invention, it comprises, camera 211, graphics processing unit 212, video encoding unit 213, video decoding unit 216, central data processing unit 1, central data processing unit 2, image zoom unit 1, image zoom unit 2, transmission network 214 and display screen 215.
Wherein, camera 211, transmission network 214 and display screen 215 are identical with structure shown in Figure 1.
Graphics processing unit 212, Party A's view data that camera 211 is gathered is done further optimization, its optimization process comprises: white balance, gamma (gamma) processing, noise processed, saturation processing, edge strengthening etc., and the Party A's image data transmission after will optimizing is given image zoom unit 1 and video encoding unit 213.
Image zoom unit 1 according to the size of default, carries out input panel 215 behind the convergent-divergent to Party A's view data.
Video encoding unit 213 carries out compressed encoding to the Party A's view data after graphics processing unit 212 optimization processes, and is transferred to central data processing unit 1.
Central data processing unit 1, according to the Party A view data packing of host-host protocol with compressed encoding, encrypt as required, scrambling, form the data flow of agreement prescribed form, as, USB (USB) data flow sends to transmission network 214 with Party A's image data packets after treatment.
Central data processing unit 2 according to host-host protocol, will be unpacked by Party B's packet that transmission network 214 receives, and be decrypted as required, Data Stream Processing such as descrambling, obtain Party B's compressing image data after, be transferred to video decoding unit 216.
Video decoding unit 216, Party B's compressing image data that central data processing unit 2 is imported decompresses, and gives image zoom unit 2 with the Party B's image data transmission that decompresses.
Image zoom unit 2 according to the size of default, carries out input panel 215 behind the convergent-divergent to Party B's view data.
Display screen 215 receives Party A's view data that image zoom unit 1 is imported, and Party A field dot image is shown in from display screen, receives Party B's view data of image zoom unit 2 inputs simultaneously, and Party B field dot image is shown on the main display.
Certainly, what the display screen 215 of this moment showed is the main interface of video conference, not only comprises main display and from display screen, also comprises interface, user list and the text chat etc. of audio frequency and video part.
Among the present invention, Party A field dot image and the Party B field display position of dot image on display screen can be selected.As shown in Figure 3, be the structural representation of another preferred embodiment of video conference image processing system of the present invention.Compare with Fig. 2, difference is, is provided with a selector respectively before two image zoom unit among Fig. 3.
Video decoding unit 311, Party B's compressing image data that central data processing unit 2 is imported decompresses, and is transferred to selector 1 and selector 2.
Graphics processing unit 312 Party A's view data that camera 211 is gathered is done further optimization, and the Party A's image data transmission after will optimizing is given video encoding unit 213, selector 1 and selector 2.
Selector 1 links to each other with graphics processing unit 312 with video decoding unit 311, according to the difference of its value of setting Party A or Party B's a field dot image data is transferred to image zoom unit 1.
Selector 2 links to each other with graphics processing unit 312 with video decoding unit 311, according to the difference of its value of setting Party A or Party B's a field dot image data is transferred to image zoom unit 2.
In the practice, when the value of setting of selector 1 and selector 2 is 1, the view data that selector 1 transmits graphics processing unit 312, it is Party A's view data input picture unit for scaling 1, the view data that selector 2 transmits video decoding unit 311, promptly Party B's view data input picture unit for scaling 2, at this moment, Party B's image is shown on the main display, and Party A's image is shown in from display screen; When the value of setting of selector 1 and selector 2 is 0, the view data that selector 1 transmits video decoding unit 311, it is Party B's view data input picture unit for scaling 1, the view data that selector 2 transmits graphics processing unit 312, it is Party A's view data input picture unit for scaling 2, at this moment, Party A's image is shown on the main display, and Party B's image is shown in from display screen.
Described selector 1 and selection 2 also can be inserted respectively in image zoom unit 1 and the image zoom unit 2.
The foregoing description is an example with local some Party A, and certainly, for any one party that participates in video conference, its image processing system is all Fig. 2 or shown in Figure 3.
The present invention can adopt hardware circuit module in the specific implementation, will all be implemented in the chips except that the part camera 211, the display screen 215.This hard-wired mode can increase substantially system running speed undoubtedly, ensures the quality that image shows, and reduces the system resource that running software takies.
In sum, more than be preferred embodiment of the present invention only, be not to be used to limit protection scope of the present invention.Within the spirit and principles in the present invention all, any modification of being done, be equal to replacement, improvement etc., all should be included within protection scope of the present invention.

Claims (6)

1, a kind of video conference image processing system, comprise camera, display screen and transmission network, it is characterized in that, this system also comprises graphics processing unit, video encoding unit, video decoding unit, the first central data processing unit, the second central data processing unit, the first image zoom unit, the second image zoom unit;
Described camera, the view data that is used to gather local point;
Described graphics processing unit is done further optimization to the local view data of camera collection, and the image data transmission after will optimizing is given first image zoom unit and the video encoding unit;
Described video encoding unit carries out compressed encoding to the local view data after the optimization of graphics processing unit output, and is transferred to the first central data processing unit;
The described first central data processing unit, to the local compressing image data packing of input, carry out Data Stream Processing after, send to transmission network;
Described transmission network, receive the image data packets of the first central data processing unit, and this image data packets is transferred to meeting field, the arbitrary strange land point that participates in video conference, simultaneously, the described transmission network image data packets that will participate in arbitrary strange land meeting field point of video conference sends the second central data processing unit to;
The described second central data processing unit, the image data packets of arbitrary strange land meeting field point of reception transmission network input is carried out Data Stream Processing, obtains the compressing image data of arbitrary strange land meeting field point, and is transferred to video decoding unit;
Described video decoding unit after the compressing image data of arbitrary strange land meeting field point of second central data processing unit output decompressed, is transferred to the second image zoom unit;
Described display screen will be shown in main interface simultaneously through this locality after the first image zoom unit and the second image zoom unit carry out convergent-divergent respectively and the image of arbitrary strange land meeting field point;
The described first image zoom unit according to the size of default, carries out being transferred to display screen behind the convergent-divergent to the local view data after the optimization of graphics processing unit output;
The described second image zoom unit according to the size of default, carries out input panel behind the convergent-divergent to the view data of video decoding unit output.
2, video conference image processing system as claimed in claim 1, it is characterized in that, the main interface that described display screen shows comprises from display screen and main display, is used for showing respectively carrying out the scaled images data by the first image zoom unit, the output of the second image zoom unit.
3, video conference image processing system as claimed in claim 2 is characterized in that, the main interface that described display screen shows comprises interface, user list and the text chat of audio frequency and video part.
4, video conference image processing system as claimed in claim 1 is characterized in that, is provided with first selector and second selector respectively before the described first image zoom unit and the second image zoom unit;
Described first selector, link to each other with graphics processing unit with video decoding unit, according to the local image data transmission after the optimization of the view data of the value of setting of the first selector arbitrary strange land meeting field point after with the decompression of video decoding unit output or graphics processing unit output to the first image zoom unit;
Described second selector, link to each other with graphics processing unit with video decoding unit, according to the local image data transmission after the optimization of the view data of the value of setting of the second selector arbitrary strange land meeting field point after with the decompression of video decoding unit output or graphics processing unit output to the second image zoom unit.
5, video conference image processing system as claimed in claim 1 is characterized in that, is provided with first selector and second selector respectively in the described first image zoom unit and the second image zoom unit;
Described first selector, link to each other with graphics processing unit with video decoding unit, according to the local image data transmission after the optimization of the view data of the value of setting of the first selector arbitrary strange land meeting field point after with the decompression of video decoding unit output or graphics processing unit output to the first image zoom unit;
Described second selector, link to each other with graphics processing unit with video decoding unit, according to the local image data transmission after the optimization of the view data of the value of setting of the second selector arbitrary strange land meeting field point after with the decompression of video decoding unit output or graphics processing unit output to the second image zoom unit.
6, as claim 4 or 5 described video conference image processing systems, it is characterized in that, the value of setting of described first selector and second selector is at 1 o'clock, the local view data of first selector after with the optimization of graphics processing unit output imported the first image zoom unit, and the view data of the arbitrary strange land meeting field point of second selector after with the decompression of video decoding unit output is imported the second image zoom unit; The value of setting of described first selector and second selector is at 0 o'clock, the view data of the arbitrary strange land meeting field point of first selector after with the decompression of video decoding unit output is imported the first image zoom unit, and the local view data after the optimization that second selector is exported graphics processing unit is imported the second image zoom unit.
CN 200610162376 2006-12-14 2006-12-14 A video conference image processing system Expired - Fee Related CN100473149C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 200610162376 CN100473149C (en) 2006-12-14 2006-12-14 A video conference image processing system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 200610162376 CN100473149C (en) 2006-12-14 2006-12-14 A video conference image processing system

Publications (2)

Publication Number Publication Date
CN1972431A CN1972431A (en) 2007-05-30
CN100473149C true CN100473149C (en) 2009-03-25

Family

ID=38112975

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 200610162376 Expired - Fee Related CN100473149C (en) 2006-12-14 2006-12-14 A video conference image processing system

Country Status (1)

Country Link
CN (1) CN100473149C (en)

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI381733B (en) * 2007-06-11 2013-01-01 Quanta Comp Inc High definition video conference system
CN101340545B (en) * 2007-07-04 2010-07-07 广达电脑股份有限公司 High-resolution video conference system and method
JP2010534971A (en) * 2007-07-26 2010-11-11 ノマド イノベーションズ リミテッド ライアビリティ カンパニー Full-duplex network-based apparatus and method
TW201026056A (en) 2008-12-16 2010-07-01 Quanta Comp Inc Image capturing device and image delivery method
CN101815192B (en) * 2009-02-23 2011-06-15 广达电脑股份有限公司 Digital video and audio capturing device and method thereof
EP2525574A4 (en) * 2010-01-29 2013-07-10 Huawei Device Co Ltd Method, apparatus and system for video communication
CN101795390B (en) * 2010-03-05 2012-11-28 圆展科技股份有限公司 Method, system and device for transmitting pictures
CN102387338B (en) * 2010-09-03 2017-04-12 中兴通讯股份有限公司 Distributed type video processing method and video session system
CN102082945A (en) * 2011-01-26 2011-06-01 青岛海信电器股份有限公司 Method for realizing multi-party video calls, video terminal and system
CN102427543B (en) * 2011-10-12 2013-10-16 大连科迪视频技术有限公司 Platform for processing frame synchronization 3D real-time video information and processing method thereof
CN109819194A (en) * 2017-11-22 2019-05-28 重庆晋才富熙科技有限公司 Remote terminal and the real-time interactive of entity main meeting-place recorded broadcast equipment meeting system
CN110446001A (en) * 2019-07-12 2019-11-12 视联动力信息技术股份有限公司 Video conference processing method, device, electronic equipment and medium based on view networking

Also Published As

Publication number Publication date
CN1972431A (en) 2007-05-30

Similar Documents

Publication Publication Date Title
CN100473149C (en) A video conference image processing system
US6442758B1 (en) Multimedia conferencing system having a central processing hub for processing video and audio data for remote users
CN101510957B (en) Image processing device, camera device, communication system, image processing method, and program
CN1571508B (en) A method for implementing multi-frame
CN101895718B (en) Video conference system multi-image broadcast method, and device and system thereof
CN102387338B (en) Distributed type video processing method and video session system
CN102342066A (en) REAL-TIME MULTI-MEDIA STREAMING processing BANDWIDTH MANAGEMENT
CN105635636A (en) Video conference system and method for realizing transmission control of video image
US5689562A (en) Method for transmitting superimposed image data in a radio frequency communication system
CN104185082A (en) Audio/video live broadcast method and system, client and server
CN102710778A (en) Collaboration wireless display system and working method thereof
CN105704424A (en) Multi-image processing method, multi-point control unit, and video system
CN102118602A (en) Method and system for displaying auxiliary streaming video in multiple pictures
CN113438442A (en) Conference data sharing method and device
CN104427295A (en) Method for processing video in video conference and terminal
CN101350908A (en) Video data transmission system and method for network video conference
US9179095B2 (en) Scalable multi-videoconferencing system
CN101237583A (en) A decoding and coding method and device for multiple screen
TWI519131B (en) Video transmission system and transmitting device and receiving device thereof
KR20160099977A (en) Data processing apparatus and data processing method for videoconferencing service
US20220311814A1 (en) Techniques for signaling multiple audio mixing gains for teleconferencing and telepresence for remote terminals
Shirai et al. Multi-point 4K/2K layered video streaming for remote collaboration
CN101742220B (en) System and method for realizing multi-picture based on serial differential switch
CN101521790A (en) Methods for realizing high definition conference system based on digital television
CN105611387A (en) Method and system for previewing video image

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
C17 Cessation of patent right
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20090325

Termination date: 20111214