Embodiment
To combine the accompanying drawing in the embodiment of the invention below, the technical scheme in the embodiment of the invention is carried out clear, intactly description, obviously, described embodiment only is the present invention's part embodiment, rather than whole embodiment.Based on the embodiment among the present invention, those of ordinary skills are not making the every other embodiment that is obtained under the creative work prerequisite, all belong to the scope of the present invention's protection.
Embodiment
At first the operational environment of the embodiment of the invention is simply introduced, be illustrated in figure 1 as a kind of videoconference system architecture figure that the embodiment of the invention one provides.This system comprises: multipoint control unit 101 (Multipoint Control Unit; MCU), the meeting-place video camera 102,103 and 104; Wherein meeting-place video camera 102,103 and 104 is distributed in three different meeting-place; They link to each other with multipoint control unit 101 through transmission line, such as linking to each other through IP network.Multipoint control unit 101 can be forwarded to other meeting-place with video and the voice data from each meeting-place; Such as will the field shooting machine 102 data forwarding of gathering give meeting- place video camera 103 and 104; Certainly multipoint control unit 101 can carry out certain processing to these data in repeating process, such as each picture being spliced to strengthen meeting experience etc.
Be illustrated in figure 2 as the method flow diagram of the on-the-spot atmosphere of a kind of outstanding video conference that the embodiment of the invention one provides, this method comprises the steps:
S201: receiving the video and the voice data in each meeting-place, is that multipoint control unit receives video and the voice data from each meeting-place specifically, and this reception data procedures belongs to prior art, has just no longer given unnecessary details at this.
S202: said video and voice data are carried out the atmosphere of video/audio processing with outstanding current video meeting.For the atmosphere that can let video and audio frequency give prominence to the current video meeting, multipoint control unit need carry out special video/audio processing to video and the voice data that receives, and makes the participant can from this video and audio frequency, experience the meeting atmosphere intuitively.
As one embodiment of the present of invention, above-mentioned video/audio is handled can comprise multiple treatment technology: play up processing, lines optimization process, background fusion treatment, special-effect generation overlap-add procedure or texture simulation process such as rhythm control and treatment, color.
Wherein, the rhythm control and treatment is to video that receives and voice data, through changing the method for its frame per second, changes the progress that whole video and voice data are handled, and makes its broadcasting speed accelerate perhaps to slow down.Accelerate to play and to give prominence to cheerful and light-hearted or rapid on-the-spot atmosphere, slow down broadcast and then can give prominence to heavy or serious on-the-spot atmosphere.Handle for 30 frame/seconds such as the videos of 25 frame/seconds and tonic train are converted into, thereby bring the people cheerful and light-hearted, rapid and nervous sensation; Perhaps the videos of 30 frame/seconds and tonic train are converted into and handle for 25 frame/seconds, to let the people feel heavy or serious atmosphere, the embodiment of the invention is not limited to the conversion of this kind frame per second certainly.
Color is played up and handled is the video that receives to be carried out with voice data color strengthens or the color desalination is handled: such as for the positive on-the-spot atmosphere in front, adopt color to strengthen, and adopt warm tones more, the sensation that makes progress to a kind of sunlight of people; And, then adopt the color desalination for the on-the-spot atmosphere of negative passiveness, and adopt cool tone more, give the sensation of a kind of dark haze of people.
The lines optimization process is that the video data that receives is detected, and finds out big profile in the image, and significantly the edge such as for the positive on-the-spot atmosphere in front, is handled outline line row culture optimization of profile, makes the shape profile of object in the image seem more graceful; And for the atmosphere of passiveness, then outline line row culture linear optimal is handled, make the shape profile of object in the image seem more dull, come outstanding dignified and serious.
The background fusion treatment is to choose the background of some theme atmosphere in advance, and the scope of choosing comprises under the different atmosphere, different industries; Various Seasonal; Different meeting-places, and some subject matters of different parliamentary dimensions size are then according to actual meeting; Choose the material that adapts to it, carry out background and the actual video that receives and the fusion of audio frequency.
It is the demand according to some particular application that special-effect generates overlap-add procedure, generates some special effects, is used for outstanding meeting atmosphere.Such as: when the meeting of holding some sad themes, can make the image of tears, be superimposed upon on some objects, the desk and the cup that for example are superimposed upon in the conference scenario are first-class.
The texture simulation process is the texture region that at first detects in the image, then according to current environment parameter, temperature; Humidity, bright-dark degree or the like processes this texture region; Make the people in other meeting-place, it is the same to see that the people at texture impression and the meeting scene of desk sees.
Certainly, it is pointed out that the video/audio that multipoint control unit carried out of the embodiment of the invention is handled the above-mentioned several kinds of modes of enumerating that are not limited to, also be not limited to use simultaneously simultaneously several kinds of above-mentioned processing modes.
S203: the said video and the voice data that will pass through after video/audio is handled feed back to each meeting-place.With video conference scene shown in Figure 1 is example; Multipoint control unit 101 is at the video of receiving meeting-place video camera 102 and voice data; And to after its video/audio processing through step S202; Treated image is redispatched to meeting-place video camera 102,103 and 104, also is to do same processing to the meeting-place 103 of reception and 104 data
The embodiment of the invention is passed through image processing techniques and the video in each meeting-place and voice data are carried out video/audio is handled the atmosphere of having given prominence to the current video meeting, thus make the participant can be intuitively on-the-spot atmosphere from this video and audio frequency enteroception to this meeting.
Embodiment two
Be illustrated in figure 3 as the method flow diagram of the on-the-spot atmosphere of a kind of outstanding video conference that the embodiment of the invention two provides, it is pointed out that the embodiment of the invention also be angle from multipoint control unit to the description that the present invention did, this method comprises the steps:
S301: set the environment pattern of current video meeting, said environment pattern comprises the atmosphere preset value.Before video conference begins; The environment pattern that meets current meeting atmosphere at first is set in multipoint control unit; These environment patterns can be stored among the memory cell in the multipoint control unit in advance, when needs call, can select wherein a kind of the operation.Comprised a series of atmosphere preset value in these environment patterns, a kind of atmosphere pattern of sadness can comprise following a series of preset value: 30-25; 0; 0; 4; 5.This group preset value is divided into 5 parts, following 5 kinds of processing modes that it is corresponding: rhythm control and treatment, color are played up processing, lines optimization process, background fusion treatment, special-effect generation overlap-add procedure, and its implication is respectively:
The rhythm control and treatment adopts and to convert 30 frames/second sequence into handle for 25 frame/seconds the playback process mode of slowing down;
Color is played up to handle and is adopted color desalination processing mode;
The lines optimization process is adopted outline line row culture linear optimal is handled;
The background fusion treatment adopts preset 4 the background that is numbered;
Special-effect generates overlap-add procedure and adopts preset 5 the special-effect that is numbered.
Certainly, above-mentionedly just enumerated a kind of possible preset value setting, the embodiment of the invention is not limited to this kind form, and the form of other various preset values also is fine.
S302: the video and voice data and the atmosphere parameter that receive each meeting-place.
Because the atmosphere of video conference progressively goes short of owing to some arguement such as the original meeting that relaxes along with certain variation may take place the carrying out of meeting, if therefore adopt original atmosphere preset value not to be inconsistent with actual conditions always.
To above-mentioned situation; Multipoint control unit is except the video and voice data that receive each meeting-place in this step; Also receive the atmosphere parameter of sending in each meeting-place simultaneously, in the present embodiment, each meeting-place can be sent to multipoint control unit together with this atmosphere parameter and video and voice data; Also can send this atmosphere parameter through auxilliary stream simultaneously, this atmosphere parameter can embody the variation of atmosphere in each meeting-place.In practical application, the transmission of this atmosphere parameter can be operated by the personnel that are responsible for shooting with video-corder in each meeting-place.
S303: judge whether needs correction atmosphere preset value: if desired, then the atmosphere preset value is revised,, then got into step S304 if do not need according to the atmosphere parameter.
Whether can comprise the information that to make amendment to the atmosphere preset value in this atmosphere parameter; And the information how to revise, multipoint control unit only need be operated accordingly according to those information and get final product, certainly; Also can directly not comprise above-mentioned information in this atmosphere parameter; But after needing multipoint control unit to handle accordingly, just can obtain above-mentioned information, such as atmosphere parameter and atmosphere preset value are carried out certain ratio equity.
S304: said video and voice data are carried out the atmosphere of video/audio processing with outstanding current video meeting according to said atmosphere preset value.
In this step according to the atmosphere preset value to video and voice data carry out video/audio handle with step S301 in describe similar, and the particular content that video/audio is handled is also similar with embodiment one, so just no longer it has been given unnecessary details at this.
S305: carry out effect assessment through video/audio processed video and audio frequency and need to judge whether renewal atmosphere preset value to said.
In order to guarantee to pass through the video/audio processed video of step S304 and the atmosphere that audio frequency meets current meeting-place; Treatment effect is satisfactory in other words; Present embodiment has carried out effect assessment to this processed video and audio frequency in this step, this effect assessment can realize through processed video and audio frequency and a preset masterplate are compared.After the effect assessment, multipoint control unit can judge whether that needs upgrade the atmosphere preset value, if desired, then revise above-mentioned atmosphere preset value, and return with step S304 according to evaluation result; If do not need, then get into step S306.
S306: the said video and the voice data that will pass through after video/audio is handled feed back to each meeting-place.
The embodiment of the invention is passed through image processing techniques and the video in each meeting-place and voice data are carried out video/audio is handled the atmosphere of having given prominence to the current video meeting; Thereby make the participant can be intuitively on-the-spot atmosphere from this video and audio frequency enteroception to this meeting; The embodiment of the invention not only detects the situation in each meeting-place in real time in addition; Change the atmosphere preset value as the case may be; But also treated video and audio frequency are carried out effect assessment, thereby it is more obvious to make that the embodiment of the invention more meets the effect of actual atmosphere situation and outstanding meeting atmosphere of meeting.
Embodiment three
Be illustrated in figure 4 as the method flow diagram of the on-the-spot atmosphere of a kind of outstanding video conference that the embodiment of the invention three provides, this method comprises the steps:
S401: environment pattern is separately selected according to meeting-place atmosphere separately in each meeting-place, and said environment pattern comprises the atmosphere preset value.
S402: each meeting-place basis atmosphere preset value separately carries out video/audio processing formerly to the video and the voice data of its collection.
Above-mentioned steps S401 and S402 respectively with embodiment two in step S301 and S304 similar; Different is; Step S301 and S304 are accomplished by multipoint control unit among the embodiment two, then are the operation of being accomplished this step by each meeting-place end in the present embodiment, specifically; Can be to accomplish this operation by the camera-shooting and recording device in each meeting-place, perhaps also can be to accomplish this operation by the separate equipment that links to each other with camera-shooting and recording device.
When accomplishing this formerly behind the video/audio treatment step, each meeting-place can be sent to multipoint control unit with video and voice data after treatment.
S404: multipoint control unit is unified the whole atmosphere of adaptive optimization with outstanding current video meeting to said video and voice data through video/audio processing formerly.
In video conference; Each meeting-place is owing to video, audio protocols, and form, network bandwidth or the like are all not necessarily identical; Therefore; In order to let the video data that all meeting-place can both other meeting-place of normal viewing, need the data in each meeting-place be carried out certain conversion, this transfer process just is called " adaptive optimization ".
S405: said video and voice data that multipoint control unit will pass through after the unified adaptive optimization process feed back to each meeting-place.
As one embodiment of the present of invention; Effect assessment also can be carried out through formerly video/audio processed video and voice data to this in each meeting-place behind completing steps S402, judge whether and need make amendment to the atmosphere preset value; Revise if desired; After then revising the atmosphere preset value this video and voice data are carried out video/audio processing formerly once more,, then this video and voice data are sent to multipoint control unit if do not need to revise.
The embodiment of the invention is passed through each meeting-place and separately video and voice data are carried out formerly video/audio is handled the atmosphere of having given prominence to the current video meeting; Thereby make the participant can be intuitively on-the-spot atmosphere from this video and audio frequency enteroception to this meeting; In addition since video/audio handle major part in the meeting-place end share completion, therefore also alleviated the burden of multipoint controller greatly.
Embodiment four
The structure drawing of device of the on-the-spot atmosphere of a kind of outstanding video conference that provides for the embodiment of the invention four like Fig. 5, this device comprises: receiving element 510, atmosphere processing unit 520 and transmitting element 530 link to each other between them successively.
Receiving element 510 is used to receive the video and the voice data in each meeting-place; In the present embodiment; Receiving element 510 can pass through the Internet, private line network or direct-connected cable etc. from each meeting-place receiver, video and voice data; Specifically, be to receive video and the voice data that the image unit in each meeting-place sends.
Atmosphere processing unit 520 is used for said video and voice data are carried out the atmosphere of video/audio processing with outstanding current video meeting.In order to let video and audio frequency give prominence to the atmosphere of current video meeting; The device of the embodiment of the invention need carry out special video/audio processing to video and the voice data that receives, and makes the participant can from this video and audio frequency, experience the meeting atmosphere intuitively.And concrete video/audio processing mode can be varied; Such as what introduced among the embodiment one: rhythm control and treatment, color are played up processing, lines optimization process, background fusion treatment, special-effect generation overlap-add procedure or texture simulation process etc.; Similar among handling principle that it is concrete and process and the embodiment one, just repeated no more.
Transmitting element 530 is used for said video and voice data after handling through video/audio are fed back to each meeting-place.
As one embodiment of the present of invention; Receiving element 510 also is used to receive video and the voice data that has passed through video/audio processing formerly; This video/audio processing is formerly handled similar with above-mentioned video/audio, play up processing, lines optimization process, background fusion treatment, special-effect generation overlap-add procedure or texture simulation process etc. such as rhythm control and treatment, color.Different is, this formerly video/audio handle and accomplish by each meeting-place end, specifically, can be by this operation of the completion of the camera-shooting and recording device in each meeting-place, perhaps also can be to accomplish this operation by the separate equipment that links to each other with camera-shooting and recording device.
Atmosphere processing unit 520 also is used for video that has passed through video/audio processing formerly and voice data are unified the whole atmosphere of adaptive optimization with outstanding current video meeting.
Like this, share most video/audio by each meeting-place end and handle, can alleviate the burden of the embodiment of the invention greatly.
The embodiment of the invention is passed through image processing techniques and the video in each meeting-place and voice data are carried out video/audio is handled the atmosphere of having given prominence to the current video meeting, thus make the participant can be intuitively on-the-spot atmosphere from this video and audio frequency enteroception to this meeting.
Embodiment five
The structure drawing of device of the on-the-spot atmosphere of a kind of outstanding video conference that provides for the embodiment of the invention five like Fig. 6, this device comprises: receiving element 610, atmosphere processing unit 620, transmitting element 630, mode initialization unit 640, revise unit 650, judging unit 660 and updating block 670.
Receiving element 610 is used to receive the video in each meeting-place and the atmosphere parameter in voice data and each meeting-place; Because the atmosphere of video conference is along with certain variation may take place in the carrying out of meeting, if therefore adopt original atmosphere preset value not to be inconsistent with actual conditions always.The atmosphere parameter that receiving element 610 is received in the present embodiment just can embody the variation of atmosphere in each meeting-place, and in practical application, the transmission of this atmosphere parameter can be operated by the personnel that are responsible for shooting with video-corder in each meeting-place.
In the present embodiment, each meeting-place can be sent to multipoint control unit together with this atmosphere parameter and video and voice data, also can send this atmosphere parameter through auxilliary stream simultaneously.
Mode initialization unit 640 is used to set the environment pattern of current video meeting; This environment pattern comprises the atmosphere preset value; These environment patterns can be stored among the memory cell of this device in advance, when needs call, can select wherein a kind of the operation.Atmosphere processing unit 620 can comprise atmosphere processing subelement, is used for according to this atmosphere preset value video and the voice data that receiving element 610 is received being carried out the atmosphere of video/audio processing with outstanding current video meeting.
Revise unit 650 and be used for the above-mentioned atmosphere preset value of atmosphere parameter modification that received according to receiving element 610; Whether can comprise the information that to make amendment to the atmosphere preset value in the above-mentioned atmosphere parameter; And the information how to revise, 650 need in modification unit are operated accordingly according to these information and are got final product, certainly; Also can directly not comprise above-mentioned information in this atmosphere parameter; But after needing modification unit 650 to handle accordingly, just can obtain above-mentioned information, such as atmosphere parameter and atmosphere preset value are carried out certain ratio equity.
Judging unit 660 is used for judging whether needs renewal atmosphere preset value to carry out effect assessment through video/audio processed video and voice data.In order to guarantee to pass through the video/audio processed video of atmosphere processing unit 620 and the atmosphere that audio frequency meets current meeting-place; Treatment effect is satisfactory in other words; 660 pairs of these processed video of the judging unit of present embodiment and audio frequency have carried out effect assessment, and this effect assessment can realize through processed video and audio frequency and a preset masterplate are compared.
Updating block 670 is used for upgrading said atmosphere preset value according to the effect assessment of judging unit 660, makes atmosphere processing unit 620 processed video and audio frequency atmosphere better effects if.
The embodiment of the invention is passed through image processing techniques and the video in each meeting-place and voice data are carried out video/audio is handled the atmosphere of having given prominence to the current video meeting; Thereby make the participant can be intuitively on-the-spot atmosphere from this video and audio frequency enteroception to this meeting; The embodiment of the invention not only detects the situation in each meeting-place in real time in addition; Change the atmosphere preset value as the case may be; But also treated video and audio frequency are carried out effect assessment, thereby it is more obvious to make that the embodiment of the invention more meets the effect of actual atmosphere situation and outstanding meeting atmosphere of meeting.
One of ordinary skill in the art will appreciate that all or part of flow process that realizes in the foregoing description method; Can instruct relevant hardware to accomplish through computer program; Described program can be stored in the computer read/write memory medium; This program can comprise the flow process like the embodiment of above-mentioned each side method when carrying out.Wherein, described storage medium can be magnetic disc, CD, read-only storage memory body (Read-Only Memory, ROM) or at random store memory body (Random Access Memory, RAM) etc.
Above-described embodiment; The object of the invention, technical scheme and beneficial effect have been carried out further explain, and institute it should be understood that the above is merely embodiment of the present invention; And be not used in qualification protection scope of the present invention; All within spirit of the present invention and principle, any modification of being made, be equal to replacement, improvement etc., all should be included within protection scope of the present invention.