Summary of the invention
In view of this, be necessary to provide the control method of the video image in a kind of video conference, by strengthening local user, contact to improve the quality that exchanges between local user and long-distance user with direct sight line between long-distance user, to address the above problem.
For achieving the above object, video image control method in video conference provided by the present invention, this video conferencing system comprises at least one local video conference terminal and a Remote Video Conference terminal, described video conference terminal includes video image acquisition device, image display and Video Conference Controlling System, and the method comprises the following steps:
The image of receiving remote video conference;
Whether judgement has facial image in received Remote Video Conference image;
While having facial image in described Remote Video Conference image, determine the user who needs to carry out direct sight line contact in described Remote Video Conference terminal;
Identify the eye image that described need carry out direct sight line contact user;
Receiving user is mapped in the input operation of the position on described image display and determines that described image collecting device is mapped in the position on described image display about described video image acquisition device;
Determine that there is the target location of direct sight line contact position that described image collecting device is mapped in described image display;
The image that described need is carried out to direct sight line contact user is shown in this target location.
In addition, the present invention also provides a kind of video conferencing system.This video conferencing system, comprises at least one local video conference terminal, a Remote Video Conference terminal and connects the network of two video video conference terminals, described video conference terminal comprises: for gathering the video image acquisition device of video conference image; For showing the image display of the video conference image of described Remote Video Conference terminal; And with described video image acquisition device and the Video Conference Controlling System being connected with described image display; This Video Conference Controlling System comprises: an image sending and receiving unit, the Remote Video Conference image of sending out for the Video Conference Controlling System of receiving remote video conference terminal and transmission local video conference image are to the Video Conference Controlling System in Remote Video Conference terminal, one control unit, for judging at received long-distance video image whether have facial image, when judging while having facial image in described long-distance video image, determine the eye image that needs to carry out the user of direct sight line contact and identify this user in described Remote Video Conference terminal; One Position input unit, is mapped in the input operation of the position on described image display and produces an input signal for responding user's described image collecting device; One position receiving element, for receive the input signal of described Position input unit and determine described image collecting device be mapped in described image display display screen position in the plane; One determining unit, for determining that described image collecting device is mapped in the target location that there is direct sight line communicative effect position on described image display; One microprocessor, for needing described Remote Video Conference terminal the image that carries out sight line contact user to be shown in above-mentioned target location.
With respect to prior art, above-mentioned video conferencing system and video image control method thereof, by judgement, in long-distance video image, whether there is user's facial image, when judging facial image, just determine the image that needs to carry out the user of direct sight line contact and identify this eyes of user in teleconference, obtaining afterwards the position of image collecting device this position of reading images harvester has direct sight line to contact the target location of effect, the image that finally long-range need is carried out to the user of sight line contact is placed into the target location that this has direct sight line contact effect, so that can carry out the direct of sight line between local user and long-distance user, contact, to improve the quality of both sides' talk.
Embodiment
The present invention causes the problem without directly sight line contacts for improving the vision deviation existing between local user and long-distance user in video conference, by judgement, in long-distance video image, can there is user's facial image, when having facial image, determine the image that needs to carry out the user of sight line contact and identify this eyes of user in teleconference, obtaining afterwards the position of image collecting device this position of reading images harvester has direct sight line to contact the target location of effect, finally long-range need are carried out to the user images of sight line contact and adjust to the target location that this has direct sight line contact effect, so that can carry out the direct of sight line between local user and long-distance user, contact, to improve the quality of video conference.
Refer to Fig. 2, the schematic diagram of the screen conference system that it is an embodiment of the present invention.This video conferencing system comprises local video conference terminal 100, this locality attend a meeting user at least 1 people, Remote Video Conference terminal 200, the long-range user of attending a meeting at least 1 people and connect the network communication module 300 of two video conference terminals.In the present embodiment, this network communication module can be GSM (global system for mobile communications) network, GPRS (GPRS) network, UMTS (Universal Mobile Telecommunications System) network, or WIFI (WLAN (wireless local area network)) network.
For simplified characterization, local video conference terminal 100 and Remote Video Conference terminal 200 are considered to identical and only local video conference terminal 100 are described in detail.Local video conference terminal 100 comprises a video image acquisition device 10, an image display 20 and a Video Conference Controlling System 30.Video image acquisition device 10 is connected with Video Conference Controlling System 30, for gathering the image of video conference rooms, especially participates in the image of Users of Video Conference System.Wherein, image collecting device 10 can be camera or video camera, and this image collecting device 10 is positioned at the surrounding of image display display screen one side.Image display 20 is connected with Video Conference Controlling System 30, for the received long-distance video image of display video conference control system 30.Wherein, this image display 20 can be the display screen of computer or notebook, the display screen in the display screen of television set or complicated video projection system.
Refer to Fig. 3, Video Conference Controlling System 30 comprises an image sending and receiving unit 31, a control unit 32, a microprocessor 36.
Image sending and receiving unit 31, the Remote Video Conference image sending for receiving remote Video Conference Controlling System and send local video conference image to the Video Conference Controlling System of long-range Remote Video Conference terminal.
Control unit 32 comprises a face recognition module 321, a mouth type identification module 322, sight line contact determination module 323 and an eyes identification module 324.
Face recognition module 321, for judging the facial image that whether has of long-distance video image that image sending and receiving unit 31 is received, when recognizing facial image in long-distance video image, face recognition module 321 is also identified the facial image quantity in long-distance video image.In the present embodiment, when the facial image quantity recognizing when face recognition module 321 is 1, illustrate that the user that this Remote Video Conference terminal 200 is participated in these video conferences is 1 people in long-distance video image; When the facial image quantity recognizing when face recognition module 321 is greater than 1, illustrate that the user that these video conferences are participated in these Remote Video Conference terminal 200 judgements is many people in long-distance video image.
Mouth type identification module 322, while being many people for the user who participates in this video conference in Remote Video Conference terminal 200, the user of the vicissitudinous Remote Video Conference terminal 200 of mouth type in identification long-distance video image.In present embodiment, when the user of participation video conference is many people, by user's mouth type, change to judge a certain user in a plurality of users of Remote Video Conference terminal 200 user for now talking or talking, this user just exchanges with local user.Give tacit consent to this Remote Video Conference terminal 200 of synchronization only has a people speaking simultaneously.
Sight line contact determination module 323, for determining that Remote Video Conference needs to carry out with local user the user that direct sight line contacts.In the present embodiment, when the facial image quantity recognizing in long-distance video image when face recognition module 321 is 1, this user that sight line contact determination module 323 is just determined Remote Video Conference terminal 200 is for carrying out the user that direct sight line contacts with the user of local video conference terminal 100; When the facial image quantity recognizing in long-distance video image when face recognition module 321 surpasses 1, sight line contact determination module 323 just determine mouth type identification module 322 identify the vicissitudinous Remote Video Conference terminal 200 of mouth type this user for carrying out the user that direct sight line contacts with the user of local video conference terminal 100.
Eye recognition module 324, the eye image that need carry out direct sight line contact user for identify this at long-distance video image.
This Video Conference Controlling System 30 also comprises 33, position, a Position input unit receiving element 37, a memory cell 34 and a determining unit 35.
It should be noted that in the present invention, the position of mentioning in following specification all refers to the coordinate position that falls into the coordinate system of being set up as benchmark with the plane at the display screen place of image display 20 and the dimensioned area of this display screen of take, wherein, this coordinate system is the initial point of one of take in four drift angles of this display screen as coordinate system, take and crossed the transverse axis that the straight line at the place, a wherein limit in two adjacent limits of this drift angle is this coordinate system, the longitudinal axis that the straight line at another place, limit in two limits of take is this coordinate system.
When video image acquisition device 10 is mounted on image display 20, user's trigger position input unit 33, Position input unit 33 response users' input operation also produces the input signal that an image collecting device 10 maps to a certain position on image display 20.
Position receiving element 37, be connected with Position input unit 33, for receive the input signal of described Position input unit 33 and determine described image collecting device 10 map to described image display 20 display screen position in the plane, image collecting device 10 be mapped in image display 20 display screen position coordinates in the plane.In the present embodiment, this Position input unit is a slidingtype input bar.In other embodiments, this Position input unit is a rotary knob.
Memory cell 34, store image collecting device be mapped in image display display screen diverse location place in the plane have the list of locations at long-distance user's image place of direct sight line contact effect, be long-distance user's image display screen of being placed on local image display position coordinates in the plane so that local user has the effect of direct sight line contact when watching this long-distance user's image, hereinafter to be referred as this position coordinates, be target location.
Determining unit 35, for determining that display screen institute that image collecting device is mapped in image display position in the plane has direct sight line to contact the target location of effect.In execution mode, determining unit 35 be reading images harvester is positioned at image display from memory cell 34 display screen the target location of position in the plane.
The image that microprocessor 36 carries out sight line contact user by the need of this Remote Video Conference terminal 200 is shown in this target location, especially this user's eye image is shown in to this target location.Further, microprocessor 36 is when whether this user's image can partly exceed the indication range of this display screen when judging that this user's eye image shows with above-mentioned target location, when when judging this user's eye image and be shown in above-mentioned target location, this user's image exceeds the indication range of this display screen by part, microprocessor 36 is also done excision and is processed and the image of this user after excision is shown in to this target location exceeding the part image of display screen in this user images.
Refer to Fig. 4, below in conjunction with video conferencing system of the present invention, video image control method of the present invention is further described in detail.
Step S401, image sending and receiving unit 31 receiving remote video images.
Step S402, face recognition module 321 identifies whether there is facial image in received long-distance video image, if so, enters step S403, and if not, flow process finishes.
Step S403, whether the quantity of the facial image in face recognition module 321 these long-distance video images of identification surpasses 1, if so, enters step S404, if not, enters step S405.
Step S404, mouth type identification module 322 is identified the vicissitudinous user of mouth type in long-distance video image.It should be noted that in the present embodiment, acquiescence synchronization Remote Video Conference terminal 200 only has a people speaking.
Step S405, sight line contact determination module 323 is determined the user who needs to carry out sight line contact in long-distance video image.In the present embodiment, when identifying facial image number be 1 in step S403, the user of this user that sight line contact determination module 323 is confirmed Remote Video Conference terminals 200 for carrying out direct sight line contact; When identifying facial image number surpass 1 in step S403, sight line contact determination module 323 is determined this user that mouth type identification modules 322 recognize the vicissitudinous Remote Video Conference terminal 200 of mouth type user for carrying out direct sight line contact.
Step S406, eye recognition module 324 is identified this eye image that need to carry out direct sight line contact user in long-distance video image.
Step S407, fixed video image collecting device 10, Position input unit 33 response users' described image collecting device 10 is mapped in the input operation of the position on described image display 20 and produces an input signal, the input signal that receiving element 37 receiving position input units 33 in position produce and determine image collecting device 10 be mapped in image display 20 display screen position in the plane.
Step S408, determining unit 35 determines that the position that image collecting device 10 is mapped on image display 20 has direct sight line to contact the target location of effect.
Step S409, the image that microprocessor 36 carries out sight line contact user by the need of Remote Video Conference terminal 200 is shown in above-mentioned target location.
In the present embodiment, the eye image that microprocessor 36 carries out sight line contact user by the need of Remote Video Conference terminal 200 is shown in above-mentioned target location.
Present embodiment also comprises step, judgement adjusts to by this user's eye image the indication range whether topography that this target is shown in this user can exceed this display screen, when judging this user's image and can exceed the indication range of described display screen, microprocessor 36 is also done excision processing to exceeding the part image of display screen in this user images, and processor is shown in the image of being this user after excision on above-mentioned target location.
Those skilled in the art will be appreciated that; above execution mode is only for the present invention is described; and be not used as limitation of the invention; as long as within connotation scope of the present invention, within the appropriate change that above execution mode is done and variation all drop on the scope of protection of present invention.