CN102638670A - Method, device and system for automatically photographing in videoconference system - Google Patents

Method, device and system for automatically photographing in videoconference system Download PDF

Info

Publication number
CN102638670A
CN102638670A CN2012101032496A CN201210103249A CN102638670A CN 102638670 A CN102638670 A CN 102638670A CN 2012101032496 A CN2012101032496 A CN 2012101032496A CN 201210103249 A CN201210103249 A CN 201210103249A CN 102638670 A CN102638670 A CN 102638670A
Authority
CN
China
Prior art keywords
eyes
participant
image
information
positional information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN2012101032496A
Other languages
Chinese (zh)
Inventor
濮晓鸣
吕兴
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to CN2012101032496A priority Critical patent/CN102638670A/en
Publication of CN102638670A publication Critical patent/CN102638670A/en
Pending legal-status Critical Current

Links

Images

Abstract

The invention discloses a method, a device and a system for automatically photographing in a videoconference system. According to the embodiment provided by the invention, the method comprises the following steps of: monitoring the positions of both eyes of a participant so as to obtain information on the positions of both eyes of the participant; then, matching the information on the positions of both eyes with preset standard regional information of both eyes; and photographing a current image of the participant if the information on the positions of both eyes is matched with the preset standard regional information of both eyes. Therefore, an automatic photographing function in a videoconference is realized, and the interference to the videoconference caused when operating personnel hold cameras by hands to photograph participants is avoided; and as the information on the positions of both eyes is matched with the preset standard regional information of both eyes prior to photographing, photographed images approach to expected demands.

Description

The methods, devices and systems of automatic camera in a kind of video conferencing system
Technical field
The present invention relates to communication technical field, be specifically related to the methods, devices and systems of automatic camera in a kind of video conferencing system.
Background technology
Along with development of Communication Technique, video conference application in daily life also more and more widely, it can help the user to break away from the restriction in geographical position, links up with remote subscriber easily.
In the middle of the application of video conference; Especially in the video conference of some industry; In more important or more formal video conference such as government, army, electric power, bank; Often need in video conference, take pictures to the participant, a part that is used as minutes perhaps is used to propagate.In the prior art, in video conference, the participant is taken pictures if desired, often need staff's handheld camera in the middle of meeting is carried out, to look for suitable angle, come the participant is taken pictures.
In research and practice process to prior art; Inventor of the present invention finds; By staff's handheld camera the participant is taken pictures; Not only be difficult to find the suitable position of taking pictures to photograph needed image,, and interfere with meeting easily such as the front of taking all participants in the meeting-place.
Summary of the invention
The embodiment of the invention provides the methods, devices and systems of automatic camera in a kind of video conferencing system, can in video conference, take pictures flexibly and automatically, makes under the prerequisite of not interference video meeting, photographs needed image.
The method of automatic camera in a kind of video conferencing system comprises:
Monitoring participant's eyes position is to obtain said participant's eyes positional information;
Said eyes positional information and the eyes standard area information that presets are mated;
If said eyes positional information can be mated with the eyes standard area information that presets, then take said participant's present image.
Optional; The method of automatic camera can also comprise in this video conferencing system: if said eyes positional information can not be mated with the eyes standard area information that presets; Then return the eyes position of carrying out the monitoring participant, to obtain the step of eyes positional information.
In addition, optional, in monitoring participant's eyes position,, can also survey the band of position of participant's eyes, and save as eyes standard area information to obtain before the eyes positional information.
In addition, optional, after the present image of taking said participant, also comprise: can preserve said present image; Obtain the image that need synthesize, wherein, this image that need synthesize is from the image of preserving, to select; The image that said needs are synthesized synthesizes by participant's azimuth information, obtains composograph.
Optional, in the band of position of surveying participant's eyes, and save as before the eyes standard area information, can also comprise: the prompting participant shows the attitude as standard.
Accordingly, the embodiment of the invention also provides Automatic camera in a kind of video conferencing system, comprises acquiring unit, matching unit and shooting unit, as follows:
Acquiring unit is used to monitor participant's eyes position, to obtain said participant's eyes positional information;
Matching unit is used for said eyes positional information and the eyes standard area information that presets are mated;
Take the unit, be used for when said eyes positional information can be mated with the eyes standard area information that presets, taking said participant's present image.
Optional, wherein, matching unit can also be used for when said eyes positional information can not be mated with the eyes standard area information that presets, triggering the eyes position that acquiring unit is carried out the monitoring participant, to obtain the step of eyes positional information.
Optional, Automatic camera can also comprise probe unit in this video conferencing system, as follows:
Probe unit is used to survey the band of position of participant's eyes, and saves as eyes standard area information.
Optional, Automatic camera can also comprise preservation unit and synthesis unit in this video conferencing system, as follows:
Preserve the unit, be used to preserve said present image;
Synthesis unit is used to obtain the image that need synthesize, and the image that said needs synthesize is from the image of preserving, to select; The image that said needs are synthesized synthesizes by participant's azimuth information, obtains composograph.
Optional, Automatic camera can also comprise Tip element in this video conferencing system, as follows:
Tip element is used to point out the participant to show the attitude as standard;
Then this moment, said probe unit specifically is used for after the participant shows the attitude as standard, surveys the band of position of participant's eyes, and saves as eyes standard area information.
Accordingly, the embodiment of the invention also provides a kind of video conferencing system, comprises Automatic camera in any video conferencing system that the embodiment of the invention provides.
The embodiment of the invention adopts monitoring participant's eyes position; To obtain said participant's eyes positional information, then this eyes positional information and the eyes standard area information that presets are mated, if can mate; Then take this participant's present image; Thereby be implemented in the automatic photo function in the video conference, having avoided by staff's handheld camera is participant's interference to meeting when taking, and has improved the flexibility ratio of taking pictures in video conference greatly; And; Eyes positional information and the eyes standard area information that presets were mated before owing to take pictures, so the image that shooting is come out and the demand of expection are comparatively approaching; Such as; The eyes positional information when if the eyes standard area information that presets is the participant front, then this moment, captured image is participant's front.
Description of drawings
In order to be illustrated more clearly in the embodiment of the invention or technical scheme of the prior art; To do to introduce simply to the accompanying drawing of required use in embodiment or the description of the Prior Art below; Obviously, the accompanying drawing in describing below only is some embodiments of the present invention, to those skilled in the art; Under the prerequisite of not paying creative work, can also obtain other accompanying drawing according to these accompanying drawings.
Fig. 1 is the flow chart of the method for automatic camera in the video conferencing system that provides of the embodiment of the invention;
Fig. 2 is the aerial view of a website of the applied common video conferencing system of the embodiment of the invention;
Fig. 3 a is another flow chart of the method for automatic camera in the video conferencing system that provides of inventive embodiments;
Sketch map when Fig. 3 b is eyes positional information and eyes standard area information matches;
Fig. 3 c is a treatment of picture sketch map in the embodiment of the invention;
Fig. 3 d is eyes positional information and the eyes standard area information sketch map when not matching;
The division sketch map of screen when Fig. 3 e is two participants of a screen correspondence;
Fig. 4 a is the structural representation of Automatic camera in the video conferencing system that provides of the embodiment of the invention;
Fig. 4 b is another structural representation of Automatic camera in the video conferencing system that provides of the embodiment of the invention.
Embodiment
To combine the accompanying drawing in the embodiment of the invention below, the technical scheme in the embodiment of the invention is carried out clear, intactly description, obviously, described embodiment only is the present invention's part embodiment, rather than whole embodiment.Based on the embodiment among the present invention, those skilled in the art are not making the every other embodiment that is obtained under the creative work prerequisite, all belong to the scope of the present invention's protection.
The embodiment of the invention provides Automatic camera and video conferencing system in the method, video conferencing system of automatic camera in a kind of video conferencing system.Below be elaborated respectively.
Embodiment one,
Present embodiment will the angle of Automatic camera be described from video conferencing system.Wherein, This camera arrangement can be specially the picture pick-up device that video conferencing system carries, and such as the camera that personal computer or portable terminal etc. carries, also can be the external picture pick-up device of video conferencing system; Such as setting up camera or camera etc. in outsides such as personal computer or portable terminals; Above-mentioned camera arrangement can one, also can be a plurality of, and concrete embodiments of the invention are not done qualification.
The method of automatic camera in a kind of video conferencing system; Comprise: monitoring participant's eyes position; To obtain said participant's eyes positional information; Eyes positional information that gets access to and the eyes standard area information that presets are mated,, then take this participant's present image if said eyes positional information can be mated with the eyes standard area information that presets.
As shown in Figure 1, idiographic flow can be following:
101, monitoring participant's eyes position is to obtain said participant's eyes positional information;
For example, specifically can realize as follows:
Face through camera monitoring participant obtains facial information, from facial information, extracts the eyes positional information through facial recognition techniques.
Perhaps, also can obtain the eyes positional information, for example: the pupil recognition technology directly through camera monitoring participant's eyes position.
Wherein, this monitoring specifically can be real-time monitoring, also can monitor (promptly periodically monitoring) according to the time interval of setting, or the like, to this, all embodiment of the present invention do not do qualification.
102, eyes positional information that gets access in the step 101 and the eyes standard area information that presets are mated, if can mate, then execution in step 103, if can not mate, then execution in step 104.
For example, specifically can realize as follows:
Eyes positional information and the eyes standard area information that presets are compared; If the tolerance between eyes positional information and the eyes standard area information that presets is smaller or equal to preset value; Then definite eyes positional information can be mated with the eyes standard area information that presets; Otherwise, if can not mate if the tolerance between eyes positional information and the eyes standard area information that presets, is then confirmed eyes positional information and the eyes standard area information that presets greater than preset value.Wherein, the preset value of this tolerance can be provided with according to the demand of practical application.
What need explanation is; It is the fluctuation range that reference value was allowed with the eyes standard area information that presets that the tolerance here refers to the eyes positional information; Tolerance is more little, and the span of eyes positional information is more little, and the eyes positional information is more near eyes standard area information; Otherwise tolerance is big more, and the span of eyes positional information is big more, specifically can repeat no more at this referring to prior art.
Wherein, Eyes standard area information can be provided with according to the demand of practical application, such as, photograph participant's front if desired; Eyes position in the time of then can surveying the participant front that need take pictures in advance saves as eyes standard area information with this eyes position then.That is, in monitoring participant's eyes position, before the eyes positional information of obtaining said participant, this method can also comprise:
Survey the band of position of participant's eyes, and save as eyes standard area information.
During concrete the preservation; Can all participants' eyes standard area information be kept in the identical file folder; Also can independently file be set for each participant; Wherein, a kind of preserving type in back is than the former (the eyes standard area information that is about to all participants is kept in the identical file folder) management of being more convenient for.
Optional, in order to obtain more accurately and get access to apace eyes standard area information, in the band of position of surveying participant's eyes; And save as before the eyes standard area information, can also point out the participant to show need be as the attitude of standard, such as; The prompting participant is seated; Positive in the face of camera lens, and show correct posture, or the like.
Wherein, the method for prompting specifically can be provided with according to user's demand and hobby, such as, can be that text prompt, voice suggestion and/or figure are imitated prompting, or the like.In addition, can also be set a time for this prompting, such as, can, video conferencing system start timer when opening, and after second, system obtains eyes standard area information automatically at n, or the like, wherein, n is 0 or positive number, the value of n can be provided with by the user.
103, when the eyes positional information can be mated with the eyes standard area information that presets, take this participant's present image.
For example,, show that then participant's's this moment attitude can satisfy the requirement of shooting, so the photo current of taking this participant is as present image when the tolerance between eyes positional information and the eyes standard area information that presets during smaller or equal to preset value.
Wherein, after taking said participant's present image, can also preserve this current image, so that follow-uply can offer the user and select.
In addition, after preserving this current image, can also synthesize image according to user's demand, for example, specifically can be following:
Obtain the image that need synthesize, wherein, this image that need synthesize is from the image of preserving, to select, and this image that need synthesize is synthesized by participant's azimuth information, obtains composograph.
Wherein, specifically can from the image of preserving, select, perhaps, also can from the image of preserving, select automatically by system according to presetting strategy by the user, or the like.In addition, participant's azimuth information specifically can be participant's a seat information, positional information of perhaps being stood or the like.
Optional, in order to improve user experience, synthesize by participant's azimuth information at the image that needs are synthesized; Obtain after the composograph, can also confirm further whether this composograph is required image, if be required image; Then preserve; Otherwise,, then return and carry out the step of obtaining the image that need synthesize if not required image.
104, when eyes positional information and the eyes standard area information that presets can not be mated, return execution in step 101, promptly monitor participant's eyes position, with the step of the eyes positional information of obtaining said participant.
For example, when the tolerance between eyes positional information and the eyes standard area information that presets during, show that then participant's's this moment attitude does not satisfy the requirement of taking, so return execution in step 101 greater than preset value.
By on can know that present embodiment adopts monitoring participant's eyes position, to obtain said participant's eyes positional information; Then this eyes positional information and the eyes standard area information that presets are mated; If can mate, then take this participant's present image, thereby be implemented in the automatic photo function in the video conference; Having avoided by staff's handheld camera is participant's interference to meeting when taking, and has improved the flexibility ratio of taking pictures in video conference greatly; And; Eyes positional information and the eyes standard area information that presets were mated before owing to take pictures, so the image that shooting is come out and the demand of expection are comparatively approaching; Such as; The eyes positional information when if the eyes standard area information that presets is the participant front, then this moment, captured image is participant's front.
For embodiments of the invention are more clearly explained, earlier the applied video conferencing system of the embodiment of the invention is carried out brief account.Video conferencing system generally comprises at least two websites (site), and wherein, the website at observer place becomes local terminal, and other websites that communicate with local terminal are called far-end.Wherein, a website has following equipment to constitute:
Many displays are used to the video information that shows that the far-end video capture device is gathered;
Audio output apparatus is used to export the audio-frequency information that the far-end audio collecting device is gathered;
Multimedia communication terminal; Be connected with above-mentioned many displays and above-mentioned audio output apparatus; Be used for the video information and the audio-frequency information of far-end transmission are handled; And pass through the video image that above-mentioned many displays show far-end, and handle through above-mentioned audio output apparatus output far-end audio signal and with the audio, video data information of local terminal, above-mentioned treated audio, video data information is sent to far-end;
Multiple cameras is connected with above-mentioned multimedia communication terminal, is used to take the video image of local terminal, and above-mentioned shooting is obtained video image sends to above-mentioned multimedia communication terminal and handle;
Audio collecting device is connected with above-mentioned multimedia communication terminal, is used for gathering the audio-frequency information of local terminal, and the audio-frequency information that collects is sent to above-mentioned multimedia communication terminal;
A plurality of customer locations, corresponding one by one with above-mentioned a plurality of video cameras, the visual field vertical plane of said a plurality of customer locations is the near normal relation with the optical axis of the camera of said a plurality of video cameras respectively.
Below in conjunction with Fig. 2 the formation of a website is described, wherein, the housing of the sealing among Fig. 2 is represented the meeting room that this website is positioned at, and the website of a kind of telepresence system that is provided (Telepresence) comprising:
One presents desktop 207; The said desktop 207 that appears comprises three parts in left, center, right; And these three parts adopt the mode at obtuse angle to make up between any two; And about part about the axis of mid portion symmetry, appear at this and to be placed with three displays that are used to show multimedia communication distal view picture on desktop 207: display 201, display 202 and display 203;
, this holds multimedia communication terminal 211 and audio output apparatus (comprising audio output apparatus 209 and audio output apparatus 210) in presenting the inside 208 of desktop 207; Three displays of multimedia communication terminal 211 and this (being display 201, display 202 and display 203) and said audio output apparatus (comprising audio output apparatus 209 and audio output apparatus 210) are connected; Wherein, Multimedia communication terminal 211 is used for the video of multimedia communication far-end and audio signal are handled; And show the video image of far-end through these three displays (being display 201, display 202 and display 203), through audio output apparatus (comprising audio output apparatus 209 and audio output apparatus 210) output multimedia communication far-end audio signal;
Upper side frame at the display 202 in centre of these three displays (being display 201, display 202 and display 203) is placed left, center, right totally three video cameras with the ethod of remittance: video camera 204, video camera 205 and video camera 206; Said three video cameras (being video camera 204, video camera 205 and video camera 206) are connected with multimedia communication terminal 211; Said three video cameras are used to take the image of multimedia communication local terminal respectively, and said shooting is obtained image send to multimedia communication terminal 211 and handle;
Place a conference table 212 and a plurality of meeting seat on the said opposite that presents desktop 207: meeting seat 216, meeting seat 217, meeting seat 218, meeting seat 219, meeting seat 220 and meeting seat 221; Wherein, Said conference table 212 also is divided into three parts in left, center, right; And these three parts adopt the mode at obtuse angle to make up between any two, and about part about the axis of mid portion symmetry, and three parts adopt the mode at obtuse angle to make up placement between any two;
Audio collecting device (comprising audio collecting device 213 and audio collecting device 214) is installed on said conference table 212; Wherein, This audio collecting device; Be that audio collecting device 213 is connected with multimedia communication terminal 211 respectively with audio collecting device 214, be used for gathering participant's audio-frequency information, and the audio-frequency information that collects is sent to multimedia communication terminal 211;
Control equipment 215 in the middle part of said conference table 212 is provided with, wherein, control equipment 215 is connected with said multimedia communication terminal 211 in this, is used for realizing multimedia communication is controlled.
In the concrete process that realizes; In said control equipment 215 be used for multimedia communication begin preceding and process in set up or hang up multimedia audio-video and call out; System parameters (for example: number of multimedia communication affiliation side or the like is regulated, set to the brightness regulation of display device, the volume of audio output apparatus) can be set, the light of adjustment meeting room, the up-down of control meeting room curtain etc.; Be appreciated that; In the process of multimedia communication, also have other control, generally all accomplish, repeat no more at this by middle control equipment.
The included equipment of a website that is appreciated that above-mentioned video conferencing system is just given an example as a kind of, and in fact, for traditional video conferencing system, an included display or the video camera of website not all is a plurality of also, promptly also possibly have only 1.Because the application scenarios of video conference is varied, the configuration of devices mode also maybe be varied in the website in the video conferencing system, and for one of ordinary skill in the art will appreciate that, embodiments of the invention are applicable to all video conferencing systems.
Embodiment two,
According to embodiment one described method, below will do further explain for example.
In the present embodiment, will be that example describes as the attitude of standard with participant's front.Shown in Fig. 3 a, automatic photographing method specifically can be following in this video conferencing system:
301, Automatic camera prompting participant system is about to obtain eyes standard area information in the video conferencing system, and the prompting participant is just sitting, and is positive in the face of camera lens, and shows good posture.
Wherein, the method for prompting specifically can be provided with according to user's demand and hobby, such as, can be that text prompt, voice suggestion and/or figure are imitated prompting, or the like.In addition, can also be set a time for this prompting, such as, can, video conferencing system start timer when opening, and after second, system obtains eyes standard area information automatically at n, or the like, wherein, n is 0 or positive number, the value of n can be provided with by the user.
302, Automatic camera is surveyed the band of position of participant's eyes in the video conferencing system, and saves as eyes standard area information.
Wherein, can in video conferencing system, set up smiling face's capture function and/or other some beautifying functions, thereby can capture the more good attitude of participant.
During concrete the preservation; Can all participants' eyes standard area information be kept in the identical file folder; Also can independently file be set for each participant; Wherein, a kind of preserving type in back is than the former (the eyes standard area information that is about to all participants is kept in the identical file folder) management of being more convenient for.
303, in conference process, Automatic camera is monitored participant's eyes position in the video conferencing system, obtains the eyes positional information.
For example; Specifically can monitor participant's eyes position in real time, perhaps, also can be at a certain time interval; Such as being that 5s monitors participant's eyes position with the cycle (second); Or the like, in the present embodiment, be that example describes in real time participant's eyes position is monitored.
When specifically obtaining the eyes positional information, can obtain facial information, from facial information, extract the eyes positional information through facial recognition techniques then through camera monitoring participant's face.Perhaps, also can such as the pupil recognition technology, obtain the eyes positional information directly through camera monitoring participant's eyes position.
304, Automatic camera matees the eyes standard area information of eyes positional information that gets access in the step 303 and preservation in the video conferencing system; If the eyes standard area information of eyes positional information and preservation can be mated; Then execution in step 305; If the eyes standard area information of eyes positional information and preservation can not be mated, then execution in step 306.
For example; Automatic camera can compare eyes positional information and the eyes that preset standard area information in the video conferencing system; If the tolerance between eyes positional information and the eyes standard area information that presets is smaller or equal to preset value; Then definite eyes positional information can be mated with the eyes standard area information that presets; Otherwise, if can not mate if the tolerance between eyes positional information and the eyes standard area information that presets, is then confirmed eyes positional information and the eyes standard area information that presets greater than preset value.Wherein, the preset value of this tolerance can be provided with according to the demand of practical application.
305, when the eyes standard area information of eyes positional information and step 302 preservation can be mated, Automatic camera was taken this participant's present image in the video conferencing system, and preserves this current image, shown in Fig. 3 b.
For example; When the tolerance between the eyes standard area information of eyes positional information and preservation during smaller or equal to preset value; Show that then participant's's this moment attitude can satisfy the requirement of shooting; So the photo current that Automatic camera is taken this participant in the video conferencing system is as present image, and this current image of preservation.
Wherein, conveniently select and manage, when preserving present image, an independently file can all be set for the participant at each seat for follow-up; Image with each participant all is kept in the corresponding file folder then, such as, referring to Fig. 3 c, if N participant arranged; Then set up N file: a position paper folder, No. two position paper folders ..., N position paper folder, or the like; These files are used to deposit the image under the real-time shooting, and wherein, N is a positive integer.
After this, can continue participant's eyes position is monitored, promptly continue execution in step 303;
306, when the eyes standard area information of eyes positional information and step 302 preservation can not be mated; Such as referring to shown in Fig. 3 d; Then Automatic camera returns execution in step 303 in the video conferencing system; Promptly monitor participant's eyes position, with the step of the eyes positional information of obtaining said participant.
For example, when the tolerance between the eyes standard area information of eyes positional information and preservation during, show that then participant's's this moment attitude does not satisfy the requirement of taking, so return execution in step 303 greater than preset value.
307, after video conference finished, video conferencing system can access the image of preservation, such as accessing the file that each has deposited participant's image; For you to choose, when specifically selecting, can select by the user; Also can select automatically by system according to presetting strategy; In the present embodiment, all describe, referring to Fig. 3 c to be picked as example by the user.
308, whether video conferencing system inquiry user need synthesize the image of selecting; If need not synthesize, then flow process finishes, and is synthetic if desired; Then video conferencing system receives the image select (image of selecting such as the user); These images of selecting (image of selecting such as the user) are synthesized by participant's azimuth information respectively, obtain composograph, promptly obtain a complete image.Wherein, participant's azimuth information specifically can be participant's a seat information, positional information of perhaps being stood or the like.
Wherein, can be through image processing software being set in multipoint control unit (MCU, Multipoint Control Unit) lining.Perhaps with computer that MCU links to each other in image processing software be set come these images are synthesized; In addition; Can also with MCU in other image processing software is set; Or with computer that MCU links to each other in image processing software be set come these images are carried out beautifying of other or special effect processing, repeat no more at this.
Optional, in order to improve user experience, synthesize by participant's azimuth information at the image that needs are synthesized; Obtain after the composograph, can also confirm further whether this composograph is required image, if be required image; Then preserve, otherwise, if not required image; Then return and carry out the step of obtaining the image that need synthesize, promptly return execution in step 307.Such as, participant user is dissatisfied to certain photo, and then he can pick out another image again from a position paper folder, and then synthesizes, i.e. execution in step 308 again.
What need were explained is in the application of reality, possibly understand corresponding plural participant by a display screen; For this situation, video conferencing system can be divided the position according to participant's position on display screen when taking pictures, each participant is taken; Such as, if corresponding two participant of display screen, two zone about then video conferencing system can be divided into display screen by participant's position; Take separately respectively, referring to Fig. 3 e, participant's attitude conformance with standard on the right; So take, and participant's attitude on the left side does not meet standard, so do not take.
By on can know that the video conferencing system of present embodiment can be provided with eyes standard area information earlier when starting; In the process of video conference, monitoring participant's eyes position is to obtain said participant's eyes positional information then; Then this eyes positional information and eyes standard area information are mated; If can mate, then take this participant's present image, thereby be implemented in the automatic photo function in the video conference; Having avoided by staff's handheld camera is participant's interference to meeting when taking, and has improved the flexibility ratio of taking pictures in video conference greatly; And, owing to eyes positional information and the eyes standard area information that presets are mated before taking pictures, so the image that shooting is come out and the demand of expection are comparatively approaching; Further; This video conferencing system can also offer the user with the image of taking in the meeting process and select, and then select image is handled, such as beautifying, synthesizing or the like; Can further improve the quality of image, improve user experience.
Embodiment three,
In order to implement above method better; The embodiment of the invention also correspondingly provides Automatic camera in a kind of video conferencing system; Shown in Fig. 4 a, Automatic camera comprises acquiring unit 301, matching unit 402 and takes unit 403 in this video conferencing system.
Acquiring unit 401 is used to monitor participant's eyes position, to obtain said participant's eyes positional information;
For example, acquiring unit 401 specifically can obtain facial information through camera monitoring participant's face, from facial information, extracts the eyes positional information through facial recognition techniques then; Perhaps, also can obtain the eyes positional information directly through camera monitoring participant's eyes position; Such as, can utilize the pupil recognition technology to obtain the eyes positional information directly through camera monitoring participant's eyes position, or the like.
Wherein, this monitoring specifically can be real-time monitoring, also can monitor according to the time interval of setting, or the like, to this, all embodiment of the present invention do not do qualification.
Matching unit 402 is used for the eyes positional information that acquiring unit 401 is got access to and matees with the eyes standard area information that presets;
For example; Matching unit 402 specifically can compare eyes positional information and the eyes that preset standard area information; If the tolerance between eyes positional information and the eyes standard area information that presets is smaller or equal to preset value; Then definite eyes positional information can be mated with the eyes standard area information that presets; Otherwise, if can not mate if the tolerance between eyes positional information and the eyes standard area information that presets, is then confirmed eyes positional information and the eyes standard area information that presets greater than preset value.Wherein, the preset value of this tolerance can be provided with according to the demand of practical application.
Take unit 403, be used for when matching unit 402 confirms that eyes positional information that gets access to and the eyes standard area information that presets can be mated, taking this participant's present image.
In addition; Matching unit 402; When also being used for the eyes positional information that gets access at acquiring unit 401 and the eyes standard area information that presets and mating, trigger the eyes position that acquiring unit 401 is carried out the monitoring participants, with the step of the eyes positional information of obtaining said participant.
Wherein, Eyes standard area information can be provided with according to the demand of practical application, such as, photograph participant's front if desired; Eyes position in the time of then can surveying the participant front that need take pictures in advance saves as eyes standard area information with this eyes position then.Promptly shown in Fig. 4 b, Automatic camera can also comprise probe unit 404 in this video conferencing system;
Probe unit 404 is used to survey the band of position of participant's eyes, and saves as eyes standard area information.
During concrete the preservation; Can all participants' eyes standard area information be kept in the identical file folder; Also can independently file be set for each participant; Wherein, a kind of preserving type in back (be each participant independently file is set) is than the former (the eyes standard area information that is about to all participants is kept in the identical file folder) management of being more convenient for.
Optional, in order to obtain more accurately and get access to apace eyes standard area information, in the band of position of surveying participant's eyes; And save as before the eyes standard area information, can also point out the participant to show need be as the attitude of standard, such as; The prompting participant is seated; Positive in the face of camera lens, and show good posture, or the like.That is, shown in Fig. 4 b, Automatic camera can also comprise Tip element 405 in this video conferencing system;
Tip element 405, being used to point out the participant to show need be as the attitude of standard;
Then probe unit 404, be used for the participant show need attitude as standard after, survey the band of position of participant's eyes, and save as eyes standard area information.
Wherein, the method for prompting specifically can be provided with according to user's demand and hobby, such as, can be that text prompt, voice suggestion and/or figure are imitated prompting, or the like.In addition, can also be set a time for this prompting, such as, can, video conferencing system start timer when opening, and after second, system obtains eyes standard area information automatically at n, or the like, wherein, n is 0 or positive number, the value of n can be provided with by the user.
In addition, after taking this participant's present image, can also preserve this current image, so that follow-uply can offer the user and select.That is, shown in Fig. 4 b, Automatic camera can also comprise preservation unit 406 in this video conferencing system;
Preserve unit 406, be used to preserve the present image of this shooting.
In addition, after preserving this current image, can also comprise according to user's demand image is synthesized that promptly, shown in Fig. 4 b, Automatic camera can also comprise synthesis unit 407 in this video conferencing system;
Synthesis unit 407 is used to obtain the image that need synthesize, and the image that said needs synthesize is from the image of preserving, to select; The image that said needs are synthesized synthesizes by participant's azimuth information, obtains composograph.
Wherein, specifically can from the image of preserving, select, perhaps, also can from the image of preserving, select automatically by system according to presetting strategy by the user, or the like.Wherein, participant's azimuth information specifically can be participant's a seat information, positional information of perhaps being stood or the like.
Optional, in order to improve user experience, the image that needs synthesize is synthesized by participant's azimuth information at synthesis unit 407; Obtain after the composograph, can also confirm further whether this composograph is required image, if be required image; Then preserve; Otherwise,, then select image again if not required image.That is, shown in Fig. 4 b, Automatic camera can also comprise judging unit 408 in this video conferencing system;
Judging unit 408 is used for confirming whether synthesis unit 407 composographs are required image;
Preserve unit 406, also be used for when judging unit 408 confirms that this composograph is required image, preserving this composograph;
Synthesis unit 407 also is used for when judging unit 408 confirms that this composograph is not required image, obtaining the image that need synthesize.
Wherein, Automatic camera can be integrated in certain equipment of video conferencing system in this video conferencing system, also can be an independent entity; For example; Specifically can be the picture pick-up device that video conferencing system carries, first-class such as the shooting that personal computer or portable terminal etc. carries, perhaps; Concrete also can be the external picture pick-up device of video conferencing system, such as setting up camera, video camera or camera etc. in outsides such as personal computer or portable terminals.
More than wherein a kind of mode that the division of each unit is only just implemented, should be understood that, also comprise other dividing mode; During practical implementation; More than each unit can be used as independent entity and realize, also can carry out combination in any, realize as same or plurality of entity; More than the practical implementation of each unit can repeat no more at this referring to the method embodiment of front.
By on can know; The acquiring unit 401 of Automatic camera can be monitored participant's eyes position in the video conferencing system of present embodiment; To obtain said participant's eyes positional information, by matching unit 402 this eyes positional information and the eyes standard area information that presets are mated then, if can mate; Then take this participant's present image by taking unit 403; Thereby be implemented in the automatic photo function in the video conference, having avoided by staff's handheld camera is participant's interference to meeting when taking, and has improved the flexibility ratio of taking pictures in video conference greatly; And; Eyes positional information and the eyes standard area information that presets were mated before owing to take pictures, so the image that shooting is come out and the demand of expection are comparatively approaching; Such as; The eyes positional information when if the eyes standard area information that presets is the participant front, then this moment, captured image is participant's front.
Further; This video conferencing system can also offer the user with the image of taking in the meeting process and select, and then select image is handled, such as beautifying, synthesizing or the like; Can further improve the quality of image, improve user experience.
Embodiment four,
Accordingly, the embodiment of the invention also provides a kind of video conferencing system, comprises Automatic camera in any video conferencing system that the embodiment of the invention provides; Wherein, The practical implementation of Automatic camera can be referring to embodiment three in this video conferencing system, such as, specifically can be following:
Automatic camera in the video conferencing system; Be used to monitor participant's eyes position; To obtain said participant's eyes positional information; Eyes positional information that gets access to and the eyes standard area information that presets are mated,, then take this participant's present image if this eyes positional information that gets access to can be mated with the eyes standard area information that presets.
For example, specifically can confirm whether eyes positional information and the eyes standard area information that presets mate, that is: through the tolerance between the eyes standard area information of judging the eyes positional information and presetting smaller or equal to preset value
Automatic camera in the video conferencing system; Specifically can be used for eyes positional information and the eyes standard area information that presets are compared; If the tolerance between eyes positional information and the eyes standard area information that presets is smaller or equal to preset value; Then definite eyes positional information can be mated with the eyes standard area information that presets; Otherwise, if can not mate if the tolerance between eyes positional information and the eyes standard area information that presets, is then confirmed eyes positional information and the eyes standard area information that presets greater than preset value.
Wherein, the preset value of this tolerance can be provided with according to the demand of practical application.
Optional, Automatic camera in the video conferencing system specifically can be used for the face through camera monitoring participant, obtains facial information, from facial information, extracts the eyes positional information through facial recognition techniques.Perhaps,
Automatic camera in the video conferencing system; The concrete eyes position that also can be used for directly monitoring the participant through camera; Obtain the eyes positional information, for example: directly, utilize the pupil recognition technology to obtain the eyes positional information through camera monitoring participant's eyes position.
Wherein, this monitoring specifically can be real-time monitoring, also can monitor (promptly periodically monitoring) according to the time interval of setting, or the like, to this, all embodiment of the present invention do not do qualification.
In addition; Optional, Automatic camera in the video conferencing system can also be used for when said eyes positional information can not be mated with the eyes standard area information that presets; Return the eyes position of carrying out the monitoring participant, with the step of the eyes positional information of obtaining said participant.
Wherein, Eyes standard area information can be provided with according to the demand of practical application, such as, photograph participant's front if desired; Eyes position in the time of then can surveying the participant front that need take pictures in advance saves as eyes standard area information with this eyes position then.That is:
Automatic camera in the video conferencing system also is used to survey the band of position of participant's eyes, and saves as eyes standard area information.
During concrete the preservation, can all participants' eyes standard area information be kept in the identical file folder, also can independently file be set for each participant.
Optional, in order to obtain more accurately and get access to apace eyes standard area information,, and save as before the eyes standard area information in the band of position of surveying participant's eyes, can also point out the participant to show need be as the attitude of standard, that is:
Automatic camera in the video conferencing system, also being used to point out the participant to show need be as the attitude of standard.Such as, the prompting participant is seated, and is positive in the face of camera lens, and shows good posture, or the like.
Wherein, the method for prompting specifically can be provided with according to user's demand and hobby, such as, can be that text prompt, voice suggestion and/or figure are imitated prompting, or the like.In addition, can also be set a time for this prompting, such as, can, video conferencing system start timer when opening, and after second, system obtains eyes standard area information automatically at n, or the like, wherein, n is 0 or positive number, the value of n can be provided with by the user.
In addition, after taking said participant's present image, can also preserve this current image,, then, can also further synthesize image, that is: according to user's demand so that follow-uply can offer the user and select
Automatic camera in the video conferencing system also is used for preserving this current image, obtains the image that need synthesize, and wherein, the image that need synthesize is from the image of preserving, to select; These images that need synthesize are synthesized by participant's azimuth information, obtain composograph.
Further, Automatic camera in the video conferencing system is used for also confirming whether this composograph is required image, if be required image, then preserve, otherwise, if not required image, then return and carry out the step of obtaining the image that need synthesize.
Wherein, Automatic camera can be integrated in certain equipment of video conferencing system in this video conferencing system, also can be an independent entity; For example; Specifically can be the picture pick-up device that video conferencing system carries, first-class such as the shooting that personal computer or portable terminal etc. carries, perhaps; Concrete also can be the external picture pick-up device of video conferencing system, such as setting up camera, video camera or camera etc. in outsides such as personal computer or portable terminals.
The practical implementation of this video conferencing system can be repeated no more at this referring to the embodiment of front.
By on can know; By on can know that the video conferencing system of present embodiment can be monitored participant's eyes position, to obtain said participant's eyes positional information; Then this eyes positional information and the eyes standard area information that presets are mated; If can mate, then take this participant's present image, thereby be implemented in the automatic photo function in the video conference; Having avoided by staff's handheld camera is participant's interference to meeting when taking, and has improved the flexibility ratio of taking pictures in video conference greatly; And; Eyes positional information and the eyes standard area information that presets were mated before owing to take pictures, so the image that shooting is come out and the demand of expection are comparatively approaching; Such as; The eyes positional information when if the eyes standard area information that presets is the participant front, then this moment, captured image is participant's front.
Further; This video conferencing system can also offer the user with the image of taking in the meeting process and select, and then select image is handled, such as beautifying, synthesizing or the like; Can further improve the quality of image, improve user experience.
One of ordinary skill in the art will appreciate that all or part of step in the whole bag of tricks of the foregoing description is to instruct relevant hardware to accomplish through program; This program can be stored in the computer-readable recording medium; Storage medium can comprise: read-only memory (ROM; Read Only Memory), random access memory (RAM, Random Access Memory), disk or CD etc.
More than the methods, devices and systems of automatic camera in a kind of video conferencing system that the embodiment of the invention provided have been carried out detailed introduction; Used concrete example among this paper principle of the present invention and execution mode are set forth, the explanation of above embodiment just is used for helping to understand method of the present invention and core concept thereof; Simultaneously, for those skilled in the art, according to thought of the present invention, the part that on embodiment and range of application, all can change, in sum, this description should not be construed as limitation of the present invention.

Claims (11)

1. the method for automatic camera in the video conferencing system is characterized in that, comprising:
Monitoring participant's eyes position is to obtain said participant's eyes positional information;
Said eyes positional information and the eyes standard area information that presets are mated;
If said eyes positional information can be mated with the eyes standard area information that presets, then take said participant's present image.
2. method according to claim 1 is characterized in that, said monitoring participant's eyes position before the eyes positional information of obtaining said participant, also comprises:
Survey the band of position of participant's eyes, and save as eyes standard area information.
3. method according to claim 1 and 2 is characterized in that, this method also comprises:
If said eyes positional information can not be mated with the eyes standard area information that presets, then return the eyes position of carrying out the monitoring participant, with the step of the eyes positional information of obtaining said participant.
4. method according to claim 1 and 2 is characterized in that, after the said participant's of said shooting the present image, also comprises:
Preserve said present image;
Obtain the image that need synthesize, the image that said needs synthesize is from the image of preserving, to select;
The image that said needs are synthesized synthesizes by participant's azimuth information, obtains composograph.
5. method according to claim 1 and 2 is characterized in that, the band of position of said detection participant eyes, and save as before the eyes standard area information, also comprise:
The prompting participant shows the attitude as standard.
6. Automatic camera in the video conferencing system is characterized in that, comprising:
Acquiring unit is used to monitor participant's eyes position, to obtain said participant's eyes positional information;
Matching unit is used for said eyes positional information and the eyes standard area information that presets are mated;
Take the unit, be used for when said eyes positional information can be mated with the eyes standard area information that presets, taking said participant's present image.
7. Automatic camera in the video conferencing system according to claim 6 is characterized in that, also comprises probe unit;
Probe unit is used to survey the band of position of participant's eyes, and saves as eyes standard area information.
8. according to Automatic camera in claim 6 or the 7 described video conferencing systems, it is characterized in that,
Said matching unit also is used for when said eyes positional information and the eyes standard area information that presets can not be mated, triggering the eyes position that acquiring unit is carried out the monitoring participant, with the step of the eyes positional information of obtaining said participant.
9. according to Automatic camera in claim 6 or the 7 described video conferencing systems, it is characterized in that, also comprise and preserve unit and synthesis unit;
Preserve the unit, be used to preserve said present image;
Synthesis unit is used to obtain the image that need synthesize, and the image that said needs synthesize is from the image of preserving, to select; The image that said needs are synthesized synthesizes by participant's azimuth information, obtains composograph.
10. according to Automatic camera in claim 6 or the 7 described video conferencing systems, it is characterized in that, also comprise Tip element;
Tip element is used to point out the participant to show the attitude as standard;
Said probe unit is used for after the participant shows the attitude as standard, surveys the band of position of participant's eyes, and saves as eyes standard area information.
11. a video conferencing system is characterized in that, comprises Automatic camera in described any video conferencing system of claim 6 to 10.
CN2012101032496A 2012-04-10 2012-04-10 Method, device and system for automatically photographing in videoconference system Pending CN102638670A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2012101032496A CN102638670A (en) 2012-04-10 2012-04-10 Method, device and system for automatically photographing in videoconference system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2012101032496A CN102638670A (en) 2012-04-10 2012-04-10 Method, device and system for automatically photographing in videoconference system

Publications (1)

Publication Number Publication Date
CN102638670A true CN102638670A (en) 2012-08-15

Family

ID=46622894

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2012101032496A Pending CN102638670A (en) 2012-04-10 2012-04-10 Method, device and system for automatically photographing in videoconference system

Country Status (1)

Country Link
CN (1) CN102638670A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105979140A (en) * 2016-06-03 2016-09-28 北京奇虎科技有限公司 Image generation device and image generation method
CN108200340A (en) * 2018-01-12 2018-06-22 深圳奥比中光科技有限公司 The camera arrangement and photographic method of eye sight line can be detected

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1388452A (en) * 2001-05-29 2003-01-01 英保达股份有限公司 Digital camera with automatic detection and shoot function and its method
JP2003052038A (en) * 2001-08-08 2003-02-21 Konica Corp Camera, and method of forming image
CN101010942A (en) * 2004-07-02 2007-08-01 索尼爱立信移动通讯股份有限公司 Capturing a sequence of images
CN101216883A (en) * 2007-12-29 2008-07-09 北京中星微电子有限公司 A photography method and device
KR20090011581A (en) * 2007-07-26 2009-02-02 삼성전자주식회사 Apparatus and method for eyeball recognition photographing of the camera in a portable terminal
CN101369307A (en) * 2007-08-14 2009-02-18 索尼株式会社 Iamge forming device, method and computer program
CN101453569A (en) * 2007-09-10 2009-06-10 卡西欧计算机株式会社 Image pickup apparatus, image pickup method and computer-readable recording medium recorded with program thereof

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1388452A (en) * 2001-05-29 2003-01-01 英保达股份有限公司 Digital camera with automatic detection and shoot function and its method
JP2003052038A (en) * 2001-08-08 2003-02-21 Konica Corp Camera, and method of forming image
CN101010942A (en) * 2004-07-02 2007-08-01 索尼爱立信移动通讯股份有限公司 Capturing a sequence of images
KR20090011581A (en) * 2007-07-26 2009-02-02 삼성전자주식회사 Apparatus and method for eyeball recognition photographing of the camera in a portable terminal
CN101369307A (en) * 2007-08-14 2009-02-18 索尼株式会社 Iamge forming device, method and computer program
CN101453569A (en) * 2007-09-10 2009-06-10 卡西欧计算机株式会社 Image pickup apparatus, image pickup method and computer-readable recording medium recorded with program thereof
CN101216883A (en) * 2007-12-29 2008-07-09 北京中星微电子有限公司 A photography method and device

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105979140A (en) * 2016-06-03 2016-09-28 北京奇虎科技有限公司 Image generation device and image generation method
CN108200340A (en) * 2018-01-12 2018-06-22 深圳奥比中光科技有限公司 The camera arrangement and photographic method of eye sight line can be detected

Similar Documents

Publication Publication Date Title
US11688034B2 (en) Virtual lens simulation for video and photo cropping
US9449413B2 (en) Image compositing via multi-spectral detection
US9342752B1 (en) Adjusting an image for video conference display
CN107613243A (en) A kind of panoramic video recording arrangement and method for recording based on tone tracking
US8749607B2 (en) Face equalization in video conferencing
CN102868859B (en) Multiple terminal networking realizes method, system and the terminal that media are taken
US20080024594A1 (en) Panoramic image-based virtual reality/telepresence audio-visual system and method
CN103595953A (en) Method and device for controlling video shooting
WO2019184650A1 (en) Subtitle generation method and terminal
CN107277427A (en) Automatically select method, device and the audio-visual system of camera picture
WO2017166360A1 (en) Video calling method and device
CN104135641B (en) The tool and intelligence of a kind of mobile terminal integrate the server of audio and video
CN104715246A (en) Photographing assisting system, device and method with a posture adjusting function,
WO2018214746A1 (en) Video conference realization method, device and system, and computer storage medium
CN105554372A (en) Photographing method and device
CN115103166A (en) Video processing method and terminal equipment
CN106454138A (en) Panoramic zoom camera
CN105760408A (en) Picture sharing method and apparatus and terminal device
CN109769087A (en) Image pickup method, device and the mobile terminal remotely taken a group photo
CN104284234A (en) Method and system for sharing synchronous images among plurality of terminals
CN105827934B (en) The image processing method and electronic equipment of a kind of electronic equipment
CN105389318B (en) A kind of information processing method and electronic equipment
CN102638670A (en) Method, device and system for automatically photographing in videoconference system
CN106791681A (en) Video monitoring and face identification method, apparatus and system
CN108718402A (en) video conference management method and device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C12 Rejection of a patent application after its publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20120815