CN105812709A - Method for realizing virtual camera by using cameras - Google Patents
Method for realizing virtual camera by using cameras Download PDFInfo
- Publication number
- CN105812709A CN105812709A CN201610161702.7A CN201610161702A CN105812709A CN 105812709 A CN105812709 A CN 105812709A CN 201610161702 A CN201610161702 A CN 201610161702A CN 105812709 A CN105812709 A CN 105812709A
- Authority
- CN
- China
- Prior art keywords
- user
- photographic head
- eyes
- processing unit
- display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
- H04N7/142—Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
Abstract
The invention discloses a method for realizing a virtual camera by using cameras. The method comprises that S1, multiple cameras obtain face image sets of a user from multiple different positions, wherein the face image sets comprise multiple face images of the face of the user at one position or multiple different positions; S2, a processing unit analyses and processes the multiple face images; and S3, the processing unit generates virtual images as the photographing results of a virtual camera according to the analyzing and processing results and the eye focused positions of the user. According to the method, when the user carries out a video call, even through the eyes of the user focus on the eyes of a dialogue partner in a dialog box and do not focus on the cameras, the images reflected to the dialogue partner show that the eyes of the user focus on the eyes of the dialogue partner because that the virtual camera is virtualized at the positions of the eyes of the dialogue partner on the display; therefore, the video call has eye contact function; the quality of the video call is greatly improved; and the user experience is good.
Description
Technical field
The present invention relates to intelligent call field, particularly to a kind of method utilizing photographic head to realize Softcam.
Background technology
At present when user is when using the smart machines such as computer to carry out video calling with dialogue side, photographic head and bitcom with the use of, but owing to video conversation the window's position (namely region of the computer monitor at image place, dialogue side) and camera position exist certain distance, so when user watch attentively in the display dialogue side converse time, the image being reacted to dialogue side is but that the face of user is not towards the dialogue side in display, the eyes of user are watched attentively at other place also without watching dialogue side attentively, such video calling lacks Eye contact, the great image quality of video calling, Consumer's Experience is not good.
Summary of the invention
It is an object of the invention to provide a kind of method utilizing photographic head to realize Softcam so that user's Softcam when carrying out video calling can make user and dialogue side carry out Eye contact.
To achieve these goals, the invention provides a kind of method utilizing photographic head to realize Softcam, comprise the steps:
S1, multiple described photographic head obtain the facial image set of user from multiple diverse locations, and described facial image set includes multiple facial images when user's face is in a position or multiple diverse location；
S2, multiple described facial images are analyzed processing by processing unit；
S3: the described processing unit position according to analysis processing result and the eye gaze of user, generates the virtual image shooting results as described Softcam.
As preferably, described photographic head is arranged on the display of intelligent communication equipment or near display.
As preferably, described photographic head is arranged on the position at the edge of described display.
As preferably, when described method includes two described photographic head, two described photographic head are separately mounted to up and down or on the symmetrical position of left and right edges of described display；When described method includes three described photographic head, three described photographic head distributions triangular in shape are also arranged on the edge of described display；When described method includes four described photographic head, two described photographic head are separately mounted on the symmetrical position of lower edges of described display, and photographic head described in another two is separately mounted on the symmetrical position of the left and right edges of described display.
As preferably, step S2 specifically includes: be analyzed processing by described processing unit, and described processing unit utilizes described photographic head that described facial image is reduced to 3-dimensional image.
As preferably, the described facial image of multiple different angles is superimposed by described processing unit, so that described facial image is reduced to 3-dimensional image.
As preferably, step S2 also includes step S21: obtain the position of the relatively described display of eyes of user after described facial image being analyzed and processed by described processing unit；S22: described processing unit obtains the eyes of described dialogue side position in described display.
As preferably, step S3 is the direction of gaze that the above-mentioned information obtained by described processing unit judges the eyes of user further, and when the eye gaze of user the eyes of described dialogue side, described processing unit further by virtual for the position of the described Softcam eyes in described dialogue side on the position of described display.
As preferably, obtaining described facial image set by three-dimensional camera.
As preferably, described intelligent communication equipment is the computer including notebook computer.
The beneficial effects of the present invention is: realize after Softcam when user is when carrying out video calling, although the eye gaze of user in dialog box the eyes of the side of dialogue without watching the photographic head that video calling uses attentively, but the eye gaze that the image being reacted to dialogue side is user the eyes of dialogue side, this is owing to Softcam is by the virtual eye position place place of the side of dialogue in display, such video calling has the function of Eye contact, greatly improving the quality of video calling, Consumer's Experience is effective.
Accompanying drawing explanation
The photographic head that utilizes that Fig. 1 is the embodiment of the present invention realizes the flow chart of method of Softcam；
Fig. 2 is the front view of the installation photographic head over the display of the embodiment of the present invention；
Fig. 3 is the position relationship schematic diagram with the eyes of user of display when making in aforementioned manners of the embodiment of the present invention.
Description of reference numerals
1-display 2-photographic head 3-dialog box 4-dialogue side
The eyes 6-Softcam of 5-user
Detailed description of the invention
For making those skilled in the art be more fully understood that the present invention, with reference to the accompanying drawings embodiments of the invention are described in detail, but not as a limitation of the invention.
A kind of method utilizing photographic head to realize Softcam of the embodiment of the present invention, it is possible to use when video calling, as it is shown in figure 1, the method comprises the steps:
S1, it is arranged on the multiple photographic head 2 on display 1 and obtains the facial image set of user from multiple diverse locations, facial image set includes user's face and is in multiple facial images during a certain position relative to photographic head 2, it is exactly specifically that user when being in certain position will be shot by multiple photographic head 2 simultaneously, after user shifts one's position, user can be shot by multiple photographic head 2 simultaneously again, and then obtains multiple facial image.
S2, uses independent processing unit or the processing unit that is integrated on photographic head 2 to be analyzed multiple facial images processing, and this analyzing and processing process includes by application program, the facial image of human body being identified.
S3, the processing unit position according to analysis processing result and the eye gaze of user, generate the virtual image shooting results as Softcam.This process is specially image data (in fact this image data is that the image of multiple photographic head 2 shooting is through reprocessing the image about the user obtained) storage shot by Softcam 6 to the intelligent communication equipment connecting display 1 in one embodiment of the invention, intelligent communication equipment sets up video calling by the dialogue side 4 (generally in strange land) of network with user, and the image (particularly the image of user's face) shot by Softcam 6 is sent to dialogue side 4；Certain the method can also use at place of the dialogue side of user 4 so that same image sends to user.
Photographic head 2 may be mounted at and combines together with display 1 on the display 1 of intelligent communication equipment, and advantage is that whole structure is comparatively succinctly attractive in appearance；Photographic head 2 can also be arranged on and depart from display 1 near display 1, and advantage is that shooting angle can arbitrarily adjust.
For ease of being analyzed the facial image that photographic head 2 shoots processing virtual image captured by Softcam 6, and more accurate image is sent to user, photographic head 2 is arranged on the position at the edge of display 1 in one embodiment of the invention.Furtherly, when the display 1 in described method is provided with two photographic head 2, as in figure 2 it is shown, two photographic head 2 be separately mounted to display 1 up and down or the symmetrical position of left and right edges (is on same level line or vertical line) relatively；When being provided with three photographic head 2 on the display 1 in described method, three photographic head 2 distributions triangular in shape are also arranged on the edge (not shown) of display 1；When described method includes four described photographic head 2, two described photographic head 2 are separately mounted on the symmetrical position of the lower edges of described display 1 (being relatively on same vertical line), photographic head 2 described in another two is separately mounted on the symmetrical position of the left and right edges of described display 1 (to be relatively on same level line), it should be noted that the multiple photographic head 2 more easily virtual image being on same level line or vertical line, particularly user's face is when same position is constant, the image captured by different photographic head 2 being on same level line or vertical line is prone to be employed to generate 3-dimensional image after program analyzes and processes.
For 3-dimensional image furthermore, it is understood that be utilize photographic head 2 to shoot and pass through to be provided with after the processing unit of application program is analyzed processing the facial image of user is reduced to 3-dimensional image.The facial image of multiple different angles is superimposed and is analyzed processing by processing unit specifically, so that the facial image of user is reduced to 3-dimensional image.User when being in certain position is shot by certain multiple photographic head 2 simultaneously, after user shifts one's position, user can be shot by multiple photographic head 2 simultaneously again, and then the multiple facial images obtained, the numerous materials so obtained can contribute to the generation of 3-dimensional image more, is more easy to the requirement reaching user to virtual image.
It should be noted that, in one embodiment of the invention, user is when carrying out video calling with other users, as shown in Figure 3, in order to make the eyes 5 of user 4 appear to the eyes watching dialogue side 4 attentively in dialogue side, video calling is made to have the effect of Eye contact, step S2 also includes step S21: by processing unit the position running eyes 5 opposite faces obtaining user after face image analysing computer is processed by corresponding application software, such that it is able to the eyes 5 of analysis user are relative to the position of dialog box 3 in display 1, lay the foundation for the Softcam 6 position in display 1, location.Step S22: pass through application software, the position of processing unit acquisition dialog box 3 and then the eyes of acquisition dialogue side 4 position in display 1, make processing unit by the position of the eyes of substantially virtual for Softcam 6 dialogue side in the display 4, and then realize the eyes 5 of user and 4 appear to the eyes watching oneself attentively in dialogue side.
In order to realize above-mentioned beneficial effect and make effect be enhanced, in conjunction with Fig. 3, step S3 can be the direction of gaze that the above-mentioned information obtained by processing unit judges the eyes 5 of user further, and when the eyes 5 of user watch the eyes of dialogue side 4 attentively (the eye gaze direction of eyes 5 direction of gaze of user and the dialogue side 4 engaged in the dialogue with user is on the same line), processing unit further by substantially virtual for the position of Softcam 6 eyes in dialogue side 4 on the position of described display 1, so that the eyes that image is user 5 that the Softcam 6 that dialogue side 4 is seen shoots watch oneself attentively, which substantially increases Eye contact function during dialogue.It is to be noted, if dialogue side 4 does not show during video calling in dialog box 3 (such as dialogue side 4 is not in face of its video call device used), at this moment the position of Softcam 6 is by the virtual center to dialog box 3, since so, even if dialogue side 4 is in the video call device used apart from it place farther out, if the eyes of user 5 watch dialog box 3 attentively (even if image of the not side of dialogue 4 in dialog box 3), the eyes 5 seeing user that dialogue side 4 also is able to be similar to from afar are look at oneself.Choosing of this external photographic head 2, selects three-dimensional camera to obtain facial image set and then the above-mentioned beneficial effect of more high-quality acquisition.It should be noted that intelligent communication equipment is smart mobile phone or the computer including notebook computer, so that using the user of smart mobile phone or computer can make in aforementioned manners in a large number.
Above example is only the exemplary embodiment of the present invention, is not used in the restriction present invention, and protection scope of the present invention is defined by the claims.The present invention in the essence of the present invention and protection domain, can be made various amendment or equivalent replacement by those skilled in the art, and this amendment or equivalent replacement also should be regarded as being within the scope of the present invention.
Claims (10)
1. one kind utilizes the method that photographic head realizes Softcam, it is characterised in that described method comprises the steps:
S1, multiple described photographic head obtain the facial image set of user from multiple diverse locations, and described facial image set includes multiple facial images when user's face is in a position or multiple diverse location；
S2, multiple described facial images are analyzed processing by processing unit；
S3: the described processing unit position according to analysis processing result and the eye gaze of user, generates the virtual image shooting results as described Softcam.
2. method according to claim 1, it is characterised in that described photographic head is arranged on the display of intelligent communication equipment or near display.
3. method according to claim 2, it is characterised in that described photographic head is arranged on the position at the edge of described display.
4. method according to claim 3, it is characterised in that when described method includes two described photographic head, two described photographic head are separately mounted to up and down or on the symmetrical position of left and right edges of described display；When described method includes three described photographic head, three described photographic head distributions triangular in shape are also arranged on the edge of described display；When described method includes four described photographic head, two described photographic head are separately mounted on the symmetrical position of lower edges of described display, and photographic head described in another two is separately mounted on the symmetrical position of the left and right edges of described display.
5. method according to claim 1, it is characterised in that step S2 specifically includes: be analyzed processing by described processing unit, and described processing unit utilizes described photographic head that described facial image is reduced to 3-dimensional image.
6. method according to claim 5, it is characterised in that the described facial image of multiple different angles is superimposed by described processing unit, to be reduced to 3-dimensional image by described facial image.
7. method according to claim 2, it is characterised in that step S2 also includes step S21: obtain the position of the relatively described display of eyes of user after described facial image being analyzed and processed by described processing unit；S22: described processing unit obtains the eyes of described dialogue side position in described display.
8. method according to claim 2, it is characterized in that, step S3 is the direction of gaze that the above-mentioned information obtained by described processing unit judges the eyes of user further, and when the eye gaze of user the eyes of described dialogue side, described processing unit further by virtual for the position of the described Softcam eyes in described dialogue side on the position of described display.
9. method according to any one of claim 1 to 8, it is characterised in that obtain described facial image set by three-dimensional camera.
10. method according to claim 2, it is characterised in that described intelligent communication equipment is the computer including notebook computer.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610161702.7A CN105812709A (en) | 2016-03-18 | 2016-03-18 | Method for realizing virtual camera by using cameras |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610161702.7A CN105812709A (en) | 2016-03-18 | 2016-03-18 | Method for realizing virtual camera by using cameras |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105812709A true CN105812709A (en) | 2016-07-27 |
Family
ID=56453498
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610161702.7A Pending CN105812709A (en) | 2016-03-18 | 2016-03-18 | Method for realizing virtual camera by using cameras |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105812709A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110009714A (en) * | 2019-03-05 | 2019-07-12 | 重庆爱奇艺智能科技有限公司 | The method and device of virtual role expression in the eyes is adjusted in smart machine |
| CN110324553A (en) * | 2018-03-28 | 2019-10-11 | 北京富纳特创新科技有限公司 | Outdoor scene window system based on video communication |
| WO2020097891A1 (en) * | 2018-11-15 | 2020-05-22 | 李庆远 | Video chat device and method |
| CN111432155A (en) * | 2020-03-30 | 2020-07-17 | 维沃移动通信有限公司 | Video call method, electronic device and computer-readable storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101930543A (en) * | 2010-08-27 | 2010-12-29 | 南京大学 | Method for adjusting eye image in self-photographed video |
| CN101986346A (en) * | 2010-11-01 | 2011-03-16 | 华为终端有限公司 | Face image processing method and device |
| KR101303203B1 (en) * | 2012-03-14 | 2013-09-10 | 주식회사 펀진 | Videotelephony apparatus and method for making full face image |
| CN104243892A (en) * | 2013-06-08 | 2014-12-24 | 安凯(广州)微电子技术有限公司 | Visible doorbell device with multiple cameras |
| CN105049778A (en) * | 2015-08-25 | 2015-11-11 | 中国联合网络通信集团有限公司 | Method and device for realizing video communication |
-
2016
- 2016-03-18 CN CN201610161702.7A patent/CN105812709A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101930543A (en) * | 2010-08-27 | 2010-12-29 | 南京大学 | Method for adjusting eye image in self-photographed video |
| CN101986346A (en) * | 2010-11-01 | 2011-03-16 | 华为终端有限公司 | Face image processing method and device |
| KR101303203B1 (en) * | 2012-03-14 | 2013-09-10 | 주식회사 펀진 | Videotelephony apparatus and method for making full face image |
| CN104243892A (en) * | 2013-06-08 | 2014-12-24 | 安凯(广州)微电子技术有限公司 | Visible doorbell device with multiple cameras |
| CN105049778A (en) * | 2015-08-25 | 2015-11-11 | 中国联合网络通信集团有限公司 | Method and device for realizing video communication |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110324553A (en) * | 2018-03-28 | 2019-10-11 | 北京富纳特创新科技有限公司 | Outdoor scene window system based on video communication |
| WO2020097891A1 (en) * | 2018-11-15 | 2020-05-22 | 李庆远 | Video chat device and method |
| CN110009714A (en) * | 2019-03-05 | 2019-07-12 | 重庆爱奇艺智能科技有限公司 | The method and device of virtual role expression in the eyes is adjusted in smart machine |
| CN111432155A (en) * | 2020-03-30 | 2020-07-17 | 维沃移动通信有限公司 | Video call method, electronic device and computer-readable storage medium |
| CN111432155B (en) * | 2020-03-30 | 2021-06-04 | 维沃移动通信有限公司 | Video call method, electronic device and computer-readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20210075963A1 (en) | Method and apparatus for obtaining binocular panoramic image, and storage medium | |
| US10943359B2 (en) | Single depth tracked accommodation-vergence solutions | |
| US8619148B1 (en) | Image correction after combining images from multiple cameras | |
| US10284817B2 (en) | Device for and method of corneal imaging | |
| US9142010B2 (en) | Image enhancement based on combining images from multiple cameras | |
| CN114223195A (en) | System and method for video communication using virtual camera | |
| US9626564B2 (en) | System for enabling eye contact in electronic images | |
| CN109952759A (en) | Improved method and system for the video conference with HMD | |
| US20170345165A1 (en) | Correcting Short Term Three-Dimensional Tracking Results | |
| US11388388B2 (en) | System and method for processing three dimensional images | |
| CN105787884A (en) | Image processing method and electronic device | |
| KR20150090183A (en) | System and method for generating 3-d plenoptic video images | |
| CN105812709A (en) | Method for realizing virtual camera by using cameras | |
| CN103475886B (en) | Stereoscopic depth image establishing system and method thereof | |
| US10885651B2 (en) | Information processing method, wearable electronic device, and processing apparatus and system | |
| CN106020480B (en) | A kind of virtual reality device and virtual reality image processing method | |
| CN102761768A (en) | Method and device for realizing three-dimensional imaging | |
| CN109982036A (en) | A kind of method, terminal and the storage medium of panoramic video data processing | |
| US20160093028A1 (en) | Image processing method, image processing apparatus and electronic device | |
| US20150244984A1 (en) | Information processing method and device | |
| US20130044180A1 (en) | Stereoscopic teleconferencing techniques | |
| WO2014008320A1 (en) | Systems and methods for capture and display of flex-focus panoramas | |
| KR101540113B1 (en) | Method, apparatus for gernerating image data fot realistic-image and computer-readable recording medium for executing the method | |
| JP6157077B2 (en) | Display device with camera | |
| WO2013112295A1 (en) | Image enhancement based on combining images from multiple cameras |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20160727 |
|
| RJ01 | Rejection of invention patent application after publication |