CN102340648A - Video communication device, image processor and method for video communication system - Google Patents
Video communication device, image processor and method for video communication system Download PDFInfo
- Publication number
- CN102340648A CN102340648A CN2011103204204A CN201110320420A CN102340648A CN 102340648 A CN102340648 A CN 102340648A CN 2011103204204 A CN2011103204204 A CN 2011103204204A CN 201110320420 A CN201110320420 A CN 201110320420A CN 102340648 A CN102340648 A CN 102340648A
- Authority
- CN
- China
- Prior art keywords
- view
- image
- user
- camera
- profile
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Image Processing (AREA)
Abstract
The invention discloses an image processor, which comprises an acquisition module, a rotating module, an interception module and a synthesis module, wherein the acquisition module acquires a left-view image and a right-view image which are shot by a left camera and a right camera respectively; the rotating module rotates the left-view and right-view images to obtain a first front view and a second front view respectively; the interception module judges and intercepts a view consisting of a half of an integral contour of a user front and a corresponding background from each front view to obtain a first half front view and a second half front view; and the synthesis module synthesizes the first and second half front views to obtain a synthesized view of the integral contour of a user and the background. The invention also provides a video communication device comprising the image processor and a corresponding image processing method. By the video communication device, the image processor and the image processing method provided by the invention, the face of the user on an image in a video communication system can be processed, so that the face of the user on the image is dead against a receiver.
Description
Technical field
The present invention relates to a kind of image processor, video communication device and the image processing method thereof that can handle video image.
Background technology
Video communication, for example the utilization of Video chat, video conference more and more widely.Video communication can provide than voice communication more information, for example, and video user's appearance, body language and surrounding environment or the like.
In chat, the chat both sides over against the other side's (when video user's head is presented on the display neither to left avertence also not to right avertence) can be better mood that demonstrates the video user and present situation.Yet; In the existing Video chat; Because the position of video camera, video communication participant are relative to the influence of factors such as the moving of camera position, deflection, side in the video communication or both sides participant can not appear over against image to video camera in all time.For example, when the relative camera of user's head slightly downwards and when being tilted to the left, be presented on recipient's display picture for user's head slightly downwards and be tilted to the left, and do not have over against the recipient.
Summary of the invention
In view of this, be necessary to provide a kind of video communication device, image processor and method that is used for video communication system,, make that the user can be over against demonstration so that the image that contains the user is handled.
This is used for the image processor of video communication system; Be used for the image that left camera and right camera absorb is respectively carried out image processing; This left side camera can comprise the left view image of half profile at least of user's overall profile from corresponding angle acquisition, and this right side camera can comprise the right view image of second half profile at least of user's overall profile from corresponding angle acquisition.This image processor comprises acquisition module, rotary module, interception module and synthesis module.This acquisition module is used to obtain left view image and the right view image that this left side camera and right camera absorb respectively; This rotary module is rotated first front view and second front view that processing obtains correspondence respectively with this left view image and right view image; Wherein, First front view is the positive view corresponding during in the face of left camera of user, and second front view be the positive view of correspondence during in the face of right camera of user.This interception module judge and intercepting first front view in the view that constitutes of positive half integrity profile of user and corresponding background and obtain the first half of front view, judge and intercepting second front view in the view that constitutes of positive second half integrity profile of user and corresponding background and obtain the second half of front view.This synthesis module synthesizes the first half of front view and the second half of front view of this intercepting, obtains the synthetic view of user front integrity profile and complete background.
A kind of video communication device comprises an image processor; This image processor is used for the image that left camera and right camera absorb is respectively carried out image processing; This left side camera can comprise the left view image of half profile at least of user's overall profile from corresponding angle acquisition; This right side camera can comprise the right view image of second half profile at least of user's overall profile from corresponding angle acquisition, and this image processor comprises acquisition module, rotary module, interception module and synthesis module.This acquisition module is used to obtain left view image and the right view image that this left side camera and right camera absorb respectively; This rotary module is rotated first front view and second front view that processing obtains correspondence respectively with this left view image and right view image; Wherein, First front view is the positive view corresponding during in the face of left camera of user, and second front view be the positive view of correspondence during in the face of right camera of user.This interception module judge and intercepting first front view in the view that constitutes of positive half integrity profile of user and corresponding background and obtain the first half of front view, judge and intercepting second front view in the view that constitutes of positive second half integrity profile of user and corresponding background and obtain the second half of front view.This synthesis module synthesizes the first half of front view and the second half of front view of this intercepting, obtains the synthetic view of user front integrity profile and complete background.
A kind of image processing method that is used for video communication system; Be used for the image that left camera and right camera absorb is respectively carried out image processing; This left side camera can comprise the left view image of half profile at least of user's overall profile from corresponding angle acquisition; This right side camera can comprise the right view image of second half profile at least of user's overall profile from corresponding angle acquisition, and this image processing method comprises the step of being carried out by image processor:
Obtain left view image and right view image that this left side camera and right camera absorb respectively;
This left view image and right view image are rotated first front view and second front view that processing obtains correspondence respectively; Wherein, First front view is the positive view corresponding during in the face of left camera of user, and second front view be the positive view of correspondence during in the face of right camera of user;
Judge and intercepting first front view in the view that constitutes of positive half integrity profile of user and corresponding background and obtain the first half of front view, judge and intercepting second front view in the view that constitutes of positive second half integrity profile of user and corresponding background and obtain the second half of front view;
The first half of front view and the second half of front view of this intercepting are synthesized, obtain the synthetic view of user front integrity profile and complete background.
Through image processor of the present invention, video communication device and image processing method, can handle the user's on the image in the video communication system face, make that user's head is in over against state on the image.
Description of drawings
Fig. 1 is the sketch map of video communication system in an embodiment of the present invention.
Fig. 2 is the module map of the video communication device in the video communication system in an embodiment of the present invention.
Fig. 3 carries out the process sketch map of image processing for video communication device in an embodiment of the present invention.
Fig. 4 is the flow chart of image processing method in an embodiment of the present invention.
The main element symbol description
| |
100 |
| |
200 |
| |
300 |
| Microphone | 10 |
| |
20 |
| |
30 |
| |
41 |
| The |
411 |
| |
42 |
| The |
421 |
| |
50 |
| |
501 |
| |
502 |
| First |
5021 |
| Second |
5022 |
| |
503 |
| |
504 |
| Complete over against |
5041 |
| |
505 |
| Step | S401-S404 |
Following embodiment will combine above-mentioned accompanying drawing to further specify the present invention.
Embodiment
See also Fig. 1, be the schematic diagram of video communication system in an embodiment of the present invention.This video communication system 200 comprises two or more video communication device 100, is used to make between two or more users to carry out audio frequency and/or video communication through network 300.This network 300 comprises wide area network, local area network (LAN) etc.
Please consult Fig. 2 and Fig. 3 in the lump, each video communication device 100 comprises microphone 10, loud speaker 20, display 30, left camera 41 and right camera 42.Should be understood that; Microphone 10, loud speaker 20, display 30 and two cameras 41,42 can all be integrated in the independent unit; In notebook computer; Also can be embodied in two or more modular units, the use that combines, this is very conspicuous for the person of ordinary skill of the art.Camera 41,42 is installed in the left side and the right side of display 30 respectively; And be arranged on the same horizontal line; So that in the user is in rational range of video the time; Left side camera 41 can comprise that the left view image 411 and the right camera 42 of user's overall profile half at least (for example half health of left side) can comprise user's overall profile right view image 421 of second half (for example half health of right side) at least from corresponding angle acquisition from corresponding angle acquisition, as shown in Figure 3.In this execution mode; The camera of these two cameras 41,42 for having the depth survey function; Be used to absorb the image that comprises the user; In the image through 41,42 picked-ups of this two cameras, each pixel be all to should there being the information of the degree of depth, thereby can easily the user in the image be separated with background according to this depth information.
This rotary module 502 can be rotated processing with this left view image 411 and right view image 421 in several ways and obtain corresponding first front view 5021 and second front view 5022 respectively.For example; The information of pixel depth is separated with user in the right view image 421 left view image 411 in the image that rotary module 502 can obtain according to acquisition module 501 with background; Be employed in the IEEE meeting about Automatic Face and Gesture Recognition 2000 (facial automatically and gesture identification 2000); At Y.Li; The sorting technique of describing in S.Gong and H.Liddell " Support Vector Regression and Classification Based Multi-View Face Detection and Recongnition (multiple view face based on support vector regression and classification detects and identification) "; The 3-D view that this left view image 411 is corresponding rotates an angle and is adjusted into the user and is positive first 3-D view during in the face of left camera 41 around the first vertical axes A; The 3-D view that this right view image 421 is corresponding rotates an angle and is adjusted into the user and is positive second 3-D view during in the face of right camera 42 around the second vertical axes B; And corresponding respectively first front view 5021 and second front view 5022 of two 3-D views of intercepting; Wherein, First front view 5021 is to have recovered half integrity profile (half the like the left side health) in user front and the view of corresponding background (like user left side half background behind of health), and second front view 5022 is to have recovered second half integrity profile (half the like the right side health) in user front and the view of corresponding background (like half background behind of user right side health).
Obtain the synthetic view 5041 of user front integrity profile and complete background thereof at synthesis module 504 after; Should be sent to the long-distance user or present to the local user by synthetic view 5041, thereby make the both sides of video communication can on display, see the image of positive surface state each other.In this execution mode, this image processor 50 is used for carrying out local image processing, has obtained reflecting that composograph 5041 backs of the positive surface state of local user are sent to long-range user through network 300.In another embodiment, this image processor 50 can be used for handling the raw video picture that sends from long-range, and the long-range user's after will handling synthetic view 5041 is presented on the local display 30.This image processor 50 can be set in the local video communication device 100, also can be arranged in Video service supplier's the webserver, is used for according to the present invention handling automatically all participants' of video communication face-image.
See also Fig. 4, a kind of image processing method that is used for video communication system is used for video pictures is handled.This image processing method comprises the step of being carried out by image processor 50:
S401: the left view image 411 and right view image 421 that obtain picked-up from left camera 41 and right camera 42 respectively;
S402: this left view image 411 and right view image 421 are rotated processing obtain corresponding first front view 5021 and second front view 5022 respectively; Wherein, First front view 5021 is the positive view corresponding during in the face of left camera 41 of user, and second front view 5022 be the positive view of correspondence during in the face of right camera 42 of user;
S403: judge and intercepting first front view 5021 in the user the front half integrity profile and view that corresponding background constitutes and obtain the first half of front view, judge and intercepting second front view 5022 in the user the front second half integrity profile and view that corresponding background constitutes and obtain the second half of front view;
S404: the first half of front view and the second half of front view of intercepting are synthesized, obtain user front integrity profile and complete background over against synthetic view 5041.
Claims (10)
1. image processor that is used for video communication system; Be used for the image that left camera and right camera absorb is respectively carried out image processing; This left side camera can comprise the left view image of half profile at least of user's overall profile from corresponding angle acquisition; This right side camera can comprise the right view image of second half profile at least of user's overall profile from corresponding angle acquisition, it is characterized in that this image processor comprises:
Acquisition module obtains left view image and right view image that this left side camera and right camera absorb respectively;
Rotary module; This left view image and right view image are rotated first front view and second front view that processing obtains correspondence respectively; Wherein, First front view is the positive view corresponding during in the face of left camera of user, and second front view be the positive view of correspondence during in the face of right camera of user;
Interception module; Judge and intercepting first front view in the view that constitutes of positive half integrity profile of user and corresponding background and obtain the first half of front view, judge and intercepting second front view in the view that constitutes of positive second half integrity profile of user and corresponding background and obtain the second half of front view;
Synthesis module synthesizes the first half of front view and the second half of front view of this intercepting, obtains the synthetic view of a user front integrity profile and complete background.
2. the image processor that is used for video communication system as claimed in claim 1; It is characterized in that; This left side camera and right camera are the camera with depth survey function; In the image of this left side camera and the picked-up of right camera; Each pixel is all to there being the information of the degree of depth; The information of pixel depth is separated with user in the right view image left view image in the image that rotary module obtains according to acquisition module with background; The 3-D view that this left view image is corresponding rotates first angle and is adjusted into the user and is positive first 3-D view during in the face of left camera around first vertical axes, and the 3-D view that this right view image is corresponding rotates second angle and is adjusted into the user and is positive second 3-D view during in the face of right camera around second vertical axes, and two 3-D views of intercepting and obtain corresponding first front view and second front view respectively.
3. the image processor that is used for video communication system as claimed in claim 1 is characterized in that, user front integrity profile that synthesis module is synthetic and complete background over against synthetic view be sent to the long-distance user or present to the local user.
4. the image processor that is used for video communication system as claimed in claim 1 is characterized in that this image processor also comprises a correcting module, and the view that is used for this after synthetic carries out the form correction, and the view after making this synthetic is fit to show.
5. video communication device; It is characterized in that; This video communication device one image processor, this image processor are used for the image that left camera and right camera absorb is respectively carried out image processing, and this left side camera can comprise the left view image of half profile at least of user's overall profile from corresponding angle acquisition; This right side camera can comprise the right view image of second half profile at least of user's overall profile from corresponding angle acquisition, and this image processor comprises:
Acquisition module obtains left view image and right view image that this left side camera and right camera absorb respectively;
Rotary module; This left view image and right view image are rotated first front view and second front view that processing obtains correspondence respectively; Wherein, First front view is the positive view corresponding during in the face of left camera of user, and second front view be the positive view of correspondence during in the face of right camera of user;
Interception module; Judge and intercepting first front view in the view that constitutes of positive half integrity profile of user and corresponding background and obtain the first half of front view, the view that positive second half integrity profile of user and corresponding background constitute in intercepting second front view and obtain the second half of front view;
Synthesis module synthesizes the first half of front view and the second half of front view of this intercepting, obtains the synthetic view of user front integrity profile and complete background.
6. video communication device as claimed in claim 5; It is characterized in that; This left side camera and right camera are the camera with depth survey function; In the image of this left side camera and the picked-up of right camera; Each pixel is all to there being the information of the degree of depth; The information of pixel depth is separated with user in the right view image left view image in the image that rotary module obtains according to acquisition module with background; The 3-D view that this left view image is corresponding rotates first angle and is adjusted into the user and is positive first 3-D view during in the face of left camera around first vertical axes, and the 3-D view that this right view image is corresponding rotates second angle and is adjusted into the user and is positive second 3-D view during in the face of right camera around second vertical axes, and two 3-D views of intercepting and obtain corresponding first front view and second front view respectively.
7. video communication device as claimed in claim 5 is characterized in that, user front integrity profile that synthesis module is synthetic and complete background over against synthetic view be sent to the long-distance user or present to the local user.
8. video communication device as claimed in claim 5 is characterized in that this image processor also comprises a correcting module, and the view that is used for this after synthetic carries out the form correction, and the view after making this synthetic is fit to show.
9. image processing method that is used for video communication system; Be used for the image that left camera and right camera absorb is respectively carried out image processing; This left side camera can comprise the left view image of half profile at least of user's overall profile from corresponding angle acquisition; This right side camera can comprise the right view image of second half profile at least of user's overall profile from corresponding angle acquisition, it is characterized in that this image processing method comprises step:
Obtain left view image and right view image that this left side camera and right camera absorb respectively;
This left view image and right view image are rotated first front view and second front view that processing obtains correspondence respectively; Wherein, This first front view is the positive view corresponding during in the face of left camera of user, and second front view be the positive view of correspondence during in the face of right camera of user;
Judge and intercepting first front view in the user the front half integrity profile and view that corresponding background constitutes and obtain the first half of front view, judge and intercepting second front view in the user the front second half integrity profile and view that corresponding background constitutes and obtain the second half of front view;
The first half of front view and the second half of front view of this intercepting are synthesized, obtain the synthetic view of user front integrity profile and complete background.
10. the image processing method that is used for video communication system as claimed in claim 9; It is characterized in that; This left side camera and right camera are the camera with depth survey function; In the image of this left side camera and the picked-up of right camera; Each pixel is all to there being the information of the degree of depth; The step that " this left view image and right view image is rotated processing obtains corresponding first front view and second front view respectively " is specially: according to the information of pixel depth in the image that obtains the left view image is separated with background with user in the right view image; The 3-D view that this left view image is corresponding rotates first angle and is adjusted into the user and is positive first 3-D view during in the face of left camera around first vertical axes; The 3-D view that this right view image is corresponding rotates second angle and is adjusted into the user and is positive second 3-D view during in the face of right camera around second vertical axes, and two 3-D views of intercepting and obtain corresponding first front view and second front view respectively.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011103204204A CN102340648A (en) | 2011-10-20 | 2011-10-20 | Video communication device, image processor and method for video communication system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011103204204A CN102340648A (en) | 2011-10-20 | 2011-10-20 | Video communication device, image processor and method for video communication system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102340648A true CN102340648A (en) | 2012-02-01 |
Family
ID=45516129
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2011103204204A Pending CN102340648A (en) | 2011-10-20 | 2011-10-20 | Video communication device, image processor and method for video communication system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102340648A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102984452A (en) * | 2012-10-29 | 2013-03-20 | 东莞宇龙通信科技有限公司 | Camera terminal and photographing self method thereof |
| CN104284130A (en) * | 2014-10-29 | 2015-01-14 | 四川智诚天逸科技有限公司 | Video communication device |
| CN104301655A (en) * | 2014-10-29 | 2015-01-21 | 四川智诚天逸科技有限公司 | Eye-tracking video communication device |
| CN104301654A (en) * | 2014-10-29 | 2015-01-21 | 四川智诚天逸科技有限公司 | Video communication system |
| CN108377355A (en) * | 2016-11-28 | 2018-08-07 | 中兴通讯股份有限公司 | A kind of video data handling procedure, device and equipment |
| CN110959286A (en) * | 2017-07-31 | 2020-04-03 | 索尼公司 | Image processing apparatus, image processing method, program, and remote communication system |
-
2011
- 2011-10-20 CN CN2011103204204A patent/CN102340648A/en active Pending
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102984452A (en) * | 2012-10-29 | 2013-03-20 | 东莞宇龙通信科技有限公司 | Camera terminal and photographing self method thereof |
| CN102984452B (en) * | 2012-10-29 | 2015-09-30 | 东莞宇龙通信科技有限公司 | The self-timer method of photograph terminal and photograph terminal |
| CN104284130A (en) * | 2014-10-29 | 2015-01-14 | 四川智诚天逸科技有限公司 | Video communication device |
| CN104301655A (en) * | 2014-10-29 | 2015-01-21 | 四川智诚天逸科技有限公司 | Eye-tracking video communication device |
| CN104301654A (en) * | 2014-10-29 | 2015-01-21 | 四川智诚天逸科技有限公司 | Video communication system |
| CN108377355A (en) * | 2016-11-28 | 2018-08-07 | 中兴通讯股份有限公司 | A kind of video data handling procedure, device and equipment |
| CN110959286A (en) * | 2017-07-31 | 2020-04-03 | 索尼公司 | Image processing apparatus, image processing method, program, and remote communication system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11962940B2 (en) | System and method for augmented reality multi-view telepresence | |
| US10984589B2 (en) | Systems and methods for reference-model-based modification of a three-dimensional (3D) mesh data model | |
| US10306254B2 (en) | Encoding free view point data in movie data container | |
| CN102340648A (en) | Video communication device, image processor and method for video communication system | |
| US11095854B2 (en) | Viewpoint-adaptive three-dimensional (3D) personas | |
| WO2018226508A1 (en) | Spatially faithful telepresence supporting varying geometries and moving users | |
| CN107005677B (en) | Method, system, device, apparatus and medium for adjusting video conference space consistency | |
| CN100446038C (en) | Method and apparatus for correcting a head pose in a video phone image | |
| CN109492506A (en) | Image processing method, device and system | |
| US9641800B2 (en) | Method and apparatus to present three-dimensional video on a two-dimensional display driven by user interaction | |
| JP2010250452A (en) | Arbitrary viewpoint image synthesizing device | |
| US9380263B2 (en) | Systems and methods for real-time view-synthesis in a multi-camera setup | |
| CN102761768A (en) | Method and device for realizing three-dimensional imaging | |
| US20130044180A1 (en) | Stereoscopic teleconferencing techniques | |
| WO2015066067A1 (en) | Automatic rectification of distortions in images | |
| CN103488039A (en) | 3D camera module and electronic equipment with 3D camera module | |
| CN103997616A (en) | Method and device for processing video conference picture, and conference terminal | |
| CN105812709A (en) | Method for realizing virtual camera by using cameras | |
| JP2010191544A (en) | Apparatus, method, and program for processing video voice | |
| EP3089104B1 (en) | Apparatus and method for insertion of photograph taker into a photograph | |
| TW201318424A (en) | Video communication device for communication system, image processor and processing method thereof | |
| US20230306698A1 (en) | System and method to enhance distant people representation | |
| EP4391522A1 (en) | Video-conference device and method | |
| CN117640874A (en) | Image processing method and device | |
| CN114882089A (en) | Image processing method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20120201 |