CN107491165A - A kind of vr eyewear faces 3d images, plane picture capture and gesture capture systems - Google Patents
A kind of vr eyewear faces 3d images, plane picture capture and gesture capture systems Download PDFInfo
- Publication number
- CN107491165A CN107491165A CN201710440211.0A CN201710440211A CN107491165A CN 107491165 A CN107491165 A CN 107491165A CN 201710440211 A CN201710440211 A CN 201710440211A CN 107491165 A CN107491165 A CN 107491165A
- Authority
- CN
- China
- Prior art keywords
- camera
- image
- glasses
- face
- images
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 239000011521 glass Substances 0.000 claims abstract description 241
- 230000001815 facial effect Effects 0.000 claims abstract description 180
- 210000001508 eye Anatomy 0.000 claims description 458
- 210000003128 head Anatomy 0.000 claims description 156
- 230000000007 visual effect Effects 0.000 claims description 87
- 210000004709 eyebrow Anatomy 0.000 claims description 73
- 210000005252 bulbus oculi Anatomy 0.000 claims description 71
- 230000003068 static effect Effects 0.000 claims description 38
- 210000001747 pupil Anatomy 0.000 claims description 33
- 210000004209 hair Anatomy 0.000 claims description 30
- 230000015572 biosynthetic process Effects 0.000 claims description 29
- 238000003786 synthesis reaction Methods 0.000 claims description 29
- 239000013589 supplement Substances 0.000 claims description 28
- 210000001061 forehead Anatomy 0.000 claims description 27
- 238000009877 rendering Methods 0.000 claims description 27
- 210000000887 face Anatomy 0.000 claims description 26
- 230000002441 reversible effect Effects 0.000 claims description 17
- 210000004874 lower jaw Anatomy 0.000 claims description 13
- 230000002194 synthesizing effect Effects 0.000 claims description 13
- 230000002093 peripheral effect Effects 0.000 claims description 11
- 238000010586 diagram Methods 0.000 claims description 10
- 230000001360 synchronised effect Effects 0.000 claims description 10
- 238000006073 displacement reaction Methods 0.000 claims description 9
- 210000000744 eyelid Anatomy 0.000 claims description 9
- 238000003384 imaging method Methods 0.000 claims description 9
- 230000009977 dual effect Effects 0.000 claims description 6
- 230000004438 eyesight Effects 0.000 claims description 6
- 239000007787 solid Substances 0.000 claims description 4
- 238000012876 topography Methods 0.000 claims description 4
- 235000013399 edible fruits Nutrition 0.000 claims description 3
- 230000003993 interaction Effects 0.000 description 3
- 230000000153 supplemental effect Effects 0.000 description 2
- 230000002452 interceptive effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/16—Constructional details or arrangements
- G06F1/1613—Constructional details or arrangements for portable computers
- G06F1/163—Wearable computers, e.g. on a belt
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/01—Indexing scheme relating to G06F3/01
- G06F2203/012—Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- Cameras Adapted For Combination With Other Photographic Or Optical Apparatuses (AREA)
Abstract
Camera group, vr glasses, it is characterised in that：A Front facial image is first provided, array camera group captures whole face-image, and vr glasses are close to facial zone due to covering and being close to face（18）Picture can not be obtained, and thus corresponding position is supplemented in the mug shot of preceding offer；Vr glasses are close to facial zone（18）Facial contact part color be green or blueness the two select one.
Description
Technical field
The present invention relates to a kind of virtual reality device system, relates in particular to a kind of by vr glasses completion remote visible
Change the system of interaction.
Background technology
The selling fast of the vr virtual reality devices problem that has thus been born steps into how two people with vr equipment pass through image
Implement it is interactive, mutually pass, problem is that vr equipment generally sets face to cause to block face and be difficult to catch people by outside camera
Facial general image and how simultaneously complete interaction interaction.
Goal of the invention is that vr equipment generally sets face to cause to block facial be difficult to by outside camera seizure people's
Facial general image, the present invention specifically addresses this problem.
A kind of vr eyewear faces 3d images, plane picture capture and gesture capture systems, including：Camera group, vr glasses,
It is characterized in that：First provide a Front facial image, array camera group captures whole face-image, and vr glasses are due to covering and tight
Veneer portion, is close to facial zone（18）Picture can not be obtained, and thus corresponding position is supplemented in the mug shot of preceding offer；
Vr glasses are close to facial zone（18）Facial contact part color be green or blueness the two select one；
Vr glasses are obtained by camera array group and are bonded facial external margin line（17）, internal edge line（16）, two lines are true
Fixed region therebetween（18）Profile, include lower jaw, eyes, pupil, face characteristic point according to the corresponding points of picture figure and figure
The corresponding relation in position of two images is determined, wherein the former is the face-image of camera array group capture, and the latter is to provide
Front facial image image；The former region of two lines determination therebetween is cut from latter image（18）Middle correspondence is schemed in the latter
The local area image of picture, and added in the former image, will because the region keeps static in facial general expression
This region static faces image is combined with other position dynamic videos according to position correspondence relation, is combined into one as dynamic is completed
Video face；
Camera a（1）, camera b（10）It is arranged at the interior zone of the vr glasses of corresponding left eye position, camera a（1）, take the photograph
As head b（10）Positioned at lenses a（6）Upper and lower both sides are set, and infrared camera is set towards eyeball pupil position, infrared to take the photograph
As head b（3）It is arranged at left eye and corresponds to lenses（6）Edge；
Camera a1（2）, camera b2（9）It is arranged at the vr glasses interior zones of corresponding left eye position, camera a1（2）, take the photograph
As head b1（9）Positioned at lenses c（7）Upper and lower both sides are set, and infrared camera is set towards eyeball pupil position, infrared to take the photograph
As head b1（8）It is arranged at right eye and corresponds to lenses c（7）Edge；
Frame on the downside of vr glasses（11）Adjacent edge（5）Place sets camera c（4）Camera d（12）, camera c（4）, shooting
Head d（12）It is symmetrical arranged along center position between left and right, capture images direction direction face；
Frame on the upside of vr glasses（15）Adjacent edge（14）Place sets camera f（23）, upside frame（15）Edge（14）Above
Camera f is set at along symmetrical point（23）, its capture images direction direction face；
Above equipment is arranged on facial positions according to camera and corresponded to, and its capture images of split, is spliced into full facial, completes
The capture of full facial image, it is specifically：
Camera a（1）, camera b（10）The eyes nasal bridge region image inside vr glasses is captured,
Camera a1（2）, camera b2（9）The eyes nasal bridge region image inside vr glasses is captured,
Infrared camera b（3）Infrared camera b1（8）It is responsible for,
Camera c（4）, camera d（12）The following station diagram picture of facial zone vr glasses of vr glasses state servants is worn in capture,
Camera f（23）Forehead image is captured,
Camera c（4）, camera d（12）The following station diagram picture of facial zone vr glasses of vr glasses state servants is worn in capture,
And by camera c（4）, camera d（12）Capture wears the facial zone vr glasses of vr glasses state servants with lower portion
Image, the facial zone image at this capped position of the correspondence cut out, the internal edge line of vr glasses fitting face（16）With
It is interior by camera a（1）, camera b（10）Capture the eyes nasal bridge region image inside vr glasses, camera a1（2）, shooting
Head b2（9）The eyes nasal bridge region image inside vr glasses is captured, in split camera f（23）Capture forehead image and will more than
Full facial image, then computer generation ear, hair and neck correspondence and face are synthesized after partial dynamic image split one
Portion's image is spliced, final to synthesize entire header picture, head portrait be combined with computer synthesis image section include hair, ear,
Entire header picture of the neck synthesis with complete head member, 3 shaft angle degree of the head anglec of rotation can be measured i.e. by setting on glasses
Change in location captures sensor；
It is final to be shown to vr glasses left eye, on right eye screen or on display, it can be connected by network remote and be sent to a distant place
Vr glasses left eye, the screen of right eye；
Camera f（23）Towards face, because forehead position changes very small can almost ignore not in normal expression hypograph
Meter, therefore select camera f（23）The tableaux at shooting forehead position replaces dynamic menu, by camera f（23）The static state of bat
Brow portion picture is synthesized in left eye face-image, is now adjusted camera f（23）In front of face orientation, camera f
（23）180 degree can be rotated, visual angle is shot backwards to face, towards front in reverse direction, camera f（23）Front can be captured
Images of gestures is simultaneously identified to gesture and obtains the manipulation instruction based on gesture change, while towards the camera c of face shots（4）
Camera d（12）, camera c（4）Camera d（12）One group of 3d image pickup head is collectively formed, and oral area shape can be obtained
Real-time change and lower jaw upper jaw position real time kinematics modified-image, using the image of shooting judging and identify oral area
The corresponding text information sent, and text information can be changed into the instruction of control operation；It will can be imaged in addition to this scheme
Head c（4）Camera d（12）Synchronous rotary 180 degree, visual angle is facial backwards in reverse direction, is shot towards front, camera c（4）Take the photograph
As head d（12）Front images of gestures can be captured and gesture be identified acquisition base by collectively forming one group of 3d image pickups head
In the manipulation instruction of gesture change；
Alternative plan
A kind of vr eyewear faces 3d images, plane picture capture and gesture capture systems, including：Camera group, vr glasses, it is special
Sign is：A Front facial image is first provided, array camera group captures whole face-image, and vr glasses are due to covering and being close to face
Portion, it is close to facial zone（18）Picture can not be obtained, and thus corresponding position is supplemented in the mug shot of preceding offer；
Vr glasses are close to facial zone（18）The color of part is that both green or blueness select one；
Obtained by camera array group and be bonded facial external margin line（17）, internal edge line（16）, both two lines determinations
Between region（18）Profile, determined according to the corresponding points of picture figure and figure including the characteristic point such as lower jaw, eyes, pupil, face
The corresponding relation in position of two images, it is therein the former be camera array group capture face-image the latter be to provide just
Face head portrait image, cuts the region between the former two lines from latter image（18）In corresponding local face-image, supplement
Into the former image, because the region keeps static in facial general expression, by image in this region still image and video
With reference to being combined into one turns into completion dynamic video face；
Camera a（1）, camera b（10）It is arranged at the vr glasses interior zones of corresponding left eye position, camera a（1）, shooting
Head b（10）Positioned at lenses a（6）Upper and lower both sides are set, and infrared camera is set towards eyeball pupil position, infrared photography
Head b（3）It is arranged at left eye and corresponds to lenses（6）Edge；
Camera a1（2）, camera b2（9）It is arranged at the vr glasses interior zones of corresponding left eye position, camera a1（2）, take the photograph
As head b1（9）Positioned at lenses c（7）Upper and lower both sides are set, and infrared camera is set towards eyeball pupil position, infrared to take the photograph
As head b1（8）It is arranged at right eye and corresponds to lenses c（7）Edge；
Frame on the downside of vr glasses（11）Edge（5）Upper setting camera n（19）, camera n（19）, along center between left and right
Point position is set, capture images direction direction face；
Frame on the upside of vr glasses（15）Edge（14）Upper setting camera f（23）, upside frame（15）Edge（14）Above along a left side
Camera f is set at right symmetric points（23）, its capture images direction direction face；
Camera a（1）, camera b（10）Infrared camera b（3）Collectively form 3d camera groups, infrared camera b（3）Pass through
The 3d profiles at position are shot at infrared light reflection capture again by 3d profiles and camera a（1）, camera b（10）It is synthetically generated 3d
Eyes and the bridge of the nose, vr glasses in eyebrow uncovered area position 3d visual images,
Camera a1（2）, camera b2（9）, infrared camera b1（8）Collectively form 3d camera groups, infrared camera b（3）
By shooting the 3d profiles at position at infrared light reflection capture again by 3d profiles and camera a（1）, camera b（10）Synthesis life
Eyebrow uncovered area position 3d visual images in eyes and the bridge of the nose, vr glasses into 3d,
It is bonded facial external margin line（17）, internal edge line（16）, the region of two lines determination therebetween（18）Profile
The still image of supplement,
Camera n（19）The following station diagram picture of facial zone vr glasses for wearing vr glasses state servants of shooting,
Camera f（23）Shooting capture forehead image,
By images above according to the split of face correspondence position generate complete face-image, then computer generation ear, hair with
Final to synthesize entire header picture and neck is corresponded to and spliced with face-image, head portrait is combined with the image section of computer synthesis
Including hair, ear, entire header picture of the neck synthesis with complete head member, the head anglec of rotation can be measured by being set on glasses
3 axle angular transducers and change in location the capture sensor of degree；When being intended to obtain posture face 3d images in front of non-face, root
The local 3d face-images of generation are handled by calculating according to the face-image of split camera capture, including：Two cheeks, forehead, nose
These move less region to son during speaking, by the nose and two cheeks, forehead of 3d angle changings, with the head captured
It is corresponding with lips face, eyes afterwards that portion's rotation corresponding angle synthesizes facial topography corresponding to corresponding visual angle in real time
The dynamic realtime 3d images for handling to obtain by computer calculating combine；When the face-image of front posture is faced on head to be obtained
When, the 3d that image is not carried out to image is calculated, but according to the position correspondence split of setting, its capture is schemed by above camera
Picture, full facial is spliced into, completes the capture of full facial image, it is corresponding to generate ear, hair and neck in computer
Spliced with face-image, final to synthesize entire header picture, the image section that head portrait is combined with computer synthesis includes hair, ear
Piece, entire header picture of the neck synthesis with complete head member and be finally shown to vr glasses left eye, on right eye screen, Ke Yitong
Cross left eye, the screen of right eye that network remote connection is sent to the vr glasses in a distant place；
Camera f（23）Towards face, because forehead position changes very small can almost ignore not in normal expression hypograph
Meter, therefore select camera f（23）The tableaux at captured forehead position replaces dynamic menu, by camera f（23）That claps is quiet
State brow portion picture is synthesized in left eye face-image, is now adjusted camera f（23）In front of facial face orientation, take the photograph
As head f（23）Can be with synchronous rotary 180 degree, visual angle is facial backwards in reverse direction, is shot towards front, camera m（23）Can be with
Capture front images of gestures and gesture is identified and obtain the manipulation instruction based on gesture change, while towards face shots
Camera n（19）The real-time change of oral area shape and the real time kinematics modified-image at lower jaw upper jaw position can be obtained, is utilized
Text information can be changed into the finger of control operation by shooting image to judge and identify text information that oral area is correspondingly sent
Order；Can be by camera n in addition to this scheme（19）180 degree can be rotated, visual angle is clapped backwards to face, towards front in reverse direction
Take the photograph, camera n（19）Front images of gestures can be captured and gesture is identified manipulation of the acquisition based on gesture change and referred to
Order；
Third program
A kind of vr eyewear faces 3d images, plane picture capture and gesture capture systems, including：Camera group, vr glasses, it is special
Sign is：A Front facial image is first provided, array camera group captures whole face-image, and vr glasses are due to covering and being close to face
Portion, it is close to facial zone（18）Picture can not be obtained, and thus corresponding position is supplemented in the mug shot of preceding offer；
Vr glasses are close to facial zone（18）The color of part is that both green or blueness select one；
Obtained by camera array group and be bonded facial external margin line（17）, internal edge line（16）, both two lines determinations
Between region（18）, two are determined including the characteristic point such as lower jaw, eyes, pupil, face according to the corresponding points of picture figure and figure
The corresponding relation in position of image, wherein the former is the Front facial image that is to provide of face-image the latter of camera array group capture
Image, the region between the former two lines is cut from latter image（18）In corresponding local face-image, add to the former
In image, because the region keeps static in facial general expression, this region still image is combined with image in video, closed
Two be one facial as dynamic video is completed；
Camera a（1）, camera b（10）It is arranged at the vr glasses interior zones of corresponding left eye position, camera a（1）, shooting
Head b（10）Positioned at lenses a（6）Upper and lower both sides are set, and infrared camera is set towards eyeball pupil position, infrared photography
Head b（3）It is arranged at left eye and corresponds to lenses（6）Edge；
Camera a1（2）, camera b2（9）It is arranged at the vr glasses interior zones of corresponding left eye position, camera a1（2）, take the photograph
As head b1（9）Positioned at lenses c（7）Upper and lower both sides are set, and infrared camera is set towards eyeball pupil position, infrared to take the photograph
As head b1（8）It is arranged at right eye and corresponds to lenses c（7）Edge；
Frame on the downside of vr glasses（11）Edge（5）The assembly of upper setting 3d cameras and visible image capturing head（20）, 3d takes the photograph
As head and the assembly of visible image capturing head（20）, along between left and right center position set, capture images direction towards face；
Frame on the upside of vr glasses（15）Edge（14）On set the assembly b of 3d cameras and visible image capturing head（71）, upper side edge
Frame（15）Edge（14）The assembly b of 3d cameras and visible image capturing head is set along symmetrical point above（72）, it is caught
Image direction is obtained towards face；3d cameras therein capture facial 3d contour structures, and light image is will be seen that according to 3d profiles
Synthesize 3d images；
According to 3d cameras and the assembly b of visible image capturing head（71）The image and 3d cameras and visible image capturing of shooting
The assembly of head（20）The image of shooting and by camera a（1）, camera b（10）Infrared camera b（3）Collectively form 3d
Camera group, infrared camera b（3）By shooting the 3d profiles at position at infrared light reflection capture again by 3d profiles and camera
a（1）, camera b（10）The 3d visual images at eyebrow uncovered area position in the raw 3d of synthesis eyes and the bridge of the nose, vr glasses,
By camera a1（2）, camera b2（9）, infrared camera b1（8）Collectively form 3d camera groups, infrared camera b（3）It is logical
Cross at infrared light reflection capture and shoot the 3d profiles at position again by 3d profiles and camera a（1）, camera b（10）It is synthetically generated
Eyebrow uncovered area position 3 D visible image in 3d eyes and the bridge of the nose, vr glasses, images above is 3d images, will be with
Upper 3d images are faced when being intended to obtain and non-face front posture according to corresponding shooting facial positions again split full facial image
During facial 3d images, by above 3d images according to corresponding shooting facial positions again split face-image by calculating processing generation
The 3d face-images of local different visual angles
Including：Two cheeks, forehead, nose, face, chin these not by vr glasses overlay area, revolved afterwards with the head captured
Turn corresponding angle to synthesize in real time after facial topography corresponding to corresponding visual angle and edge line（17）, internal edge line
（16）, the region of two lines determination therebetween（18）In overlay area generation supplemental image correspondingly carried out by computer
3d calculating handles the obtained real-time 3d images of the regional dynamics, by above station diagram as correspondence position split one figure obtains completely
Facial 3d images, finally it is shown to vr glasses left eye, on right eye screen, the vr that be sent to a distant place can be connected by network remote
The left eye of glasses, the screen of right eye；
Utilize 3d cameras and the assembly of visible image capturing head（20）3d cameras thereon can capture the solid of oral area
Change, using 3d images to judge and identify text information that oral area is correspondingly sent, and text information can be changed into control
The instruction of operation；In addition, the assembly of 3d cameras and visible image capturing head（20）With 3d cameras and visible image capturing head
Assembly b（71）3d cameras can rotate 180 degree, in reverse direction visual angle backwards to face, towards front shoot, can capture
Manipulation of the acquisition based on gesture change is identified to front images of gestures and to gesture to refer to；
Scheme four
A kind of vr eyewear faces 3d images, plane picture capture and gesture capture systems, including：Camera group, vr glasses, its
It is characterised by：Two head portraits are first provided, wherein one is camera and is located at the shooting of facial left front position to face angle shot,
Wherein one is that camera is located at the shooting of facial one o'clock position to face angle shot, the whole face of array camera group capture
Image, vr glasses are close to facial zone due to covering and being close to face（18）Picture can not obtain, thus the face photograph of preceding offer
Corresponding position is supplemented in piece；
Vr glasses are close to facial zone（18）Facial contact part（121）Color be green or blueness the two select one；
Two head photos are uploaded, wherein a camera site for requiring camera is located at the shooting of facial leftward position, wherein separately
One camera site for requiring camera is shot positioned at face right side；
Vr glasses are obtained by camera array group and are bonded facial external margin line（17）, internal edge line（16）, two lines are true
Fixed region therebetween（18）, included according to the corresponding points of picture figure and figure：The characteristic points such as lower jaw, eyes, pupil, face are true
The corresponding relation in position of fixed two images, two above image refer to that camera array group captures and splices the face of synthesis
Portion's image and the head portrait provided before, the former is the head portrait figure that face-image the latter of camera array group capture is to provide
Picture, the region between the former two lines is cut from latter image（18）In corresponding local face-image, add to the former figure
As in, because the region keeps static in facial general expression, by this region static faces image and other position dynamic visions
Frequency combines according to position correspondence relation, is combined into one as dynamic video face is completed；
Wherein left eye camera A (104) shooting images and left eye camera B (126) shooting images and edge line（17）, it is internal
Edge line（16）, the region of two lines determination therebetween（18）, the corresponding figure positioned at the shooting of facial right positions by uploading
As supplement, and the camera camera C inside vr glasses（101）The left eye eye first half image and camera of the people of shooting
H（110）The left eye eye lower half image of the people of shooting, camera C1（102）The right eye eye first half image of the people of shooting,
Camera H1（109）The right eye eye lower half image of the people of shooting synthesizes a breadth portion figure jointly by images above by splicing
Picture, the face being finally synthesizing is generated ear, hair and neck and corresponded to by computer again to be spliced with face-image, final to close
Into entire header picture, we it be referred to as left eye face-image, the image shows that the image can in the screen that vr glasses correspond to left eye
To be sent to the left eye of vr glasses in a distant place by network remote connection, show on the screen of right eye；
Wherein right eye camera A1 (112) shooting images and right eye camera B1 (125) shooting images and edge line（17）, it is interior
Portion's edge line（16）, the region of two lines determination therebetween（18）, it is corresponding to be located at what facial right positions were shot by what is uploaded
Image supplements, and the camera camera C inside vr glasses（101）The left eye eye first half image of the people of shooting and shooting
Head H（110）The left eye eye lower half image of the people of shooting, camera C1（102）The right eye eye first half figure of the people of shooting
Picture, camera H1（109）The right eye eye lower half image of the people of shooting synthesizes a breadth jointly by images above by splicing
The face that portion's image eventually forms is generated ear, hair and neck and corresponded to by computer again to be spliced with face-image, I
It is referred to as right eye face-image, the image is shown in the screen that vr glasses correspond to right eye, and the image can pass through net
Remotely connection is sent to the left eye of vr glasses in a distant place, shown on the screen of right eye network；
Left eye camera A (104), left eye camera B (126), sensitive chip is arranged in parallel；
Right eye camera A1 (112), right eye camera B1 (125) sensitive chip are arranged in parallel；
Left eye camera A (104), right eye camera A1 (112), are arranged at lower frame A（111）, the two edge is between left and right away from
Heart point A (105) is symmetrical arranged, and is located at lower frame A（111）Close on the edge A of front side（128）Place is set；
Left eye camera B (126), right eye camera B1 (125), are arranged at upper side frame A（115）, the two edge is between left and right away from
Heart point A（127）It is symmetrical arranged and is located at upper side frame A（115）Close on the edge A of front side（129）Place is set；
Camera C（101）, camera H（110）It is arranged at the interior zone of the vr glasses of corresponding left eye position, camera C
（101）, camera H（110）Positioned at lenses A（106）Upper and lower both sides are set, and infrared camera is towards eyeball pupil position
Set, infrared camera B（103）It is arranged at left eye and corresponds to lenses A（106）Edge；
Camera C1（2）, camera H2（109）It is arranged at the vr glasses interior zones of corresponding left eye position, camera C1
（102）, camera H1（109）Positioned at lenses C（107）Upper and lower both sides are set, and infrared camera is towards eyeball pupil position
Set, infrared camera B1（108）It is arranged at right eye and corresponds to lenses C（107）Edge；
Left eye camera A (104), left eye camera B (126), right eye camera A1 (112), right eye camera B1 (125) face phase
The face shots of people；
Scheme five
A kind of vr eyewear faces 3d images, plane picture capture and gesture capture systems, including：Camera group, vr glasses, it is special
Sign is：Two head portraits are first provided, wherein one is camera and is located at the shooting of facial left front position to face angle shot, its
In one be that camera is located at the shooting of facial one o'clock position to face angle shot, the whole face figure of array camera group capture
Picture, vr glasses are close to facial zone due to covering and being close to face（18）Picture can not obtain, thus the mug shot of preceding offer
Middle corresponding position is supplemented；
Vr glasses are close to facial zone（18）Facial contact part A（121）Color be green or blueness the two select one；
Two head photos are uploaded, wherein a camera site for requiring camera is located at the shooting of facial leftward position, wherein separately
One camera site for requiring camera is shot positioned at face right side；
Vr glasses are obtained by camera array group and are bonded facial external margin line（17）, internal edge line（16）, two lines are true
Fixed region therebetween（18）, it is true to include the characteristic point such as lower jaw, eyes, pupil, face according to the corresponding points of picture figure and figure
The corresponding relation in position of fixed two images, two images are that camera array group captures and splices the face-image of synthesis,
The head portrait provided before, the former is the head portrait image that face-image the latter of camera array group capture is to provide, and is schemed from the latter
The region between the former two lines is cut as in（18）In corresponding local face-image, add in the former image because should
Region keeps static in facial general expression, by this region static faces image and other position dynamic videos according to position pair
Combination should be related to, be combined into one as dynamic video face is completed；
Left eye camera A (104), left eye camera B (126), sensitive chip is arranged in parallel；
Right eye camera A1 (112), right eye camera B1 (125) sensitive chip are arranged in parallel；
Left eye camera A (104), right eye camera A1 (112), are arranged at lower frame A（111）, the two edge is between left and right away from
Heart point A (105) is symmetrical arranged, and is located at lower frame A（111）Close on the edge A of front side（128）Place is set；
Left eye camera B (126), right eye camera B1 (125), are arranged at upper side frame A（115）, the two edge is between left and right away from
Heart point A（127）It is symmetrical arranged and is located at upper side frame A（115）Close on the edge A of front side（129）Place is set；
Camera C（101）, camera H（110）It is arranged at the interior zone of the vr glasses of corresponding left eye position, camera C
（101）, camera H（110）Positioned at lenses A（106）Upper and lower both sides are set, and infrared camera is towards eyeball pupil position
Set, infrared camera B（103）It is arranged at left eye and corresponds to lenses A（106）Edge；
Camera C1（102）, camera H2（109）It is arranged at the vr glasses interior zones of corresponding left eye position, camera C1
（102）, camera H1（109）Positioned at lenses C（107）Upper and lower both sides are set, and infrared camera is towards eyeball pupil position
Set, infrared camera B1（108）It is arranged at right eye and corresponds to lenses C（107）Edge；
Left eye camera A (104), left eye camera B（126）, right eye camera A1（112）Right eye camera B1（125）Set
In on upper side frame and lower frame, upper side frame is with lower frame each parallel to horizontal plane, left eye camera A（104）, left eye camera B
（126）, right eye camera A1（112）Right eye camera B1（125）It can be revolved along connector in 180 degree and in the horizontal direction
Turn, can be by can be manually rotated, left eye camera A（104）, left eye camera B（126）, right eye camera A1（112）, right eye shooting
Head B1（125）Rotary shaft is set between the upper side frame, lower frame with vr glasses and by rotating axis connection；
Left eye camera A（104）, left eye camera B（126）, right eye camera A1（112）Right eye camera B1（125）Can be with
Rotate in 180 degree and in the horizontal direction along connector and by the scheme of driven by power controlling party be：Each it is arranged on upper side frame A
（111）Or lower frame A（115）Camera upper side frame A is fixed by motor below（111）Or A on lower frame
（115）, camera is fixed on the rotor of motor, stator and upper side frame A（111）Or lower frame A（115）Fixed, motor drives
Move and control camera relative to upper side frame A（111）Or lower frame A（115）Rotation, motor drive and control camera relative to
Upper side frame rotates；
Camera C1（102）, camera H2（109）, infrared camera B1（108）Collectively form 3d camera groups, infrared photography
Head B1（108）By shooting the 3d profiles at position at infrared light reflection capture again by 3d profiles and camera C1（102）, camera
H2（109）The image of shooting is synthetically generated eyebrow uncovered area position 3d visual images in 3d eyes and the bridge of the nose, vr glasses,
Camera C（101）, camera H（110）, infrared camera B（103）Collectively form 3d camera groups, infrared camera B（103）
By shooting the 3d profiles at position at infrared light reflection capture again by 3d profiles and camera C（101）, camera H（110）Shooting
Image be synthetically generated eyebrow uncovered area position 3d visual images in 3d eyes and the bridge of the nose, vr glasses, due to eyes and
The bridge of the nose is that the picture of eyebrow regional area varies less, and the obvious region of its image change is only eyeball and eyelid, infrared photography
Head B（103）Simultaneously to judge that the state opened or opened of eyes, and the left and right upper and lower displacement of eyeball are moved, eye is established
The 3d modelings of ball, and the image of real-time rendering eyeball, only changed in position and update a frame eyeball image constantly and by image
It is synthesized in the eyes for being synthetically generated 3d and the bridge of the nose, vr glasses in the 3d visual images of eyebrow uncovered area position, in general shape
Under state calculation resources it is limited or compared with the low-frequency eyes for being synthetically generated 3d and the bridge of the nose are only carried out under low state, eyebrow in vr glasses
Uncovered area position 3d visual images 1-30 frames per second and only in infrared camera B（103）The eyeball position hair captured
A new two field picture is updated during changing, renders the image eyes and nose of the 3d modelings of closed-eye state automatically when recognizing eye closing
Eyebrow uncovered area position in beam, vr glasses, therefore also to establish eyebrow uncovered area portion in eyes and the bridge of the nose, vr glasses
The 3d of position is modeled to be rendered when closing one's eyes；By the above-mentioned corresponding image aspects and left eye camera A for generating the image with rendering
（104）, left eye camera B（126）, real-time synchronization corresponding rotation and in real time corresponding to the image aspects of angle be consistent,
And the two split is gone out with real-time rendering again and left eye camera A（104）, left eye camera B（126）Consistent visual angle to edge
Line（17）, internal edge line（16）Two lines determine region therebetween（18）3d Image Mosaics, the face being finally synthesizing is again
Corresponded to and spliced with face-image by computer generation ear, hair and neck, it is final to synthesize entire header picture and then acquisition
And generate the 3d face-images in different angle and correspond to this image including on the left side plan of vr glasses；
To edge line（17）, internal edge line（16）Two lines determine region therebetween（18）It is corresponding to be located at face by what is uploaded
The image supplement of portion's right positions shooting carries out two with the corresponding image supplement positioned at the shooting of facial leftward position by uploading
Figure progress 3d calculates the 3d images in the Static planar 180 degree angular field of view in the processing acquisition region, and real-time rendering goes out and a left side
Eye imaging head A（104）, left eye camera B（126）Consistent visual angle to edge line（17）, internal edge line（16）Two lines are true
Fixed region therebetween（18）3d images；
Camera C1（102）, camera H2（109）, infrared camera B1（108）Collectively form 3d camera groups, infrared photography
Head B1（108）By shooting the 3d profiles at position at infrared light reflection capture again by 3d profiles and camera C1（102）, camera
H2（109）The image of shooting is synthetically generated eyebrow uncovered area position 3d visual images in 3d eyes and the bridge of the nose, vr glasses,
Camera C（101）, camera H（110）, infrared camera B（103）Collectively form 3d camera groups, infrared camera B（103）
By shooting the 3d profiles at position at infrared light reflection capture again by 3d profiles and camera C（101）, camera H（110）Shooting
Image be synthetically generated eyebrow uncovered area position 3d visual images in 3d eyes and the bridge of the nose, vr glasses, due to eyes and
The bridge of the nose is that the picture of eyebrow regional area varies less, and the obvious region of its image change is only eyeball and eyelid, infrared photography
Head B（103）, infrared camera B1（108）While to judge the state opened or opened of eyes, and on the left and right of eyeball
Lower section displacement is moved, and is established the 3d modelings of eyeball, and the image of real-time rendering eyeball, is only changed and updated constantly newly in position
Image is simultaneously synthesized to eyebrow uncovered area position 3d in the eyes for being synthetically generated 3d and the bridge of the nose, vr glasses by one frame eyeball image
In visual image, calculation resources are limited or compared with only carrying out low-frequency eyes for being synthetically generated 3d under low state under general state
And eyebrow uncovered area position 3d visual images 1-30 frames per second and only in infrared camera B in the bridge of the nose, vr glasses
（103）, infrared camera B1（108）A new two field picture is updated when the eyeball position captured changes, is closed when recognizing
Eyebrow uncovered area position in the image eyes and the bridge of the nose, vr glasses of the 3d modelings of closed-eye state is at the moment rendered automatically, therefore
Also the 3d in eyes and the bridge of the nose, vr glasses under the closed-eye state at eyebrow uncovered area position is established to model to when closing one's eyes
Render because it is usually that need not render 3d modelings under accurate image and each closed-eye state of acquiescence moment not send out to close one's eyes
Changing, above-mentioned correspondence generates, the image aspects and left eye camera A of the image that render（104）, left eye camera B（126）Clap
The real-time synchronization corresponding rotation taken the photograph and in real time corresponding to the image aspects of angle be consistent, and will the two split again with real-time wash with watercolours
Dye and left eye camera A（104）, left eye camera B（126）Consistent visual angle to edge line（17）, internal edge line（16）
Two lines determine region therebetween（18）3d Image Mosaics, the face being finally synthesizing generate ear, hair by computer again
It is final to synthesize entire header picture and then obtain and generate in the 3d faces of different angle and neck is corresponded to and spliced with face-image
Portion's image is simultaneously corresponding including in the left screen of vr glasses by this image；
To edge line（17）, internal edge line（16）Two lines determine region therebetween（18）It is corresponding to be located at face by what is uploaded
The image supplement of portion's right positions shooting carries out two with the corresponding image supplement positioned at the shooting of facial leftward position by uploading
Figure progress 3d calculates the 3d images in the Static planar 180 degree angular field of view in the processing acquisition region, and real-time rendering goes out and a left side
Eye imaging head A（104）, left eye camera B（126）Consistent visual angle to edge line（17）, internal edge line（16）Two lines are true
Fixed region therebetween（18）3d images；
Camera C1（102）, camera H2（109）, infrared camera B1（108）Collectively form 3d camera groups, infrared photography
Head B1（108）By shooting the 3d profiles at position at infrared light reflection capture again by 3d profiles and camera C1（102）, camera
H2（109）The image of shooting is synthetically generated eyebrow uncovered area position 3d visual images in 3d eyes and the bridge of the nose, vr glasses,
Camera C（101）, camera H（110）, infrared camera B（103）Collectively form 3d camera groups, infrared camera B（103）
By shooting the 3d profiles at position at infrared light reflection capture again by 3d profiles and camera C（101）, camera H（110）Shooting
Image be synthetically generated eyebrow uncovered area position 3d visual images in 3d eyes and the bridge of the nose, vr glasses, due to eyes and
The bridge of the nose is that the picture of eyebrow regional area varies less, and the obvious region of its image change is only eyeball and eyelid, infrared photography
Head B（103）, infrared camera B1（108）While to judge the state opened or opened of eyes, and on the left and right of eyeball
Lower section displacement is moved, and is established the 3d modelings of eyeball, and the image of real-time rendering eyeball, is only changed and updated constantly newly in position
Image is simultaneously synthesized to eyebrow uncovered area position 3d in the eyes for being synthetically generated 3d and the bridge of the nose, vr glasses by one frame eyeball image
In visual image, calculation resources are limited or compared with only carrying out low-frequency eyes for being synthetically generated 3d under low state under general state
And eyebrow uncovered area position 3d visual images 1-30 frames per second and only in infrared camera B in the bridge of the nose, vr glasses
（103）, infrared camera B1（108）A new two field picture is updated when the eyeball position captured changes, is closed when recognizing
Eyebrow uncovered area position in the image eyes and the bridge of the nose, vr glasses of the 3d modelings of closed-eye state is at the moment rendered automatically, therefore
Also the 3d in eyes and the bridge of the nose, vr glasses under the closed-eye state at eyebrow uncovered area position is established to model to when closing one's eyes
Render because it is usually that need not render 3d modelings under accurate image and each closed-eye state of acquiescence moment not send out to close one's eyes
Changing, above-mentioned correspondence generates, the image aspects and left eye camera right eye camera A1 of the image that render（112）Taken the photograph with right eye
As head B1（125）
The real-time synchronization corresponding rotation of shooting and in real time corresponding to the image aspects of angle be consistent, and will the two split again with
Real-time rendering goes out and left eye camera right eye camera A1（112）With right eye camera B1（125）
Consistent visual angle to edge line（17）, internal edge line（16）Two lines determine region therebetween（18）3d images are spelled
Close, the face being finally synthesizing is generated ear, hair and neck and corresponded to by computer again to be spliced with face-image, final to close
Into entire header picture and then obtain and generate the 3d face-images in different angle and include this image is corresponding on the right side of vr glasses
On the screen of side；
To edge line（17）, internal edge line（16）Two lines determine region therebetween（18）It is corresponding to be located at face by what is uploaded
The image supplement of portion's right positions shooting carries out two with the corresponding image supplement positioned at the shooting of facial leftward position by uploading
Figure progress 3d calculates the 3d images in the Static planar 180 degree angular field of view in the processing acquisition region, and real-time rendering goes out and the right side
Eye imaging head A1（112）With right eye camera B1（125）
Consistent visual angle to edge line（17）, internal edge line（16）Two lines determine region therebetween（18）3d images；
By the screen display before corresponding images of left and right eyes, band is given different angle and sees that the facial vision of people is imitated by image
Fruit, left eye, the screen of right eye of the vr glasses for being sent to a distant place can be connected by network remote；
The connected mode of camera and vr glasses can be following pattern：Annular peripheral frame A is set（77）, the inward flange A of frame
（66）Shape is consistent with the outward flange size of vr glasses, and the inward flange of annular peripheral frame can be enclosed on the outward flange A of vr glasses（88）
On, it is fixed on annular peripheral frame；
Two camera left eye camera B (126), right eye camera B1 (125) are towards face, because forehead position is in normal table
The variation of feelings hypograph is very small almost to be can be ignored, therefore selects camera left eye camera B (126), right eye camera B1
(125) tableaux for shooting forehead position replaces dynamic menu, and the static brow portion that left eye camera B (126) is clapped is drawn
Face synthesis is schemed in left eye face-image, the static brow portion picture synthesis that right eye camera B1 (125) is clapped in right eye face
Picture, now adjust two camera left eye camera B (126), right eye camera B1 (125) before facial face orientation
Side, two cameras can be with synchronous rotary 180 degree, and visual angle is facial backwards in reverse direction, is shot towards front, dual camera left eye
Camera B (126), right eye camera B1 (125) form 3d cameras, can capture front images of gestures and gesture is carried out
Identification obtains the manipulation instruction based on gesture change, while is formed towards two camera left eye camera A (104) of face shots
A pair of 3d cameras can obtain the real-time change of oral area shape and the real time kinematics modified-image at lower jaw upper jaw position, utilize
Text information can be changed into control operation by interpretation 3d images to judge and identify text information that oral area is correspondingly sent
Instruction；Can be synchronous by (112) two left eye camera A (104), right eye camera A1 cameras in addition to this scheme
180 degree is rotated, visual angle is shot backwards to face, towards front in reverse direction, dual camera left eye camera A (104), right eye shooting
Head A1 (112), which can capture front images of gestures and gesture is identified, obtains the manipulation instruction based on gesture change.
Brief description of the drawings
Fig. 1 is front view
Fig. 2 is bottom displaying figure
Fig. 3 is vr glasses and facial overlapping region schematic diagram
Fig. 4 is vr glasses and facial overlapping region figure
Fig. 5 is vr glasses and annular peripheral frame combination perspective view
Fig. 6 is displaying before annular peripheral frame is combined with vr glasses.
Fig. 7 is front view
Fig. 8 is ground plan
Fig. 9 is facial overlay area schematic diagram
Figure 10 is facial zone explanation figure
Figure 11 is look up figure
Figure 12 is combination shot system
Frame on the upside of Figure 13 vr glasses（15）Edge（14）On set the assembly b of 3d cameras and visible image capturing head（71）.
Embodiment
Third program
A kind of vr eyewear faces 3d images, plane picture capture and gesture capture systems, including：Camera group, vr glasses, it is special
Sign is：A Front facial image is first provided, array camera group captures whole face-image, and vr glasses are due to covering and being close to face
Portion, it is close to facial zone（18）Picture can not be obtained, and thus corresponding position is supplemented in the mug shot of preceding offer, referring to figure
3；
Vr glasses are close to facial zone（18）The color of part is that both green or blueness select one；
Obtained by camera array group and be bonded facial external margin line（17）, internal edge line（16）, both two lines determinations
Between region（18）, two are determined including the characteristic point such as lower jaw, eyes, pupil, face according to the corresponding points of picture figure and figure
The corresponding relation in position of image, wherein the former is the Front facial image that is to provide of face-image the latter of camera array group capture
Image, the region between the former two lines is cut from latter image（18）In corresponding local face-image, add to the former
In image, because the region keeps static in facial general expression, this region still image is combined with image in video, closed
Two be one facial as dynamic video is completed；
Referring to Figure 12,13, camera a（1）, camera b（10）It is arranged at the vr glasses interior zones of corresponding left eye position, shooting
Head a（1）, camera b（10）Positioned at lenses a（6）Upper and lower both sides are set, and infrared camera is set towards eyeball pupil position
Put, infrared camera b（3）It is arranged at left eye and corresponds to lenses（6）Edge；
Camera a1（2）, camera b2（9）It is arranged at the vr glasses interior zones of corresponding left eye position, camera a1（2）, take the photograph
As head b1（9）Positioned at lenses c（7）Upper and lower both sides are set, and infrared camera is set towards eyeball pupil position, infrared to take the photograph
As head b1（8）It is arranged at right eye and corresponds to lenses c（7）Edge；
Frame on the downside of vr glasses（11）Edge（5）The assembly of upper setting 3d cameras and visible image capturing head（20）, 3d takes the photograph
As head and the assembly of visible image capturing head（20）, along between left and right center position set, capture images direction towards face；
Frame on the upside of vr glasses（15）Edge（14）On set the assembly b of 3d cameras and visible image capturing head（71）, upper side edge
Frame（15）Edge（14）The assembly b of 3d cameras and visible image capturing head is set along symmetrical point above（72）, it is caught
Image direction is obtained towards face；3d cameras therein capture facial 3d contour structures, and light image is will be seen that according to 3d profiles
Synthesize 3d images；
According to 3d cameras and the assembly b of visible image capturing head（71）The image and 3d cameras and visible image capturing of shooting
The assembly of head（20）The image of shooting and by camera a（1）, camera b（10）Infrared camera b（3）Collectively form 3d
Camera group, infrared camera b（3）By shooting the 3d profiles at position at infrared light reflection capture again by 3d profiles and camera
a（1）, camera b（10）The 3d visual images at eyebrow uncovered area position in the raw 3d of synthesis eyes and the bridge of the nose, vr glasses,
By camera a1（2）, camera b2（9）, infrared camera b1（8）Collectively form 3d camera groups, infrared camera b（3）It is logical
Cross at infrared light reflection capture and shoot the 3d profiles at position again by 3d profiles and camera a（1）, camera b（10）It is synthetically generated
The 3d visual images at eyebrow uncovered area position in 3d eyes and the bridge of the nose, vr glasses, images above is 3d images, will be with
Upper 3d images are faced when being intended to obtain and non-face front posture according to corresponding shooting facial positions again split full facial image
During facial 3d images, by above 3d images according to corresponding shooting facial positions again split face-image by calculating processing generation
The 3d face-images of local different visual angles, including：Two cheeks, forehead, nose, face, chin these not by the vr glasses areas of coverage
The facial zone in domain, it is local to synthesize face corresponding to corresponding visual angle in real time with the end rotation corresponding angle captured afterwards
After image and edge line（17）, internal edge line（16）, the region of two lines determination therebetween（18）In overlay area
The supplemental image of generation correspondingly handles the obtained real-time 3d images of the regional dynamics by computer progress 3d calculating, will be with top
Bit image correspondence position split one figure obtains full facial 3d images, is finally shown to vr glasses left eye, on right eye screen, can
To be sent to the screen of the left eye of the vr glasses in a distant place, right eye by network remote connection；
3d cameras and the assembly of visible image capturing head are utilized referring to Figure 12,13（20）3d cameras thereon can capture
To the solid change of oral area, using 3d images to judge and identify text information that oral area is correspondingly sent, and word can be believed
Breath is changed into the instruction of control operation；In addition, the assembly of 3d cameras and visible image capturing head（20）With 3d cameras with can
See the assembly b of light video camera head（71）3d cameras can rotate 180 degree, in reverse direction visual angle backwards to face, towards front
Shooting, can capture front images of gestures and to gesture be identified obtain based on gesture change manipulation refer to；
A kind of vr eyewear faces 3d images, plane picture capture and gesture capture systems
Scheme four
A kind of vr eyewear faces 3d images, plane picture capture and gesture capture systems, including：Camera group, vr glasses, its
It is characterised by：Two head portraits are first provided, wherein one is camera and is located at the shooting of facial left front position to face angle shot,
Wherein one is that camera is located at the shooting of facial one o'clock position to face angle shot, the whole face of array camera group capture
Image, vr glasses are close to facial zone due to covering and being close to face（18）Picture can not obtain, thus the face photograph of preceding offer
Corresponding position is supplemented in piece；
Referring to Fig. 2, vr glasses are close to facial zone（18）Facial contact part（121）Color be green or blueness the two select it
One；
Two head photos are uploaded, wherein a camera site for requiring camera is located at the shooting of facial leftward position, wherein separately
One camera site for requiring camera is shot positioned at face right side；
Vr glasses are obtained by camera array group and are bonded facial external margin line（17）, internal edge line（16）, two lines are true
Fixed region therebetween（18）, included according to the corresponding points of picture figure and figure：The characteristic points such as lower jaw, eyes, pupil, face are true
The corresponding relation in position of fixed two images, two above image refer to that camera array group captures and splices the face of synthesis
Portion's image and the head portrait provided before, the former is the head portrait figure that face-image the latter of camera array group capture is to provide
Picture, the region between the former two lines is cut from latter image（18）In corresponding local face-image, add to the former figure
As in, because the region keeps static in facial general expression, by this region static faces image and other position dynamic visions
Frequency combines according to position correspondence relation, is combined into one as dynamic video face is completed；Referring to Fig. 3,4；
Referring to Fig. 1, wherein left eye camera A (104) shooting images and left eye camera B (126) shooting images and edge line
（17）, internal edge line（16）, the region of two lines determination therebetween（18）, it is corresponding to be located at facial right positions by what is uploaded
The image supplement of shooting, and the camera camera C inside vr glasses（101）The left eye eye first half image of the people of shooting
With camera H（110）The left eye eye lower half image of the people of shooting, camera C1（102）On the right eye eye of the people of shooting
Half portion image, camera H1（109）The right eye eye lower half image of the people of shooting is synthesized jointly by images above by splicing
One width face-image, the face being finally synthesizing generate ear, hair and neck by computer again and corresponded to and face-image progress
Splicing, it is final to synthesize entire header picture, we it be referred to as left eye face-image, the image is aobvious in the screen that vr glasses correspond to left eye
Show, the image can be connected by network remote and be sent to the left eye of vr glasses in a distant place, shown on the screen of right eye；
Wherein right eye camera A1 (112) shooting images and right eye camera B1 (125) shooting images and edge line（17）, it is interior
Portion's edge line（16）, the region of two lines determination therebetween（18）, it is corresponding to be located at what facial right positions were shot by what is uploaded
Image supplements, and the camera camera C inside vr glasses（101）The left eye eye first half image of the people of shooting and shooting
Head H（110）The left eye eye lower half image of the people of shooting, camera C1（102）The right eye eye first half figure of the people of shooting
Picture, camera H1（109）The right eye eye lower half image of the people of shooting synthesizes a breadth jointly by images above by splicing
The face that portion's image eventually forms is generated ear, hair and neck and corresponded to by computer again to be spliced with face-image, I
It is referred to as right eye face-image, the image is shown in the screen that vr glasses correspond to right eye, and the image can pass through net
Remotely connection is sent to the left eye of vr glasses in a distant place, shown on the screen of right eye network；
Referring to Fig. 1, Fig. 2, left eye camera A (104), left eye camera B (126), sensitive chip is arranged in parallel；
Right eye camera A1 (112), right eye camera B1 (125) sensitive chip are arranged in parallel；
Left eye camera A (104), right eye camera A1 (112), are arranged at lower frame A（111）, the two edge is between left and right away from
Heart point A (105) is symmetrical arranged, and is located at lower frame A（111）Close on the edge A of front side（128）Place is set；
Left eye camera B (126), right eye camera B1 (125), are arranged at upper side frame A（115）, the two edge is between left and right away from
Heart point A（127）It is symmetrical arranged and is located at upper side frame A（115）Close on the edge A of front side（129）Place is set；
Referring to Fig. 1, Fig. 2, camera C（101）, camera H（110）It is arranged at the inner area of the vr glasses of corresponding left eye position
Domain, camera C（101）, camera H（110）Positioned at lenses A（106）Upper and lower both sides are set, and infrared camera is towards eye
Ball pupil position is set, infrared camera B（103）It is arranged at left eye and corresponds to lenses A（106）Edge；
Camera C1（2）, camera H2（109）It is arranged at the vr glasses interior zones of corresponding left eye position, camera C1
（102）, camera H1（109）Positioned at lenses C（107）Upper and lower both sides are set, and infrared camera is towards eyeball pupil position
Set, infrared camera B1（108）It is arranged at right eye and corresponds to lenses C（107）Edge；
Left eye camera A (104), left eye camera B (126), right eye camera A1 (112), right eye camera B1 (125) face phase
The face shots of people；
Scheme five
A kind of vr eyewear faces 3d images, plane picture capture and gesture capture systems, including：Camera group, vr glasses, it is special
Sign is：Two head portraits are first provided, wherein one is camera and is located at the shooting of facial left front position to face angle shot, its
In one be that camera is located at the shooting of facial one o'clock position to face angle shot, the whole face figure of array camera group capture
Picture, vr glasses are close to facial zone due to covering and being close to face（18）Picture can not obtain, thus the mug shot of preceding offer
Middle corresponding position is supplemented；
Vr glasses are close to facial zone（18）Facial contact part A（121）Color be green or blueness the two select one；
Two head photos are uploaded, wherein a camera site for requiring camera is located at the shooting of facial leftward position, wherein separately
One camera site for requiring camera is shot positioned at face right side；
Vr glasses are obtained by camera array group and are bonded facial external margin line（17）, internal edge line（16）, two lines are true
Fixed region therebetween（18）, it is true to include the characteristic point such as lower jaw, eyes, pupil, face according to the corresponding points of picture figure and figure
The corresponding relation in position of fixed two images, two images are that camera array group captures and splices the face-image of synthesis,
The head portrait provided before, the former is the head portrait image that face-image the latter of camera array group capture is to provide, and is schemed from the latter
The region between the former two lines is cut as in（18）In corresponding local face-image, add in the former image because should
Region keeps static in facial general expression, by this region static faces image and other position dynamic videos according to position pair
Combination should be related to, be combined into one as dynamic video face is completed；
Left eye camera A (104), left eye camera B (126), sensitive chip is arranged in parallel；
Right eye camera A1 (112), right eye camera B1 (125) sensitive chip are arranged in parallel；
Left eye camera A (104), right eye camera A1 (112), are arranged at lower frame A（111）, the two edge is between left and right away from
Heart point A (105) is symmetrical arranged, and is located at lower frame A（111）Close on the edge A of front side（128）Place is set；
Left eye camera B (126), right eye camera B1 (125), are arranged at upper side frame A（115）, the two edge is between left and right away from
Heart point A（127）It is symmetrical arranged and is located at upper side frame A（115）Close on the edge A of front side（129）Place is set；
Camera C（101）, camera H（110）It is arranged at the interior zone of the vr glasses of corresponding left eye position, camera C
（101）, camera H（110）Positioned at lenses A（106）Upper and lower both sides are set, and infrared camera is towards eyeball pupil position
Set, infrared camera B（103）It is arranged at left eye and corresponds to lenses A（106）Edge；
Camera C1（102）, camera H2（109）It is arranged at the vr glasses interior zones of corresponding left eye position, camera C1
（102）, camera H1（109）Positioned at lenses C（107）Upper and lower both sides are set, and infrared camera is towards eyeball pupil position
Set, infrared camera B1（108）It is arranged at right eye and corresponds to lenses C（107）Edge；
Left eye camera A (104), left eye camera B（126）, right eye camera A1（112）Right eye camera B1（125）Set
In on upper side frame and lower frame, upper side frame is with lower frame each parallel to horizontal plane, left eye camera A（104）, left eye camera B
（126）, right eye camera A1（112）Right eye camera B1（125）It can be revolved along connector in 180 degree and in the horizontal direction
Turn, can be by can be manually rotated, left eye camera A（104）, left eye camera B（126）, right eye camera A1（112）, right eye shooting
Head B1（125）Rotary shaft is set between the upper side frame, lower frame with vr glasses and by rotating axis connection；
Left eye camera A（104）, left eye camera B（126）, right eye camera A1（112）Right eye camera B1（125）Can be with
Rotate in 180 degree and in the horizontal direction along connector and by the scheme of driven by power controlling party be：Each it is arranged on upper side frame A
（111）Or lower frame A（115）Camera upper side frame A is fixed by motor below（111）Or A on lower frame
（115）, camera is fixed on the rotor of motor, stator and upper side frame A（111）Or lower frame A（115）Fixed, motor drives
Move and control camera relative to upper side frame A（111）Or lower frame A（115）Rotation, motor drive and control camera relative to
Upper side frame rotates；
Camera C1（102）, camera H2（109）, infrared camera B1（108）Collectively form 3d camera groups, infrared photography
Head B1（108）By shooting the 3d profiles at position at infrared light reflection capture again by 3d profiles and camera C1（102）, camera
H2（109）The image of shooting is synthetically generated eyebrow uncovered area position 3d visual images in 3d eyes and the bridge of the nose, vr glasses,
Camera C（101）, camera H（110）, infrared camera B（103）Collectively form 3d camera groups, infrared camera B（103）
By shooting the 3d profiles at position at infrared light reflection capture again by 3d profiles and camera C（101）, camera H（110）Shooting
Image be synthetically generated eyebrow uncovered area position 3d visual images in 3d eyes and the bridge of the nose, vr glasses, due to eyes and
The bridge of the nose is that the picture of eyebrow regional area varies less, and the obvious region of its image change is only eyeball and eyelid, infrared photography
Head B（103）Simultaneously to judge that the state opened or opened of eyes, and the left and right upper and lower displacement of eyeball are moved, eye is established
The 3d modelings of ball, and the image of real-time rendering eyeball, only changed in position and update a frame eyeball image constantly and by image
It is synthesized in the eyes for being synthetically generated 3d and the bridge of the nose, vr glasses in the 3d visual images of eyebrow uncovered area position, in general shape
Under state calculation resources it is limited or compared with the low-frequency eyes for being synthetically generated 3d and the bridge of the nose are only carried out under low state, eyebrow in vr glasses
Uncovered area position 3d visual images 1-30 frames per second and only in infrared camera B（103）The eyeball position hair captured
A new two field picture is updated during changing, renders the image eyes and nose of the 3d modelings of closed-eye state automatically when recognizing eye closing
Eyebrow uncovered area position in beam, vr glasses, therefore also to establish eyebrow uncovered area portion in eyes and the bridge of the nose, vr glasses
The 3d of position is modeled to be rendered when closing one's eyes；By the above-mentioned corresponding image aspects and left eye camera A for generating the image with rendering
（104）, left eye camera B（126）, real-time synchronization corresponding rotation and in real time corresponding to the image aspects of angle be consistent,
And the two split is gone out with real-time rendering again and left eye camera A（104）, left eye camera B（126）Consistent visual angle to edge
Line（17）, internal edge line（16）Two lines determine region therebetween（18）3d Image Mosaics, the face being finally synthesizing is again
Corresponded to and spliced with face-image by computer generation ear, hair and neck, it is final to synthesize entire header picture and then acquisition
And generate the 3d face-images in different angle and correspond to this image including on the left side plan of vr glasses；
To edge line（17）, internal edge line（16）Two lines determine region therebetween（18）It is corresponding to be located at face by what is uploaded
The image supplement of portion's right positions shooting carries out two with the corresponding image supplement positioned at the shooting of facial leftward position by uploading
Figure progress 3d calculates the 3d images in the Static planar 180 degree angular field of view in the processing acquisition region, and real-time rendering goes out and a left side
Eye imaging head A（104）, left eye camera B（126）Consistent visual angle to edge line（17）, internal edge line（16）Two lines are true
Fixed region therebetween（18）3d images；
Camera C1（102）, camera H2（109）, infrared camera B1（108）Collectively form 3d camera groups, infrared photography
Head B1（108）By shooting the 3d profiles at position at infrared light reflection capture again by 3d profiles and camera C1（102）, camera
H2（109）The image of shooting is synthetically generated eyebrow uncovered area position 3d visual images in 3d eyes and the bridge of the nose, vr glasses,
Camera C（101）, camera H（110）, infrared camera B（103）Collectively form 3d camera groups, infrared camera B（103）
By shooting the 3d profiles at position at infrared light reflection capture again by 3d profiles and camera C（101）, camera H（110）Shooting
Image be synthetically generated eyebrow uncovered area position 3d visual images in 3d eyes and the bridge of the nose, vr glasses, due to eyes and
The bridge of the nose is that the picture of eyebrow regional area varies less, and the obvious region of its image change is only eyeball and eyelid, infrared photography
Head B（103）, infrared camera B1（108）While to judge the state opened or opened of eyes, and on the left and right of eyeball
Lower section displacement is moved, and is established the 3d modelings of eyeball, and the image of real-time rendering eyeball, is only changed and updated constantly newly in position
Image is simultaneously synthesized to eyebrow uncovered area position 3d in the eyes for being synthetically generated 3d and the bridge of the nose, vr glasses by one frame eyeball image
In visual image, calculation resources are limited or compared with only carrying out low-frequency eyes for being synthetically generated 3d under low state under general state
And eyebrow uncovered area position 3d visual images 1-30 frames per second and only in infrared camera B in the bridge of the nose, vr glasses
（103）, infrared camera B1（108）A new two field picture is updated when the eyeball position captured changes, is closed when recognizing
Eyebrow uncovered area position in the image eyes and the bridge of the nose, vr glasses of the 3d modelings of closed-eye state is at the moment rendered automatically, therefore
Also the 3d in eyes and the bridge of the nose, vr glasses under the closed-eye state at eyebrow uncovered area position is established to model to when closing one's eyes
Render because it is usually that need not render 3d modelings under accurate image and each closed-eye state of acquiescence moment not send out to close one's eyes
Changing, above-mentioned correspondence generates, the image aspects and left eye camera A of the image that render（104）, left eye camera B（126）Clap
The real-time synchronization corresponding rotation taken the photograph and in real time corresponding to the image aspects of angle be consistent, and will the two split again with real-time wash with watercolours
Dye and left eye camera A（104）, left eye camera B（126）Consistent visual angle to edge line（17）, internal edge line（16）
Two lines determine region therebetween（18）3d Image Mosaics, the face being finally synthesizing generate ear, hair by computer again
It is final to synthesize entire header picture and then obtain and generate in the 3d faces of different angle and neck is corresponded to and spliced with face-image
Portion's image is simultaneously corresponding including in the left screen of vr glasses by this image；
To edge line（17）, internal edge line（16）Two lines determine region therebetween（18）It is corresponding to be located at face by what is uploaded
The image supplement of portion's right positions shooting carries out two with the corresponding image supplement positioned at the shooting of facial leftward position by uploading
Figure progress 3d calculates the 3d images in the Static planar 180 degree angular field of view in the processing acquisition region, and real-time rendering goes out and a left side
Eye imaging head A（104）, left eye camera B（126）Consistent visual angle to edge line（17）, internal edge line（16）Two lines are true
Fixed region therebetween（18）3d images；
Camera C1（102）, camera H2（109）, infrared camera B1（108）Collectively form 3d camera groups, infrared photography
Head B1（108）By shooting the 3d profiles at position at infrared light reflection capture again by 3d profiles and camera C1（102）, camera
H2（109）The image of shooting is synthetically generated eyebrow uncovered area position 3d visual images in 3d eyes and the bridge of the nose, vr glasses,
Camera C（101）, camera H（110）, infrared camera B（103）Collectively form 3d camera groups, infrared camera B（103）
By shooting the 3d profiles at position at infrared light reflection capture again by 3d profiles and camera C（101）, camera H（110）Shooting
Image be synthetically generated eyebrow uncovered area position 3d visual images in 3d eyes and the bridge of the nose, vr glasses, due to eyes and
The bridge of the nose is that the picture of eyebrow regional area varies less, and the obvious region of its image change is only eyeball and eyelid, infrared photography
Head B（103）, infrared camera B1（108）While to judge the state opened or opened of eyes, and on the left and right of eyeball
Lower section displacement is moved, and is established the 3d modelings of eyeball, and the image of real-time rendering eyeball, is only changed and updated constantly newly in position
Image is simultaneously synthesized to eyebrow uncovered area position 3d in the eyes for being synthetically generated 3d and the bridge of the nose, vr glasses by one frame eyeball image
In visual image, calculation resources are limited or compared with only carrying out low-frequency eyes for being synthetically generated 3d under low state under general state
And eyebrow uncovered area position 3d visual images 1-30 frames per second and only in infrared camera B in the bridge of the nose, vr glasses
（103）, infrared camera B1（108）A new two field picture is updated when the eyeball position captured changes, is closed when recognizing
Eyebrow uncovered area position in the image eyes and the bridge of the nose, vr glasses of the 3d modelings of closed-eye state is at the moment rendered automatically, therefore
Also the 3d in eyes and the bridge of the nose, vr glasses under the closed-eye state at eyebrow uncovered area position is established to model to when closing one's eyes
Render because it is usually that need not render 3d modelings under accurate image and each closed-eye state of acquiescence moment not send out to close one's eyes
Changing, above-mentioned correspondence generates, the image aspects and left eye camera right eye camera A1 of the image that render（112）Taken the photograph with right eye
As head B1（125）
The real-time synchronization corresponding rotation of shooting and in real time corresponding to the image aspects of angle be consistent, and will the two split again with
Real-time rendering goes out and left eye camera right eye camera A1（112）With right eye camera B1（125）
Consistent visual angle to edge line（17）, internal edge line（16）Two lines determine region therebetween（18）3d images are spelled
Close, the face being finally synthesizing is generated ear, hair and neck and corresponded to by computer again to be spliced with face-image, final to close
Into entire header picture and then obtain and generate the 3d face-images in different angle and include this image is corresponding on the right side of vr glasses
On the screen of side；
To edge line（17）, internal edge line（16）Two lines determine region therebetween（18）It is corresponding to be located at face by what is uploaded
The image supplement of portion's right positions shooting carries out two with the corresponding image supplement positioned at the shooting of facial leftward position by uploading
Figure progress 3d calculates the 3d images in the Static planar 180 degree angular field of view in the processing acquisition region, and real-time rendering goes out and the right side
Eye imaging head A1（112）With right eye camera B1（125）
Consistent visual angle to edge line（17）, internal edge line（16）Two lines determine region therebetween（18）3d images；
By the screen display before corresponding images of left and right eyes, band is given different angle and sees that the facial vision of people is imitated by image
Fruit, left eye, the screen of right eye of the vr glasses for being sent to a distant place can be connected by network remote；
The connected mode of camera and vr glasses can be following pattern：Annular peripheral frame A is set（77）, the inward flange A of frame
（66）Shape is consistent with the outward flange size of vr glasses, and the inward flange of annular peripheral frame can be enclosed on the outward flange A of vr glasses（88）
On, it is fixed on annular peripheral frame；
Two camera left eye camera B (126), right eye camera B1 (125) are towards face, because forehead position is in normal table
The variation of feelings hypograph is very small almost to be can be ignored, therefore selects camera left eye camera B (126), right eye camera B1
(125) tableaux for shooting forehead position replaces dynamic menu, and the static brow portion that left eye camera B (126) is clapped is drawn
Face synthesis is schemed in left eye face-image, the static brow portion picture synthesis that right eye camera B1 (125) is clapped in right eye face
Picture, now adjust two camera left eye camera B (126), right eye camera B1 (125) before facial face orientation
Side, two cameras can be with synchronous rotary 180 degree, and visual angle is facial backwards in reverse direction, is shot towards front, dual camera left eye
Camera B (126), right eye camera B1 (125) form 3d cameras, can capture front images of gestures and gesture is carried out
Identification obtains the manipulation instruction based on gesture change, while is formed towards two camera left eye camera A (104) of face shots
A pair of 3d cameras can obtain the real-time change of oral area shape and the real time kinematics modified-image at lower jaw upper jaw position, utilize
Text information can be changed into control operation by interpretation 3d images to judge and identify text information that oral area is correspondingly sent
Instruction；Can be synchronous by (112) two left eye camera A (104), right eye camera A1 cameras in addition to this scheme
180 degree is rotated, visual angle is shot backwards to face, towards front in reverse direction, dual camera left eye camera A (104), right eye shooting
Head A1 (112), which can capture front images of gestures and gesture is identified, obtains the manipulation instruction based on gesture change.
Claims (5)
1. a kind of vr eyewear faces 3d images, plane picture capture and gesture capture systems, including：Camera group, vr glasses, its
It is characterised by：A Front facial image is first provided, array camera group captures whole face-image, and vr glasses are due to covering and being close to
Face, it is close to facial zone（18）Picture can not be obtained, and thus corresponding position is supplemented in the mug shot of preceding offer；
Vr glasses are close to facial zone（18）Facial contact part color be green or blueness the two select one；
Vr glasses are obtained by camera array group and are bonded facial external margin line（17）, internal edge line（16）, two lines are true
Fixed region therebetween（18）Profile, include lower jaw, eyes, pupil, face characteristic point according to the corresponding points of picture figure and figure
The corresponding relation in position of two images is determined, wherein the former is the face-image of camera array group capture, and the latter is to provide
Front facial image image；The former region of two lines determination therebetween is cut from latter image（18）Middle correspondence is schemed in the latter
The local area image of picture, and added in the former image, will because the region keeps static in facial general expression
This region static faces image is combined with other position dynamic videos according to position correspondence relation, is combined into one as dynamic is completed
Video face；
Camera a（1）, camera b（10）It is arranged at the interior zone of the vr glasses of corresponding left eye position, camera a（1）, take the photograph
As head b（10）Positioned at lenses a（6）Upper and lower both sides are set, and infrared camera is set towards eyeball pupil position, infrared to take the photograph
As head b（3）It is arranged at left eye and corresponds to lenses（6）Edge；
Camera a1（2）, camera b2（9）It is arranged at the vr glasses interior zones of corresponding left eye position, camera a1（2）, take the photograph
As head b1（9）Positioned at lenses c（7）Upper and lower both sides are set, and infrared camera is set towards eyeball pupil position, infrared to take the photograph
As head b1（8）It is arranged at right eye and corresponds to lenses c（7）Edge；
Frame on the downside of vr glasses（11）Adjacent edge（5）Place sets camera c（4）Camera d（12）, camera c（4）, shooting
Head d（12）It is symmetrical arranged along center position between left and right, capture images direction direction face；
Frame on the upside of vr glasses（15）Adjacent edge（14）Place sets camera f（23）, upside frame（15）Edge（14）Above
Camera f is set at along symmetrical point（23）, its capture images direction direction face；
Above equipment is arranged on facial positions according to camera and corresponded to, and its capture images of split, is spliced into full facial, completes
The capture of full facial image, it is specifically：
Camera a（1）, camera b（10）The eyes nasal bridge region image inside vr glasses is captured,
Camera a1（2）, camera b2（9）The eyes nasal bridge region image inside vr glasses is captured,
Infrared camera b（3）Infrared camera b1（8）It is responsible for,
Camera c（4）, camera d（12）The following station diagram picture of facial zone vr glasses of vr glasses state servants is worn in capture,
Camera f（23）Forehead image is captured,
Camera c（4）, camera d（12）The following station diagram picture of facial zone vr glasses of vr glasses state servants is worn in capture,
And by camera c（4）, camera d（12）Capture wears the facial zone vr glasses of vr glasses state servants with lower portion
Image, the facial zone image at this capped position of the correspondence cut out, the internal edge line of vr glasses fitting face（16）With
It is interior by camera a（1）, camera b（10）Capture the eyes nasal bridge region image inside vr glasses, camera a1（2）, shooting
Head b2（9）The eyes nasal bridge region image inside vr glasses is captured, in split camera f（23）Capture forehead image and will more than
Full facial image, then computer generation ear, hair and neck correspondence and face are synthesized after partial dynamic image split one
Portion's image is spliced, final to synthesize entire header picture, head portrait be combined with computer synthesis image section include hair, ear,
Entire header picture of the neck synthesis with complete head member, 3 shaft angle degree of the head anglec of rotation can be measured i.e. by setting on glasses
Change in location captures sensor；
It is final to be shown to vr glasses left eye, on right eye screen or on display, it can be connected by network remote and be sent to a distant place
Vr glasses left eye, the screen of right eye；
Camera f（23）Towards face, because forehead position changes very small can almost ignore not in normal expression hypograph
Meter, therefore select camera f（23）The tableaux at shooting forehead position replaces dynamic menu, by camera f（23）The static state of bat
Brow portion picture is synthesized in left eye face-image, is now adjusted camera f（23）In front of face orientation, camera f
（23）180 degree can be rotated, visual angle is shot backwards to face, towards front in reverse direction, camera f（23）Front can be captured
Images of gestures is simultaneously identified to gesture and obtains the manipulation instruction based on gesture change, while towards the camera c of face shots（4）
Camera d（12）, camera c（4）Camera d（12）One group of 3d image pickup head is collectively formed, and oral area shape can be obtained
Real-time change and lower jaw upper jaw position real time kinematics modified-image, using the image of shooting judging and identify oral area
The corresponding text information sent, and text information can be changed into the instruction of control operation；It will can be imaged in addition to this scheme
Head c（4）Camera d（12）Synchronous rotary 180 degree, visual angle is facial backwards in reverse direction, is shot towards front, camera c（4）Take the photograph
As head d（12）Front images of gestures can be captured and gesture be identified acquisition base by collectively forming one group of 3d image pickups head
In the manipulation instruction of gesture change；
Alternative plan
2. a kind of vr eyewear faces 3d images, plane picture capture and gesture capture systems, including：Camera group, vr glasses, its
It is characterised by：A Front facial image is first provided, array camera group captures whole face-image, and vr glasses are due to covering and being close to
Face, it is close to facial zone（18）Picture can not be obtained, and thus corresponding position is supplemented in the mug shot of preceding offer；
Vr glasses are close to facial zone（18）The color of part is that both green or blueness select one；
Obtained by camera array group and be bonded facial external margin line（17）, internal edge line（16）, both two lines determinations
Between region（18）Profile, determined according to the corresponding points of picture figure and figure including the characteristic point such as lower jaw, eyes, pupil, face
The corresponding relation in position of two images, it is therein the former be camera array group capture face-image the latter be to provide just
Face head portrait image, cuts the region between the former two lines from latter image（18）In corresponding local face-image, supplement
Into the former image, because the region keeps static in facial general expression, by image in this region still image and video
With reference to being combined into one turns into completion dynamic video face；
Camera a（1）, camera b（10）It is arranged at the vr glasses interior zones of corresponding left eye position, camera a（1）, shooting
Head b（10）Positioned at lenses a（6）Upper and lower both sides are set, and infrared camera is set towards eyeball pupil position, infrared photography
Head b（3）It is arranged at left eye and corresponds to lenses（6）Edge；
Camera a1（2）, camera b2（9）It is arranged at the vr glasses interior zones of corresponding left eye position, camera a1（2）, take the photograph
As head b1（9）Positioned at lenses c（7）Upper and lower both sides are set, and infrared camera is set towards eyeball pupil position, infrared to take the photograph
As head b1（8）It is arranged at right eye and corresponds to lenses c（7）Edge；
Frame on the downside of vr glasses（11）Edge（5）Upper setting camera n（19）, camera n（19）, along center between left and right
Point position is set, capture images direction direction face；
Frame on the upside of vr glasses（15）Edge（14）Upper setting camera f（23）, upside frame（15）Edge（14）Above along a left side
Camera f is set at right symmetric points（23）, its capture images direction direction face；
Camera a（1）, camera b（10）Infrared camera b（3）Collectively form 3d camera groups, infrared camera b（3）Pass through
The 3d profiles at position are shot at infrared light reflection capture again by 3d profiles and camera a（1）, camera b（10）It is synthetically generated 3d
Eyes and the bridge of the nose, vr glasses in eyebrow uncovered area position 3d visual images,
Camera a1（2）, camera b2（9）, infrared camera b1（8）Collectively form 3d camera groups, infrared camera b（3）
By shooting the 3d profiles at position at infrared light reflection capture again by 3d profiles and camera a（1）, camera b（10）Synthesis life
Eyebrow uncovered area position 3d visual images in eyes and the bridge of the nose, vr glasses into 3d,
It is bonded facial external margin line（17）, internal edge line（16）, the region of two lines determination therebetween（18）Profile
The still image of supplement,
Camera n（19）The following station diagram picture of facial zone vr glasses for wearing vr glasses state servants of shooting,
Camera f（23）Shooting capture forehead image,
By images above according to the split of face correspondence position generate complete face-image, then computer generation ear, hair with
Final to synthesize entire header picture and neck is corresponded to and spliced with face-image, head portrait is combined with the image section of computer synthesis
Including hair, ear, entire header picture of the neck synthesis with complete head member, the head anglec of rotation can be measured by being set on glasses
3 axle angular transducers and change in location the capture sensor of degree；When being intended to obtain posture face 3d images in front of non-face, root
The local 3d face-images of generation are handled by calculating according to the face-image of split camera capture, including：Two cheeks, forehead, nose
These move less region to son during speaking, by the nose and two cheeks, forehead of 3d angle changings, with the head captured
It is corresponding with lips face, eyes afterwards that portion's rotation corresponding angle synthesizes facial topography corresponding to corresponding visual angle in real time
The dynamic realtime 3d images for handling to obtain by computer calculating combine；When the face-image of front posture is faced on head to be obtained
When, the 3d that image is not carried out to image is calculated, but according to the position correspondence split of setting, its capture is schemed by above camera
Picture, full facial is spliced into, completes the capture of full facial image, it is corresponding to generate ear, hair and neck in computer
Spliced with face-image, final to synthesize entire header picture, the image section that head portrait is combined with computer synthesis includes hair, ear
Piece, entire header picture of the neck synthesis with complete head member and be finally shown to vr glasses left eye, on right eye screen, Ke Yitong
Cross left eye, the screen of right eye that network remote connection is sent to the vr glasses in a distant place；
Camera f（23）Towards face, because forehead position changes very small can almost ignore not in normal expression hypograph
Meter, therefore select camera f（23）The tableaux at captured forehead position replaces dynamic menu, by camera f（23）That claps is quiet
State brow portion picture is synthesized in left eye face-image, is now adjusted camera f（23）In front of facial face orientation, take the photograph
As head f（23）Can be with synchronous rotary 180 degree, visual angle is facial backwards in reverse direction, is shot towards front, camera m（23）Can be with
Capture front images of gestures and gesture is identified and obtain the manipulation instruction based on gesture change, while towards face shots
Camera n（19）The real-time change of oral area shape and the real time kinematics modified-image at lower jaw upper jaw position can be obtained, is utilized
Text information can be changed into the finger of control operation by shooting image to judge and identify text information that oral area is correspondingly sent
Order；Can be by camera n in addition to this scheme（19）180 degree can be rotated, visual angle is clapped backwards to face, towards front in reverse direction
Take the photograph, camera n（19）Front images of gestures can be captured and gesture is identified manipulation of the acquisition based on gesture change and referred to
Order；
Third program
3. a kind of vr eyewear faces 3d images, plane picture capture and gesture capture systems, including：Camera group, vr glasses, its
It is characterised by：A Front facial image is first provided, array camera group captures whole face-image, and vr glasses are due to covering and being close to
Face, it is close to facial zone（18）Picture can not be obtained, and thus corresponding position is supplemented in the mug shot of preceding offer；
Vr glasses are close to facial zone（18）The color of part is that both green or blueness select one；
Obtained by camera array group and be bonded facial external margin line（17）, internal edge line（16）, both two lines determinations
Between region（18）, two are determined including the characteristic point such as lower jaw, eyes, pupil, face according to the corresponding points of picture figure and figure
The corresponding relation in position of image, wherein the former is the Front facial image that is to provide of face-image the latter of camera array group capture
Image, the region between the former two lines is cut from latter image（18）In corresponding local face-image, add to the former
In image, because the region keeps static in facial general expression, this region still image is combined with image in video, closed
Two be one facial as dynamic video is completed；
Camera a（1）, camera b（10）It is arranged at the vr glasses interior zones of corresponding left eye position, camera a（1）, shooting
Head b（10）Positioned at lenses a（6）Upper and lower both sides are set, and infrared camera is set towards eyeball pupil position, infrared photography
Head b（3）It is arranged at left eye and corresponds to lenses（6）Edge；
Camera a1（2）, camera b2（9）It is arranged at the vr glasses interior zones of corresponding left eye position, camera a1（2）, take the photograph
As head b1（9）Positioned at lenses c（7）Upper and lower both sides are set, and infrared camera is set towards eyeball pupil position, infrared to take the photograph
As head b1（8）It is arranged at right eye and corresponds to lenses c（7）Edge；
Frame on the downside of vr glasses（11）Edge（5）The assembly of upper setting 3d cameras and visible image capturing head（20）, 3d takes the photograph
As head and the assembly of visible image capturing head（20）, along between left and right center position set, capture images direction towards face；
Frame on the upside of vr glasses（15）Edge（14）On set the assembly b of 3d cameras and visible image capturing head（71）, upper side edge
Frame（15）Edge（14）The assembly b of 3d cameras and visible image capturing head is set along symmetrical point above（72）, it is caught
Image direction is obtained towards face；3d cameras therein capture facial 3d contour structures, and light image is will be seen that according to 3d profiles
Synthesize 3d images；
According to 3d cameras and the assembly b of visible image capturing head（71）The image and 3d cameras and visible image capturing of shooting
The assembly of head（20）The image of shooting and by camera a（1）, camera b（10）Infrared camera b（3）Collectively form 3d
Camera group, infrared camera b（3）By shooting the 3d profiles at position at infrared light reflection capture again by 3d profiles and camera
a（1）, camera b（10）It is synthetically generated eyebrow uncovered area position 3d Visual Graphs in the eyes and the bridge of the nose, vr glasses of solid
Picture, by camera a1（2）, camera b2（9）, infrared camera b1（8）Collectively form 3d camera groups, infrared camera b（3）
By shooting the 3d profiles at position at infrared light reflection capture again by 3d profiles and camera a（1）, camera b（10）Synthesis life
Eyebrow uncovered area position 3 D visible image, images above are 3d images in eyes and the bridge of the nose, vr glasses into 3d, will
Above 3d images are faced when being intended to obtain and non-face front appearance according to corresponding shooting facial positions again split full facial image
During gesture face 3d images, by above 3d images according to corresponding shooting facial positions again split face-image by calculating processing life
Into the 3d face-images of the different visual angles of part, including：Two cheeks, forehead, nose, face, chin these do not covered by vr glasses
Region, after synthesizing facial topography corresponding to corresponding visual angle in real time with the end rotation corresponding angle captured afterwards
With edge line（17）, internal edge line（16）, the region of two lines determination therebetween（18）In overlay area generation benefit
The real-time 3d images of the regional dynamics that image correspondingly handles to obtain by computer progress 3d calculating are filled, by above station diagram picture pair
Answer split one figure in position to obtain full facial 3d images, be finally shown to vr glasses left eye, on right eye screen, net can be passed through
Network remotely connects left eye, the screen of right eye for the vr glasses for being sent to a distant place；
Utilize 3d cameras and the assembly of visible image capturing head（20）3d cameras thereon can capture the solid of oral area
Change, using 3d images to judge and identify text information that oral area is correspondingly sent, and text information can be changed into control
The instruction of operation；In addition, the assembly of 3d cameras and visible image capturing head（20）With 3d cameras and visible image capturing head
Assembly b（71）3d cameras can rotate 180 degree, in reverse direction visual angle backwards to face, towards front shoot, can capture
Manipulation of the acquisition based on gesture change is identified to front images of gestures and to gesture to refer to；
Scheme four
4. a kind of vr eyewear faces 3d images, plane picture capture and gesture capture systems, including：Camera group, vr glasses,
It is characterized in that：Two head portraits are first provided, wherein one is camera and is located at the shooting of facial left front position with the bat of positive angle
Take the photograph, wherein one is camera and is located at the shooting of facial one o'clock position to face angle shot, the capture of array camera group is entirely
Face-image, vr glasses are close to facial zone due to covering and being close to face（18）Picture can not obtain, thus the face of preceding offer
Corresponding position is supplemented in portion's photo；
Vr glasses are close to facial zone（18）Facial contact part（121）Color be green or blueness the two select one；
Two head photos are uploaded, wherein a camera site for requiring camera is located at the shooting of facial leftward position, wherein separately
One camera site for requiring camera is shot positioned at face right side；
Vr glasses are obtained by camera array group and are bonded facial external margin line（17）, internal edge line（16）, two lines are true
Fixed region therebetween（18）, included according to the corresponding points of picture figure and figure：The characteristic points such as lower jaw, eyes, pupil, face are true
The corresponding relation in position of fixed two images, two above image refer to that camera array group captures and splices the face of synthesis
Portion's image and the head portrait provided before, the former is the head portrait figure that face-image the latter of camera array group capture is to provide
Picture, the region between the former two lines is cut from latter image（18）In corresponding local face-image, add to the former figure
As in, because the region keeps static in facial general expression, by this region static faces image and other position dynamic visions
Frequency combines according to position correspondence relation, is combined into one as dynamic video face is completed；
Wherein left eye camera A (104) shooting images and left eye camera B (126) shooting images and edge line（17）, it is internal
Edge line（16）, the region of two lines determination therebetween（18）, the corresponding figure positioned at the shooting of facial right positions by uploading
As supplement, and the camera camera C inside vr glasses（101）The left eye eye first half image and camera of the people of shooting
H（110）The left eye eye lower half image of the people of shooting, camera C1（102）The right eye eye first half image of the people of shooting,
Camera H1（109）The right eye eye lower half image of the people of shooting synthesizes a breadth portion figure jointly by images above by splicing
Picture, the face being finally synthesizing is generated ear, hair and neck and corresponded to by computer again to be spliced with face-image, final to close
Into entire header picture, we it be referred to as left eye face-image, the image shows that the image can in the screen that vr glasses correspond to left eye
To be sent to the left eye of vr glasses in a distant place by network remote connection, show on the screen of right eye；
Wherein right eye camera A1 (112) shooting images and right eye camera B1 (125) shooting images and edge line（17）, it is interior
Portion's edge line（16）, the region of two lines determination therebetween（18）, it is corresponding to be located at what facial right positions were shot by what is uploaded
Image supplements, and the camera camera C inside vr glasses（101）The left eye eye first half image of the people of shooting and shooting
Head H（110）The left eye eye lower half image of the people of shooting, camera C1（102）The right eye eye first half figure of the people of shooting
Picture, camera H1（109）The right eye eye lower half image of the people of shooting synthesizes a breadth jointly by images above by splicing
The face that portion's image eventually forms is generated ear, hair and neck and corresponded to by computer again to be spliced with face-image, I
It is referred to as right eye face-image, the image is shown in the screen that vr glasses correspond to right eye, and the image can pass through net
Remotely connection is sent to the left eye of vr glasses in a distant place, shown on the screen of right eye network；
Left eye camera A (104), left eye camera B (126), sensitive chip is arranged in parallel；
Right eye camera A1 (112), right eye camera B1 (125) sensitive chip are arranged in parallel；
Left eye camera A (104), right eye camera A1 (112), are arranged at lower frame A（111）, the two edge is between left and right away from
Heart point A (105) is symmetrical arranged, and is located at lower frame A（111）Close on the edge A of front side（128）Place is set；
Left eye camera B (126), right eye camera B1 (125), are arranged at upper side frame A（115）, the two edge is between left and right away from
Heart point A（127）It is symmetrical arranged and is located at upper side frame A（115）Close on the edge A of front side（129）Place is set；
Camera C（101）, camera H（110）It is arranged at the interior zone of the vr glasses of corresponding left eye position, camera C
（101）, camera H（110）Positioned at lenses A（106）Upper and lower both sides are set, and infrared camera is towards eyeball pupil position
Set, infrared camera B（103）It is arranged at left eye and corresponds to lenses A（106）Edge；
Camera C1（2）, camera H2（109）It is arranged at the vr glasses interior zones of corresponding left eye position, camera C1
（102）, camera H1（109）Positioned at lenses C（107）Upper and lower both sides are set, and infrared camera is towards eyeball pupil position
Set, infrared camera B1（108）It is arranged at right eye and corresponds to lenses C（107）Edge；
Left eye camera A (104), left eye camera B (126), right eye camera A1 (112), right eye camera B1 (125) face phase
The face shots of people；
Scheme five
5. a kind of vr eyewear faces 3d images, plane picture capture and gesture capture systems, including：Camera group, vr glasses, its
It is characterised by：Two head portraits are first provided, wherein one is camera and is located at the shooting of facial left front position to face angle shot,
Wherein one is that camera is located at the shooting of facial one o'clock position to face angle shot, the whole face of array camera group capture
Image, vr glasses are close to facial zone due to covering and being close to face（18）Picture can not obtain, thus the face photograph of preceding offer
Corresponding position is supplemented in piece；
Vr glasses are close to facial zone（18）Facial contact part A（121）Color be green or blueness the two select one；
Two head photos are uploaded, wherein a camera site for requiring camera is located at the shooting of facial leftward position, wherein separately
One camera site for requiring camera is shot positioned at face right side；
Vr glasses are obtained by camera array group and are bonded facial external margin line（17）, internal edge line（16）, two lines are true
Fixed region therebetween（18）, it is true to include the characteristic point such as lower jaw, eyes, pupil, face according to the corresponding points of picture figure and figure
The corresponding relation in position of fixed two images, two images are that camera array group captures and splices the face-image of synthesis,
The head portrait provided before, the former is the head portrait image that face-image the latter of camera array group capture is to provide, and is schemed from the latter
The region between the former two lines is cut as in（18）In corresponding local face-image, add in the former image because should
Region keeps static in facial general expression, by this region static faces image and other position dynamic videos according to position pair
Combination should be related to, be combined into one as dynamic video face is completed；
Left eye camera A (104), left eye camera B (126), sensitive chip is arranged in parallel；
Right eye camera A1 (112), right eye camera B1 (125) sensitive chip are arranged in parallel；
Left eye camera A (104), right eye camera A1 (112), are arranged at lower frame A（111）, the two edge is between left and right away from
Heart point A (105) is symmetrical arranged, and is located at lower frame A（111）Close on the edge A of front side（128）Place is set；
Left eye camera B (126), right eye camera B1 (125), are arranged at upper side frame A（115）, the two edge is between left and right away from
Heart point A（127）It is symmetrical arranged and is located at upper side frame A（115）Close on the edge A of front side（129）Place is set；
Camera C（101）, camera H（110）It is arranged at the interior zone of the vr glasses of corresponding left eye position, camera C
（101）, camera H（110）Positioned at lenses A（106）Upper and lower both sides are set, and infrared camera is towards eyeball pupil position
Set, infrared camera B（103）It is arranged at left eye and corresponds to lenses A（106）Edge；
Camera C1（102）, camera H2（109）It is arranged at the vr glasses interior zones of corresponding left eye position, camera C1
（102）, camera H1（109）Positioned at lenses C（107）Upper and lower both sides are set, and infrared camera is towards eyeball pupil position
Set, infrared camera B1（108）It is arranged at right eye and corresponds to lenses C（107）Edge；
Left eye camera A (104), left eye camera B（126）, right eye camera A1（112）Right eye camera B1（125）Set
In on upper side frame and lower frame, upper side frame is with lower frame each parallel to horizontal plane, left eye camera A（104）, left eye camera B
（126）, right eye camera A1（112）Right eye camera B1（125）It can be revolved along connector in 180 degree and in the horizontal direction
Turn, can be by can be manually rotated, left eye camera A（104）, left eye camera B（126）, right eye camera A1（112）, right eye shooting
Head B1（125）Rotary shaft is set between the upper side frame, lower frame with vr glasses and by rotating axis connection；
Left eye camera A（104）, left eye camera B（126）, right eye camera A1（112）Right eye camera B1（125）Can be with
Rotate in 180 degree and in the horizontal direction along connector and by the scheme of driven by power controlling party be：Each it is arranged on upper side frame A
（111）Or lower frame A（115）Camera upper side frame A is fixed by motor below（111）Or A on lower frame
（115）, camera is fixed on the rotor of motor, stator and upper side frame A（111）Or lower frame A（115）Fixed, motor drives
Move and control camera relative to upper side frame A（111）Or lower frame A（115）Rotation, motor drive and control camera relative to
Upper side frame rotates；
Camera C1（102）, camera H2（109）, infrared camera B1（108）Collectively form 3d camera groups, infrared photography
Head B1（108）By shooting the 3d profiles at position at infrared light reflection capture again by 3d profiles and camera C1（102）, camera
H2（109）The image of shooting is synthetically generated eyebrow uncovered area position 3d visual images in 3d eyes and the bridge of the nose, vr glasses,
Camera C（101）, camera H（110）, infrared camera B（103）Collectively form 3d camera groups, infrared camera B（103）
By shooting the 3d profiles at position at infrared light reflection capture again by 3d profiles and camera C（101）, camera H（110）Shooting
Image be synthetically generated eyebrow uncovered area position 3d visual images in 3d eyes and the bridge of the nose, vr glasses, due to eyes and
The bridge of the nose is that the picture of eyebrow regional area varies less, and the obvious region of its image change is only eyeball and eyelid, infrared photography
Head B（103）Simultaneously to judge that the state opened or opened of eyes, and the left and right upper and lower displacement of eyeball are moved, eye is established
The 3d modelings of ball, and the image of real-time rendering eyeball, only changed in position and update a frame eyeball image constantly and by image
It is synthesized in the eyes for being synthetically generated 3d and the bridge of the nose, vr glasses in the 3d visual images of eyebrow uncovered area position, in general shape
Under state calculation resources it is limited or compared with the low-frequency eyes for being synthetically generated 3d and the bridge of the nose are only carried out under low state, eyebrow in vr glasses
Uncovered area position 3d visual images 1-30 frames per second and only in infrared camera B（103）The eyeball position hair captured
A new two field picture is updated during changing, renders the image eyes and nose of the 3d modelings of closed-eye state automatically when recognizing eye closing
Eyebrow uncovered area position in beam, vr glasses, therefore also to establish eyebrow uncovered area portion in eyes and the bridge of the nose, vr glasses
The 3d of position is modeled to be rendered when closing one's eyes；By the above-mentioned corresponding image aspects and left eye camera A for generating the image with rendering
（104）, left eye camera B（126）, real-time synchronization corresponding rotation and in real time corresponding to the image aspects of angle be consistent,
And the two split is gone out with real-time rendering again and left eye camera A（104）, left eye camera B（126）Consistent visual angle to edge
Line（17）, internal edge line（16）Two lines determine region therebetween（18）3d Image Mosaics, the face being finally synthesizing is again
Corresponded to and spliced with face-image by computer generation ear, hair and neck, it is final to synthesize entire header picture and then acquisition
And generate the 3d face-images in different angle and correspond to this image including on the left side plan of vr glasses；
To edge line（17）, internal edge line（16）Two lines determine region therebetween（18）It is corresponding to be located at face by what is uploaded
The image supplement of portion's right positions shooting carries out two with the corresponding image supplement positioned at the shooting of facial leftward position by uploading
Figure progress 3d calculates the 3d images in the Static planar 180 degree angular field of view in the processing acquisition region, and real-time rendering goes out and a left side
Eye imaging head A（104）, left eye camera B（126）Consistent visual angle to edge line（17）, internal edge line（16）Two lines are true
Fixed region therebetween（18）3d images；
Camera C1（102）, camera H2（109）, infrared camera B1（108）Collectively form 3d camera groups, infrared photography
Head B1（108）By shooting the 3d profiles at position at infrared light reflection capture again by 3d profiles and camera C1（102）, camera
H2（109）The image of shooting is synthetically generated eyebrow uncovered area position 3d visual images in 3d eyes and the bridge of the nose, vr glasses,
Camera C（101）, camera H（110）, infrared camera B（103）Collectively form 3d camera groups, infrared camera B（103）
By shooting the 3d profiles at position at infrared light reflection capture again by 3d profiles and camera C（101）, camera H（110）Shooting
Image be synthetically generated eyebrow uncovered area position 3d visual images in 3d eyes and the bridge of the nose, vr glasses, due to eyes and
The bridge of the nose is that the picture of eyebrow regional area varies less, and the obvious region of its image change is only eyeball and eyelid, infrared photography
Head B（103）, infrared camera B1（108）While to judge the state opened or opened of eyes, and on the left and right of eyeball
Lower section displacement is moved, and is established the 3d modelings of eyeball, and the image of real-time rendering eyeball, is only changed and updated constantly newly in position
Image is simultaneously synthesized to eyebrow uncovered area position 3d in the eyes for being synthetically generated 3d and the bridge of the nose, vr glasses by one frame eyeball image
In visual image, calculation resources are limited or compared with only carrying out low-frequency eyes for being synthetically generated 3d under low state under general state
And eyebrow uncovered area position 3d visual images 1-30 frames per second and only in infrared camera B in the bridge of the nose, vr glasses
（103）, infrared camera B1（108）A new two field picture is updated when the eyeball position captured changes, is closed when recognizing
Eyebrow uncovered area position in the image eyes and the bridge of the nose, vr glasses of the 3d modelings of closed-eye state is at the moment rendered automatically, therefore
Also the 3d in eyes and the bridge of the nose, vr glasses under the closed-eye state at eyebrow uncovered area position is established to model to when closing one's eyes
Render because it is usually that need not render 3d modelings under accurate image and each closed-eye state of acquiescence moment not send out to close one's eyes
Changing, above-mentioned correspondence generates, the image aspects and left eye camera A of the image that render（104）, left eye camera B（126）Clap
The real-time synchronization corresponding rotation taken the photograph and in real time corresponding to the image aspects of angle be consistent, and will the two split again with real-time wash with watercolours
Dye and left eye camera A（104）, left eye camera B（126）Consistent visual angle to edge line（17）, internal edge line（16）
Two lines determine region therebetween（18）3d Image Mosaics, the face being finally synthesizing generate ear, hair by computer again
It is final to synthesize entire header picture and then obtain and generate in the 3d faces of different angle and neck is corresponded to and spliced with face-image
Portion's image is simultaneously corresponding including in the left screen of vr glasses by this image；
To edge line（17）, internal edge line（16）Two lines determine region therebetween（18）It is corresponding to be located at face by what is uploaded
The image supplement of portion's right positions shooting carries out two with the corresponding image supplement positioned at the shooting of facial leftward position by uploading
Figure progress 3d calculates the 3d images in the Static planar 180 degree angular field of view in the processing acquisition region, and real-time rendering goes out and a left side
Eye imaging head A（104）, left eye camera B（126）Consistent visual angle to edge line（17）, internal edge line（16）Two lines are true
Fixed region therebetween（18）3d images；
Camera C1（102）, camera H2（109）, infrared camera B1（108）Collectively form 3d camera groups, infrared photography
Head B1（108）By shooting the 3d profiles at position at infrared light reflection capture again by 3d profiles and camera C1（102）, camera
H2（109）The image of shooting is synthetically generated eyebrow uncovered area position 3d visual images in 3d eyes and the bridge of the nose, vr glasses,
Camera C（101）, camera H（110）, infrared camera B（103）Collectively form 3d camera groups, infrared camera B（103）
By shooting the 3d profiles at position at infrared light reflection capture again by 3d profiles and camera C（101）, camera H（110）Shooting
Image be synthetically generated eyebrow uncovered area position 3d visual images in 3d eyes and the bridge of the nose, vr glasses, due to eyes and
The bridge of the nose is that the picture of eyebrow regional area varies less, and the obvious region of its image change is only eyeball and eyelid, infrared photography
Head B（103）, infrared camera B1（108）While to judge the state opened or opened of eyes, and on the left and right of eyeball
Lower section displacement is moved, and is established the 3d modelings of eyeball, and the image of real-time rendering eyeball, is only changed and updated constantly newly in position
Image is simultaneously synthesized to eyebrow uncovered area position 3d in the eyes for being synthetically generated 3d and the bridge of the nose, vr glasses by one frame eyeball image
In visual image, calculation resources are limited or compared with only carrying out low-frequency eyes for being synthetically generated 3d under low state under general state
And eyebrow uncovered area position 3d visual images 1-30 frames per second and only in infrared camera B in the bridge of the nose, vr glasses
（103）, infrared camera B1（108）A new two field picture is updated when the eyeball position captured changes, is closed when recognizing
Eyebrow uncovered area position in the image eyes and the bridge of the nose, vr glasses of the 3d modelings of closed-eye state is at the moment rendered automatically, therefore
Also the 3d in eyes and the bridge of the nose, vr glasses under the closed-eye state at eyebrow uncovered area position is established to model to when closing one's eyes
Render because it is usually that need not render 3d modelings under accurate image and each closed-eye state of acquiescence moment not send out to close one's eyes
Changing, above-mentioned correspondence generates, the image aspects and left eye camera right eye camera A1 of the image that render（112）Taken the photograph with right eye
As head B1（125）
The real-time synchronization corresponding rotation of shooting and in real time corresponding to the image aspects of angle be consistent, and will the two split again with
Real-time rendering goes out and left eye camera right eye camera A1（112）With right eye camera B1（125）
Consistent visual angle to edge line（17）, internal edge line（16）Two lines determine region therebetween（18）3d images are spelled
Close, the face being finally synthesizing is generated ear, hair and neck and corresponded to by computer again to be spliced with face-image, final to close
Into entire header picture and then obtain and generate the 3d face-images in different angle and include this image is corresponding on the right side of vr glasses
On the screen of side；
To edge line（17）, internal edge line（16）Two lines determine region therebetween（18）It is corresponding to be located at face by what is uploaded
The image supplement of portion's right positions shooting carries out two with the corresponding image supplement positioned at the shooting of facial leftward position by uploading
Figure progress 3d calculates the 3d images in the Static planar 180 degree angular field of view in the processing acquisition region, and real-time rendering goes out and the right side
Eye imaging head A1（112）With right eye camera B1（125）
Consistent visual angle to edge line（17）, internal edge line（16）Two lines determine region therebetween（18）3d images；
By the screen display before corresponding images of left and right eyes, band is given different angle and sees that the facial vision of people is imitated by image
Fruit, left eye, the screen of right eye of the vr glasses for being sent to a distant place can be connected by network remote；
The connected mode of camera and vr glasses can be following pattern：Annular peripheral frame A is set（77）, the inward flange A of frame
（66）Shape is consistent with the outward flange size of vr glasses, and the inward flange of annular peripheral frame can be enclosed on the outward flange A of vr glasses（88）
On, it is fixed on annular peripheral frame；
Two camera left eye camera B (126), right eye camera B1 (125) are towards face, because forehead position is in normal table
The variation of feelings hypograph is very small almost to be can be ignored, therefore selects camera left eye camera B (126), right eye camera B1
(125) tableaux for shooting forehead position replaces dynamic menu, and the static brow portion that left eye camera B (126) is clapped is drawn
Face synthesis is schemed in left eye face-image, the static brow portion picture synthesis that right eye camera B1 (125) is clapped in right eye face
Picture, now adjust two camera left eye camera B (126), right eye camera B1 (125) before facial face orientation
Side, two cameras can be with synchronous rotary 180 degree, and visual angle is facial backwards in reverse direction, is shot towards front, dual camera left eye
Camera B (126), right eye camera B1 (125) form 3d cameras, can capture front images of gestures and gesture is carried out
Identification obtains the manipulation instruction based on gesture change, while is formed towards two camera left eye camera A (104) of face shots
A pair of 3d cameras can obtain the real-time change of oral area shape and the real time kinematics modified-image at lower jaw upper jaw position, utilize
Text information can be changed into control operation by interpretation 3d images to judge and identify text information that oral area is correspondingly sent
Instruction；Can be synchronous by (112) two left eye camera A (104), right eye camera A1 cameras in addition to this scheme
180 degree is rotated, visual angle is shot backwards to face, towards front in reverse direction, dual camera left eye camera A (104), right eye shooting
Head A1 (112), which can capture front images of gestures and gesture is identified, obtains the manipulation instruction based on gesture change.
Applications Claiming Priority (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610408021 | 2016-06-12 | ||
| CN2016104080199 | 2016-06-12 | ||
| CN201610408019 | 2016-06-12 | ||
| CN2016104080216 | 2016-06-12 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107491165A true CN107491165A (en) | 2017-12-19 |
Family
ID=60643350
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710440211.0A Pending CN107491165A (en) | 2016-06-12 | 2017-06-12 | A kind of vr eyewear faces 3d images, plane picture capture and gesture capture systems |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107491165A (en) |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107932527A (en) * | 2017-12-25 | 2018-04-20 | 深圳艾比仿生机器人科技有限公司 | Bionical eye |
| WO2019041992A1 (en) * | 2017-08-30 | 2019-03-07 | 歌尔股份有限公司 | Image processing method and device and terminal device |
| WO2019178276A1 (en) | 2018-03-13 | 2019-09-19 | Ronald Winston | Virtual reality system and method |
| CN110827414A (en) * | 2019-11-05 | 2020-02-21 | 江西服装学院 | Virtual digital library experience device based on VR technique |
| US10838203B2 (en) | 2018-07-17 | 2020-11-17 | Apple Inc. | Adjustable electronic device system with facial mapping |
| CN112596605A (en) * | 2020-12-14 | 2021-04-02 | 清华大学 | AR (augmented reality) glasses control method and device, AR glasses and storage medium |
| WO2021227916A1 (en) * | 2020-05-09 | 2021-11-18 | 维沃移动通信有限公司 | Facial image generation method and apparatus, electronic device, and readable storage medium |
| CN114564100A (en) * | 2021-11-05 | 2022-05-31 | 南京大学 | Free stereoscopic display hand-eye interaction method based on infrared guidance |
| WO2022110752A1 (en) * | 2020-11-30 | 2022-06-02 | 华为技术有限公司 | Image processing method, server, and virtual reality device |
| US20220343471A1 (en) * | 2019-11-12 | 2022-10-27 | Sony Semiconductor Solutions Corporation | Electronic apparatus |
| US11551427B2 (en) | 2017-08-30 | 2023-01-10 | Ronald H. Winston | System and method for rendering virtual reality interactions |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2007289683A (en) * | 2006-03-31 | 2007-11-08 | Hoya Corp | Glasses wearing parameter measuring instrument, glasses wearing parameter measuring method, glasses lens manufacturing method and glasses manufacturing method |
| CN201903695U (en) * | 2010-08-31 | 2011-07-20 | 夏翔 | Wireless IoT (Internet of Things) glasses |
| CN103020579A (en) * | 2011-09-22 | 2013-04-03 | 上海银晨智能识别科技有限公司 | Face recognition method and system, and removing method and device for glasses frame in face image |
| CN103853071A (en) * | 2014-01-20 | 2014-06-11 | 南京升泰元机器人科技有限公司 | Human-computer facial expression interaction system based on biological signal |
| CN204483185U (en) * | 2015-03-02 | 2015-07-22 | 兰州交通大学 | A kind of wireless helmet facial expression trap setting |
-
2017
- 2017-06-12 CN CN201710440211.0A patent/CN107491165A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2007289683A (en) * | 2006-03-31 | 2007-11-08 | Hoya Corp | Glasses wearing parameter measuring instrument, glasses wearing parameter measuring method, glasses lens manufacturing method and glasses manufacturing method |
| CN201903695U (en) * | 2010-08-31 | 2011-07-20 | 夏翔 | Wireless IoT (Internet of Things) glasses |
| CN103020579A (en) * | 2011-09-22 | 2013-04-03 | 上海银晨智能识别科技有限公司 | Face recognition method and system, and removing method and device for glasses frame in face image |
| CN103853071A (en) * | 2014-01-20 | 2014-06-11 | 南京升泰元机器人科技有限公司 | Human-computer facial expression interaction system based on biological signal |
| CN204483185U (en) * | 2015-03-02 | 2015-07-22 | 兰州交通大学 | A kind of wireless helmet facial expression trap setting |
Cited By (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11551427B2 (en) | 2017-08-30 | 2023-01-10 | Ronald H. Winston | System and method for rendering virtual reality interactions |
| WO2019041992A1 (en) * | 2017-08-30 | 2019-03-07 | 歌尔股份有限公司 | Image processing method and device and terminal device |
| US11295550B2 (en) | 2017-08-30 | 2022-04-05 | Goertek Inc. | Image processing method and apparatus, and terminal device |
| US12067686B2 (en) | 2017-08-30 | 2024-08-20 | Ronald H. Winston | System and method for rendering virtual reality interactions |
| CN107932527B (en) * | 2017-12-25 | 2024-05-21 | 深圳艾比仿生机器人科技有限公司 | Bionic eye |
| CN107932527A (en) * | 2017-12-25 | 2018-04-20 | 深圳艾比仿生机器人科技有限公司 | Bionical eye |
| WO2019178276A1 (en) | 2018-03-13 | 2019-09-19 | Ronald Winston | Virtual reality system and method |
| CN111936910A (en) * | 2018-03-13 | 2020-11-13 | 罗纳德·温斯顿 | Virtual reality system and method |
| EP3729177A4 (en) * | 2018-03-13 | 2021-10-06 | Ronald Winston | Virtual reality system and method |
| US10838203B2 (en) | 2018-07-17 | 2020-11-17 | Apple Inc. | Adjustable electronic device system with facial mapping |
| US11150474B2 (en) | 2018-07-17 | 2021-10-19 | Apple Inc. | Adjustable electronic device system with facial mapping |
| CN110827414A (en) * | 2019-11-05 | 2020-02-21 | 江西服装学院 | Virtual digital library experience device based on VR technique |
| US20220343471A1 (en) * | 2019-11-12 | 2022-10-27 | Sony Semiconductor Solutions Corporation | Electronic apparatus |
| WO2021227916A1 (en) * | 2020-05-09 | 2021-11-18 | 维沃移动通信有限公司 | Facial image generation method and apparatus, electronic device, and readable storage medium |
| WO2022110752A1 (en) * | 2020-11-30 | 2022-06-02 | 华为技术有限公司 | Image processing method, server, and virtual reality device |
| CN114594851A (en) * | 2020-11-30 | 2022-06-07 | 华为技术有限公司 | Image processing method, server and virtual reality equipment |
| CN114594851B (en) * | 2020-11-30 | 2024-06-25 | 华为技术有限公司 | Image processing method, server and virtual reality device |
| CN112596605A (en) * | 2020-12-14 | 2021-04-02 | 清华大学 | AR (augmented reality) glasses control method and device, AR glasses and storage medium |
| CN114564100A (en) * | 2021-11-05 | 2022-05-31 | 南京大学 | Free stereoscopic display hand-eye interaction method based on infrared guidance |
| CN114564100B (en) * | 2021-11-05 | 2023-12-12 | 南京大学 | Infrared guiding-based hand-eye interaction method for auto-stereoscopic display |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107491165A (en) | A kind of vr eyewear faces 3d images, plane picture capture and gesture capture systems | |
| US20180365484A1 (en) | Head-mounted display with facial expression detecting capability | |
| US11314088B2 (en) | Camera-based mixed reality glass apparatus and mixed reality display method | |
| US7606392B2 (en) | Capturing and processing facial motion data | |
| WO2011148449A1 (en) | Image processing apparatus, image processing method, and image communicating system | |
| CN109313346A (en) | Conversion between binocular view and monocular view | |
| CN109035413B (en) | Virtual fitting method and system for image deformation | |
| WO2002030171A3 (en) | Facial animation of a personalized 3-d face model using a control mesh | |
| CN106139519A (en) | A kind of universal treadmill of mixed reality and application process thereof | |
| WO2005071617A1 (en) | Methods and systems for compositing images | |
| CN104581119B (en) | A kind of display methods of 3D rendering and a kind of helmet | |
| JP2004506276A (en) | Three-dimensional face modeling system and modeling method | |
| US11551427B2 (en) | System and method for rendering virtual reality interactions | |
| CN105761243A (en) | Three-dimensional full face photographing system based on structured light projection and photographing method thereof | |
| KR101670328B1 (en) | The appratus and method of immersive media display and image control recognition using real-time image acquisition cameras | |
| JPH0738873A (en) | Method for real-time recognition and composition of human image | |
| CN107306352A (en) | The display of wear-type human eye deflection control shooting, capture apparatus system | |
| JP5362357B2 (en) | Capture and process facial movement data | |
| CN113941138A (en) | AR interaction control system, device and application | |
| CN107305621A (en) | The image capture device and image synthesis system of a kind of virtual reality glasses | |
| CN107147896A (en) | Camera device and the live video camera of 3D augmented realities | |
| CN109756663B (en) | AR device control method and device and AR device | |
| CN205901975U (en) | Demonstration, shooting equipment system that wear -type people's eye deflection control was shot | |
| CN207354506U (en) | Camera device and the live video camera of 3D augmented realities | |
| CN106774869A (en) | A kind of method for realizing virtual reality, device and virtual implementing helmet |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |