CN106412558A

CN106412558A - Method, equipment and device for stereo virtual reality live broadcasting

Info

Publication number: CN106412558A
Application number: CN201610812623.8A
Authority: CN
Inventors: 李东方
Original assignee: Shenzhen Super Technology Co Ltd
Current assignee: Shenzhen Super Technology Co Ltd
Priority date: 2016-09-08
Filing date: 2016-09-08
Publication date: 2017-02-15
Anticipated expiration: 2036-09-08
Also published as: CN106412558B

Abstract

The invention provides a method, equipment and a device for stereo virtual reality live broadcasting and relates to the technical field of display. The invention solves the problem of poor viewing user experience of fusing display of virtuality and reality. The method includes: left and right images of a live broadcasting scene are obtained; left and right views of an anchor in the live broadcasting scene are obtained by separately carrying out matting on the left and right images of the live broadcasting scene; according to the live broadcasting scene shooting distance corresponding to the position of the anchor in the live broadcasting scene and the virtual scene shooting distance corresponding to the preset positions of the left and right views in a virtual scene, the sizes of the left and right views are adjusted; after adjustment, the left and right views are located on the preset positions in the virtual scene and shooting is carried out by left and right virtual cameras, and a stereo fusing view combining the anchor and the virtual scene is obtained, thus achieving stereo virtual reality live broadcasting by carrying out stereo virtual reality displaying according to the stereo fusing view. The invention optimizes the displaying effect of fusing reality and virtuality, and improves user experience.

Description

A kind of stereoscopic Virtual Reality live broadcasting method, device and equipment

Technical field

The present invention relates to display technology field, particularly to a kind of stereoscopic Virtual Reality live broadcasting method, device and equipment.

Background technology

Rise with VR (Virtual Reality, virtual and real) technology and network direct broadcasting platform prevailing, make Must be stood on the air port in epoch based on the live broadcast system of VR, possess unlimited market potential, and be based on virtual scene and reality The live broadcast system that live main body (i.e. main broadcaster) in live scene combines even more allows people be filled with imagination space.Wherein, empty Intending scene utilizes computer to pass through the graphics engines such as OpenGL (Open Graphics Library, open graphic library) structure, and Real live scene is the true living broadcast environment that main broadcaster is located.This live broadcast system combining, by the main broadcaster in live scene It is fused in virtual scene, brings VR user, that is, utilize the live spectators of VR equipment viewing similar to the true user's body participating in Test.

At present, the problem of the display system maximum being combined with the live main body of reality based on virtual scene is how Merge virtual scene with real live scene so that user can enjoy a kind of comfortable, natural, closer to real user's body Test.Therefore, how to lift the viewing experience of user, be a problem demanding prompt solution.

Content of the invention

The technical problem to be solved in the present invention is to provide a kind of stereoscopic Virtual Reality live broadcasting method, device and equipment, can The VR realizing solid is live, and can solve the problem that when merging virtual scene with real live scene, because virtual scene is with now Real live scene image scaled is inconsistent, reduces the problem of user's viewing experience, provides the user with more on the spot in person immersing Sense.

For solving above-mentioned technical problem, embodiments of the invention provide a kind of stereoscopic Virtual Reality live broadcasting method, including：

Obtain the left images of the live scene that left and right binocular camera shoots；

Respectively the left images of described live scene are carried out with FIG pull handle, obtains the left and right of main broadcaster in described live scene View；

According to main broadcaster position corresponding live scene shooting distance in live scene and described left and right view virtual At least one of the predetermined placement location corresponding virtual scene shooting distance of scene distance, the size to described left and right view It is adjusted；

Left and right view after adjustment is placed on the described predetermined placement location in described virtual scene, virtual using left and right Video camera shoots and is placed with the described virtual scene of left and right view, thus obtaining synthesis have described main broadcaster and described virtual scene Stereoscopic fusion view, described stereoscopic fusion view includes left eye and merges view and right eye fusion view, thus according to described solid The virtual reality that fusion view carries out three-dimensional shows, thus it is live to realize stereoscopic Virtual Reality.

Furthermore, it is understood that it is described according to main broadcaster position corresponding live scene shooting distance in live scene and described Left and right view at least one of the predetermined placement location corresponding virtual scene shooting distance distance of virtual scene, to described The step that the size of left and right view is adjusted includes：

According to main broadcaster position corresponding live scene shooting distance in live scene and described left and right view virtual At least one of the predetermined placement location corresponding virtual scene shooting distance of scene distance, obtains the contracting of described left and right view Put ratio；

According to the scaling of described left and right view, the size of described left and right view is adjusted.

Furthermore, it is understood that before the described scaling obtaining described left and right view, methods described also includes：

Determine in described scaling and described live scene shooting distance and described virtual scene shooting distance at least The functional relationship of one distance；

Described existed according to main broadcaster position corresponding live scene shooting distance in live scene and described left and right view At least one of the predetermined placement location corresponding virtual scene shooting distance of virtual scene distance, obtains described left and right view The step of scaling include：

According to main broadcaster position corresponding live scene shooting distance in live scene and described left and right view virtual At least one of predetermined placement location corresponding virtual scene shooting distance of scene distance, described scaling are straight with described Broadcast the functional relationship of at least one of scene capture distance and described virtual scene shooting distance distance, obtain described left and right and regard The scaling of figure；

Wherein, the described scaling of described determination and described live scene shooting distance and described virtual scene shooting distance At least one of the step of the functional relationship of distance include：

Using the live scene image of predetermined labels thing and the virtual scene image of Virtual Subscription label, determine described contracting Put the functional relationship of ratio and at least one of described live scene shooting distance and described virtual scene shooting distance distance, Wherein, described virtual predetermined labels thing is to render according to the full-size(d) of described predetermined labels thing to obtain.

Furthermore, it is understood that the virtual scene of the live scene image of described utilization predetermined labels thing and Virtual Subscription label Image, determines described scaling and at least one of described live scene shooting distance and described virtual scene shooting distance The functional relationship of distance includes：

Obtain under at least one live scene shooting distance, what left and right binocular camera shot includes predetermined labels thing Live scene image, carries out FIG pull handle to the described live scene image including predetermined labels thing, obtains described pre- calibration Note thing view, and obtain the Pixel Dimensions of predetermined labels thing described in described predetermined labels thing view；

Obtain under at least one virtual scene shooting distance, what left and right virtual video camera shot includes virtual predetermined labels The virtual scene image of thing, wherein, described virtual predetermined labels thing is to render according to the full-size(d) of described predetermined labels thing Arrive, and obtain the Pixel Dimensions of virtual predetermined labels thing described in described virtual scene image；

Predetermined labels thing according to described at least one live scene shooting distance, described predetermined labels thing view Virtual predetermined labels thing described in Pixel Dimensions, described at least one virtual scene shooting distance, described virtual scene image Pixel Dimensions, determine that described scaling and the function of described live scene shooting distance and described virtual scene shooting distance close System.

Furthermore, it is understood that described according to described at least one live scene shooting distance, in described predetermined labels thing view Described in the Pixel Dimensions of described predetermined labels thing, described at least one virtual scene shooting distance, described virtual scene image The Pixel Dimensions of virtual predetermined labels thing, determine described scaling and described live scene shooting distance and described virtual scene The step of the functional relationship of shooting distance includes：

Determine that described scaling is clapped with described live scene shooting distance and described virtual scene using method of least square The functional relationship of photographic range.

Determine described scaling and described live scene shooting distance, the shooting focal length of described left and right binocular camera and The functional relationship of described virtual scene shooting distance；

According to the corresponding live scene in main broadcaster position shooting distance, described left and right view in live scene in virtual field The predetermined placement location corresponding virtual scene shooting distance of scape, the shooting focal length of described left and right binocular camera, described scaling Ratio and described live scene shooting distance, the shooting focal length of described left and right binocular camera and described virtual scene shooting distance Functional relationship, obtain the scaling of described left and right view；

Wherein, described described scaling and described live scene shooting distance, described left and right binocular camera are determined The step of the functional relationship of shooting focal length and described virtual scene shooting distance includes：

Obtain under at least one live scene shooting distance, what left and right binocular camera shot includes predetermined labels thing Live scene image, carries out FIG pull handle to the described live scene image including predetermined labels thing, obtains described pre- calibration Note thing view, and obtain the Pixel Dimensions of predetermined labels thing described in described predetermined labels thing view；Obtain at least one virtual Under scene capture distance, the virtual scene image including virtual predetermined labels thing that left and right virtual video camera shoots, wherein, institute Stating virtual predetermined labels thing is to render according to the full-size(d) of described predetermined labels thing to obtain, and obtains described virtual scene figure The Pixel Dimensions of virtual predetermined labels thing described in picture；According to described at least one live scene shooting distance, described pre- calibration The Pixel Dimensions of predetermined labels thing described in note thing view, described at least one virtual scene shooting distance, described virtual scene The Pixel Dimensions of virtual predetermined labels thing described in image, determine described scaling and described live scene shooting distance and institute State the first function relation of virtual scene shooting distance；And

Obtaining described left and right binocular camera is under standard focal length, and it is predetermined that what left and right binocular camera shot includes second The live scene image of label, carries out FIG pull handle to the described live scene image including the second predetermined labels thing, obtains Take the label view under standard focal length, and obtain the picture of the second predetermined labels thing described in the label view under standard focal length Plain size；Obtain under at least one shooting focal length of left and right binocular camera, the shooting of left and right binocular camera include the The live scene image of two predetermined labels things, carries out to the described live scene image including the second predetermined labels thing scratching at figure Reason, obtains the label view under at least one shooting focal length, and obtains in the label view under at least one shooting focal length The Pixel Dimensions of described second predetermined labels thing, wherein, described shooting focal length is different from standard focal length；Burnt according to described standard Away from the Pixel Dimensions of the second predetermined labels thing described in the label view under described standard focal length, described at least one shooting The Pixel Dimensions of the second predetermined labels thing described in label view under focal length, described at least one shooting focal length, determine and clap Take the photograph the image scaling proportionate relationship of focal length and standard focal length；

According to the image scaling proportionate relationship of described first function relation, described shooting focal length and described standard focal length, really Fixed described scaling and described live scene shooting distance, the shooting focal length of described left and right binocular camera and described virtual field The functional relationship of scape shooting distance.

Furthermore, it is understood that described according to described at least one live scene shooting distance, in described predetermined labels thing view Described in the Pixel Dimensions of described predetermined labels thing, described at least one virtual scene shooting distance, described virtual scene image The Pixel Dimensions of virtual predetermined labels thing, determine described scaling and described live scene shooting distance and described virtual scene The step of the first function relation of shooting distance includes：

Determine that described scaling is clapped with described live scene shooting distance and described virtual scene using method of least square The first function relation of photographic range；

Described according to described standard focal length, the second predetermined labels thing described in the label view under described standard focal length Described in label view under Pixel Dimensions, described at least one shooting focal length, described at least one shooting focal length, second is pre- Determine the Pixel Dimensions of label, determine that shooting focal length and the step of the image scaling proportionate relationship of standard focal length include：

Determine the image scaling proportionate relationship of shooting focal length and standard focal length using method of least square.

Furthermore, it is understood that described carry out FIG pull handle respectively to the left images of described live scene, obtain described live After the left and right view of main broadcaster in scene, methods described also includes：

Row bound optimization processing is entered to the border of main broadcaster described in the view of described left and right；And/or

Colour temperature according to described virtual scene and/or tone, adjust to the colour temperature and/or tone of described left and right view Whole.

For solving above-mentioned technical problem, embodiments of the invention also provide a kind of stereoscopic Virtual Reality live broadcast device, including：

Acquisition module, for obtaining the left images of the live scene that left and right binocular camera shoots；

Stingy module, for respectively the left images of described live scene are carried out with FIG pull handle, obtains described live field The left and right view of main broadcaster in scape；

Size adjustment module, for according to main broadcaster position corresponding live scene shooting distance and institute in live scene State at least one of the predetermined placement location corresponding virtual scene shooting distance distance in virtual scene for the left and right view, to institute The size stating left and right view is adjusted；

Fusion Module, for being placed on the described predetermined placement position in described virtual scene by the left and right view after adjustment Putting, shooting, using left and right virtual video camera, the described virtual scene being placed with left and right view, thus obtaining synthesis have described main broadcaster With the stereoscopic fusion view of described virtual scene, described stereoscopic fusion view includes left eye fusion view and right eye merges view, Thus being shown according to the virtual reality that described stereoscopic fusion view carries out three-dimensional, thus it is live to realize stereoscopic Virtual Reality.

Furthermore, it is understood that described size adjustment module includes：

First acquisition submodule, for according to the corresponding live scene in main broadcaster position shooting distance in live scene and Described left and right view, at least one of the predetermined placement location corresponding virtual scene shooting distance distance of virtual scene, obtains Take the scaling of described left and right view；

Adjustment submodule, for the scaling according to described left and right view, adjusts to the size of described left and right view Whole.

Furthermore, it is understood that described device also includes：

First determining module, for determining described scaling and described live scene shooting distance and described virtual scene The functional relationship of at least one of shooting distance distance, specifically for：Live scene image and void using predetermined labels thing Intend subscribing the virtual scene image of label, determine described scaling and described live scene shooting distance and described virtual field The functional relationship of at least one of scape shooting distance distance, wherein, described virtual predetermined labels thing is according to described pre- calibration The full-size(d) of note thing renders and obtains.

Furthermore, it is understood that described first acquisition submodule includes：

First acquisition unit, for according to main broadcaster position corresponding live scene shooting distance and institute in live scene State at least one of the predetermined placement location corresponding virtual scene shooting distance distance, described in virtual scene for the left and right view Scaling is closed with the function of at least one of described live scene shooting distance and described virtual scene shooting distance distance System, obtains the scaling of described left and right view；

Wherein, described first determining module includes：

Second acquisition submodule, for obtaining under at least one live scene shooting distance, left and right binocular camera shoots The live scene image including predetermined labels thing, the described live scene image including predetermined labels thing is carried out scratch figure Process, obtain described predetermined labels thing view, and obtain the pixel chi of predetermined labels thing described in described predetermined labels thing view Very little；

3rd acquisition submodule, for obtaining under at least one virtual scene shooting distance, left and right virtual video camera shoots The virtual scene image including virtual predetermined labels thing, wherein, described virtual predetermined labels thing is according to described pre- calibration The full-size(d) of note thing renders and obtains, and obtains the pixel chi of virtual predetermined labels thing described in described virtual scene image Very little；

First determination sub-module, for regarding according to described at least one live scene shooting distance, described predetermined labels thing In Pixel Dimensions of predetermined labels thing described in figure, described at least one virtual scene shooting distance, described virtual scene image The Pixel Dimensions of described virtual predetermined labels thing, determine described scaling and described live scene shooting distance and described virtual The functional relationship of scene capture distance.

Furthermore, it is understood that described first determination sub-module includes：

First determining unit, for determining described scaling and described live scene shooting distance using method of least square Functional relationship with described virtual scene shooting distance.

Furthermore, it is understood that described device also includes：

Second determining module, for determining described scaling and described live scene shooting distance, described left and right binocular The shooting focal length of video camera and the functional relationship of described virtual scene shooting distance；

Described first acquisition submodule includes：

Second acquisition unit, for according to the corresponding live scene in main broadcaster position shooting distance, institute in live scene State left and right view in the predetermined placement location corresponding virtual scene shooting distance of virtual scene, described left and right binocular camera Shooting focal length, described scaling and described live scene shooting distance, the shooting focal length of described left and right binocular camera and institute State the functional relationship of virtual scene shooting distance, obtain the scaling of described left and right view；

Wherein, described second determining module includes：

Second determination sub-module, for obtaining under at least one live scene shooting distance, left and right binocular camera shoots The live scene image including predetermined labels thing, the described live scene image including predetermined labels thing is carried out scratch figure Process, obtain described predetermined labels thing view, and obtain the pixel chi of predetermined labels thing described in described predetermined labels thing view Very little；Obtain under at least one virtual scene shooting distance, what left and right virtual video camera shot includes virtual predetermined labels thing Virtual scene image, wherein, described virtual predetermined labels thing is to render according to the full-size(d) of described predetermined labels thing to obtain, And obtain the Pixel Dimensions of virtual predetermined labels thing described in described virtual scene image；According to described at least one live scene The Pixel Dimensions of predetermined labels thing described in shooting distance, described predetermined labels thing view, described at least one virtual scene are clapped The Pixel Dimensions of virtual predetermined labels thing described in photographic range, described virtual scene image, determine described scaling with described Live scene shooting distance and the first function relation of described virtual scene shooting distance；And

3rd determination sub-module, is left and right binocular camera under standard focal length for obtaining described left and right binocular camera The live scene image including the second predetermined labels thing shooting, to the described live scene including the second predetermined labels thing Image carries out FIG pull handle, obtains the label view under standard focal length, and obtains institute in the label view under standard focal length State the Pixel Dimensions of the second predetermined labels thing；Obtain under at least one shooting focal length of left and right binocular camera, left and right binocular The live scene image including the second predetermined labels thing that video camera shoots, includes the straight of the second predetermined labels thing to described Broadcast scene image and carry out FIG pull handle, obtain the label view under at least one shooting focal length, and obtain at least one shooting The Pixel Dimensions of the second predetermined labels thing described in label view under focal length, wherein, described shooting focal length and standard focal length Different；According to described standard focal length, the pixel chi of the second predetermined labels thing described in the label view under described standard focal length Second predetermined labels described in label view under very little, described at least one shooting focal length, described at least one shooting focal length The Pixel Dimensions of thing, determine the image scaling proportionate relationship of shooting focal length and standard focal length；

4th determination sub-module, for according to described first function relation, described shooting focal length and described standard focal length Image scaling proportionate relationship, determines described scaling and described live scene shooting distance, described left and right binocular camera Shooting focal length and the functional relationship of described virtual scene shooting distance.

Furthermore, it is understood that described second determination sub-module includes：

Second determining unit, for determining described scaling and described live scene shooting distance using method of least square First function relation with described virtual scene shooting distance；

Described 3rd determination sub-module includes：

Using method of least square, 3rd determining unit, for determining that shooting focal length and the image scaling ratio of standard focal length are closed System.

Furthermore, it is understood that described device also includes：

Border optimization module, for entering row bound optimization processing to the border of main broadcaster described in the view of described left and right；And/or

Picture adjusting module, for the colour temperature according to described virtual scene and/or tone, the colour temperature to described left and right view And/or tone is adjusted.

For solving above-mentioned technical problem, embodiments of the invention also provide a kind of stereoscopic Virtual Reality live equipment, including： Display screen, housing, processor, memorizer, circuit board and power circuit, wherein：

Described display screen is rabbeted on the housing, surrounds closing space together with described housing；

Described circuit board is placed in the interior volume that described housing and described display screen surround, described processor and described deposit Reservoir is arranged on described circuit board；

Described power circuit, for being each circuit of the live equipment of above-mentioned stereoscopic Virtual Reality or device is powered；

Described memorizer is used for storing executable program code；

Described processor is run and executable program code by reading the executable program code of storage in memorizer Corresponding program, execution：

Left and right view after adjustment is placed on the described predetermined placement location in described virtual scene, virtual using left and right Video camera shoots and is placed with the described virtual scene of left and right view, thus obtaining synthesis have described main broadcaster and described virtual scene Stereoscopic fusion view, described stereoscopic fusion view includes left eye and merges view and right eye fusion view, thus by described display Screen shows according to the virtual reality that described stereoscopic fusion view carries out three-dimensional, thus it is live to realize stereoscopic Virtual Reality.

The having the beneficial effect that of the technique scheme of the present invention：

The stereoscopic Virtual Reality live broadcasting method of the embodiment of the present invention, device and equipment, obtain left and right binocular camera and shoot The left images of live scene after, respectively the left images of live scene are carried out with FIG pull handle, obtain main in live scene The left and right view broadcast；Then existed according to main broadcaster position corresponding live scene shooting distance and left and right view in live scene The predetermined placement location corresponding virtual scene shooting distance of virtual scene, is adjusted to the size of left and right view, after adjustment Left and right view consistent with the dimension scale of virtual scene；Finally the left and right view after adjustment is placed on pre- in virtual scene Determining placement location, shooting, using left and right virtual video camera, the virtual scene being placed with left and right view, thus obtaining synthesis have main broadcaster With the stereoscopic fusion view of virtual scene, this stereoscopic fusion view includes left eye and merges view and right eye fusion view, thus root Show according to the virtual reality that described stereoscopic fusion view carries out three-dimensional, it is achieved thereby that stereoscopic Virtual Reality is live.The method Merged it is achieved that stereoscopic Virtual Reality is live with virtual scene by shooting live stereo-picture；And by standing to live The size of body image is adjusted, and so that live stereo-picture and the dimension scale of virtual scene is matched, and optimizes reality straight Broadcast the effect that scene is merged with virtual scene, improve user's viewing experience, effectively prevent and merging virtual scene and reality During live scene, because virtual scene is inconsistent with real live scene image scaled, reduce the problem of user's viewing experience.

Brief description

Fig. 1 is the flow chart of stereoscopic Virtual Reality live broadcasting method of the present invention；

Fig. 2 is the live schematic flow sheet of the present invention；

Fig. 3 is another live schematic flow sheet of the present invention；

Fig. 4 is that predetermined labels thing of the present invention arranges schematic diagram；

Fig. 5 is the structural representation of stereoscopic Virtual Reality live broadcast device of the present invention；

Fig. 6 is the structural representation of the live equipment of stereoscopic Virtual Reality of the present invention；

Fig. 7 is that in stereoscopic Virtual Reality live broadcasting method of the present invention, live scene binocular camera shoots schematic diagram；

Fig. 8 is that in stereoscopic Virtual Reality live broadcasting method of the present invention, virtual scene virtual video camera shoots schematic diagram.

Specific embodiment

For making the technical problem to be solved in the present invention, technical scheme and advantage clearer, below in conjunction with accompanying drawing and tool Body embodiment is described in detail.

In order that those skilled in the art are better understood from the present invention, first to the virtual field sayed in the embodiment of the present invention The live flow process that scape is combined with real live scene is briefly introduced.

Virtual scene utilizes computer to pass through the figures such as OpenGL (Open Graphics Library, open graphic library) Engine builds, and computer can be by rendering the image obtaining virtual scene, and real live scene (abbreviation live scene) is The true living broadcast environment that main broadcaster is located, can be shot by real camera and obtain the image of live scene.In simple terms, reality Live scene is the scene that can be shot using real camera.Virtual scene is the scene that computer renders according to design.This In inventive embodiments, as shown in Figure 2,3, real live scene image and virtual scene image can first pass around image algorithm and melt Close, be then passed through the device transmission such as network, bluetooth to live equipment and shown.Real live scene and virtual scene can also First pass through the device transmission such as network, bluetooth to live equipment, show after then carrying out image algorithm fusion.

The stereoscopic Virtual Reality live broadcasting method of the embodiment of the present invention, device and equipment are straight in aforementioned virtual scene and reality Broadcast that scene combines live on the basis of it is achieved that the virtual reality of three-dimensional is live, shown by three-dimensional and bring user more Plus real feeling of immersion.And, when live scene is merged with virtual scene, carried out by the size of the left and right view to main broadcaster Adjustment, so that the left and right view dimensions of main broadcaster and the dimension scale of virtual scene is matched, optimize real live scene with virtual The effect that scene merges, improves user's viewing experience, effectively prevent when merging virtual scene with real live scene, by Inconsistent with real live scene image scaled in virtual scene, reduce the problem of user's viewing experience.

First embodiment

In conjunction with shown in Fig. 1, the stereoscopic Virtual Reality live broadcasting method of the embodiment of the present invention, including：

Step 101, obtains the left images of the live scene that left and right binocular camera shoots.

Here, real live scene is shot by left and right binocular camera, obtained the stereo-picture with parallax, that is, directly Broadcast the left images of scene.

The background environment that live main body (i.e. main broadcaster) and live main body are located all is included in the left images of this live scene. Main broadcaster can be people naturally it is also possible to be certain object.For convenience of describing, taking main broadcaster's behaviour as a example it is described below, permissible It is understood by, main broadcaster is not limited to people.

Due to subsequently main broadcaster's portrait and virtual scene being merged, need by main broadcaster's portrait scratch from left images from Out, therefore, in live scene, the background environment of main broadcaster can be set to green curtain or blue curtain, to facilitate in subsequent treatment The background environment of actual photographed is removed, main broadcaster's portrait will scratch and separate out, and by main broadcaster's figure information and virtual scene model Synthesized.

The left images of described live scene are carried out FIG pull handle by step 102 respectively, obtain main in described live scene The left and right view broadcast.

Here, in order to be put into the main broadcaster (as people) in live scene in virtual scene, need the left and right to live scene Image carries out scratching figure, obtains the left and right view of main broadcaster in live scene.

Specifically it is assumed that the background environment of main broadcaster is set to green curtain or blue curtain, then, in this step, first, calculated using stingy picture Method removes the blueness of main broadcaster behind or green background in live scene image information respectively.Described scratching as algorithm can be chroma key Scratch as method, this algorithm by finding the higher blueness of those saturations or green background color region, and by these background face The transparent value in zone domain is set to minima, and portrait color region then keeps primitive color, thus in live scene image information In significantly distinguish portrait area and background area, complete scratch figure.After FIG pull handle, main broadcaster's portrait can be obtained Two views in left and right.

Step 103, regards according to main broadcaster position corresponding live scene shooting distance and described left and right in live scene Figure, at least one of the predetermined placement location corresponding virtual scene shooting distance distance of virtual scene, regards to described left and right The size of figure is adjusted.

Because left and right binocular camera has the reasons such as specific camera parameter, affect the image size collecting and length Wide ratio, and the virtual video camera in virtual scene need shoot (rendering) virtual scene have the size having set and Aspect Ratio, both is often inconsistent.In various virtual scene, live main body is (as after scratching as algorithm Portrait) shown with many large scales and Aspect Ratio in diverse location and can make personage and background closer to true, to lifting user Viewing experience plays vital effect.Accordingly, it would be desirable to the left and right view before main broadcaster and virtual scene are merged, to main broadcaster Size is adjusted.

Here, because shooting the factor restriction such as place or resolution of video camera, real live scene shooting distance and virtual field Scape shooting distance is usually different.Such as live scene shooting distance is generally 3m, and virtual scene shooting distance is generally 8m.The change of live scene shooting distance and virtual scene shooting distance all can produce impact to the size adjusting of left and right view.

Referring to Fig. 7, L and R is the left and right binocular camera of live scene, and A0 is main broadcaster place plane, and that is, main broadcaster is located The corresponding plane in position, then live scene shooting distance is Z0.It is left and right virtual video camera referring to Fig. 8, L ' and R ', A1 is main broadcaster Left and right view is placed on the plane that about main broadcaster after in virtual scene, view is located, and that is, the predetermined placement location of main broadcaster's view is located Plane, then virtual scene shooting distance be Z1.

In this step, according to the position corresponding live scene shooting distance at main broadcaster place and left and right view in live scene At least one of predetermined placement location corresponding virtual scene shooting distance in virtual scene distance, the chi to left and right view Very little it is adjusted so that the left and right view after adjusting is matched with the dimension scale of virtual scene.

Specifically, can be previously according to the position corresponding live scene shooting distance being located according to main broadcaster in live scene Determine at least one of the predetermined placement location corresponding virtual scene shooting distance distance of virtual scene with left and right view The size scaling ratio of left and right view, in this step, can be with this size scaling ratio of direct access and according to this ratio to left and right View zooms in and out process.Certainly, in this step it is also possible in real time according to live scene shooting distance and virtual scene shoot away from From at least one of with a distance from, calculate the size scaling ratio of left and right view, according to the size scaling ratio pair being calculated Left and right view zooms in and out process.

This scaling can be the function or virtual scene shooting distance that live scene shooting distance is variable For the function of variable, for example, for one of both distances fixing situation of distance, then can with another kind of on-fixed away from From for variable, determine current size scaling ratio.Certainly, this scaling can also be live scene shooting distance and void Intend the function of two variables of scene capture distance.

Step 104, the left and right view after adjustment is placed on the described predetermined placement location in described virtual scene, utilizes Left and right virtual video camera shoots the described virtual scene being placed with left and right view, thus obtaining synthesis have described main broadcaster and described void Intend the stereoscopic fusion view of scene, described stereoscopic fusion view includes left eye and merges view and right eye fusion view, thus according to The virtual reality that described stereoscopic fusion view carries out three-dimensional shows, thus it is live to realize stereoscopic Virtual Reality.

Here, shoot, using left and right virtual video camera, the virtual scene that (rendering) is placed with left and right view, closed Become to have the stereoscopic fusion view of main broadcaster and virtual scene, stereoscopic fusion view includes left eye and merges view and right eye fusion view, Thus being shown it is achieved that stereoscopic Virtual Reality is live according to the virtual reality that stereoscopic fusion view carries out three-dimensional.And due to chi Left and right view after very little adjustment is consistent with the dimension scale of virtual scene, therefore improves user's viewing experience.

Carrying out in the case of known left-eye view and right-eye view that VR shows can be using display common in the art Technology, is no longer described in detail here.Briefly, the left figure that can show left eye fusion view as VR, right eye is melted Close the right figure that view shows as VR, thus left eye fusion view is supplied to the left eye of VR equipment wearer, right eye is merged View is supplied to the right eye of VR equipment wearer, thus bringing the virtual reality perception of user's three-dimensional.

Additionally, for " head is taken aim at " function of being adapted to VR equipment, you can changed with the head pose according to VR equipment wearer Shown content, makes that shown content is corresponding with the visual angle of VR equipment wearer, and available left and right virtual video camera is pressed Shoot, according to different shooting angles, the default virtual scene being placed with main broadcaster's portrait, obtain multiple stereoscopic fusion views, then to this A little three-dimensional views carry out panoramic mosaic, obtain left and right panorama and merge view, and then are shown using these panoramas fusion view, The left view part corresponding with equipment wearer visual angle is supplied to the left eye of equipment wearer, will be with equipment wearer visual angle Corresponding right view part is supplied to the right eye of equipment wearer, and when equipment wearer visual angle changes, corresponding change Shown View component, makes display corresponding with the visual angle of equipment wearer.

For example, virtual scene can be 360 degree of panorama stage image informations, and main broadcaster can be fused center before the lights Position.Shot just in live main broadcaster by left and right binocular camera, the three-dimensional view of main broadcaster can be merged in virtual scene Stage position, make user can see that main broadcaster does live stereo scene in virtual scene at VR end.

The stereoscopic Virtual Reality live broadcasting method of the embodiment of the present invention, is melted with virtual scene by the stereo-picture shooting live Close it is achieved that stereoscopic Virtual Reality is live；And by being adjusted to the size of live stereo-picture, make live axonometric chart As consistent with the dimension scale of virtual scene, optimize the effect that real live scene is merged with virtual scene, improve user Viewing experience, it is to avoid when merging virtual scene with real live scene, due to virtual scene and real live scene image Ratio is inconsistent, reduces the problem of user's viewing experience.

Preferably, the step of above-mentioned steps 103 includes：

Step 1031, regards according to main broadcaster position corresponding live scene shooting distance and described left and right in live scene Figure, at least one of the predetermined placement location corresponding virtual scene shooting distance distance of virtual scene, obtains described left and right The scaling of view.

Here, first according at least one of live scene shooting distance and virtual scene shooting distance distance, obtain The scaling of left and right view, to be adjusted to the size of left and right view according to scaling.

Step 1032, according to the scaling of described left and right view, is adjusted to the size of described left and right view.

Here, after respectively left and right view being adjusted according to scaling, so that the chi of left and right view and virtual scene Very little ratio matches.

Now, by obtaining the scaling of left and right view, accurately the size of left and right view can be adjusted, make adjustment Rear left right view is matched with the dimension scale of virtual scene.

Because during actual photographed, live scene shooting distance is change, such as main broadcaster can move forward or backward Dynamic, and virtual scene shooting distance is it could also be possible that change.In order to shoot in live scene shooting distance and/or virtual scene When distance changes, quick determine scaling it is preferred that before the described scaling obtaining described left and right view, institute The method of stating can also include：

Step 105, determines described scaling and described live scene shooting distance and described virtual scene shooting distance At least one of distance functional relationship.

Here, it is first determined scaling and at least one of live scene shooting distance and virtual scene shooting distance The functional relationship of distance, so that follow-up determine different live scene shooting distances and/or different lower point of virtual scene shooting distance Not corresponding scaling.

Then, the step of above-mentioned steps 1031 includes：

Step 10311, according to main broadcaster position corresponding live scene shooting distance and described left and right in live scene View is at least one of the predetermined placement location corresponding virtual scene shooting distance distance of virtual scene, described pantograph ratio Example and the functional relationship of at least one of described live scene shooting distance and described virtual scene shooting distance distance, obtain The scaling of described left and right view.

Now, when live scene shooting distance and/or virtual scene shooting distance change, using scaling with Live scene shooting distance and the functional relationship of virtual scene shooting distance, quickly and accurately can determine scaling, thus right The size of left and right view is adjusted, and improves treatment effeciency and intellectuality.

Hereinafter, for the ease of understand and describe, live scene shooting distance is labeled as d2, by virtual scene shoot away from From being labeled as d1, shooting focal length is labeled as a, standard focal length is labeled as a0.

Wherein, the step of above-mentioned steps 105 includes：

Specifically may include：

Step 1051, obtains under at least one live scene shooting distance d2, what left and right binocular camera shot includes The live scene image of predetermined labels thing, carries out FIG pull handle to the described live scene image including predetermined labels thing, obtains Take described predetermined labels thing view, and obtain the Pixel Dimensions of predetermined labels thing described in described predetermined labels thing view.

Here, the predetermined labels thing of known dimensions can be placed in advance in live scene, such as length, width and height are the vertical of 1m Cube.Then obtain under at least one live scene shooting distance d2, what left and right binocular camera shot includes predetermined labels The live scene image of thing, and live scene image is carried out scratch figure, obtain predetermined labels thing view, and obtain predetermined labels thing The Pixel Dimensions of predetermined labels thing in view.

Wherein, due to left and right binocular camera, to shoot the picture size that obtains identical, therefore can only pass through left lens camera Or right lens camera shoots live scene image.

Step 1052, obtains under at least one virtual scene shooting distance d1, what left and right virtual video camera shot includes The virtual scene image of virtual predetermined labels thing, wherein, described virtual predetermined labels thing is true according to described predetermined labels thing Real size renders and obtains, and obtains the Pixel Dimensions of virtual predetermined labels thing described in described virtual scene image.

Here, can render in virtual scene in advance virtual pre- with predetermined labels thing actual size identical in live scene Determine label, for example, render the cube that 1 length, width and height are 1m.Then obtain under at least one virtual scene shooting distance d1, The virtual scene image including virtual predetermined labels thing that left and right virtual video camera shoots, and virtual scene image is scratched Figure, obtains virtual predetermined labels thing view, and obtains the Pixel Dimensions of virtual predetermined labels thing in virtual predetermined labels thing view.

Wherein, due to left and right virtual video camera, to shoot the picture size that obtains identical, therefore can be only by left virtual shooting Machine or right virtual video camera shoot virtual scene image.

Step 1053, according to described at least one live scene shooting distance d2, described predetermined labels thing view Empty described in the Pixel Dimensions of predetermined labels thing, described at least one virtual scene shooting distance d1, described virtual scene image Intend the Pixel Dimensions of predetermined labels thing, determine that described scaling is clapped with described live scene shooting distance and described virtual scene The functional relationship of at least one of photographic range distance.

Here, using the Pixel Dimensions data of predetermined labels thing and virtual predetermined labels thing, scaling and d1 can be obtained Functional relationship with d2.

Wherein, in the case that d1 and d2 is fixing, that is, under a kind of d1 and d2, the Pixel Dimensions of virtual predetermined labels thing with The ratio of the Pixel Dimensions of predetermined labels thing is as the scaling under this d1 and d2.

For example, assuming that live photographed scene is 3m apart from d2 and virtual scene shooting distance d1, as shown in figure 4, can away from Place the cube that length, width and height are 1m from the position of left and right binocular camera 3m, in the position apart from left and right virtual video camera 3m Render an equal amount of virtual cube.It is assumed that comprise cubical straight through the shooting of left lens camera taking left lens camera as a example Broadcast scene, obtain the left live scene image that Pixel Dimensions are 1920*1080, then cube in left live scene image is scratched Go out, obtain the cube view that cubical Pixel Dimensions are 800*600.Taking left virtual video camera as a example it is assumed that through a left side virtual Video camera shoots and comprises virtual cubical virtual scene, obtains the left virtual scene image that Pixel Dimensions are 1920*1080, so Afterwards the virtual cube in left virtual scene image is plucked out, obtain the virtual cube view that Pixel Dimensions are 50*30.Then exist When d1 and d2 is 3m, the scaling obtaining is length scale ratio 50/800, width scaling 30/600.

In as live in reality, if d1 and d2 fixes, directly can determine scaling using said method.

But, actual live in, at least one in d1 and d2 can be change, in this case, can be in difference Under d1 and d2, the repeatedly Pixel Dimensions data of the predetermined labels thing of acquisition and virtual predetermined labels thing, and utilize these pixel chis Very little data can obtain the corresponding scaling of difference under different d1 and d2, and then obtains the function of scaling and d1 and d2 Relation.

In this case, above-mentioned steps 1053 can determine described scaling and described live scene using method of least square Shooting distance d2 and the functional relationship of described virtual scene shooting distance d1.

Wherein, the scaling of left and right view generally comprises the scaling of length direction and width, using minimum The scaling that square law determines is as follows with the functional relation of live scene shooting distance d2 and virtual scene shooting distance d1 Shown in formula (1)：

Wherein, sH0 is the length scale ratio of left and right view, and sW0 is the width scaling of left and right view.

Now, left and right view can accurately and rapidly be determined according to the functional relationship shown in d1 and d2 and formula (1) Scaling, and then the size of left and right view is adjusted.

It is true that when the focal length of left and right binocular camera changes, that is, when the switching in need of left and right binocular camera During far and near camera lens, the change of focal length is also influential on the scaling of left and right view.Therefore, the present invention is with reference to live bat The shooting focal length a of on the basis of taking the photograph scene distance d2 and virtual scene shooting distance d1 it is also possible to reference left and right binocular camera The size of left and right view is adjusted.Introduce in detail below.

Preferably, before the described scaling obtaining described left and right view, methods described also includes：

Step 106, determines described scaling and described live scene shooting distance, the bat of described left and right binocular camera Take the photograph focal length and the functional relationship of described virtual scene shooting distance.

Here, by determine scaling and live scene shooting distance d2, the shooting focal length a of left and right binocular camera and The functional relationship of virtual scene shooting distance d1, can accurately and rapidly determine different live live scene shooting distance d2, no With the corresponding scaling of difference under the shooting focal length a and different virtual scene shooting distance d1 of left and right binocular camera.

The step of above-mentioned steps 1031 includes：

Step 10312, according to the corresponding live scene in main broadcaster position shooting distance d2, described left and right in live scene The predetermined placement location corresponding virtual scene shooting distance d1 in virtual scene for the view, the shooting of described left and right binocular camera Focal length a, described scaling and described live scene shooting distance d2, the shooting focal length a of described left and right binocular camera and institute State the functional relationship of virtual scene shooting distance d1, obtain the scaling of described left and right view.

Now, in live scene shooting distance d2, the shooting focal length a of left and right binocular camera and virtual scene shooting distance During d1 change, using scaling and live scene shooting distance d2, the shooting focal length a of left and right binocular camera and virtual scene The functional relationship of shooting distance d1, can quickly and accurately determine scaling, thus being adjusted to the size of left and right view, Improve treatment effeciency and intellectuality.

Wherein, the step of above-mentioned steps 106 includes：

Step 1061, obtains under at least one live scene shooting distance d2, what left and right binocular camera shot includes The live scene image of predetermined labels thing, carries out FIG pull handle to the described live scene image including predetermined labels thing, obtains Take described predetermined labels thing view, and obtain the Pixel Dimensions of predetermined labels thing described in described predetermined labels thing view；

Step 1062, obtains under at least one virtual scene shooting distance d1, what left and right virtual video camera shot includes The virtual scene image of virtual predetermined labels thing, wherein, described virtual predetermined labels thing is true according to described predetermined labels thing Real size renders and obtains, and obtains the Pixel Dimensions of virtual predetermined labels thing described in described virtual scene image；

Step 1063, according to described at least one live scene shooting distance d2, described predetermined labels thing view Empty described in the Pixel Dimensions of predetermined labels thing, described at least one virtual scene shooting distance d1, described virtual scene image Intend the Pixel Dimensions of predetermined labels thing, determine that described scaling is clapped with described live scene shooting distance and described virtual scene The first function relation of photographic range.

Here, step 1061-1063 can refer to the introduction with above-mentioned steps 1051-1053, will not be described here.

And step 1064, obtaining described left and right binocular camera is under standard focal length a0, and left and right binocular camera shoots The live scene image including the second predetermined labels thing, to the described live scene image including the second predetermined labels thing Carry out FIG pull handle, obtain the label view under standard focal length a0, and obtain institute in the label view under standard focal length a0 State the Pixel Dimensions of the second predetermined labels thing.

Here, the second predetermined labels thing of known dimensions can be placed in advance in live scene, such as length, width and height are 1m Cube.Then obtain under standard focal length a0, what left and right binocular camera shot includes the live of the second predetermined labels thing Scene image, wherein, live scene shooting distance d2 adopts a rational fixed value, is not limited thereto.Then to To live scene image carry out scratching figure, obtain label view, and obtain second in the label view under standard focal length a0 The Pixel Dimensions of predetermined labels thing.

Wherein, the value of standard focal length a0 can be the intrinsic parameter of camera, set also dependent on demand, here does not limit Fixed.

Step 1065, obtains under at least one shooting focal length a of left and right binocular camera, left and right binocular camera shoots The live scene image including the second predetermined labels thing, to the described live scene image including the second predetermined labels thing Carry out FIG pull handle, obtain the label view under at least one shooting focal length a, and obtain under at least one shooting focal length a The Pixel Dimensions of the second predetermined labels thing described in label view, wherein, described shooting focal length a is different from standard focal length a0.

Here, left and right binocular camera can be carried out with zoom, obtain left and right binocular camera at least one burnt with standard Under the different shooting focal length a of a0, the live scene image including the second predetermined labels thing that left and right binocular camera shoots, Wherein, live scene shooting distance d2 adopts and identical fixed value under standard focal length a0.Then to the live scene figure obtaining As carrying out scratching figure, obtain label view, and obtain the second predetermined labels in the label view under at least one shooting focal length a The Pixel Dimensions of thing.

Step 1066, according to described standard focal length a0, described in the label view under described standard focal length a0, second is pre- Determine the Pixel Dimensions of label, the label view under described at least one shooting focal length a, described at least one shooting focal length a Described in the second predetermined labels thing Pixel Dimensions, determine the image scaling proportionate relationship of shooting focal length a and standard focal length a0.

Here, using the pixel of the second predetermined labels thing of standard focal length a0 and the second predetermined labels thing of shooting focal length a Sized data, can obtain the image scaling proportionate relationship of shooting focal length a and standard focal length a0, with the change to left and right binocular camera Burnt behavior is corrected.

Wherein, it is assumed that the Pixel Dimensions of the second predetermined labels thing of shooting focal length a1 are under a kind of shooting focal length a1 (w1, h1) it is assumed that the Pixel Dimensions of the second predetermined labels thing of standard focal length a0 are (w0, h0), then image scaling ratio is w1/ W0, h1/h0.

Now, obtained not with multiple using the Pixel Dimensions data of the second predetermined labels thing of standard focal length a0 obtaining With the Pixel Dimensions data of the second predetermined labels thing of shooting focal length a, can obtain corresponding respectively under different shooting focal length a Image scaling ratio, and then obtain the image scaling proportionate relationship of shooting focal length a and standard focal length a0.

The execution sequence of step 1061-1063 and step 1064-1066 does not limit, can be successively it is also possible to carry out simultaneously.

Step 1067, according to the image scaling of described first function relation, described shooting focal length a and described standard focal length a0 Proportionate relationship, determines that described scaling is burnt with the shooting of described live scene shooting distance d2, described left and right binocular camera Functional relationship away from a and described virtual scene shooting distance d1.

Now, the image scaling proportionate relationship according to first function relation, shooting focal length a and standard focal length a0, obtains Scaling and live scene shooting distance d2, the shooting focal length a of left and right binocular camera and virtual scene shooting distance d1's Functional relationship, and then different live scene shooting distance d2, the shooting focal length a of different left and right binocular camera and not can be obtained With virtual scene shooting distance d1 corresponding scaling respectively, to be adjusted to left and right view.

Further, using method of least square, above-mentioned steps 1063 can determine that described scaling is clapped with described live scene Photographic range d2 and the first function relation of described virtual scene shooting distance d1.Above-mentioned steps 1066 are possible with method of least square Determine the image scaling proportionate relationship of shooting focal length a and standard focal length a0.

Here, with reference to the introduction of above-mentioned steps 1053, the scaling of left and right view generally comprises length direction and width The scaling in direction, is shot with live scene shooting distance d2 and virtual scene using the scaling that method of least square determines Apart from shown in the first function relational expression such as above-mentioned formula (1) of d1：

Determine image scaling proportionate relationship equation below (2) of shooting focal length a and standard focal length a0 using method of least square Shown：

Here, sH1 is left image scaling relationships, and sW0 is right image scaling relationships.

According to the image scaling proportionate relationship of first function relation, shooting focal length a and standard focal length a0, the pantograph ratio of determination Example is as follows with the functional relationship of live scene shooting distance, the shooting focal length of left and right binocular camera and virtual scene shooting distance Shown in formula (3)：

Wherein, sH is the length scale ratio of left and right view, and sW is the width scaling of left and right view.

Now, left and right view can accurately and rapidly be determined according to the functional relationship shown in d1, d2, a and formula (3) Scaling, and then the size of left and right view is adjusted.

Further, the embodiment of the present invention also can be managed by program according to the parameter of left and right binocular camera and shooting distance By the scaling calculating left and right view.This mode can also be adapted to left and right binocular camera in shooting process walk and Far and near Shot change, being dynamically adapted scaling makes real live scene and the size of virtual scene coordinate.

More than, it is adjusted by the size of the left and right view to main broadcaster, make the chi of real live scene and virtual scene Very little harmonious, optimize the effect that real live scene is merged with virtual scene, improve user's viewing experience.

Wherein, after live scene being shot using left and right binocular camera, the left images to live scene are needed to carry out FIG pull handle, the left and right view of the main broadcaster that stingy figure is obtained is merged with virtual scene.Now, the quality of stingy figure directly affects and melts Close effect, such as scratch figure border and user totally can not allowed to see burr, cause reality scene inharmonious with virtual scene, so that user is seen See that experience declines.Therefore scratch the complete smoothness that figure result will keep border as far as possible, keep the integrity of details, such as first-class, use up Amount will be clean for background button.

Can be improved as follows to improve stingy plot quality：Improve lighting environment；From preferable video camera；Choose and master Broadcast the larger background colour of difference；From stingy nomography being more suitable for etc..

Further, in order to keep scratching the complete smoothness on figure border, after above-mentioned steps 102, methods described also includes：

Step 1010, enters row bound optimization processing to the border of main broadcaster described in the view of described left and right.

Wherein, if anchor edge is scratched totally, Image erosion algorithm optimization border can be passed through.If edge sawtooth sense Relatively strong, row bound smoothing processing of going forward side by side can be detected by image boundary.Furthermore it is also possible to by border detection algorithm and one Simple emergence algorithm makes border excessively more natural.

Now, if the junction of left and right view and virtual scene can feel excessively too steep if being left intact, do not assist Adjust.By row bound optimization is entered to the border of main broadcaster in the view of left and right, the viewing experience of boundary can be obviously improved.

Further, since left and right binocular camera own hardware characteristic, the left and right view collecting may be with virtual scene Image is inconsistent on colour temperature, tone.In order to keep the concordance of left and right view and virtual scene it is preferred that above-mentioned steps 102 Afterwards, methods described can also include：

Step 1011, the colour temperature according to described virtual scene and/or tone, the colour temperature to described left and right view and/or color Tune is adjusted.

Now, by being adjusted it is ensured that left and right view and virtual scene figure to the colour temperature of left and right view and/or tone The concordance of picture, improves image syncretizing effect.

Additionally, it is contemplated that the left and right view that following several respects reason also can shoot, to left and right binocular camera, the main broadcaster obtaining enters Row parallax adjusts.

On the one hand, limit because shooting the factor such as place or resolution of video camera, the shooting adopting in real live scene Distance is different with the shooting distance of employing in virtual scene, so causes left and right binocular camera in real live scene The left images parallax that the left images parallax shooting is shot with left and right virtual video camera in virtual scene is inconsistent.Such as reality Live scene typically adopts the remote distance of 3m to shoot, and typically adopts the remote distance of 8m to shoot in virtual scene.

On the other hand, in order to meet human eye viewing demand, in virtual scene, the spacing between the virtual video camera of left and right is general Average headway for human eye.But due to there is specific distance it is contemplated that the volume etc. of video camera between the binocular camera of left and right Reason, the spacing of left and right binocular camera is not to set according to the spacing of human eye, left and right binocular camera under general scenario Between spacing differ larger with the average headway of human eye.Such as spacing only has the left and right binocular camera shooting distance 3m of 3cm The left images of remote object, watch remote object the mirrored left and right eyes retina of 3m with actual human eye (average headway 6.5cm) The parallax of left images be inconsistent.

In addition, left and right binocular camera there may be certain angle error used in reality is live, this angle error Influence whether human eye viewing parallax.

Therefore, also can carry out parallax adjustment to left and right view, make left and right view parallax and the parallax of virtual scene require one Cause, and consistent with the parallax requirement of human eye viewing.

To sum up, the stereoscopic Virtual Reality live broadcasting method of the embodiment of the present invention, by shoot live stereo-picture with virtual Scene merges it is achieved that stereoscopic Virtual Reality is live；And by being adjusted to the size of live stereo-picture, make live Stereo-picture is consistent with the dimension scale of virtual scene；In addition, optimized by border, colour temperature and/or hue adjustment etc. it is ensured that Left and right view and the concordance of virtual scene image；Optimize the effect that real live scene is merged with virtual scene, improve User's viewing experience.Effectively prevent when merging virtual scene with real live scene it is impossible to Reasonable adjustment parallax, reduce and use The problem of family viewing experience.

Second embodiment

As shown in figure 5, embodiments of the invention also provide a kind of stereoscopic Virtual Reality live broadcast device, including：

Acquisition module 501, for obtaining the left images of the live scene that left and right binocular camera shoots；

Stingy module 502, for respectively the left images of described live scene are carried out with FIG pull handle, obtains described live The left and right view of main broadcaster in scene；

Size adjustment module 503, for according to the corresponding live scene in main broadcaster position shooting distance in live scene With described left and right view virtual scene at least one of predetermined placement location corresponding virtual scene shooting distance distance, The size of described left and right view is adjusted；

Fusion Module 504, for being placed on the described predetermined placement in described virtual scene by the left and right view after adjustment Position, shoots, using left and right virtual video camera, the described virtual scene being placed with left and right view, thus obtaining synthesis have described master Broadcast the stereoscopic fusion view with described virtual scene, described stereoscopic fusion view includes left eye fusion view and right eye fusion regards Figure, thus show according to the virtual reality that described stereoscopic fusion view carries out three-dimensional, thus it is live to realize stereoscopic Virtual Reality.

The stereoscopic Virtual Reality live broadcast device of the embodiment of the present invention, is melted with virtual scene by the stereo-picture shooting live Close it is achieved that stereoscopic Virtual Reality is live；And by being adjusted to the size of live stereo-picture, make live axonometric chart As consistent with the dimension scale of virtual scene, optimize the effect that real live scene is merged with virtual scene, improve user Viewing experience.Effectively prevent when merging virtual scene with real live scene, due to virtual scene and real live scene Image scaled is inconsistent, reduces the problem of user's viewing experience.

Preferably, described size adjustment module 503 includes：

Preferably, described device also includes：

First determining module, for determining described scaling and described live scene shooting distance and described virtual scene The functional relationship of at least one of shooting distance distance, specifically for：Live scene image and void using predetermined labels thing Intend subscribing the virtual scene image of label, determine described scaling and described live scene shooting distance and described virtual field The functional relationship of at least one of scape shooting distance distance, wherein, described virtual predetermined labels thing is according to described pre- calibration The full-size(d) of note thing renders and obtains；

Described first acquisition submodule includes：

Wherein, described first determining module includes：

Preferably, described first determination sub-module includes：

Preferably, described device also includes：

Described first acquisition submodule includes：

Wherein, described second determining module includes：

Preferably, described second determination sub-module includes：

Described 3rd determination sub-module includes：

Preferably, described device also includes：

The stereoscopic Virtual Reality live broadcast device of the embodiment of the present invention, is melted with virtual scene by the stereo-picture shooting live Close it is achieved that stereoscopic Virtual Reality is live；And by being adjusted to the size of live stereo-picture, make live axonometric chart As consistent with the dimension scale of virtual scene；In addition, by border optimization, colour temperature and/or hue adjustment etc. it is ensured that left and right regards Figure and the concordance of virtual scene image；Optimize the effect that real live scene is merged with virtual scene, improve user and see See experience, effectively prevent when merging virtual scene with real live scene it is impossible to Reasonable adjustment parallax, reduce user's viewing The problem of experience.

It should be noted that this stereoscopic Virtual Reality live broadcast device is corresponding with above-mentioned stereoscopic Virtual Reality live broadcasting method Device, wherein in said method embodiment, all implementations, all be applied to the embodiment of this device, also can reach same Technique effect.

3rd embodiment

The embodiment of the present invention provides a kind of live equipment of stereoscopic Virtual Reality, and the live equipment of described stereoscopic Virtual Reality can wrap Containing the stereoscopic Virtual Reality live broadcast device described in aforementioned any embodiment.

Fig. 6 is the structural representation of stereoscopic Virtual Reality of the present invention one embodiment of live equipment, it is possible to achieve the present invention The flow process of embodiment illustrated in fig. 1.As shown in fig. 6, the live equipment of above-mentioned stereoscopic Virtual Reality, including：Display screen (not shown), shell Body 61, processor 62, memorizer 63, circuit board 64 and power circuit 65, wherein, display screen is rabbeted on housing 61, with housing Surround closing space together；Circuit board 64 is placed in the interior volume that display screen and housing 61 surround, processor 62 and memorizer 63 are arranged on circuit board 64；Power circuit 65, for for each circuit of the live equipment of above-mentioned stereoscopic Virtual Reality or device Power supply；Memorizer 63 is used for storing executable program code；Processor 62 passes through to read the executable journey of storage in memorizer 63 Sequence code is running program corresponding with executable program code, existing for executing tridimensional virtual described in aforementioned any embodiment Real live broadcasting method, obtains the left images of the live scene that left and right binocular camera shoots；A left side to described live scene respectively Right image carries out FIG pull handle, obtains the left and right view of main broadcaster in described live scene；In place according to main broadcaster institute in live scene Put the corresponding live scene shooting distance and described left and right view corresponding virtual scene of predetermined placement location in virtual scene At least one of shooting distance distance, is adjusted to the size of described left and right view；Left and right view after adjustment is placed Described predetermined placement location in described virtual scene, is shot using left and right virtual video camera and is placed with described in the view of left and right Virtual scene, thus obtain synthesis have the stereoscopic fusion view of described main broadcaster and described virtual scene, described stereoscopic fusion view Merge view including left eye and right eye merges view, thus solid is carried out according to described stereoscopic fusion view by described display screen The virtual reality changed shows, thus it is live to realize stereoscopic Virtual Reality.

Processor 62 to the concrete implementation procedure of above-mentioned steps and processor 62 by run executable program code The step executing further, may refer to the description of embodiment illustrated in fig. 1 of the present invention, will not be described here.

The live equipment of this stereoscopic Virtual Reality exists, including but not limited in a variety of forms：

(1) mobile communication equipment：The feature of this kind equipment is that possess mobile communication function, and to provide speech, data Communicate as main target.This Terminal Type includes：Smart mobile phone (such as iPhone), multimedia handset, feature mobile phone, and low End mobile phone etc..

(2) super mobile personal computer equipment：This kind equipment belongs to the category of personal computer, has calculating and processes work( Can, typically also possess mobile Internet access characteristic.This Terminal Type includes：PDA, MID and UMPC equipment etc., such as iPad.

(3) portable entertainment device：This kind equipment can show and play content of multimedia.This kind equipment includes：Audio frequency, The provider (such as iPod) of application program, handheld device, e-book, and intelligent toy and portable car-mounted navigation set Standby.

(4) server：There is provided the equipment of the service of calculating, it is total that the composition of server includes processor, hard disk, internal memory, system Line etc., server is similar with general computer architecture, but due to needing to provide highly reliable service, is therefore processing energy The aspects such as power, stability, reliability, safety, extensibility, manageability require higher.

(5) other have the electronic equipment of data interaction function.

In the embodiment of the present invention, module can be realized with software, so that by various types of computing devices.Citing comes Say, the executable code module of a mark can include one or more physics or the logical block of computer instruction, citing For, it can be built as object, process or function.Even so, the executable code of institute's mark module is without physically It is located together, but the different instruction being stored in different positions can be included, when being combined together in these command logics When, its regulation purpose constituting module and realizing this module.

In fact, executable code module can be individual instructions or many bar instructions, and even can be distributed On multiple different code segments, it is distributed in the middle of distinct program, and cross over multiple memory devices distributions.Similarly, grasp Make data to be identified in module, and can realize according to any suitable form and be organized in any suitable class In the data structure of type.Described peration data can be collected as individual data collection, or can be distributed on diverse location (including in different storage device), and electronic signal can be only used as at least in part be present on system or network.

When module can be realized using software it is contemplated that the level of existing hardware technique is it is possible to implemented in software Module, in the case of not considering cost, those skilled in the art can build corresponding hardware circuit come to realize correspond to Function, described hardware circuit include routine ultra-large integrated (VLSI) circuit or gate array and such as logic core The existing quasiconductor of piece, transistor etc or other discrete element.Module can also use programmable hardware device, such as Field programmable gate array, programmable logic array, programmable logic device etc. are realized.

In various embodiments of the present invention it should be appreciated that the size of the sequence number of above-mentioned each process be not meant to execute suitable The priority of sequence, the execution sequence of each process should be determined with its function and internal logic, and should not be to the enforcement of the embodiment of the present invention Process constitutes any restriction.

The above is the preferred embodiment of the present invention it is noted that for those skilled in the art For, on the premise of without departing from principle of the present invention, some improvements and modifications can also be made, these improvements and modifications Should be regarded as protection scope of the present invention.

Claims

1. a kind of stereoscopic Virtual Reality live broadcasting method is it is characterised in that include：

Respectively the left images of described live scene are carried out with FIG pull handle, the left and right obtaining main broadcaster in described live scene regards Figure；

According to main broadcaster position corresponding live scene shooting distance in live scene and described left and right view in virtual scene At least one of predetermined placement location corresponding virtual scene shooting distance distance, the size of described left and right view is carried out Adjustment；

Left and right view after adjustment is placed on the described predetermined placement location in described virtual scene, using the virtual shooting in left and right Machine shoots the described virtual scene being placed with left and right view, thus obtaining synthesis have described main broadcaster and the solid of described virtual scene Merge view, described stereoscopic fusion view includes left eye and merges view and right eye fusion view, thus according to described stereoscopic fusion The virtual reality that view carries out three-dimensional shows, thus it is live to realize stereoscopic Virtual Reality.

2. method according to claim 1 is it is characterised in that described corresponding according to main broadcaster position in live scene Live scene shooting distance and described left and right view are in the predetermined placement location corresponding virtual scene shooting distance of virtual scene At least one of distance, the step that the size of described left and right view is adjusted is included：

According to main broadcaster position corresponding live scene shooting distance in live scene and described left and right view in virtual scene At least one of predetermined placement location corresponding virtual scene shooting distance distance, obtain the pantograph ratio of described left and right view Example；

3. method according to claim 2 is it is characterised in that before the described scaling obtaining described left and right view, Methods described also includes：

Determine described scaling and at least one of described live scene shooting distance and described virtual scene shooting distance The functional relationship of distance；

Described according to main broadcaster position corresponding live scene shooting distance in live scene and described left and right view virtual At least one of the predetermined placement location corresponding virtual scene shooting distance of scene distance, obtains the contracting of described left and right view The step putting ratio includes：

According to main broadcaster position corresponding live scene shooting distance in live scene and described left and right view in virtual scene At least one of predetermined placement location corresponding virtual scene shooting distance distance, described scaling and described live field The functional relationship of at least one of scape shooting distance and described virtual scene shooting distance distance, obtains described left and right view Scaling；

Wherein, in the described scaling of described determination and described live scene shooting distance and described virtual scene shooting distance The step of the functional relationship of at least one distance includes：

Using the live scene image of predetermined labels thing and the virtual scene image of Virtual Subscription label, determine described pantograph ratio Example and the functional relationship of at least one of described live scene shooting distance and described virtual scene shooting distance distance, its In, described virtual predetermined labels thing is to render according to the full-size(d) of described predetermined labels thing to obtain.

4. method according to claim 3 is it is characterised in that the live scene image of described utilization predetermined labels thing and void Intend subscribing the virtual scene image of label, determine described scaling and described live scene shooting distance and described virtual field The functional relationship of at least one of scape shooting distance distance includes：

Obtain under at least one live scene shooting distance, what left and right binocular camera shot includes the live of predetermined labels thing Scene image, carries out FIG pull handle to the described live scene image including predetermined labels thing, obtains described predetermined labels thing View, and obtain the Pixel Dimensions of predetermined labels thing described in described predetermined labels thing view；

Obtain under at least one virtual scene shooting distance, what left and right virtual video camera shot includes virtual predetermined labels thing Virtual scene image, wherein, described virtual predetermined labels thing is to render according to the full-size(d) of described predetermined labels thing to obtain, And obtain the Pixel Dimensions of virtual predetermined labels thing described in described virtual scene image；

The pixel of predetermined labels thing according to described at least one live scene shooting distance, described predetermined labels thing view The pixel of virtual predetermined labels thing described in size, described at least one virtual scene shooting distance, described virtual scene image Size, determines the functional relationship of described scaling and described live scene shooting distance and described virtual scene shooting distance.

5. method according to claim 4 it is characterised in that described according to described at least one live scene shoot away from From the Pixel Dimensions of predetermined labels thing described in, described predetermined labels thing view, described at least one virtual scene shooting distance, The Pixel Dimensions of virtual predetermined labels thing described in described virtual scene image, determine described scaling and described live scene The step of the functional relationship of shooting distance and described virtual scene shooting distance includes：

Determine described scaling and described live scene shooting distance using method of least square and described virtual scene shoot away from From functional relationship.

6. method according to claim 2 is it is characterised in that before the described scaling obtaining described left and right view, Methods described also includes：

Determine described scaling and described live scene shooting distance, the shooting focal length of described left and right binocular camera and described The functional relationship of virtual scene shooting distance；

According to the corresponding live scene in main broadcaster position shooting distance, described left and right view in live scene in virtual scene The corresponding virtual scene shooting distance of predetermined placement location, the shooting focal length of described left and right binocular camera, described scaling Letter with described live scene shooting distance, the shooting focal length of described left and right binocular camera and described virtual scene shooting distance Number relation, obtains the scaling of described left and right view；

Wherein, the described scaling of described determination and described live scene shooting distance, the shooting of described left and right binocular camera The step of the functional relationship of focal length and described virtual scene shooting distance includes：

Obtain under at least one live scene shooting distance, what left and right binocular camera shot includes the live of predetermined labels thing Scene image, carries out FIG pull handle to the described live scene image including predetermined labels thing, obtains described predetermined labels thing View, and obtain the Pixel Dimensions of predetermined labels thing described in described predetermined labels thing view；Obtain at least one virtual scene Under shooting distance, the virtual scene image including virtual predetermined labels thing that left and right virtual video camera shoots, wherein, described void Intending predetermined labels thing is to render according to the full-size(d) of described predetermined labels thing to obtain, and obtains in described virtual scene image The Pixel Dimensions of described virtual predetermined labels thing；According to described at least one live scene shooting distance, described predetermined labels thing The Pixel Dimensions of predetermined labels thing described in view, described at least one virtual scene shooting distance, described virtual scene image Described in virtual predetermined labels thing Pixel Dimensions, determine described scaling and described live scene shooting distance and described void Intend the first function relation of scene capture distance；And

Obtaining described left and right binocular camera is under standard focal length, and what left and right binocular camera shot includes the second predetermined labels The live scene image of thing, carries out FIG pull handle to the described live scene image including the second predetermined labels thing, obtains mark Label view under quasi- focal length, and obtain the pixel chi of the second predetermined labels thing described in the label view under standard focal length Very little；Obtain under at least one shooting focal length of left and right binocular camera, it is pre- that what left and right binocular camera shot includes second Determine the live scene image of label, FIG pull handle carried out to the described live scene image including the second predetermined labels thing, Obtain the label view under at least one shooting focal length, and obtain described in the label view under at least one shooting focal length The Pixel Dimensions of the second predetermined labels thing, wherein, described shooting focal length is different from standard focal length；According to described standard focal length, institute State the Pixel Dimensions of the second predetermined labels thing described in the label view under standard focal length, described at least one shooting focal length, Described in label view under described at least one shooting focal length, the Pixel Dimensions of the second predetermined labels thing, determine shooting focal length Image scaling proportionate relationship with standard focal length；

According to described first function relation, described shooting focal length and the image scaling proportionate relationship of described standard focal length, determine institute State scaling to clap with described live scene shooting distance, the shooting focal length of described left and right binocular camera and described virtual scene The functional relationship of photographic range.

7. method according to claim 6 it is characterised in that described according to described at least one live scene shoot away from From the Pixel Dimensions of predetermined labels thing described in, described predetermined labels thing view, described at least one virtual scene shooting distance, The Pixel Dimensions of virtual predetermined labels thing described in described virtual scene image, determine described scaling and described live scene The step of the first function relation of shooting distance and described virtual scene shooting distance includes：

Determine described scaling and described live scene shooting distance using method of least square and described virtual scene shoot away from From first function relation；

Described according to described standard focal length, the pixel of the second predetermined labels thing described in the label view under described standard focal length Described in label view under size, described at least one shooting focal length, described at least one shooting focal length, second calibrates in advance The Pixel Dimensions of note thing, determine that shooting focal length and the step of the image scaling proportionate relationship of standard focal length include：

8. the method according to any one of claim 1-7 is it is characterised in that the described left and right to described live scene respectively Image carries out FIG pull handle, and after obtaining the left and right view of main broadcaster in described live scene, methods described also includes：

Colour temperature according to described virtual scene and/or tone, are adjusted to the colour temperature and/or tone of described left and right view.

9. a kind of stereoscopic Virtual Reality live broadcast device is it is characterised in that include：

Stingy module, for respectively the left images of described live scene are carried out with FIG pull handle, obtains in described live scene The left and right view of main broadcaster；

Size adjustment module, for according to main broadcaster position corresponding live scene shooting distance and a described left side in live scene Right view at least one of the predetermined placement location corresponding virtual scene shooting distance distance of virtual scene, to a described left side The size of right view is adjusted；

Fusion Module, for the described predetermined placement location being placed on the left and right view after adjustment in described virtual scene, profit Shot with left and right virtual video camera and be placed with the described virtual scene of left and right view, thus obtaining synthesis have described main broadcaster and described The stereoscopic fusion view of virtual scene, described stereoscopic fusion view includes left eye and merges view and right eye fusion view, thus root Show according to the virtual reality that described stereoscopic fusion view carries out three-dimensional, thus it is live to realize stereoscopic Virtual Reality.

10. device according to claim 9 is it is characterised in that described size adjustment module includes：

First acquisition submodule, for according to main broadcaster position corresponding live scene shooting distance in live scene and described Left and right view, at least one of the predetermined placement location corresponding virtual scene shooting distance distance of virtual scene, obtains institute State the scaling of left and right view；

Adjustment submodule, for the scaling according to described left and right view, is adjusted to the size of described left and right view.

11. devices according to claim 10 are it is characterised in that described device also includes：

First determining module, for determining described scaling and described live scene shooting distance and the shooting of described virtual scene The functional relationship of at least one of distance distance；

Described first acquisition submodule includes：

First acquisition unit, for according to main broadcaster position corresponding live scene shooting distance and a described left side in live scene Right view is at least one of the predetermined placement location corresponding virtual scene shooting distance distance of virtual scene, described scaling Ratio and the functional relationship of at least one of described live scene shooting distance and described virtual scene shooting distance distance, obtain Take the scaling of described left and right view；

Wherein, described first determining module is used for：

12. devices according to claim 11 are it is characterised in that described first determining module includes：

Second acquisition submodule, for obtaining under at least one live scene shooting distance, the bag that left and right binocular camera shoots Live scene image containing predetermined labels thing, carries out to the described live scene image including predetermined labels thing scratching at figure Reason, obtains described predetermined labels thing view, and obtains the Pixel Dimensions of predetermined labels thing described in described predetermined labels thing view；

3rd acquisition submodule, for obtaining under at least one virtual scene shooting distance, the bag that left and right virtual video camera shoots Virtual scene image containing virtual predetermined labels thing, wherein, described virtual predetermined labels thing is according to described predetermined labels thing Full-size(d) render and obtain, and obtain the Pixel Dimensions of virtual predetermined labels thing described in described virtual scene image；

First determination sub-module, for according in described at least one live scene shooting distance, described predetermined labels thing view Described in the Pixel Dimensions of described predetermined labels thing, described at least one virtual scene shooting distance, described virtual scene image The Pixel Dimensions of virtual predetermined labels thing, determine described scaling and described live scene shooting distance and described virtual scene The functional relationship of shooting distance.

13. devices according to claim 12 are it is characterised in that described first determination sub-module includes：

First determining unit, for determining described scaling and described live scene shooting distance and institute using method of least square State the functional relationship of virtual scene shooting distance.

14. devices according to claim 10 are it is characterised in that described device also includes：

Second determining module, for determining described scaling and described live scene shooting distance, described left and right binocular camera shooting The shooting focal length of machine and the functional relationship of described virtual scene shooting distance；

Described first acquisition submodule includes：

Second acquisition unit, for according to the corresponding live scene in main broadcaster position shooting distance, a described left side in live scene The predetermined placement location corresponding virtual scene shooting distance in virtual scene for the right view, the shooting of described left and right binocular camera Focal length, described scaling and described live scene shooting distance, the shooting focal length of described left and right binocular camera and described void Intend the functional relationship of scene capture distance, obtain the scaling of described left and right view；

Wherein, described second determining module includes：

Second determination sub-module, for obtaining under at least one live scene shooting distance, the bag that left and right binocular camera shoots Live scene image containing predetermined labels thing, carries out to the described live scene image including predetermined labels thing scratching at figure Reason, obtains described predetermined labels thing view, and obtains the Pixel Dimensions of predetermined labels thing described in described predetermined labels thing view； Obtain under at least one virtual scene shooting distance, what left and right virtual video camera shot includes the virtual of virtual predetermined labels thing Scene image, wherein, described virtual predetermined labels thing is to render according to the full-size(d) of described predetermined labels thing to obtain, and obtains Take the Pixel Dimensions of virtual predetermined labels thing described in described virtual scene image；Shot according to described at least one live scene Distance, the Pixel Dimensions of predetermined labels thing described in described predetermined labels thing view, described at least one virtual scene shoot away from From the Pixel Dimensions of virtual predetermined labels thing described in, described virtual scene image, determine that described scaling is live with described Scene capture distance and the first function relation of described virtual scene shooting distance；And the 3rd determination sub-module, for obtaining Described left and right binocular camera is under standard focal length, and what left and right binocular camera shot includes the live of the second predetermined labels thing Scene image, carries out FIG pull handle to the described live scene image including the second predetermined labels thing, obtains under standard focal length Label view, and obtain the Pixel Dimensions of the second predetermined labels thing described in the label view under standard focal length；Obtain Under at least one shooting focal length of left and right binocular camera, what left and right binocular camera shot includes the second predetermined labels thing Live scene image, the described live scene image including the second predetermined labels thing is carried out with FIG pull handle, obtains at least A kind of label view under shooting focal length, and obtain described in the label view under at least one shooting focal length second and make a reservation for The Pixel Dimensions of label, wherein, described shooting focal length is different from standard focal length；According to described standard focal length, described standard is burnt Away under label view described in the second predetermined labels thing Pixel Dimensions, described at least one shooting focal length, described at least The Pixel Dimensions of the second predetermined labels thing described in a kind of label view under shooting focal length, determine that shooting focal length is burnt with standard Away from image scaling proportionate relationship；

4th determination sub-module, for the image according to described first function relation, described shooting focal length and described standard focal length Scaling relationships, determine described scaling and described live scene shooting distance, the shooting of described left and right binocular camera Focal length and the functional relationship of described virtual scene shooting distance.

15. devices according to claim 14 are it is characterised in that described second determination sub-module includes：

Second determining unit, for determining described scaling and described live scene shooting distance and institute using method of least square State the first function relation of virtual scene shooting distance；

Described 3rd determination sub-module includes：

3rd determining unit, for determining the image scaling proportionate relationship of shooting focal length and standard focal length using method of least square.

16. devices according to any one of claim 9-15 are it is characterised in that described device also includes：

Picture adjusting module, for the colour temperature according to described virtual scene and/or tone, colour temperature to described left and right view and/ Or tone is adjusted.

A kind of live equipment of 17. stereoscopic Virtual Reality is it is characterised in that include：Display screen, housing, processor, memorizer, electricity Road plate and power circuit, wherein：

Described circuit board is placed in the interior volume that described housing and described display screen surround, described processor and described memorizer It is arranged on described circuit board；

Described memorizer is used for storing executable program code；

Described processor is run corresponding with executable program code by the executable program code of storage in reading memorizer Program, execution：

Left and right view after adjustment is placed on the described predetermined placement location in described virtual scene, using the virtual shooting in left and right Machine shoots the described virtual scene being placed with left and right view, thus obtaining synthesis have described main broadcaster and the solid of described virtual scene Merge view, described stereoscopic fusion view includes left eye and merges view and right eye fusion view, thus passing through described display screen root Show according to the virtual reality that described stereoscopic fusion view carries out three-dimensional, thus it is live to realize stereoscopic Virtual Reality.