CN107396084A - A kind of MR implementation methods and equipment based on dual camera - Google Patents

A kind of MR implementation methods and equipment based on dual camera Download PDF

Info

Publication number
CN107396084A
CN107396084A CN201710616657.4A CN201710616657A CN107396084A CN 107396084 A CN107396084 A CN 107396084A CN 201710616657 A CN201710616657 A CN 201710616657A CN 107396084 A CN107396084 A CN 107396084A
Authority
CN
China
Prior art keywords
scene
real time
background
virtual
time scene
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710616657.4A
Other languages
Chinese (zh)
Inventor
沈时进
盛中华
李志雄
潘镭
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Leafun Culture Science and Technology Co Ltd
Original Assignee
Guangzhou Leafun Culture Science and Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Leafun Culture Science and Technology Co Ltd filed Critical Guangzhou Leafun Culture Science and Technology Co Ltd
Priority to CN201710616657.4A priority Critical patent/CN107396084A/en
Publication of CN107396084A publication Critical patent/CN107396084A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • G06T15/10Geometric effects
    • G06T15/20Perspective computation
    • G06T15/205Image-based rendering
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/006Mixed reality
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/204Image signal generators using stereoscopic image cameras
    • H04N13/207Image signal generators using stereoscopic image cameras using a single 2D image sensor
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/44012Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs

Abstract

The embodiment of the invention discloses a kind of MR implementation methods based on dual camera and equipment, this method to include:The real time scene of current environment is gathered by dual camera, and the background and prospect entity in the real time scene are separated by default background color, obtain background view and entity scene, being sent to rendering server includes the render request of the background view, and receive rendering server and render response for what the render request returned, the background view that the real time scene includes is substituted for the virtual scene of background view matching, and exports the virtual scene and the entity scene.VR and AR function can be merged by implementing the embodiment of the present invention, by the way that by way of physical surroundings are combined virtual digit space can accurately be recognized into mutual identity between each other when more people interact, improve the security when realizing that more people interact by the virtual scenes of 3D, interactive mode is enriched, more three-dimensional safer diversified Interactive Experience more true to nature is brought to user.

Description

A kind of MR implementation methods and equipment based on dual camera
Technical field
The present invention relates to real (Mediated Reality, the MR) technical field of mediation, more particularly to one kind to be taken the photograph based on double As the MR implementation methods and equipment of head.
Background technology
Currently, with the fast development of electronic technology, the application of virtual reality (Virtual Reality, VR) technology It is more and more extensive, wherein, the most common application of VR technologies is presented as its application in aspects of game play, i.e., abundant perception with 3D display environment causes VR equipment to become preferable video-game instrument, for example, user can pass through after putting on VR equipment The stimulation or mutual with the virtual role progress in the virtual scenes of 3D during roller-coaster is sat in the virtual scene experience of 3D that VR equipment is shown It is dynamic, it can so make user on the spot in person, with the enjoyment of increase game.Practice is found, is realizing that more people interact by VR technologies During, not only include virtual scene in the virtual scenes of 3D that VR equipment is shown, in addition to for interactive user virtualization after Virtual role obtain and in the virtual scene, the difference on build and equipment due to virtual role and interactive user be present It is different, during the virtual scenes of 3D and the virtual role of interactive user that user is shown by VR equipment interact, user Interactive user can be collided, this gives interaction both sides to bring infliction of body.It can be seen that existing realized by the virtual scenes of 3D The problem of security is low be present in the mode of more people's interactions.
The content of the invention
, can be to based on double shootings the embodiment of the invention discloses a kind of MR implementation methods and equipment based on dual camera The real person or scenery that head captures carry out actualization and shown, improve when realizing that more people interact by the virtual scenes of 3D Security.
First aspect of the embodiment of the present invention discloses a kind of MR implementation methods based on dual camera, and methods described includes:
The real time scene of current environment is gathered by dual camera, and by presetting the reality of background color separation collection Background in Shi Jingxiang and prospect entity, obtain background view and entity scene, the background color of the background view with it is described Default background color matches;
Being sent to rendering server includes the render request of the background view, and receives the rendering server and be directed to institute The response that renders of render request return is stated, the render request is used for the virtual scene that background view described in acquisition request matches, The virtual scene for rendering the background view of the response including being determined by the rendering server and matching;
The background view that the real time scene is included is substituted for the virtual scene of the background view matching, and defeated Go out the virtual scene and the entity scene.
As an alternative embodiment, in first aspect of the embodiment of the present invention, it is described by presetting background color The background and prospect entity in the real time scene of collection are separated, obtains background view and entity scene, including:
Known otherwise by background color, color and default background color phase are identified from the real time scene of collection The part real time scene of matching, and whether judge in the part real time scene comprising certain for personage in the real time scene The real time scene of a little body parts;
When judged result is to be, some bodies for being directed to personage in the real time scene will be removed in the part real time scene The first remaining real time scene outside the real time scene of body region is defined as background view, and by pin in the part real time scene Entity scape is defined as to the real time scene of some body parts of personage in the real time scene and the second remaining real time scene As the real time scene of the part real time scene and the second remaining real time scene composition collection.
As an alternative embodiment, in first aspect of the embodiment of the present invention, service is rendered described in the reception Device for the render request return render response after, and the background view that the real time scene is included It is substituted for before the virtual scene of the background view matching, methods described also includes:
The virtual of the background view determined by the rendering server matching that response includes is rendered described in judgement Whether the number of scene is more than 1;
When judging the background view determined by the rendering server matching for rendering response and including When the number of virtual scene is not more than 1, triggering performs the background view for including the real time scene and is substituted for institute State the operation of the virtual scene of background view matching;
Methods described also includes:
When judging the background view determined by the rendering server matching for rendering response and including When the number of virtual scene is more than 1, all virtual scenes that response is rendered described in output to be included select for user;
One of them virtual scene that user selects from all virtual scenes is determined, and by the real time scene Including the background view be substituted for one of them described virtual scene, and the output entity scene and it is described wherein One virtual scene.
As an alternative embodiment, in first aspect of the embodiment of the present invention, methods described also includes:
Body-sensing action of the user for the dummy object in the virtual scene is gathered, and judges the dynamic of the body-sensing action Make whether parameter meets parameter preset condition;
When the action parameter of body-sensing action meets the parameter preset condition, according to the action of body-sensing action Parameter generation for the dummy object control instruction, and according to the control instruction, control the dummy object perform with The operation that the control instruction matches.
As an alternative embodiment, in first aspect of the embodiment of the present invention, methods described also includes:
When interaction personage in the entity scene be present, interactive information of the collection for the interactive personage;
Judge whether the interactive information is legal interactive information, when judging that the interactive information is the legal interaction During information, the interactive information is sent to the rendering server, to trigger the rendering server by the interactive information It is issued to interactive device corresponding to the interactive personage.
Second aspect of the embodiment of the present invention discloses a kind of MR based on dual camera and realizes equipment, and the equipment includes:
Collecting unit, for gathering the real time scene of current environment by dual camera;
Separative element, the back of the body in the real time scene for separating the collecting unit collection by presetting background color Scape and prospect entity, obtain background view and entity scene, the background color of the background view and the default background color Match;
Communication unit, the render request of the background view is included for being sent to rendering server, and receives the wash with watercolours Dye server renders response for what the render request returned, and the render request is used for background view described in acquisition request The virtual scene matched somebody with somebody, the virtual scape for rendering the background view of the response including being determined by the rendering server and matching As;
Replacement unit, the background view for the real time scene to be included are substituted for the background view matching Virtual scene;
Output unit, for exporting the virtual scene and the entity scene.
As an alternative embodiment, in second aspect of the embodiment of the present invention, the separative element includes:
Subelement is identified, for knowing otherwise by background color, color is identified from the real time scene of collection The part real time scene to match with default background color;
Judgment sub-unit, personage in the real time scene is directed to for judging whether to include in the part real time scene The real time scene of some body parts;
Determination subelement, for when the judgment sub-unit judged result for be when, by the part real time scene The first remaining real time scene in for the real time scene in addition to the real time scene of some body parts of personage is defined as Background view, and the real time scene for some body parts of personage in the real time scene being directed in the part real time scene And second remaining real time scene be defined as entity scene, the part real time scene and the second remaining real time scene group Into the real time scene of collection.
As an alternative embodiment, in second aspect of the embodiment of the present invention, the equipment also includes:
First judging unit, returned for receiving the rendering server in the communication unit for the render request Render after response and in the background view that the replacement unit includes the real time scene be substituted for the back of the body Before the virtual scene of scape scene matching aided navigation, the back of the body determined by the rendering server that response includes is rendered described in judgement Whether the number of the virtual scene of scape scene matching aided navigation is more than 1, when judge it is described render that response includes render service by described When the number of the virtual scene for the background view matching that device is determined is not more than 1, trigger described in the replacement unit execution The background view that the real time scene is included is substituted for the operation of the virtual scene of the background view matching;
Output unit, be additionally operable to when first judging unit judge it is described render that response includes render clothes by described When the number of the virtual scene for the background view matching that business device is determined is more than 1, render what response included described in output All virtual scenes select for user;
The equipment also includes:
Determining unit, one of them the virtual scene selected for determining user from all virtual scenes;
The replacement unit, the background view for being additionally operable to include the real time scene are substituted for described wherein one Individual virtual scene;
The output unit, it is additionally operable to export the entity scene and one of them described virtual scene.
As an alternative embodiment, in second aspect of the embodiment of the present invention, the collecting unit, it is additionally operable to adopt Collect body-sensing action of the user for the dummy object in the virtual scene;
The equipment also includes:
Second judging unit, for judging whether the action parameter of the body-sensing action meets parameter preset condition;
Generation unit, when the action parameter for being acted when the body-sensing meets the parameter preset condition, according to described Control instruction of the action parameter generation of body-sensing action for the dummy object;
Control unit, for according to the control instruction, controlling the dummy object to perform and the control instruction phase The operation matched somebody with somebody.
As an alternative embodiment, in second aspect of the embodiment of the present invention, the collecting unit, it is additionally operable to work as When interaction personage in the entity scene be present, interactive information of the collection for the interactive personage;
The equipment also includes:
3rd judging unit, for judging whether the interactive information is legal interactive information;
The communication unit, it is additionally operable to when the 3rd judging unit judges that the interactive information is the legal interaction During information, the interactive information is sent to the rendering server, to trigger the rendering server by the interactive information It is issued to interactive device corresponding to the interactive personage.
Compared with prior art, the embodiment of the present invention possesses following beneficial effect:
In the embodiment of the present invention, the real time scene of current environment is gathered by dual camera, and by presetting background color The background and prospect entity in the real time scene are separated, obtains background view and entity scene, the background color of the background view Match with default background color, the render request for including the background view is sent to rendering server, and receive and render service Device renders response for what the render request returned, and the render request is used for the virtual scape of acquisition request background view matching As this renders the virtual scene that the background view of response including being determined by rendering server matches, by the real time scene bag The background view included is substituted for the virtual scene of background view matching, and exports the virtual scene and the entity scene.Can See, real time scene can be caught by dual camera by implementing the embodiment of the present invention, and be taken the photograph by way of colour recognition for double The real time scene captured as head realizes the separation of background and prospect entity, and background further can also be substituted for into virtual number Mapping of the word space (i.e. the virtual scenes of 3D) in physical surroundings, it is this by virtual digit space and physical surroundings (also known as physics Environment, including personage and scenery) mode that is combined merged the work(of VR and augmented reality (Augmented Reality, AR) Can, mutual identity can be accurately recognized between each other when more people interact, improve and realized by the virtual scenes of 3D Security during more people's interactions, enriches interactive mode, and it is interactive to bring more three-dimensional safer variation more true to nature to user Experience.
Brief description of the drawings
Technical scheme in order to illustrate the embodiments of the present invention more clearly, it will use below required in embodiment Accompanying drawing is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the present invention, for ability For the those of ordinary skill of domain, on the premise of not paying creative work, it can also be obtained according to these accompanying drawings other attached Figure.
Fig. 1 is a kind of schematic flow sheet of the MR implementation methods based on dual camera disclosed in the embodiment of the present invention;
Fig. 2 is the schematic flow sheet of MR implementation method of the another kind disclosed in the embodiment of the present invention based on dual camera;
Fig. 3 is the structural representation that a kind of MR based on dual camera disclosed in the embodiment of the present invention realizes equipment;
Fig. 4 is the structural representation that MR of the another kind disclosed in the embodiment of the present invention based on dual camera realizes equipment;
Fig. 5 is the structural representation that another disclosed MR based on dual camera of the embodiment of the present invention realizes equipment;
Fig. 6 is the structural representation that another disclosed MR based on dual camera of the embodiment of the present invention realizes equipment;
Fig. 7 is the structural representation that another disclosed MR based on dual camera of the embodiment of the present invention realizes equipment;
Fig. 8 is the effect diagram that a kind of MR based on dual camera disclosed in the embodiment of the present invention realizes equipment.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete Site preparation describes, it is clear that described embodiment is only part of the embodiment of the present invention, rather than whole embodiments.Based on this Embodiment in invention, the every other reality that those of ordinary skill in the art are obtained under the premise of creative work is not made Example is applied, belongs to the scope of protection of the invention.
It should be noted that the term " comprising " and " having " of the embodiment of the present invention and their any deformation, it is intended that Be to cover it is non-exclusive include, for example, containing the process of series of steps or unit, method, system, product or equipment not Be necessarily limited to those steps or the unit clearly listed, but may include not list clearly or for these processes, side The intrinsic other steps of method, product or equipment or unit.
The embodiment of the invention discloses a kind of MR implementation methods and equipment based on dual camera, dual camera can be passed through Real time scene is caught, and realizes that background is real with prospect for the real time scene that dual camera captures by way of colour recognition The separation of body, and background further can also be substituted for virtual digit space (i.e. the virtual scenes of 3D) reflecting in physical surroundings Penetrate, this mode for being combined virtual digit space and physical surroundings (also known as physical environment, including personage and scenery) merges VR and augmented reality (Augmented Reality, AR) function, can accurately be recognized between each other when more people interact Go out mutual identity, improve the security when realizing that more people interact by the virtual scenes of 3D, interactive mode is enriched, to use Family brings more three-dimensional safer diversified Interactive Experience more true to nature.Accompanying drawing is combined below to be described in detail.
Embodiment one
Referring to Fig. 1, Fig. 1 is that a kind of flow of the MR implementation methods based on dual camera is shown disclosed in the embodiment of the present invention It is intended to.Wherein, the method described by Fig. 1 shows equipment suitable for the MR heads with dual camera.As shown in figure 1, should be based on double The MR implementation methods of camera can include following operation:
101st, MR heads show the real time scene that equipment gathers current environment by dual camera.
In the embodiment of the present invention, MR heads show equipment can have at least three kinds of experience modes, as VR patterns, AR patterns and VR+AR MR patterns etc., after MR heads show equipment startup, at least three kinds of experience modes can be exported and selected for user, work as inspection When the experience mode for measuring user's selection is MR patterns, triggering performs step 101- steps 105, and the aobvious equipment of MR heads can also be default Start MR patterns, the embodiment of the present invention does not limit.
In the embodiment of the present invention, MR heads, which show equipment, has dual camera, and the dual camera is adopted to simulate human eye work Collect real time scene within the vision, real-time rendering, overlapping portion are carried out to the real time scene (or digital picture) collected Virtual scene realizes AR patterns, can also be superimposed virtual scene completely and realize VR patterns, can also pass through step 102- steps 105 Operation realize MR patterns, the embodiment of the present invention does not limit.
102nd, MR heads show the background and prospect reality in above-mentioned real time scene of the equipment by presetting background color separation collection Body, obtain background view and entity scene.
In the embodiment of the present invention, the background color of the background view matches with the default background color, and optionally, this is pre- Do not limited if background color can be green or blueness, the embodiment of the present invention.Specifically, in actual applications, can be by electricity It is real with prospect that the green curtain (default background color is green) or blue curtain (default background color is blueness) of shadow special efficacy are applied to background The separation process of body, you can so that certain specific physical environment is partly or entirely arranged into green curtain or blue curtain in advance, MR heads show Equipment is under MR patterns by color is identical with default background color or matches scape by way of identifying default background color As being defined as background view, and scene that is color is different from default background color or not matching that is defined as the reality of prospect entity Body scene.
In the embodiment of the present invention, optionally, MR heads show the above-mentioned real-time scape that equipment gathers by presetting background color separation Background and prospect entity as in, obtaining background view and entity scene can include:
MR heads show equipment to be known otherwise by background color, identifies color with presetting from the above-mentioned real time scene of collection The part real time scene that background color matches, and judge whether to include in the part real time scene and be directed in above-mentioned real time scene Some body parts of personage are (such as the head and/or personage of the upper part of the body of personage and/or the lower part of the body of personage and/or personage Foot etc.) real time scene;
When judged result for when being, MR heads, which will show equipment, to be removed in the part real time scene for personage in above-mentioned real time scene Some body parts real time scene outside the first remaining real time scene be defined as background view, and by the real-time scape in the part The real time scene of some body parts of personage and the second remaining real time scene in above-mentioned real time scene is directed to as in be defined as The above-mentioned real time scene of entity scene, the part real time scene and the second remaining real time scene composition collection;
When judged result is no, MR heads show equipment and the part real time scene are defined as into background view, and will be remaining real Shi Jingxiang is defined as entity scene, the above-mentioned real time scene of the part real time scene and the remaining real time scene composition collection
103rd, MR heads show the render request that equipment includes above-mentioned background view to rendering server transmission, and the render request is used In the virtual scene of the above-mentioned background view matching of acquisition request.
In the embodiment of the present invention, MR heads, which show the render request that equipment is sent, can also include the equipment mark that MR heads show equipment Know.Specifically, after the aobvious equipment of MR heads sends the render request for including above-mentioned background view to rendering server, by rendering service Device performs following operate:
The device identification included by rendering server according to the render request judges that MR heads show whether equipment is to authorize in advance MR heads show equipment, when judging MR heads to show equipment being that the MR heads that authorize in advance show equipment, identify that the render request includes Background view in multiple calibration points, and according to the multiple calibration points identified determine MR heads show equipment residing for concrete scene And MR heads show specific visual angle of the equipment in the concrete scene, and determined according to the concrete scene and the specific visual angle Corresponding virtual scene, and the virtual scene that the virtual scene determined is matched as above-mentioned background view, and will include The response that renders for the virtual scene determined returns to the aobvious equipment of MR heads.
104th, the aobvious equipment of MR heads receives rendering server and renders response for what above-mentioned render request returned, and this renders response Including the virtual scene for the above-mentioned background view matching determined by rendering server.
In the embodiment of the present invention, a variety of background views are stored with the rendering server and matched with background view to A few virtual scene.
105th, the above-mentioned background view that the aobvious equipment of MR heads includes above-mentioned real time scene is substituted for above-mentioned background view matching Virtual scene, and export the virtual scene and above-mentioned entity scene.
In the embodiment of the present invention, MR heads show equipment and the background view that above-mentioned real time scene includes are replaced with into background view The virtual scene of matching, to realize the separation of background and prospect entity, and is substituted for virtual digit space in entity ring by background Mapping in border.
In the embodiment of the present invention, it is assumed that two users (party A-subscriber and party B-subscriber) show equipment by MR heads and interacted, now, MR heads show the effect that shows of equipment can with as shown in figure 8, Fig. 8 be disclosed in the embodiment of the present invention it is a kind of based on dual camera MR realizes the effect diagram of equipment.As shown in figure 8, the wall in physical environment and floor are arranged to the default back of the body in advance Scape color (green), and multiple calibration points are provided with the wall, the physical environment includes entity tables and chairs and entity hides Sunshade, party A-subscriber and party B-subscriber with the aobvious equipment of MR heads, the MR heads that party A-subscriber wears show equipment and captured for the physical rings After the real time scene in border, the real time scene is separated into including party B-subscriber, entity tables and chairs and reality by way of identifying green The entity scene of body parasols and the background view including wall and floor, and obtain the background view from rendering server Including multiple calibration points corresponding to virtual scene, and by background mirror image replace with corresponding to virtual scene, finally, party A-subscriber The visual effect seen by the aobvious equipment of the MR heads of its wearing can be as shown in the lower right-most portion in Fig. 8, i.e., party A-subscriber can pass through MR heads show the entity scene that equipment sees formed objects, including entity parasols, entity tables and chairs and party B-subscriber.
It can be seen that the MR implementation methods based on dual camera implemented described by Fig. 1 can be caught in real time by dual camera Scene, and realize background and point of prospect entity for the real time scene that dual camera captures by way of colour recognition From, and background further can also be substituted for mapping of the virtual digit space (i.e. the virtual scenes of 3D) in physical surroundings, this Kind by the mode that virtual digit space and physical surroundings (also known as physical environment, including personage and scenery) are combined merged VR and The function of augmented reality (Augmented Reality, AR), can accurately it be recognized between each other each other when more people interact Identity, improve the security when realizing that more people interact by the virtual scenes of 3D, enrich interactive mode, brought to user More three-dimensional safer diversified Interactive Experience more true to nature.
Embodiment two
Referring to Fig. 2, Fig. 2 is that a kind of flow of the MR implementation methods based on dual camera is shown disclosed in the embodiment of the present invention It is intended to.Wherein, the method described by Fig. 2 shows equipment suitable for the MR heads with dual camera.As shown in Fig. 2 should be based on double The MR implementation methods of camera can include following operation:
201st, MR heads show the real time scene that equipment gathers current environment by dual camera.
202nd, MR heads show the background and prospect reality in above-mentioned real time scene of the equipment by presetting background color separation collection Body, obtain background view and entity scene.
In the embodiment of the present invention, the background color of the background view matches with the default background color, and optionally, this is pre- Do not limited if background color can be green or blueness, the embodiment of the present invention.
In the embodiment of the present invention, optionally, MR heads show the above-mentioned real-time scape that equipment gathers by presetting background color separation Background and prospect entity as in, obtaining background view and entity scene can include:
MR heads show equipment to be known otherwise by background color, identifies color with presetting from the above-mentioned real time scene of collection The part real time scene that background color matches, and judge whether to include in the part real time scene and be directed in above-mentioned real time scene Some body parts of personage are (such as the head and/or personage of the upper part of the body of personage and/or the lower part of the body of personage and/or personage Foot etc.) real time scene;
When judged result for when being, MR heads, which will show equipment, to be removed in the part real time scene for personage in above-mentioned real time scene Some body parts real time scene outside the first remaining real time scene be defined as background view, and by the real-time scape in the part The real time scene of some body parts of personage and the second remaining real time scene in above-mentioned real time scene is directed to as in be defined as The above-mentioned real time scene of entity scene, the part real time scene and the second remaining real time scene composition collection;
When judged result is no, MR heads show equipment and the part real time scene are defined as into background view, and will be remaining real Shi Jingxiang is defined as entity scene, the above-mentioned real time scene of the part real time scene and the remaining real time scene composition collection.
203rd, MR heads show the render request that equipment includes above-mentioned background view to rendering server transmission, and the render request is used In the virtual scene of the above-mentioned background view matching of acquisition request.
In the embodiment of the present invention, MR heads, which show the render request that equipment is sent, can also include the equipment mark that MR heads show equipment Know.Specifically, after the aobvious equipment of MR heads sends the render request for including above-mentioned background view to rendering server, by rendering service Device performs following operate:
The device identification included by rendering server according to the render request judges that MR heads show whether equipment is to authorize in advance MR heads show equipment, when judging MR heads to show equipment being that the MR heads that authorize in advance show equipment, identify that the render request includes Background view in multiple calibration points, and according to the multiple calibration points identified determine MR heads show equipment residing for concrete scene And MR heads show specific visual angle of the equipment in the concrete scene, and determined according to the concrete scene and the specific visual angle Corresponding virtual scene, and the virtual scene that the virtual scene determined is matched as above-mentioned background view, and will include The response that renders for the virtual scene determined returns to the aobvious equipment of MR heads.
204th, the aobvious equipment of MR heads receives rendering server and renders response for what above-mentioned render request returned, and this renders response Including the virtual scene for the above-mentioned background view matching determined by rendering server.
205th, MR heads show equipment and judge to render the above-mentioned background view determined by the rendering server matching that response includes Virtual scene number whether be more than 1, when step 205 judged result for it is no when, trigger step 206, when sentencing for step 205 Disconnected result is when being, triggering performs step 207- steps 208.
206th, the above-mentioned background view that the aobvious equipment of MR heads includes above-mentioned real time scene is substituted for above-mentioned background view matching Virtual scene, and export the virtual scene and above-mentioned entity scene.
207th, the aobvious equipment output of MR heads, which renders, responds all virtual scenes included for user's selection, and determination user One of them the virtual scene selected from all virtual scenes.
208th, the above-mentioned background view that the aobvious equipment of MR heads includes above-mentioned real time scene is substituted for above-mentioned one of empty Intend scene, and export above-mentioned entity scene and one of them above-mentioned virtual scene.
In an optional embodiment, after be finished step 206 or the step 208 that is finished, this is based on The MR implementation methods of dual camera can also include following operation:
MR heads show equipment, and by the body-sensing sensor in the aobvious equipment of MR heads, (such as gyroscope, gravity sensor and acceleration pass Sensor etc.) collection user acts for the body-sensing of the dummy object in above-mentioned virtual scene, and judges the action of body-sensing action Whether parameter meets parameter preset condition;
When the action parameter of body-sensing action meets parameter preset condition, MR heads show equipment and moved according to what the body-sensing acted Make control instruction of the parameter generation for dummy object, and according to the control instruction, control dummy object performs to be referred to the control Make the operation to match.
It can be seen that the optional embodiment can act generation according to the body-sensing of user is directed to dummy object in virtual scene Control instruction, enrich the interactive mode of user and virtual scene so that the aobvious equipment of MR heads is more intelligent, further improves The usage experience of user.
In another optional embodiment, after be finished step 206 or the step 208 that is finished, this is based on The MR implementation methods of dual camera can also include following operation:
When interaction personage in above-mentioned entity scene be present, MR heads show interaction letter of the equipment collection for interaction personage Breath;
MR heads show equipment and judge whether the interactive information is legal interactive information, when judging that the interactive information is legal friendship During mutual information, the interactive information is sent to rendering server, the interactive information is issued to interaction to trigger rendering server Interactive device corresponding to personage.Interaction is carried out between the interaction personage that so can allow for occurring in real time scene, is enhanced mutually Kinetoplast is tested, and can also carry out legitimate verification to interactive information, is conducive to provide a harmonious mutual environment of health, is entered one Step improves the usage experience of user.
It can be seen that the MR implementation methods based on dual camera implemented described by Fig. 2 can be caught in real time by dual camera Scene, and realize background and point of prospect entity for the real time scene that dual camera captures by way of colour recognition From, and background further can also be substituted for mapping of the virtual digit space (i.e. the virtual scenes of 3D) in physical surroundings, this Kind by the mode that virtual digit space and physical surroundings (also known as physical environment, including personage and scenery) are combined merged VR and The function of augmented reality (Augmented Reality, AR), can accurately it be recognized between each other each other when more people interact Identity, improve the security when realizing that more people interact by the virtual scenes of 3D, enrich interactive mode, brought to user More three-dimensional safer diversified Interactive Experience more true to nature, and can also provide the user what is matched with user's local environment Virtual scene selects for user, virtual scene when selecting interactive according to self-demand so as to user, personalized strong, further carries The high usage experience of user.
Embodiment three
Referring to Fig. 3, Fig. 3 is that a kind of MR based on dual camera realizes that the structure of equipment is shown disclosed in the embodiment of the present invention It is intended to.As shown in figure 3, being somebody's turn to do the MR based on dual camera realizes that equipment can apply to have the MR heads of dual camera to show equipment In.As shown in figure 3, being somebody's turn to do the MR based on dual camera realizes that equipment can include:
Collecting unit 301, for gathering the real time scene of current environment by dual camera.
Separative element 302, the background in real time scene for separating the collection of collecting unit 301 by presetting background color With prospect entity, background view and entity scene are obtained, wherein, the background color of the background view and default background color phase Match somebody with somebody.
Communication unit 303, the render request of above-mentioned background view is included for being sent to rendering server, and receive and render Server renders response for what the render request returned, and the render request is used for the virtual scape of acquisition request background view matching As this renders the virtual scene that background view of the response including being determined by rendering server matches.
Replacement unit 304, the above-mentioned background view for above-mentioned real time scene to be included are substituted for above-mentioned background view The virtual scene matched somebody with somebody.
Output unit 305, for exporting above-mentioned virtual scene and above-mentioned entity scene.
It can be caught in real time by dual camera it can be seen that the MR heads based on dual camera described by implementing Fig. 3 show equipment Scene, and realize background and point of prospect entity for the real time scene that dual camera captures by way of colour recognition From, and background further can also be substituted for mapping of the virtual digit space (i.e. the virtual scenes of 3D) in physical surroundings, this Kind by the mode that virtual digit space and physical surroundings (also known as physical environment, including personage and scenery) are combined merged VR and The function of augmented reality (Augmented Reality, AR), can accurately it be recognized between each other each other when more people interact Identity, improve the security when realizing that more people interact by the virtual scenes of 3D, enrich interactive mode, brought to user More three-dimensional safer diversified Interactive Experience more true to nature.
In an optional embodiment, separative element 302 can include identification subelement 3021, judgment sub-unit 3022 And determination subelement 3023, now, it is somebody's turn to do the MR based on dual camera and realizes that the structure of equipment can be with as shown in figure 4, Fig. 4 be this MR of the another kind disclosed in inventive embodiments based on dual camera realizes the structural representation of equipment.Wherein:
Subelement 3021 is identified, for being known otherwise by background color, is identified from the above-mentioned real time scene of collection The part real time scene that color matches with default background color.
Judgment sub-unit 3022, for judging identify in the part real time scene that identifies of subelement 3021 whether include pin To the real time scene of some body parts of personage in real time scene.
Determination subelement 3023, for when judgment sub-unit 3022 judged result for be when, by the real-time scape in above-mentioned part The first remaining real time scene as in for above-mentioned real time scene in addition to the real time scene of some body parts of personage is true It is set to background view, and will be remaining real for the real time scene of some body parts of personage in above-mentioned real time scene and second Shi Jingxiang is defined as entity scene, wherein, the reality of above-mentioned part real time scene and the second remaining real time scene composition collection Shi Jingxiang.
Determination subelement 3023, it is additionally operable to when the judged result of judgment sub-unit 3022 is no, by the real-time scape in the part It is defined as entity scene as being defined as background view, and by remaining real time scene, the part real time scene and the residue are real-time The above-mentioned real time scene of scene composition collection.
It can be seen that the MR based on dual camera implemented described by Fig. 4 realizes that equipment can also ensure that the entity scape collected As the integrality of middle personage, security during more people's interactions is further ensured.
In another optional embodiment, it is somebody's turn to do the MR based on dual camera and realizes that equipment can also include first and judge list Member 306 and determining unit 307, now, it is somebody's turn to do the MR based on dual camera and realizes that the structure of equipment can be with as shown in figure 5, Fig. 5 be Another MR based on dual camera disclosed in the embodiment of the present invention realizes the structural representation of equipment.Wherein:
First judging unit 306, rendered for receiving rendering server in communication unit 303 for what render request returned The virtual scene of background view matching is substituted for after response and in the background view that replacement unit 304 includes real time scene Before, judge whether the number for rendering the virtual scene for the background view determined by the rendering server matching that response includes is big In 1, when the virtual scene for judging to render the background view determined by the rendering server matching that response includes number not During more than 1, triggering replacement unit 304 performs the void that the above-mentioned background view for including real time scene is substituted for background view matching Intend the operation of scene.
Output unit 305, be additionally operable to when the first judging unit 306 judge to render response include it is true by rendering server When the number of the virtual scene for the background view matching made is more than 1, all virtual scenes that output renders response and included supply User selects.
Determining unit 307, one of them the virtual scene selected for determining user from all virtual scenes.
Replacement unit 304, the background view for being additionally operable to include real time scene are substituted for one of them virtual scene.
Output unit 305, it is additionally operable to export entity scene and one of them virtual scene.
It can be seen that the MR based on dual camera implemented described by Fig. 5 realizes that equipment can also provide the user and user institute The virtual scene that place's environment matches selects for user, and virtual scene when selecting interactive according to self-demand so as to user is individual Propertyization is strong, further increases the usage experience of user.
In another optional embodiment, it is somebody's turn to do the MR based on dual camera and realizes that equipment can also include second and judge list Member 308, generation unit 309 and control unit 310, now, should MR based on dual camera realize that the structure of equipment can be as Shown in Fig. 6, Fig. 6 is the structural representation that another disclosed MR based on dual camera of the embodiment of the present invention realizes equipment.Its In:
Collecting unit 301, it can be also used for gathering body-sensing action of the user for the dummy object in above-mentioned virtual scene.
Second judging unit 308, for judging whether the action parameter of above-mentioned body-sensing action meets parameter preset condition.
Generation unit 309, the action parameter for judging above-mentioned body-sensing action when the second judging unit 308 meet default During Parameter Conditions, the control instruction according to the action parameter generation that above-mentioned body-sensing acts for dummy object.
Control unit 310, for performing the behaviour to match with control instruction according to above-mentioned control instruction, control dummy object Make.
It can be seen that the MR based on dual camera implemented described by Fig. 6 realizes that equipment can also act according to the body-sensing of user Generation is directed to the control instruction of dummy object in virtual scene, enriches the interactive mode of user and virtual scene so that MR heads Aobvious equipment is more intelligent, further increases the usage experience of user.
In another optional embodiment, it is somebody's turn to do the MR based on dual camera and realizes that equipment can also include the 3rd and judge list Member 311, now, it is somebody's turn to do the MR based on dual camera and realizes that the structure of equipment can be with as shown in fig. 7, Fig. 7 be public affairs of the embodiment of the present invention MR of another opened based on dual camera realizes the structural representation of equipment.Wherein:
Collecting unit 301, it can be also used for when interaction personage in above-mentioned entity scene be present, collection is directed to interaction people The interactive information of thing.
3rd judging unit 311, for judging whether the interactive information that collecting unit 301 collects is legal interaction letter Breath.
Communication unit 303, it can be also used for when the 3rd judging unit 311 judges that above-mentioned interactive information is believed for legal interaction During breath, above-mentioned interactive information is sent to rendering server, interactive information is issued to interactive personage to trigger rendering server Corresponding interactive device.
It can be seen that the MR based on dual camera implemented described by Fig. 7 realizes that equipment can also allow to occur in real time scene Interaction personage between carry out interactive, enhance Interactive Experience, and legitimate verification can also be carried out to interactive information, be advantageous to One harmonious mutual environment of health is provided, further increases the usage experience of user.
One of ordinary skill in the art will appreciate that all or part of step in the various methods of above-described embodiment is can To instruct the hardware of correlation to complete by program, the program can be stored in a computer-readable recording medium, storage Medium include read-only storage (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), programmable read only memory (Programmable Read-only Memory, PROM), erasable programmable is read-only deposits Reservoir (Erasable Programmable Read Only Memory, EPROM), disposable programmable read-only storage (One- Time Programmable Read-Only Memory, OTPROM), the electronics formula of erasing can make carbon copies read-only storage (Electrically-Erasable Programmable Read-Only Memory, EEPROM), read-only optical disc (Compact Disc Read-Only Memory, CD-ROM) or other disk storages, magnetic disk storage, magnetic tape storage or can For carrying or any other computer-readable medium of data storage.
A kind of MR implementation methods and equipment based on dual camera disclosed in the embodiment of the present invention have been carried out in detail above Introduce, specific case used herein is set forth to the principle and embodiment of the present invention, the explanation of above example It is only intended to help the method and its core concept for understanding the present invention;Meanwhile for those of ordinary skill in the art, according to this The thought of invention, there will be changes in specific embodiments and applications, in summary, this specification content should It is interpreted as limitation of the present invention.

Claims (10)

1. a kind of MR implementation methods based on dual camera, it is characterised in that methods described includes:
The real time scene of current environment is gathered by dual camera, and by presetting the real-time scape of background color separation collection Background and prospect entity as in, obtain background view and entity scene, and the background color of the background view is preset with described Background color matches;
Being sent to rendering server includes the render request of the background view, and receives the rendering server and be directed to the wash with watercolours What dye request returned renders response, and the render request is used for the virtual scene that background view described in acquisition request matches, described The virtual scene that the background view that rendering response includes being determined by the rendering server matches;
The background view that the real time scene is included is substituted for the virtual scene of the background view matching, and exports institute State virtual scene and the entity scene.
2. the MR implementation methods according to claim 1 based on dual camera, it is characterised in that described by presetting background Background and prospect entity in the real time scene of color separated collection, obtain background view and entity scene, including:
Known otherwise by background color, identify that color matches with default background color from the real time scene of collection Part real time scene, and judge in the part real time scene whether to include some bodies for being directed to personage in the real time scene The real time scene of body region;
When judged result is to be, some body for being directed to personage in the real time scene will be removed in the part real time scene The first remaining real time scene outside the real time scene of position is defined as background view, and institute will be directed in the part real time scene State the real time scene of some body parts of personage and the second remaining real time scene in real time scene and be defined as entity scene, institute State part real time scene and the real time scene of the second remaining real time scene composition collection.
3. the MR implementation methods according to claim 1 or 2 based on dual camera, it is characterised in that described in the reception Rendering server for the render request return render response after, and it is described the real time scene is included described in Background view is substituted for before the virtual scene of the background view matching, and methods described also includes:
The virtual scene for the background view determined by the rendering server matching that response includes is rendered described in judgement Number whether be more than 1;
When judging the virtual of the background view determined by the rendering server matching for rendering response and including When the number of scene is not more than 1, triggering performs the background view for including the real time scene and is substituted for the back of the body The operation of the virtual scene of scape scene matching aided navigation;
Methods described also includes:
When judging the virtual of the background view determined by the rendering server matching for rendering response and including When the number of scene is more than 1, all virtual scenes that response is rendered described in output to be included select for user;
One of them virtual scene that user selects from all virtual scenes is determined, and the real time scene is included The background view be substituted for one of them described virtual scene, and the output entity scene and it is described one of them Virtual scene.
4. the MR implementation methods based on dual camera according to claim any one of 1-3, it is characterised in that methods described Also include:
Body-sensing action of the user for the dummy object in the virtual scene is gathered, and judges the action ginseng of the body-sensing action Whether number meets parameter preset condition;
When the action parameter of body-sensing action meets the parameter preset condition, according to the action parameter of body-sensing action Generation for the dummy object control instruction, and according to the control instruction, control the dummy object perform with it is described The operation that control instruction matches.
5. the MR implementation methods based on dual camera according to claim any one of 1-4, it is characterised in that methods described Also include:
When interaction personage in the entity scene be present, interactive information of the collection for the interactive personage;
Judge whether the interactive information is legal interactive information, when judging that the interactive information is the legal interactive information When, the interactive information is sent to the rendering server, issued the interactive information with triggering the rendering server To interactive device corresponding to the interactive personage.
6. a kind of MR based on dual camera realizes equipment, it is characterised in that the equipment includes:
Collecting unit, for gathering the real time scene of current environment by dual camera;
Separative element, for by preset background color separate background in the real time scene that the collecting unit gathers with Prospect entity, obtain background view and entity scene, the background color of the background view and the default background color phase Match somebody with somebody;
Communication unit, the render request of the background view is included for being sent to rendering server, and clothes are rendered described in reception Business device renders response for what the render request returned, and the render request is used for what background view described in acquisition request matched Virtual scene, the virtual scene for rendering the background view of the response including being determined by the rendering server and matching;
Replacement unit, the background view for the real time scene to be included are substituted for the virtual of the background view matching Scene;
Output unit, for exporting the virtual scene and the entity scene.
7. the MR according to claim 6 based on dual camera realizes equipment, it is characterised in that the separative element bag Include:
Identify subelement, for being known otherwise by background color, identified from the real time scene of collection color with it is pre- If the part real time scene that background color matches;
Judgment sub-unit, some of personage in the real time scene are directed to for judging in the part real time scene whether to include The real time scene of body part;
Determination subelement, for when the judged result of the judgment sub-unit is is, pin being removed in the part real time scene Background is defined as to the first remaining real time scene outside the real time scene of some body parts of personage in the real time scene Scene, and will in the part real time scene be directed to the real time scene in personage some body parts real time scene and Second remaining real time scene is defined as entity scene, and the part real time scene and the second remaining real time scene composition are adopted The real time scene of collection.
8. the MR based on dual camera according to claim 6 or 7 realizes equipment, it is characterised in that the equipment is also wrapped Include:
First judging unit, for receiving wash with watercolours of the rendering server for render request return in the communication unit The background scape is substituted for after dye response and in the background view that the replacement unit includes the real time scene As matching virtual scene before, the background scape determined by the rendering server that includes of response is rendered described in judgement As whether the number of the virtual scene of matching is more than 1, when judge it is described render response include it is true by the rendering server When the number of the virtual scene for the background view matching made is not more than 1, it is described by institute to trigger the replacement unit execution The background view that stating real time scene includes is substituted for the operation of the virtual scene of the background view matching;
Output unit, be additionally operable to when first judging unit judge it is described render that response includes by the rendering server When the number of the virtual scene for the background view matching determined is more than 1, render described in output response include it is all Virtual scene selects for user;
The equipment also includes:
Determining unit, one of them the virtual scene selected for determining user from all virtual scenes;
The replacement unit, the background view for being additionally operable to include the real time scene are substituted for described one of empty Intend scene;
The output unit, it is additionally operable to export the entity scene and one of them described virtual scene.
9. the MR based on dual camera according to claim any one of 6-8 realizes equipment, it is characterised in that the collection Unit, it is additionally operable to gather body-sensing action of the user for the dummy object in the virtual scene;
The equipment also includes:
Second judging unit, for judging whether the action parameter of the body-sensing action meets parameter preset condition;
Generation unit, when the action parameter for being acted when the body-sensing meets the parameter preset condition, according to the body-sensing Control instruction of the action parameter generation of action for the dummy object;
Control unit, for according to the control instruction, controlling the dummy object to perform what is matched with the control instruction Operation.
10. the MR based on dual camera according to claim any one of 6-9 realizes equipment, it is characterised in that described to adopt Collecting unit, being additionally operable to when interaction personage in the entity scene be present, interactive information of the collection for the interactive personage;
The equipment also includes:
3rd judging unit, for judging whether the interactive information is legal interactive information;
The communication unit, it is additionally operable to when the 3rd judging unit judges that the interactive information is the legal interactive information When, the interactive information is sent to the rendering server, issued the interactive information with triggering the rendering server To interactive device corresponding to the interactive personage.
CN201710616657.4A 2017-07-20 2017-07-20 A kind of MR implementation methods and equipment based on dual camera Pending CN107396084A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710616657.4A CN107396084A (en) 2017-07-20 2017-07-20 A kind of MR implementation methods and equipment based on dual camera

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710616657.4A CN107396084A (en) 2017-07-20 2017-07-20 A kind of MR implementation methods and equipment based on dual camera

Publications (1)

Publication Number Publication Date
CN107396084A true CN107396084A (en) 2017-11-24

Family

ID=60341213

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710616657.4A Pending CN107396084A (en) 2017-07-20 2017-07-20 A kind of MR implementation methods and equipment based on dual camera

Country Status (1)

Country Link
CN (1) CN107396084A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110012229A (en) * 2019-04-12 2019-07-12 维沃移动通信有限公司 A kind of image processing method and terminal
CN110730340A (en) * 2019-09-19 2020-01-24 天脉聚源(杭州)传媒科技有限公司 Lens transformation-based virtual auditorium display method, system and storage medium
CN113223186A (en) * 2021-07-07 2021-08-06 江西科骏实业有限公司 Processing method, equipment, product and device for realizing augmented reality

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3927965B2 (en) * 2004-05-12 2007-06-13 キヤノン株式会社 Video processing apparatus and method
CN101727182A (en) * 2010-01-28 2010-06-09 南京航空航天大学 Method and system for visualizing real hand of participant in helmet-type virtual reality environment
CN204989626U (en) * 2015-07-22 2016-01-20 杭州睿唯投资管理有限公司 Smart spectacles
CN105955456A (en) * 2016-04-15 2016-09-21 深圳超多维光电子有限公司 Virtual reality and augmented reality fusion method, device and intelligent wearable equipment
CN106055113A (en) * 2016-07-06 2016-10-26 北京华如科技股份有限公司 Reality-mixed helmet display system and control method
CN106097435A (en) * 2016-06-07 2016-11-09 北京圣威特科技有限公司 A kind of augmented reality camera system and method
CN106873778A (en) * 2017-01-23 2017-06-20 深圳超多维科技有限公司 A kind of progress control method of application, device and virtual reality device

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3927965B2 (en) * 2004-05-12 2007-06-13 キヤノン株式会社 Video processing apparatus and method
CN101727182A (en) * 2010-01-28 2010-06-09 南京航空航天大学 Method and system for visualizing real hand of participant in helmet-type virtual reality environment
CN204989626U (en) * 2015-07-22 2016-01-20 杭州睿唯投资管理有限公司 Smart spectacles
CN105955456A (en) * 2016-04-15 2016-09-21 深圳超多维光电子有限公司 Virtual reality and augmented reality fusion method, device and intelligent wearable equipment
CN106097435A (en) * 2016-06-07 2016-11-09 北京圣威特科技有限公司 A kind of augmented reality camera system and method
CN106055113A (en) * 2016-07-06 2016-10-26 北京华如科技股份有限公司 Reality-mixed helmet display system and control method
CN106873778A (en) * 2017-01-23 2017-06-20 深圳超多维科技有限公司 A kind of progress control method of application, device and virtual reality device

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110012229A (en) * 2019-04-12 2019-07-12 维沃移动通信有限公司 A kind of image processing method and terminal
CN110012229B (en) * 2019-04-12 2021-01-08 维沃移动通信有限公司 Image processing method and terminal
CN110730340A (en) * 2019-09-19 2020-01-24 天脉聚源(杭州)传媒科技有限公司 Lens transformation-based virtual auditorium display method, system and storage medium
CN110730340B (en) * 2019-09-19 2023-06-20 北京拉近众博科技有限公司 Virtual audience display method, system and storage medium based on lens transformation
CN113223186A (en) * 2021-07-07 2021-08-06 江西科骏实业有限公司 Processing method, equipment, product and device for realizing augmented reality

Similar Documents

Publication Publication Date Title
CN107077755B (en) Virtual and reality fusion method and system and virtual reality equipment
CN107370831A (en) Show the multiusers interaction realization method and system of equipment based on MR heads
CN105556508B (en) The devices, systems, and methods of virtual mirror
CN107396084A (en) A kind of MR implementation methods and equipment based on dual camera
JP7140487B2 (en) Information processing device, display control method, and program
CN105303557B (en) A kind of see-through type intelligent glasses and its perspective method
CN109218619A (en) Image acquiring method, device and system
CN105528799A (en) Virtual fitting device and virtual fitting method thereof
CN107209962A (en) For the method for the 3D virtual body models for generating the people combined with 3D clothes images, and related device, system and computer program product
CN106354251A (en) Model system and method for fusion of virtual scene and real scene
CN107590859A (en) A kind of mixed reality picture processing method and service equipment
CN106445131B (en) Virtual target operating method and device
WO2013185714A1 (en) Method, system, and computer for identifying object in augmented reality
CN110532991A (en) A kind of face identification method, device and equipment
CN106791389A (en) Image processing method, image processing apparatus and terminal
CN102647606A (en) Stereoscopic image processor, stereoscopic image interaction system and stereoscopic image display method
CN108108012A (en) Information interacting method and device
CN107578435A (en) A kind of picture depth Forecasting Methodology and device
CN109316747A (en) Game auxiliary information reminding method, device and electronic equipment
CN107507280A (en) Show the switching method and system of the VR patterns and AR patterns of equipment based on MR heads
CN110189202A (en) A kind of three-dimensional virtual fitting method and system
CN105929538A (en) Virtual reality equipment display method and device
CN106791769A (en) Virtual reality realization method and system
CN107146275A (en) A kind of method and device of setting virtual image
CN107945284A (en) A kind of scene display methods and intelligent glasses for automatic driving vehicle

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20171124

RJ01 Rejection of invention patent application after publication