CN109947246A - A kind of holographic electronic sand table natural interaction implementation method based on HoloLens and sensor - Google Patents

A kind of holographic electronic sand table natural interaction implementation method based on HoloLens and sensor Download PDF

Info

Publication number
CN109947246A
CN109947246A CN201910187889.1A CN201910187889A CN109947246A CN 109947246 A CN109947246 A CN 109947246A CN 201910187889 A CN201910187889 A CN 201910187889A CN 109947246 A CN109947246 A CN 109947246A
Authority
CN
China
Prior art keywords
hololens
sensor
operator
sand table
implementation method
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910187889.1A
Other languages
Chinese (zh)
Inventor
乔辉
朱恺真
刘莹
游冰
崔鹤
李豪
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
SIPPR Engineering Group Co Ltd
Original Assignee
SIPPR Engineering Group Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by SIPPR Engineering Group Co Ltd filed Critical SIPPR Engineering Group Co Ltd
Priority to CN201910187889.1A priority Critical patent/CN109947246A/en
Publication of CN109947246A publication Critical patent/CN109947246A/en
Pending legal-status Critical Current

Links

Landscapes

  • User Interface Of Digital Computer (AREA)

Abstract

The holographic electronic sand table natural interaction implementation method based on HoloLens and sensor that the invention discloses a kind of, is related to mixed reality natural interaction technical field, comprising the following steps: step 1, operator's bone site information that specified region is obtained using sensor;Operator's bone site information is sent HoloLens equipment by step 2;Step 3, the HoloLens equipment receive operator's bone site information;Step 4, the HoloLens equipment feed back interaction results.The present invention reduces user using difficulty, enriches user's interactive mode, the interactive mode of user and target object is more natural under holographic electronic sand table situation by increasing the originally single interactive mode of natural interactive style supplement.

Description

It is a kind of to be realized based on the holographic electronic sand table natural interaction of HoloLens and sensor Method
Technical field
The present invention relates to mixed reality natural interaction technical fields more particularly to a kind of based on HoloLens and sensor Holographic electronic sand table natural interaction implementation method.
Background technique
HoloLens is a mixed reality equipment that Microsoft releases.It is virtual right that such equipment can generate computer As being superimposed on real world, give user a kind of visual field of mixed reality.HoloLens wearing experience the sense of reality, from So degree is all considerably beyond any a AR glasses on the market.With the iteration of hardware, the customization of software, product content it is continuous It is promoted, so that AR technology is known by more and more users, and shows up prominently in many fields, such as game products, advertisement battalion Pin, education (early education, toy etc.), tourist service, clothes, medical educational, direct seeding operation, strange land medicine are supervised, are remotely made the rounds of the wards, is intelligent The fields such as maintenance, electricapparatus, mass media.HoloLens included natural interactive style is in addition to voice and stares, and only two Kind gesture --- it blooms (Bloom) and clicks (Air tap).
In the prior art, there is presently no the holographies and natural interaction technology for computer operation table, due to computation The production of platform is time-consuming and laborious, once it is determined that model, is difficult to make any small change, especially needs volume production towards large enterprise, It even more pulls one hair and move the whole body, and businessman is difficult to meet all types of user crowd, traditional computer operation table cost of manufacture is high, Period is long, transformation is slow, using being inconvenient.
Chinese invention patent " the computer operation table holography based on HoloLens shows and natural interaction application method " CN201710872591.5, disclose a kind of computer operation table holography based on HoloLens show with natural interaction application method, Successively the following steps are included: according to practical computer operation table scaled down size, establishes computer operation table model and taken with this Virtual scene is built, virtual scene is imported into HoloLens glasses, holography is shown in real space;It is utilized by HoloLens SLAM technology carries out environment understanding, positions user, obtains true environment data;User and virtual electricity are realized by HoloLens Close friend's interaction of brain station.The present invention towards the 3D of computer operation table show with natural interaction application, by environment sensing with Dummy object projection, by natural interactive styles such as sight, gesture, voices, adjusts height, size, the screen of computer operation table The combination between position, angle and a variety of stations that gradient, single operation platform are put is put, can also be according to user preferences Convert unlike material, color, style, style.The invention shows and natural interaction application towards the 3D of computer operation table.
With the continuous enhancing of environmental unit, the infrastructure for meeting interactive is gradually perfect, polymorphic type intelligence occurs It can terminal, on the one hand, the universal of multi scale display screen in the environment is embodied, using smart phone as the small-sized interactive screen of representative It solves the problems, such as the portability of interaction screen, ubiquitous interactive interface is provided;On the other hand, with electronic sand table, data wall, Smart television is that the large-screen of representative then has preferable visual effect and feeling of immersion, is mentioned for the interaction based on limb action Having supplied may.Holographic technique is divided into holographic physics, digital hologram and calculates holographic.Calculating holography is based on the true of wavefront reconstruction Dimension display technologies, its display technology show identical with optical holographic, its display effect can be with human eye 3D vision characteristic Exact matching, provides full depth information needed for human visual system, it is the necessarily knot of information age optical holographic development Fruit.Calculating holographic technique has the advantages that great flexibility and uniqueness, it not only can be the amplitude and phase of practical light wave Comprehensively coding comes out, moreover it is possible to synthesis before the object wave that physical space is not present be come out, therefore it is most potential for calculating holography Dimension display technologies.HoloLens is the best calculating hologram device in the current whole world.
Chinese invention patent " a kind of command post's work compound goods electronic sand map system based on HoloLens " CN201710689811.0 discloses a kind of command post's work compound goods electronic sand map system based on HoloLens, including hardware Supporting layer, resource management layer, using supporting layer and business function layer, hardware support layer acquires commander by the hardware in system Interactive information is simultaneously transmitted to resource management layer by the interactive information of member;Resource data in resource management layer managing system and to System administration, resource control and data access interface are provided using supporting layer;Using supporting layer realize hologram calculate and Application and development and running environment support are provided for business function layer;Business function layer realizes holographic situation displaying, polygonal color operation Personnel's interaction, natural interaction, Collaborative Plotting, discussion process management and control and hologram generate.
Those skilled in the art is dedicated to developing a kind of based on the holographic electronic sand table of HoloLens and sensor nature Interaction implementation method.
Summary of the invention
In view of the above drawbacks of the prior art, the technical problem to be solved by the present invention is to current, how simply to have Effect ground increases nature gesture interaction mode, makes up the extremely limited defect of the included natural gesture interaction mode of HoloLens.
To achieve the above object, the present invention provides a kind of based on the holographic electronic sand table of HoloLens and sensor nature Interaction implementation method, comprising the following steps:
Step 1, operator's bone site information that specified region is obtained using sensor;
Operator's bone site information is sent HoloLens equipment by step 2;
Step 3, the HoloLens equipment receive operator's bone site information;
Step 4, the HoloLens equipment feed back interaction results.
Optionally, in the above-described embodiments based on the holographic electronic sand table natural interaction of HoloLens and sensor realize In method, step 1 further include:
The sensor is connected by step 1.1 with computer one;
Step 1.2, the development kit that the sensor is installed in computer one;
Step 1.3 obtains operator's bone site information in the sensor by the development kit;
Step 1.4 writes script one, storage and analysis operator's bone site information in computer one, judges that posture is dynamic Make;
HoloLens sharing service device is downloaded and installed to step 1.5 in the computer one, and the HoloLens shares Server can obtain on its website of increasing income;
Step 1.6 writes script two in above-mentioned computer, connects above-mentioned HoloLens sharing service device and transmission is made by oneself Operator's bone site information that above-mentioned steps 1.4 store is sent above-mentioned HoloLens sharing service device by adopted message;
Step 1.7, the program that will be made of associated script in the script one, the script two and the development kit It runs on the computer.
Optionally, the holographic electronic sand table natural interaction based on HoloLens and sensor in any of the above-described embodiment In implementation method, the available sensor to operator's bone site information of sensor in step 1, including but not limited to Kinect series sensor.
Optionally, the holographic electronic sand table natural interaction based on HoloLens and sensor in any of the above-described embodiment In implementation method, the development kit in step 1.2 meets the need that operator's bone site information is calculated from sensing data It wants, is provided for HoloLens official.
Optionally, the holographic electronic sand table natural interaction based on HoloLens and sensor in any of the above-described embodiment In implementation method, the gesture actions in step 1.4 include " waving to the right ", " waving to the left ", " both hands side raise ", " sitting down " Deng.
Further, the holographic electronic sand table based on HoloLens and sensor in any of the above-described embodiment is handed over naturally In mutual implementation method, the script one in step 1.4 include two array nowJointsPos and definedJointsPos and DTW (Dynamic time warping, i.e. dynamic time adjustment algorithm) compares function, and the nowJointsPos array is deposited The real-time position information for the human synovial that the sensor obtains is stored up, the data that array about stores 5 seconds (are deposited by sensor frame Storage), the definedJointsPos array defines the location information of a movement in advance, for example waves to the right, DTW ratio Function is compared the two arrays using dynamic time warping algorithm and the sensor according to the threshold determination of setting Whether the movement of acquisition is the movement defined.Realize to operator's " waving to the right ", " waving to the left ", " both hands side raise ", The judgement of gesture actions such as " sitting down ".
Optionally, the function of the transmission of script two self-defined message is as follows:
The posture movement that script one determined in sending step 1.4 is similar with above-mentioned function, and modification suction parameter is agreement Movement.
Optionally, the holographic electronic sand table natural interaction based on HoloLens and sensor in any of the above-described embodiment In implementation method, step 2, HoloLens sharing service device is used to edit as relay device, or by using unity3D The unet function that device provides, sends HoloLens equipment for operator's bone site information.
Optionally, the holographic electronic sand table natural interaction based on HoloLens and sensor in any of the above-described embodiment In implementation method, step 2 further include:
Script in step 2.1, configuration step 1.6 is connected to above-mentioned HoloLens sharing service device;
Step 2.2 opens HoloLens sharing on one same network segment of computer or the computer two of different segment Server;
HoloLens sharing service device in program Connection Step 2.2 in step 2.3, step 1.7.
Optionally, the holographic electronic sand table natural interaction based on HoloLens and sensor in any of the above-described embodiment In implementation method, step 2.2, computer two can also be with computer one in different segment, as long as guaranteeing the journey in step 1.7 Sequence and sensor may be connected to this HoloLens sharing service device.
Optionally, the holographic electronic sand table natural interaction based on HoloLens and sensor in any of the above-described embodiment In implementation method, step 2.3, it can also be connected manually using automatic connection.
Optionally, the holographic electronic sand table natural interaction based on HoloLens and sensor in any of the above-described embodiment In implementation method, step 3 further include:
Step 3.1, according to the self-defined message sent in step 1.6, parsing script is write, from above-mentioned HoloLens point It enjoys server and receives self-defined message, parse operator's bone site information;
Step 3.2 is fed back in HoloLens according to the operation logic that above-mentioned parsing script defines.
Optionally, the holographic electronic sand table natural interaction based on HoloLens and sensor in any of the above-described embodiment Operation logic in implementation method, in step 3.2 are as follows: when the arm of user lifts and operates in dummy object in HoloLens When, dummy object shows the effect of amplification, diminution, rotation or the next dummy object of replacement.Give user a kind of unarmed nature Operate the feeling of dummy object in HoloLens.
Optionally, the holographic electronic sand table natural interaction based on HoloLens and sensor in any of the above-described embodiment In implementation method, the feedback information in step 3.2 include text, sound, audio, model color, model size, modal position, Model direction.
Optionally, the holographic electronic sand table natural interaction based on HoloLens and sensor in any of the above-described embodiment In implementation method, customized message package is received from HoloLens sharing service device in step 3.1 and includes operator's location information and step Gesture actions in rapid 1.4.
A kind of holographic electronic sand table natural interaction implementation method based on HoloLens and sensor provided by the invention, pole Big enriches user's interactive mode, and single interactive mode completion logical operation, drop can be used by increasing interaction logic Low user uses difficulty, and the interactive mode of user and target object is more natural under holographic electronic sand table situation.
The present invention supplements originally single interactive mode by increasing natural interactive style, reduces user and uses difficulty, User's interactive mode is enriched, the interactive mode of user and target object is more natural under holographic electronic sand table situation.
It is described further below with reference to technical effect of the attached drawing to design of the invention, specific structure and generation, with It is fully understood from the purpose of the present invention, feature and effect.
Detailed description of the invention
Fig. 1 is the flow chart of exemplary embodiment of the present invention;
Fig. 2 is the schematic diagram of exemplary embodiment of the present invention.
Specific embodiment
Multiple preferred embodiments of the invention are introduced below with reference to Figure of description, keep its technology contents more clear and just In understanding.The present invention can be emerged from by many various forms of embodiments, and protection scope of the present invention not only limits The embodiment that Yu Wenzhong is mentioned.
In the accompanying drawings, the identical component of structure is indicated with same numbers label, everywhere the similar component of structure or function with Like numeral label indicates.The size and thickness of each component shown in the drawings are to be arbitrarily shown, and there is no limit by the present invention The size and thickness of each component.Apparent in order to make to illustrate, some places suitably exaggerate the thickness of component in attached drawing.
As shown in Figure 1, one exemplary embodiment of the present invention includes the following steps:
Step 1, operator's bone site information that specified region is obtained using sensor, which, which need to only have, obtains Extract operation person's bone site information, including but not limited to Kinect series sensor;
Operator's bone site information is sent HoloLens equipment by step 2;
Step 3, the HoloLens equipment receive operator's bone site information;
Step 4, the HoloLens equipment feed back interaction results.
In order to realize step 1, inventor has done following refinement, this refinement step is an example, can also use it His refinement step, as long as can achieve the function of step 1 realization:
The sensor is connected by step 1.1 with computer one;
Step 1.2, the development kit that the sensor is installed in computer one, development kit meet from sensing data In calculate the needs of operator's bone site information, provided by HoloLens official;
Step 1.3 obtains operator's bone site information in the sensor by above-mentioned development kit;
Step 1.4 writes script one, storage and analysis operator's bone site information in above-mentioned computer one, judges appearance Gesture movement, gesture actions are the common actions of human body, including but not limited to " waving to the right ", " waving to the left ", " both hands side is flat Act ", " sitting down " etc.;
Step 1.5, downloading simultaneously install HoloLens sharing service device, the HoloLens sharing service in computer one Device can obtain on its website of increasing income;
Step 1.6 writes script two in above-mentioned computer, connects above-mentioned HoloLens sharing service device and transmission is made by oneself Operator's bone site information that above-mentioned steps 1.4 store is sent above-mentioned HoloLens sharing service device by adopted message;
Step 1.7 runs program on the computer, and described program is script one, script two and above-mentioned exploitation set The program that associated script forms in part.
For step 1.4, script one may include two array nowJointsPos and definedJointsPos and DTW (Dynamic time warping, i.e. dynamic time adjustment algorithm) compares function, the nowJointsPos storage of array institute The real-time position information of the human synovial of sensor acquisition is stated, array about stores 5 seconds data (storing by sensor frame), The definedJointsPos array defines the location information of a movement in advance, for example waves to the right, and DTW compares letter Number is compared the two arrays using dynamic time warping algorithm and the sensor according to the threshold determination of setting obtains Movement whether be definition movement.It realizes to operator's " waving to the right ", " waving to the left ", " both hands side raise ", " sitting down " Etc. gesture actions judgement.
Script two sends the function of self-defined message, and example is as follows:
, modification suction parameter similar with above-mentioned function is being realized in the posture movement that script one determined in sending step 1.4 For the movement of agreement.
For step 2, since sensor cannot be directly connected to HoloLens equipment, so needing using HoloLens points Server is enjoyed as relay device, or the unet function of providing by using unity3D editing machine, by operator's bone Bone location information is sent to HoloLens equipment.
In order to realize step 2, inventor has done following refinement, this refinement step is an example, can also use it His refinement step, as long as can achieve the function of step 2 realization:
Script in step 2.1, configuration step 1.6 is connected to above-mentioned HoloLens sharing service device;
Step 2.2, one same network segment of computer in step 1.1 computer two on open HoloLens sharing service Device, it is of course also possible to use the computer two of different segment as HoloLens sharing service device, as long as guaranteeing HoloLens Program and sensor routines may be connected to this server;
HoloLens sharing service device in step 2.3, step 1.7 in program Connection Step 2.2, can be using automatic Connection, can also connect manually.
In order to realize step 3, inventor has done following refinement, this refinement step is an example, can also use it His refinement step, as long as can achieve the function of step 3 realization:
Step 3.1, according to the self-defined message sent in step 1.6, parsing script is write, from above-mentioned HoloLens point It enjoys server and receives self-defined message (the gesture actions letter including but not limited in operator's bone site information and step 1.4 Breath), parse operator's bone site information;
Step 3.2 is fed back in HoloLens according to the operation logic that above-mentioned parsing script defines, and feedback information includes But it is not limited to text, sound, audio, model color, model size, modal position, model direction.
Sensor is using Microsoft's Kinect sensor for obtaining operator's bone site information;Step 1.2 uses Development kit provided by HoloLens official, operator's bone site information is calculated from sensing data;Step 1.4 In the script one write be named as BodySourceView.cs, storage and analysis operator's bone site information, judge posture Movement;The script write in step 1.6 is named as CustomMessage1.cs, to connect HoloLens sharing service device and Self-defined message is sent, sends HoloLens sharing service device for operator's bone site information.
The parsing script write in step 3.1 is named as ReceiveMessage.cs, takes for sharing from HoloLens Business device receives self-defined message, parses operator's bone site information.In addition, the script of CustomMessage2.cs For receiving the self-defined message of the transmission of computer one.
The preferred embodiment of the present invention has been described in detail above.It should be appreciated that the ordinary skill of this field is without wound The property made labour, which according to the present invention can conceive, makes many modifications and variations.Therefore, all technician in the art Pass through the available skill of logical analysis, reasoning, or a limited experiment on the basis of existing technology under this invention's idea Art scheme, all should be within the scope of protection determined by the claims.

Claims (10)

1. a kind of holographic electronic sand table natural interaction implementation method based on HoloLens and sensor, which is characterized in that described Method the following steps are included:
Step 1, operator's bone site information that specified region is obtained using sensor;
Operator's bone site information is sent HoloLens equipment by step 2;
Step 3, the HoloLens equipment receive operator's bone site information;
Step 4, the HoloLens equipment feed back interaction results.
2. the holographic electronic sand table natural interaction implementation method based on HoloLens and sensor as described in claim 1, It is characterized in that, the step 1 further include:
The sensor is connected by step 1.1 with computer one;
Step 1.2, the development kit that the sensor is installed in the computer one;
Step 1.3 obtains operator's bone site information in the sensor by the development kit;
Step 1.4 writes script one, storage and analysis operator's bone site information in the computer one, judges that posture is dynamic Make;
Step 1.5 is downloaded in the computer one and installs HoloLens sharing service device;
Step 1.6 writes script two in the computer, connects the HoloLens sharing service device and sends customized disappear Breath, sends the HoloLens sharing service device for operator's bone site information that the step 1.4 stores;
Step 1.7, by the program being made of associated script in the script one, the script two and the development kit described It is run on computer.
3. the holographic electronic sand table natural interaction implementation method based on HoloLens and sensor as claimed in claim 2, It is characterized in that, the gesture actions include " waving to the right ", " waving to the left ", " both hands side raise ", " sitting down ".
4. the holographic electronic sand table natural interaction implementation method based on HoloLens and sensor as claimed in claim 2, It is characterized in that, the step 2 further include:
Step 2.1, the configuration script two, are connected to the HoloLens sharing service device;
Step 2.2 opens HoloLens sharing service on one same network segment of computer or the computer two of different segment Device;
Program in step 2.3, the step 1.7 connects the HoloLens sharing service device in the step 2.2.
5. the holographic electronic sand table natural interaction implementation method based on HoloLens and sensor as claimed in claim 2, It is characterized in that, the step 3 further include:
Step 3.1, according to the self-defined message sent in the step 1.6, parsing script is write, from the HoloLens Sharing service device receives the self-defined message, parses operator's bone site information;
Step 3.2 is fed back in HoloLens according to the operation logic that the parsing script defines.
6. the holographic electronic sand table natural interaction implementation method based on HoloLens and sensor as described in claim 1, It is characterized in that, the sensor is Kinect series sensor.
7. the holographic electronic sand table natural interaction implementation method based on HoloLens and sensor as claimed in claim 2, It is characterized in that, the development kit provides for HoloLens official.
8. the holographic electronic sand table natural interaction implementation method based on HoloLens and sensor as described in claim 1, It is characterized in that, the step 2, HoloLens sharing service device is used to edit as relay device, or by using unity3D The unet function that device provides, sends HoloLens equipment for operator's bone site information.
9. the holographic electronic sand table natural interaction implementation method based on HoloLens and sensor as claimed in claim 5, Be characterized in that, the information that the step 3.2 is fed back include text, sound, audio, model color, model size, modal position, Model direction.
10. the holographic electronic sand table natural interaction implementation method based on HoloLens and sensor as claimed in claim 5, from It is dynamic that the HoloLens sharing service device receives the posture that customized message package includes in operator's location information and the step 1.4 Make.
CN201910187889.1A 2019-03-13 2019-03-13 A kind of holographic electronic sand table natural interaction implementation method based on HoloLens and sensor Pending CN109947246A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910187889.1A CN109947246A (en) 2019-03-13 2019-03-13 A kind of holographic electronic sand table natural interaction implementation method based on HoloLens and sensor

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910187889.1A CN109947246A (en) 2019-03-13 2019-03-13 A kind of holographic electronic sand table natural interaction implementation method based on HoloLens and sensor

Publications (1)

Publication Number Publication Date
CN109947246A true CN109947246A (en) 2019-06-28

Family

ID=67009710

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910187889.1A Pending CN109947246A (en) 2019-03-13 2019-03-13 A kind of holographic electronic sand table natural interaction implementation method based on HoloLens and sensor

Country Status (1)

Country Link
CN (1) CN109947246A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021179399A1 (en) * 2019-10-29 2021-09-16 南京翱翔信息物理融合创新研究院有限公司 Mixed reality-based remote operation guidance system and method

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2003071410A2 (en) * 2002-02-15 2003-08-28 Canesta, Inc. Gesture recognition system using depth perceptive sensors
CN103914129A (en) * 2013-01-04 2014-07-09 云联(北京)信息技术有限公司 Man-machine interactive system and method
CN104750397A (en) * 2015-04-09 2015-07-01 重庆邮电大学 Somatosensory-based natural interaction method for virtual mine
CN107680165A (en) * 2017-09-25 2018-02-09 中国电子科技集团公司第二十八研究所 Computer operation table holography based on HoloLens shows and natural interaction application process

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2003071410A2 (en) * 2002-02-15 2003-08-28 Canesta, Inc. Gesture recognition system using depth perceptive sensors
CN103914129A (en) * 2013-01-04 2014-07-09 云联(北京)信息技术有限公司 Man-machine interactive system and method
CN104750397A (en) * 2015-04-09 2015-07-01 重庆邮电大学 Somatosensory-based natural interaction method for virtual mine
CN107680165A (en) * 2017-09-25 2018-02-09 中国电子科技集团公司第二十八研究所 Computer operation table holography based on HoloLens shows and natural interaction application process

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021179399A1 (en) * 2019-10-29 2021-09-16 南京翱翔信息物理融合创新研究院有限公司 Mixed reality-based remote operation guidance system and method

Similar Documents

Publication Publication Date Title
JP7110252B2 (en) Methods and systems for creating virtual and augmented reality
US11507193B2 (en) Methods and systems for creating virtual and augmented reality
US10203762B2 (en) Methods and systems for creating virtual and augmented reality
CN104011788B (en) For strengthening and the system and method for virtual reality
WO2013120851A1 (en) Method for sharing emotions through the creation of three-dimensional avatars and their interaction through a cloud-based platform
US10846919B2 (en) Eye image generation method and apparatus
CN105139446A (en) Holographic virtual fitting system based on kinect
CN109255841A (en) AR image presentation method, device, terminal and storage medium
Li et al. Research on the application of AR technology based on Unity3D in education
CN108648061A (en) image generating method and device
JP2022500795A (en) Avatar animation
KR101839118B1 (en) A multi-access virtual space provisioning system linked with a multi-user real space location system
CN109947246A (en) A kind of holographic electronic sand table natural interaction implementation method based on HoloLens and sensor
De Paolis et al. Augmented Reality, Virtual Reality, and Computer Graphics: 4th International Conference, AVR 2017, Ugento, Italy, June 12-15, 2017, Proceedings, Part I
CN114222076A (en) Face changing video generation method, device, equipment and storage medium
Helle et al. Miracle Handbook: Guidelines for Mixed Reality Applications for culture and learning experiences
CN110188652A (en) Processing method, device, terminal and the storage medium of facial image
WO2019170835A1 (en) Advertising in augmented reality
Sumpeno et al. Virtualization and exploration of the Garudeya historical objects using immersive devices
CN110767031A (en) Music teaching platform of VR technique
CN111915737B (en) Human-object interaction system based on augmented reality
KR100965622B1 (en) Method and Apparatus for making sensitive character and animation
KR20190115621A (en) Method and apparatus of displaying virtual reality based artwork
Mouth Ground breaking of new residence hall
NZ727637B2 (en) Methods and systems for creating virtual and augmented reality

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20190628

RJ01 Rejection of invention patent application after publication