CN109933195A - The three-dimensional methods of exhibiting in interface and interactive system based on MR mixed reality technology - Google Patents

The three-dimensional methods of exhibiting in interface and interactive system based on MR mixed reality technology Download PDF

Info

Publication number
CN109933195A
CN109933195A CN201910168623.2A CN201910168623A CN109933195A CN 109933195 A CN109933195 A CN 109933195A CN 201910168623 A CN201910168623 A CN 201910168623A CN 109933195 A CN109933195 A CN 109933195A
Authority
CN
China
Prior art keywords
interface
dough sheet
round dough
spherical model
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910168623.2A
Other languages
Chinese (zh)
Other versions
CN109933195B (en
Inventor
高杰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Shifeng Digital Technology Co Ltd
Original Assignee
Guangzhou Shifeng Digital Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Shifeng Digital Technology Co Ltd filed Critical Guangzhou Shifeng Digital Technology Co Ltd
Priority to CN201910168623.2A priority Critical patent/CN109933195B/en
Publication of CN109933195A publication Critical patent/CN109933195A/en
Application granted granted Critical
Publication of CN109933195B publication Critical patent/CN109933195B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)

Abstract

The invention discloses a kind of three-dimensional methods of exhibiting in interface based on MR mixed reality technology, it include: that spherical model and several round dough sheets are established as display object based on unity3D software platform, wherein the spherical model diameter is greater than the round dough sheet diameter, and the round dough sheet is hidden in the spherical model, the spherical model is only presented in original state menu interface;It receives and identifies user and triggers interface instructions, control the round dough sheet and rest on fixed spatial position after flying out outward in the spherical model according to fixed route, the spherical model position immobilizes;Need to content information to be shown be shown by the round dough sheet;The present invention is based on MR mixed realities, enhance the fitness at 3 d menu interface and reality scene, while also improving the three-dimensional sense of menu interface;It arranges additionally by Layering manifestation object, allows the simple and clear content for seeing display of user;So that user interacts with interface naturally, interface experience is more preferably.

Description

The three-dimensional methods of exhibiting in interface and interactive system based on MR mixed reality technology
Technical field
The present invention relates to mixed reality technical field more particularly to a kind of interface based on MR mixed reality technology are three-dimensional Methods of exhibiting and interactive system.
Background technique
In recent years, with the rapid development of intelligent wearable device technology, using intelligent glasses as the New Product of representative by Gradually come into all trades and professions.Intelligent wearable device assists thought in emerging application with the application of " liberation both hands, high efficiency interactive ", real The working efficiency of existing tradesman is improved, and gains great popularity in industry field application, while promoting answering for Nover practical It is developed with by Kechuang.Currently, the wearable device based on mixed reality technology, service, overhaul of the equipments, medical treatment, system at the scene It makes and logistic industry is proposed products application successively.
Further development of the mixed reality technology (MR) as virtual reality technology, the technology in reality scene by presenting Virtual scene information sets up the information circuits of an interaction feedback between real world, virtual world and user, to enhance use The sense of reality of family experience.But lack solid on menu interface now for the software systems of mixed reality technology (MR) exploitation Sense, level distribution it is flat, also rest on over two dimension interface application thought, cannot really play the virtual of mixed reality technology With the characteristic that reality combines.In addition, the interaction logic at interface is particularly significant to user experience, provided for user's use habit A kind of system interacted.
Summary of the invention
The present invention provides a kind of three-dimensional methods of exhibiting in interface and interactive system based on MR mixed reality technology, with solution Lack three-dimensional sense on certainly present menu interface, level distribution is flat, cannot really play mixed reality technology it is virtual with it is real The technical issues of combining characteristic, to construct one kind in conjunction with the relevant technologies such as graph processing techniques by mixed reality technology Stereo exhibition method, and then realize user by mixed reality equipment just it can be seen that a solid, level be clearly demarcated, dynamic dish Single interface.
In order to solve the above-mentioned technical problem, it is vertical that the embodiment of the invention provides a kind of interfaces based on MR mixed reality technology Body formula methods of exhibiting, comprising:
Spherical model and several round dough sheets are established as display object, wherein the ball based on unity3D software platform Shape model diameter is greater than the round dough sheet diameter, and the round dough sheet is hidden in the spherical model, original state The spherical model is only presented in menu interface;
It receives and identifies user and triggers interface instructions, control the round dough sheet from the spherical model according to fixed road Diameter rests on fixed spatial position after flying out outward, the spherical model position immobilizes;
Need to content information to be shown be shown by the round dough sheet.
Preferably, further includes: the circle dough sheet is arranged in right above the spherical model, and forms upper, middle and lower Three layers of space layout;
Wherein, each layer of the round dough sheet is surrounded by a circular queue using fixed coordinate as reference center;Often Space length between one round dough sheet is all impartial;
Wherein, the diameter Relationship for three circular queues that several round dough sheets surround is first layer and third layer phase Together, first layer, third layer are smaller than second layer diameter.
Preferably, further includes: the round dough sheet described in each hangs down perpendicular to ground with user's sight plane Directly, user is facilitated to check.
The embodiment of the invention also provides a kind of three-dimensional displaying interactive system in the interface based on MR mixed reality technology, packets Include display module, content module and interactive module;
Display module for the spherical model and the round dough sheet to be realized display in space, and passes through reception After the content information that the content module is sent, the content information is shown in the rounded face on piece;
Content module, after required content information to be shown is transferred to the display module, so that the content Information MAP is to the rounded face on piece;
Interactive module, the interface operation of user instructs and sends corresponding instruction, institute to the display module for identification The interface operation instruction for stating identification user includes movement, click and the drag motions of cursor in identification MR equipment;
Wherein, the display module is also used to generate the three dimensional space coordinate of the spherical model and the round dough sheet, And the spherical model and the round dough sheet are laid out in space according to respective three dimensional space coordinate, it is vertical to be formed Body is round.
Preferably, the display module only shows the spherical model in the initial state, when the mutual dynamic model After block obtains and identifies that user's cursor clicks menu interface instruction, Xiang Suoshu display module sends corresponding instruction execution and opens dish Single interface action, and trigger the round dough sheet expansion.
Preferably, the interactive module is referred to by the operation that identification user's cursor is moved to the round dough sheet It enables, chooses or rotate operation according to what preset rules sent that corresponding instruction carries out the round dough sheet to the display module.
Preferably, the interactive module is also used to obtain and identify that user selects to click the dynamic of the round dough sheet After instructing, Xiang Suoshu display module sends the round dough sheet that corresponding instruction control is chosen and moves forward and become larger, and makes The content for obtaining the rounded face on piece, which is more clear, shows user.
Preferably, the interactive module is also used to obtain and identify that user rotates the dragging of the round dough sheet After instruction, Xiang Suoshu display module sends corresponding instruction execution and rotates the circular movement of solid, so that user checks view The round dough sheet in field.
Preferably, the interactive module is also used to when the round dough sheet is in outside the spherical model, It obtains and identifies that the mobile cursor of user clicks the action command of the spherical model, Xiang Suoshu display module sends corresponding instruction It controls all round dough sheets to move back to inside the spherical model, be restPosed with turning off menu interface.
Preferably, the content information of the content module transmission includes picture, text or icon.
Compared with the prior art, the embodiment of the present invention has the following beneficial effects:
Based on MR mixed reality, the stereo exhibition method and interaction systems at a kind of novel menu interface, enhancing three are devised The fitness of menu interface and reality scene is tieed up, while also improving the three-dimensional sense of menu interface;Additionally by Layering manifestation pair As arrangement, the simple and clear content for seeing display of user is allowed;By interactive module function, so that user hands over interface naturally Mutually, interface experience is more preferably.
Detailed description of the invention
Fig. 1 is a kind of menu interface bandwagon effect figure based on MR mixed reality technology provided in an embodiment of the present invention;
Fig. 2 provides a kind of structural schematic diagram of interface system that can be interacted for the embodiment of the present invention;
Fig. 3 is a kind of specific flow chart for interactive system that preferred embodiment of the present invention provides.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete Site preparation description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on Embodiment in the present invention, it is obtained by those of ordinary skill in the art without making creative efforts every other Embodiment shall fall within the protection scope of the present invention.
Fig. 1 is a kind of menu interface bandwagon effect figure based on MR mixed reality technology provided in an embodiment of the present invention.Such as Shown in Fig. 1, in a preferred embodiment of the invention, showing interface is carried out in three dimensions, this space is in user The same dimension, respectively two separate components.Set MR mixed reality technology, which projects reality scene by MR equipment In, user can check around interface, enhance the presence of virtual interface.As shown, 1 is spherical model, 2 be it In a round dough sheet.In this preferred embodiment, the initial coordinate of spherical model and all round dough sheets is (0,0,0), separately The radius of outer spherical model is greater than radius, that is, r ball > r circle of round dough sheet.When menu interface expansion, all circle dough sheets will It is moved to corresponding spatial position according to preset coordinate, that is, is in the top of spherical model 2, and form three layers of upper, middle and lower of sky Between be laid out, in this preferred embodiment a circle dough sheet coordinate from (0,0,0) becomes (5,5,5).As shown, all circles Dough sheet is respectively with coordinate (0,0,5), and (0,0,10), (0,0,15) is reference center, surrounds circle according to fixed space coordinate Queue.Wherein the space length between each described round dough sheet is impartial.In addition all round dough sheets surround three The radius relationship of a circular queue is that first layer is identical as third layer, and first layer, third layer are less than normal than second layer diameter, i.e. r1 =r3 < r2.In this preferred embodiment, each round dough sheet should be that is, vertical with user's sight plane perpendicular to ground, so more Be conducive to user to check the content of rounded face on piece.
Menu interface layout method provided by the invention can be widely applied and various computers, mobile terminal and virtual existing Reality, augmented reality, mixed reality equipment etc..Such as applied to MR mixed reality equipment, mixed reality equipment can be by the interface It projects in reality scene, while the spatial position of user can be positioned, user can freely walk about in actual environment, enclose It is checked and is interacted around interface.The three-dimensional menu interface can by display object clearly show user, grasp Make simplicity, the sense of reality is stronger.
Fig. 2 provides a kind of structural schematic diagram of interface system that can be interacted for the embodiment of the present invention.Described in Fig. 2, the present invention Interactive system structure include display module 110, content module 120 and interactive module 130.
Spherical model and all round dough sheets can be realized in space display by display module 110 first, be presented to the user The clearly demarcated menu interface of 3 D stereo, level.Display module 110 mainly assigns three-dimensional space to spherical model and round dough sheet and sits Mark, is laid out according to respective three dimensional space coordinate in space.Wherein round dough sheet forms upper, middle and lower according to fixed position Three layout layers, each round dough sheet front is outwardly, it is ensured that user is allowed to see the content of rounded face on piece mapping.
The main storage related system content of content module 120, can be icon or software etc., by with the round dough sheet Mapping relations are established, realize that 120 content of content module is presented in display module 110.
Interactive module 130 is mainly used for identifying that user carries out interface operation and function is realized, passes through light in identification MR equipment Target is mobile, click and drag motions, realization interactive function allow user to have and more preferably experience.
Fig. 3 is a kind of specific flow chart for interactive system that preferred embodiment of the present invention provides.As shown in figure 3, to be preferred real Applying the interface interaction method that example provides includes:
Step S110: only existing spherical model under original state, when user's cursor is moved in spherical model, and carries out a little It hits, that is, can trigger and open menu interface.
Step S120: all circle dough sheets fly out outward inside spherical model, according to the three-dimensional of each round dough sheet Space coordinate forms three layers of circular queue on solid space.
Step 130: when user selects cursor to be moved to the round dough sheet, judging whether user single clicks on.If User carries out single clicing on movement, thens follow the steps 140;It is no to then follow the steps S150.
Step 140: single clicing on the round dough sheet chosen, position moves forward, and mainly passes through space coordinate X-axis and Y-axis Upper number increases to realize, as a round dough sheet coordinate (5,5,5) in preferred embodiment is changing into (8,8,5).In addition, round The radius of dough sheet also increases with it, and allows users to be clearly apparent the content that rounded face on piece is shown.
Step 150: user's cursor dwell judges whether to rotation operation in rounded face on piece.If user carries out rotation behaviour Make, thens follow the steps S160;It is no to then follow the steps S120.
Step S160: user rotates after operation, same circular queue all rounded face sector-meetings according to same side The round dough sheet of other positions is checked by rotating circular queue to rotation.When user gesture port, circular queue is pressed According to rotating clockwise;When user gesture turns right, circular queue is according to rotating counterclockwise.
Step S170: restPosing when user needs to close menu interface, need to only move the cursor to the spherical mold Type is clicked, and all circle dough sheets, which will move back to inside spherical model, to stash.
In conclusion the beneficial effects of the invention are as follows vertical based on a kind of novel menu interface of MR mixed reality Technology design Body display method and interaction systems, enhance the fitness at 3 d menu interface and reality scene, while also improving menu interface Three-dimensional sense.It arranges additionally by Layering manifestation object, allows the simple and clear content for seeing display of user.In preferred embodiment, By interactive module function, so that user interacts with interface naturally, interface experience is more preferably.
It to a kind of menu interface methods of exhibiting based on MR mixed reality technology provided herein and can interact above System has carried out detailed introduction, and specific example used herein is expounded the application embodiment, the above implementation step Rapid explanation is merely used to help understand the present processes and its core concept, particular embodiments described above, to this hair Bright purpose, technical scheme and beneficial effects have carried out further detailed description, it should be understood that the foregoing is merely the present invention Specific embodiment, be not intended to limit the scope of protection of the present invention.It particularly points out, those skilled in the art is come It says, all within the spirits and principles of the present invention, any modification, equivalent substitution, improvement and etc. done should be included in the present invention Protection scope within.

Claims (10)

1. a kind of three-dimensional methods of exhibiting in interface based on MR mixed reality technology characterized by comprising
Spherical model and several round dough sheets are established as display object, wherein the spherical mold based on unity3D software platform Type diameter is greater than the round dough sheet diameter, and the round dough sheet is hidden in the spherical model, original state menu The spherical model is only presented in interface;
Receive and identify user and trigger interface instructions, control the round dough sheet from the spherical model according to fixed route to Fixed spatial position is rested on after flying out outside, the spherical model position immobilizes;
Need to content information to be shown be shown by the round dough sheet.
2. as described in claim 1 based on the three-dimensional methods of exhibiting in interface of MR mixed reality technology, which is characterized in that also wrap Include: the circle dough sheet is arranged in right above the spherical model, and forms three layers of upper, middle and lower of space layout;
Wherein, each layer of the round dough sheet is surrounded by a circular queue using fixed coordinate as reference center;Each Space length between the circle dough sheet is all impartial;
Wherein, the diameter Relationship for three circular queues that several round dough sheets surround is that first layer is identical as third layer, First layer, third layer are smaller than second layer diameter.
3. as described in claim 1 based on the three-dimensional methods of exhibiting in interface of MR mixed reality technology, which is characterized in that also wrap Include: the round dough sheet described in each is perpendicular to ground, i.e., vertical with user's sight plane, and user is facilitated to check.
4. a kind of interaction system based on the interface three-dimensional methods of exhibiting described in claim 1 based on MR mixed reality technology System, which is characterized in that including display module, content module and interactive module;
Display module, for the spherical model and the round dough sheet to be realized display in space, and by described in reception After the content information that content module is sent, the content information is shown in the rounded face on piece;
Content module, after required content information to be shown is transferred to the display module, so that the content information It is mapped to the rounded face on piece;
Interactive module, the interface operation of user instructs and sends corresponding instruction, the knowledge to the display module for identification The interface operation instruction of other user includes movement, click and the drag motions of cursor in identification MR equipment;
Wherein, the display module is also used to generate the three dimensional space coordinate of the spherical model and the round dough sheet, and root The spherical model and the round dough sheet are laid out in space according to respective three dimensional space coordinate, to form three-dimensional circle Shape.
5. the three-dimensional displaying interactive system in interface as claimed in claim 4 based on MR mixed reality technology, which is characterized in that The display module only shows the spherical model in the initial state, when the interactive module obtains and identifies user's cursor point After hitting menu interface instruction, Xiang Suoshu display module sends corresponding instruction execution and opens menu interface movement, and described in triggering Round dough sheet expansion.
6. the three-dimensional displaying interactive system in interface as claimed in claim 5 based on MR mixed reality technology, which is characterized in that The interactive module is by identifying that user's cursor is moved to the operational order of the round dough sheet, according to preset rules to the exhibition Show that module sent that corresponding instruction carries out the round dough sheet chooses or rotate operation.
7. the three-dimensional displaying interactive system in interface as claimed in claim 6 based on MR mixed reality technology, which is characterized in that After the interactive module is also used to obtain and identify the action command that user selects the click round dough sheet, to the displaying mould Block sends the round dough sheet that corresponding instruction control is chosen and moves forward and become larger, so that the content of the rounded face on piece It is more clear and shows user.
8. the three-dimensional displaying interactive system in interface as claimed in claim 6 based on MR mixed reality technology, which is characterized in that After the interactive module is also used to obtain and identify user to the dragging rotation command of the round dough sheet, Xiang Suoshu display module It sends corresponding instruction execution and rotates the circular movement of solid, so that user checks the round dough sheet outside the visual field.
9. the three-dimensional displaying interactive system in interface as claimed in claim 4 based on MR mixed reality technology, which is characterized in that The interactive module is also used to obtain when the round dough sheet is in outside the spherical model and identify the mobile cursor of user The action command of the spherical model is clicked, Xiang Suoshu display module sends corresponding all round dough sheets of instruction control and moves It is dynamic to return to inside the spherical model, it is restPosed with turning off menu interface.
10. the three-dimensional displaying interactive system in interface as claimed in claim 4 based on MR mixed reality technology, feature exist In the content information of the content module transmission includes picture, text or icon.
CN201910168623.2A 2019-03-06 2019-03-06 Interface three-dimensional display method and interaction system based on MR mixed reality technology Active CN109933195B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910168623.2A CN109933195B (en) 2019-03-06 2019-03-06 Interface three-dimensional display method and interaction system based on MR mixed reality technology

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910168623.2A CN109933195B (en) 2019-03-06 2019-03-06 Interface three-dimensional display method and interaction system based on MR mixed reality technology

Publications (2)

Publication Number Publication Date
CN109933195A true CN109933195A (en) 2019-06-25
CN109933195B CN109933195B (en) 2022-04-22

Family

ID=66986459

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910168623.2A Active CN109933195B (en) 2019-03-06 2019-03-06 Interface three-dimensional display method and interaction system based on MR mixed reality technology

Country Status (1)

Country Link
CN (1) CN109933195B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112256185A (en) * 2020-10-23 2021-01-22 广东智源机器人科技有限公司 Display method and device of 3D menu, processor and display equipment

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103218125A (en) * 2013-04-18 2013-07-24 广东欧珀移动通信有限公司 Operation method and system for sliding menu and mobile terminal
CN103324400A (en) * 2013-07-15 2013-09-25 天脉聚源(北京)传媒科技有限公司 Method and device for displaying menus in 3D model
CN103503030A (en) * 2012-03-23 2014-01-08 松下电器产业株式会社 Image processing device for specifying depth of object present in real space by performing image processing, stereoscopic viewing device, integrated circuit, and program
US20150169045A1 (en) * 2012-07-23 2015-06-18 Zte Corporation 3D human-machine interaction method and system
CN105677275A (en) * 2015-12-31 2016-06-15 北京小鸟看看科技有限公司 Interface layout method and wraparound interface system
CN106940477A (en) * 2017-03-14 2017-07-11 联想(北京)有限公司 A kind of control method and electronic equipment
CN108803876A (en) * 2018-06-08 2018-11-13 华北水利水电大学 Hydraulic engineering displaying exchange method based on augmented reality and system

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103503030A (en) * 2012-03-23 2014-01-08 松下电器产业株式会社 Image processing device for specifying depth of object present in real space by performing image processing, stereoscopic viewing device, integrated circuit, and program
US20150169045A1 (en) * 2012-07-23 2015-06-18 Zte Corporation 3D human-machine interaction method and system
CN103218125A (en) * 2013-04-18 2013-07-24 广东欧珀移动通信有限公司 Operation method and system for sliding menu and mobile terminal
CN103324400A (en) * 2013-07-15 2013-09-25 天脉聚源(北京)传媒科技有限公司 Method and device for displaying menus in 3D model
CN105677275A (en) * 2015-12-31 2016-06-15 北京小鸟看看科技有限公司 Interface layout method and wraparound interface system
CN106940477A (en) * 2017-03-14 2017-07-11 联想(北京)有限公司 A kind of control method and electronic equipment
CN108803876A (en) * 2018-06-08 2018-11-13 华北水利水电大学 Hydraulic engineering displaying exchange method based on augmented reality and system

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112256185A (en) * 2020-10-23 2021-01-22 广东智源机器人科技有限公司 Display method and device of 3D menu, processor and display equipment
CN112256185B (en) * 2020-10-23 2022-09-30 广东智源机器人科技有限公司 Display method and device of 3D menu, processor and display equipment

Also Published As

Publication number Publication date
CN109933195B (en) 2022-04-22

Similar Documents

Publication Publication Date Title
EP3223116B1 (en) Multiplatform based experience generation
WO2021022967A1 (en) Virtual object control method and apparatus, terminal, and storage medium
JP7387758B2 (en) Interface display method, device, terminal, storage medium and computer program
CN107890664A (en) Information processing method and device, storage medium, electronic equipment
CN103955308B (en) Touch interaction with a curved display
WO2019205879A1 (en) Method for realizing virtual scene conversion and related device
CN105096384B (en) Adjust the method and device of virtual article position and attitude angle
US7043695B2 (en) Object positioning and display in virtual environments
WO2014119098A1 (en) Information processing device, terminal device, information processing method, and programme
WO2014119097A1 (en) Information processing device, terminal device, information processing method, and programme
CN109685909A (en) Display methods, device, storage medium and the electronic device of image
CN107930114A (en) Information processing method and device, storage medium, electronic equipment
CN114089784B (en) Unmanned aerial vehicle control method and system based on MR glasses
CN106445118A (en) Virtual reality interaction method and apparatus
Capece et al. Graphvr: A virtual reality tool for the exploration of graphs with htc vive system
US20230321535A1 (en) Coordinate axis display method and apparatus applied to virtual environments, terminal, and medium
CN109701265A (en) Remote desktop cursor mode switching method, system, client and remote server
Englmeier et al. Spherical world in miniature: Exploring the tiny planets metaphor for discrete locomotion in virtual reality
CN106598228A (en) Object vision locating and control technology in VR environment
CN109933195A (en) The three-dimensional methods of exhibiting in interface and interactive system based on MR mixed reality technology
CN113190142B (en) Cubic model-based 3D environment interaction method and device
WO2023236602A1 (en) Display control method and device for virtual object, and storage medium and electronic device
CN109375866B (en) Screen touch click response method and system for realizing same
CN112181139B (en) Cooperative control interaction method for virtual reality and mixed reality
Bondarenko et al. Latency Visualization Emulation Scheme for Interactive Cloud XR Gaming

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant