CN109933195A - The three-dimensional methods of exhibiting in interface and interactive system based on MR mixed reality technology - Google Patents
The three-dimensional methods of exhibiting in interface and interactive system based on MR mixed reality technology Download PDFInfo
- Publication number
- CN109933195A CN109933195A CN201910168623.2A CN201910168623A CN109933195A CN 109933195 A CN109933195 A CN 109933195A CN 201910168623 A CN201910168623 A CN 201910168623A CN 109933195 A CN109933195 A CN 109933195A
- Authority
- CN
- China
- Prior art keywords
- interface
- dough sheet
- round dough
- spherical model
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- User Interface Of Digital Computer (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention discloses a kind of three-dimensional methods of exhibiting in interface based on MR mixed reality technology, it include: that spherical model and several round dough sheets are established as display object based on unity3D software platform, wherein the spherical model diameter is greater than the round dough sheet diameter, and the round dough sheet is hidden in the spherical model, the spherical model is only presented in original state menu interface;It receives and identifies user and triggers interface instructions, control the round dough sheet and rest on fixed spatial position after flying out outward in the spherical model according to fixed route, the spherical model position immobilizes;Need to content information to be shown be shown by the round dough sheet;The present invention is based on MR mixed realities, enhance the fitness at 3 d menu interface and reality scene, while also improving the three-dimensional sense of menu interface;It arranges additionally by Layering manifestation object, allows the simple and clear content for seeing display of user;So that user interacts with interface naturally, interface experience is more preferably.
Description
Technical field
The present invention relates to mixed reality technical field more particularly to a kind of interface based on MR mixed reality technology are three-dimensional
Methods of exhibiting and interactive system.
Background technique
In recent years, with the rapid development of intelligent wearable device technology, using intelligent glasses as the New Product of representative by
Gradually come into all trades and professions.Intelligent wearable device assists thought in emerging application with the application of " liberation both hands, high efficiency interactive ", real
The working efficiency of existing tradesman is improved, and gains great popularity in industry field application, while promoting answering for Nover practical
It is developed with by Kechuang.Currently, the wearable device based on mixed reality technology, service, overhaul of the equipments, medical treatment, system at the scene
It makes and logistic industry is proposed products application successively.
Further development of the mixed reality technology (MR) as virtual reality technology, the technology in reality scene by presenting
Virtual scene information sets up the information circuits of an interaction feedback between real world, virtual world and user, to enhance use
The sense of reality of family experience.But lack solid on menu interface now for the software systems of mixed reality technology (MR) exploitation
Sense, level distribution it is flat, also rest on over two dimension interface application thought, cannot really play the virtual of mixed reality technology
With the characteristic that reality combines.In addition, the interaction logic at interface is particularly significant to user experience, provided for user's use habit
A kind of system interacted.
Summary of the invention
The present invention provides a kind of three-dimensional methods of exhibiting in interface and interactive system based on MR mixed reality technology, with solution
Lack three-dimensional sense on certainly present menu interface, level distribution is flat, cannot really play mixed reality technology it is virtual with it is real
The technical issues of combining characteristic, to construct one kind in conjunction with the relevant technologies such as graph processing techniques by mixed reality technology
Stereo exhibition method, and then realize user by mixed reality equipment just it can be seen that a solid, level be clearly demarcated, dynamic dish
Single interface.
In order to solve the above-mentioned technical problem, it is vertical that the embodiment of the invention provides a kind of interfaces based on MR mixed reality technology
Body formula methods of exhibiting, comprising:
Spherical model and several round dough sheets are established as display object, wherein the ball based on unity3D software platform
Shape model diameter is greater than the round dough sheet diameter, and the round dough sheet is hidden in the spherical model, original state
The spherical model is only presented in menu interface;
It receives and identifies user and triggers interface instructions, control the round dough sheet from the spherical model according to fixed road
Diameter rests on fixed spatial position after flying out outward, the spherical model position immobilizes;
Need to content information to be shown be shown by the round dough sheet.
Preferably, further includes: the circle dough sheet is arranged in right above the spherical model, and forms upper, middle and lower
Three layers of space layout;
Wherein, each layer of the round dough sheet is surrounded by a circular queue using fixed coordinate as reference center;Often
Space length between one round dough sheet is all impartial;
Wherein, the diameter Relationship for three circular queues that several round dough sheets surround is first layer and third layer phase
Together, first layer, third layer are smaller than second layer diameter.
Preferably, further includes: the round dough sheet described in each hangs down perpendicular to ground with user's sight plane
Directly, user is facilitated to check.
The embodiment of the invention also provides a kind of three-dimensional displaying interactive system in the interface based on MR mixed reality technology, packets
Include display module, content module and interactive module;
Display module for the spherical model and the round dough sheet to be realized display in space, and passes through reception
After the content information that the content module is sent, the content information is shown in the rounded face on piece;
Content module, after required content information to be shown is transferred to the display module, so that the content
Information MAP is to the rounded face on piece;
Interactive module, the interface operation of user instructs and sends corresponding instruction, institute to the display module for identification
The interface operation instruction for stating identification user includes movement, click and the drag motions of cursor in identification MR equipment;
Wherein, the display module is also used to generate the three dimensional space coordinate of the spherical model and the round dough sheet,
And the spherical model and the round dough sheet are laid out in space according to respective three dimensional space coordinate, it is vertical to be formed
Body is round.
Preferably, the display module only shows the spherical model in the initial state, when the mutual dynamic model
After block obtains and identifies that user's cursor clicks menu interface instruction, Xiang Suoshu display module sends corresponding instruction execution and opens dish
Single interface action, and trigger the round dough sheet expansion.
Preferably, the interactive module is referred to by the operation that identification user's cursor is moved to the round dough sheet
It enables, chooses or rotate operation according to what preset rules sent that corresponding instruction carries out the round dough sheet to the display module.
Preferably, the interactive module is also used to obtain and identify that user selects to click the dynamic of the round dough sheet
After instructing, Xiang Suoshu display module sends the round dough sheet that corresponding instruction control is chosen and moves forward and become larger, and makes
The content for obtaining the rounded face on piece, which is more clear, shows user.
Preferably, the interactive module is also used to obtain and identify that user rotates the dragging of the round dough sheet
After instruction, Xiang Suoshu display module sends corresponding instruction execution and rotates the circular movement of solid, so that user checks view
The round dough sheet in field.
Preferably, the interactive module is also used to when the round dough sheet is in outside the spherical model,
It obtains and identifies that the mobile cursor of user clicks the action command of the spherical model, Xiang Suoshu display module sends corresponding instruction
It controls all round dough sheets to move back to inside the spherical model, be restPosed with turning off menu interface.
Preferably, the content information of the content module transmission includes picture, text or icon.
Compared with the prior art, the embodiment of the present invention has the following beneficial effects:
Based on MR mixed reality, the stereo exhibition method and interaction systems at a kind of novel menu interface, enhancing three are devised
The fitness of menu interface and reality scene is tieed up, while also improving the three-dimensional sense of menu interface;Additionally by Layering manifestation pair
As arrangement, the simple and clear content for seeing display of user is allowed;By interactive module function, so that user hands over interface naturally
Mutually, interface experience is more preferably.
Detailed description of the invention
Fig. 1 is a kind of menu interface bandwagon effect figure based on MR mixed reality technology provided in an embodiment of the present invention;
Fig. 2 provides a kind of structural schematic diagram of interface system that can be interacted for the embodiment of the present invention;
Fig. 3 is a kind of specific flow chart for interactive system that preferred embodiment of the present invention provides.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on
Embodiment in the present invention, it is obtained by those of ordinary skill in the art without making creative efforts every other
Embodiment shall fall within the protection scope of the present invention.
Fig. 1 is a kind of menu interface bandwagon effect figure based on MR mixed reality technology provided in an embodiment of the present invention.Such as
Shown in Fig. 1, in a preferred embodiment of the invention, showing interface is carried out in three dimensions, this space is in user
The same dimension, respectively two separate components.Set MR mixed reality technology, which projects reality scene by MR equipment
In, user can check around interface, enhance the presence of virtual interface.As shown, 1 is spherical model, 2 be it
In a round dough sheet.In this preferred embodiment, the initial coordinate of spherical model and all round dough sheets is (0,0,0), separately
The radius of outer spherical model is greater than radius, that is, r ball > r circle of round dough sheet.When menu interface expansion, all circle dough sheets will
It is moved to corresponding spatial position according to preset coordinate, that is, is in the top of spherical model 2, and form three layers of upper, middle and lower of sky
Between be laid out, in this preferred embodiment a circle dough sheet coordinate from (0,0,0) becomes (5,5,5).As shown, all circles
Dough sheet is respectively with coordinate (0,0,5), and (0,0,10), (0,0,15) is reference center, surrounds circle according to fixed space coordinate
Queue.Wherein the space length between each described round dough sheet is impartial.In addition all round dough sheets surround three
The radius relationship of a circular queue is that first layer is identical as third layer, and first layer, third layer are less than normal than second layer diameter, i.e. r1
=r3 < r2.In this preferred embodiment, each round dough sheet should be that is, vertical with user's sight plane perpendicular to ground, so more
Be conducive to user to check the content of rounded face on piece.
Menu interface layout method provided by the invention can be widely applied and various computers, mobile terminal and virtual existing
Reality, augmented reality, mixed reality equipment etc..Such as applied to MR mixed reality equipment, mixed reality equipment can be by the interface
It projects in reality scene, while the spatial position of user can be positioned, user can freely walk about in actual environment, enclose
It is checked and is interacted around interface.The three-dimensional menu interface can by display object clearly show user, grasp
Make simplicity, the sense of reality is stronger.
Fig. 2 provides a kind of structural schematic diagram of interface system that can be interacted for the embodiment of the present invention.Described in Fig. 2, the present invention
Interactive system structure include display module 110, content module 120 and interactive module 130.
Spherical model and all round dough sheets can be realized in space display by display module 110 first, be presented to the user
The clearly demarcated menu interface of 3 D stereo, level.Display module 110 mainly assigns three-dimensional space to spherical model and round dough sheet and sits
Mark, is laid out according to respective three dimensional space coordinate in space.Wherein round dough sheet forms upper, middle and lower according to fixed position
Three layout layers, each round dough sheet front is outwardly, it is ensured that user is allowed to see the content of rounded face on piece mapping.
The main storage related system content of content module 120, can be icon or software etc., by with the round dough sheet
Mapping relations are established, realize that 120 content of content module is presented in display module 110.
Interactive module 130 is mainly used for identifying that user carries out interface operation and function is realized, passes through light in identification MR equipment
Target is mobile, click and drag motions, realization interactive function allow user to have and more preferably experience.
Fig. 3 is a kind of specific flow chart for interactive system that preferred embodiment of the present invention provides.As shown in figure 3, to be preferred real
Applying the interface interaction method that example provides includes:
Step S110: only existing spherical model under original state, when user's cursor is moved in spherical model, and carries out a little
It hits, that is, can trigger and open menu interface.
Step S120: all circle dough sheets fly out outward inside spherical model, according to the three-dimensional of each round dough sheet
Space coordinate forms three layers of circular queue on solid space.
Step 130: when user selects cursor to be moved to the round dough sheet, judging whether user single clicks on.If
User carries out single clicing on movement, thens follow the steps 140;It is no to then follow the steps S150.
Step 140: single clicing on the round dough sheet chosen, position moves forward, and mainly passes through space coordinate X-axis and Y-axis
Upper number increases to realize, as a round dough sheet coordinate (5,5,5) in preferred embodiment is changing into (8,8,5).In addition, round
The radius of dough sheet also increases with it, and allows users to be clearly apparent the content that rounded face on piece is shown.
Step 150: user's cursor dwell judges whether to rotation operation in rounded face on piece.If user carries out rotation behaviour
Make, thens follow the steps S160;It is no to then follow the steps S120.
Step S160: user rotates after operation, same circular queue all rounded face sector-meetings according to same side
The round dough sheet of other positions is checked by rotating circular queue to rotation.When user gesture port, circular queue is pressed
According to rotating clockwise;When user gesture turns right, circular queue is according to rotating counterclockwise.
Step S170: restPosing when user needs to close menu interface, need to only move the cursor to the spherical mold
Type is clicked, and all circle dough sheets, which will move back to inside spherical model, to stash.
In conclusion the beneficial effects of the invention are as follows vertical based on a kind of novel menu interface of MR mixed reality Technology design
Body display method and interaction systems, enhance the fitness at 3 d menu interface and reality scene, while also improving menu interface
Three-dimensional sense.It arranges additionally by Layering manifestation object, allows the simple and clear content for seeing display of user.In preferred embodiment,
By interactive module function, so that user interacts with interface naturally, interface experience is more preferably.
It to a kind of menu interface methods of exhibiting based on MR mixed reality technology provided herein and can interact above
System has carried out detailed introduction, and specific example used herein is expounded the application embodiment, the above implementation step
Rapid explanation is merely used to help understand the present processes and its core concept, particular embodiments described above, to this hair
Bright purpose, technical scheme and beneficial effects have carried out further detailed description, it should be understood that the foregoing is merely the present invention
Specific embodiment, be not intended to limit the scope of protection of the present invention.It particularly points out, those skilled in the art is come
It says, all within the spirits and principles of the present invention, any modification, equivalent substitution, improvement and etc. done should be included in the present invention
Protection scope within.
Claims (10)
1. a kind of three-dimensional methods of exhibiting in interface based on MR mixed reality technology characterized by comprising
Spherical model and several round dough sheets are established as display object, wherein the spherical mold based on unity3D software platform
Type diameter is greater than the round dough sheet diameter, and the round dough sheet is hidden in the spherical model, original state menu
The spherical model is only presented in interface;
Receive and identify user and trigger interface instructions, control the round dough sheet from the spherical model according to fixed route to
Fixed spatial position is rested on after flying out outside, the spherical model position immobilizes;
Need to content information to be shown be shown by the round dough sheet.
2. as described in claim 1 based on the three-dimensional methods of exhibiting in interface of MR mixed reality technology, which is characterized in that also wrap
Include: the circle dough sheet is arranged in right above the spherical model, and forms three layers of upper, middle and lower of space layout;
Wherein, each layer of the round dough sheet is surrounded by a circular queue using fixed coordinate as reference center;Each
Space length between the circle dough sheet is all impartial;
Wherein, the diameter Relationship for three circular queues that several round dough sheets surround is that first layer is identical as third layer,
First layer, third layer are smaller than second layer diameter.
3. as described in claim 1 based on the three-dimensional methods of exhibiting in interface of MR mixed reality technology, which is characterized in that also wrap
Include: the round dough sheet described in each is perpendicular to ground, i.e., vertical with user's sight plane, and user is facilitated to check.
4. a kind of interaction system based on the interface three-dimensional methods of exhibiting described in claim 1 based on MR mixed reality technology
System, which is characterized in that including display module, content module and interactive module;
Display module, for the spherical model and the round dough sheet to be realized display in space, and by described in reception
After the content information that content module is sent, the content information is shown in the rounded face on piece;
Content module, after required content information to be shown is transferred to the display module, so that the content information
It is mapped to the rounded face on piece;
Interactive module, the interface operation of user instructs and sends corresponding instruction, the knowledge to the display module for identification
The interface operation instruction of other user includes movement, click and the drag motions of cursor in identification MR equipment;
Wherein, the display module is also used to generate the three dimensional space coordinate of the spherical model and the round dough sheet, and root
The spherical model and the round dough sheet are laid out in space according to respective three dimensional space coordinate, to form three-dimensional circle
Shape.
5. the three-dimensional displaying interactive system in interface as claimed in claim 4 based on MR mixed reality technology, which is characterized in that
The display module only shows the spherical model in the initial state, when the interactive module obtains and identifies user's cursor point
After hitting menu interface instruction, Xiang Suoshu display module sends corresponding instruction execution and opens menu interface movement, and described in triggering
Round dough sheet expansion.
6. the three-dimensional displaying interactive system in interface as claimed in claim 5 based on MR mixed reality technology, which is characterized in that
The interactive module is by identifying that user's cursor is moved to the operational order of the round dough sheet, according to preset rules to the exhibition
Show that module sent that corresponding instruction carries out the round dough sheet chooses or rotate operation.
7. the three-dimensional displaying interactive system in interface as claimed in claim 6 based on MR mixed reality technology, which is characterized in that
After the interactive module is also used to obtain and identify the action command that user selects the click round dough sheet, to the displaying mould
Block sends the round dough sheet that corresponding instruction control is chosen and moves forward and become larger, so that the content of the rounded face on piece
It is more clear and shows user.
8. the three-dimensional displaying interactive system in interface as claimed in claim 6 based on MR mixed reality technology, which is characterized in that
After the interactive module is also used to obtain and identify user to the dragging rotation command of the round dough sheet, Xiang Suoshu display module
It sends corresponding instruction execution and rotates the circular movement of solid, so that user checks the round dough sheet outside the visual field.
9. the three-dimensional displaying interactive system in interface as claimed in claim 4 based on MR mixed reality technology, which is characterized in that
The interactive module is also used to obtain when the round dough sheet is in outside the spherical model and identify the mobile cursor of user
The action command of the spherical model is clicked, Xiang Suoshu display module sends corresponding all round dough sheets of instruction control and moves
It is dynamic to return to inside the spherical model, it is restPosed with turning off menu interface.
10. the three-dimensional displaying interactive system in interface as claimed in claim 4 based on MR mixed reality technology, feature exist
In the content information of the content module transmission includes picture, text or icon.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910168623.2A CN109933195B (en) | 2019-03-06 | 2019-03-06 | Interface three-dimensional display method and interaction system based on MR mixed reality technology |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910168623.2A CN109933195B (en) | 2019-03-06 | 2019-03-06 | Interface three-dimensional display method and interaction system based on MR mixed reality technology |
Publications (2)
Publication Number | Publication Date |
---|---|
CN109933195A true CN109933195A (en) | 2019-06-25 |
CN109933195B CN109933195B (en) | 2022-04-22 |
Family
ID=66986459
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201910168623.2A Active CN109933195B (en) | 2019-03-06 | 2019-03-06 | Interface three-dimensional display method and interaction system based on MR mixed reality technology |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN109933195B (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112256185A (en) * | 2020-10-23 | 2021-01-22 | 广东智源机器人科技有限公司 | Display method and device of 3D menu, processor and display equipment |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103218125A (en) * | 2013-04-18 | 2013-07-24 | 广东欧珀移动通信有限公司 | Operation method and system for sliding menu and mobile terminal |
CN103324400A (en) * | 2013-07-15 | 2013-09-25 | 天脉聚源(北京)传媒科技有限公司 | Method and device for displaying menus in 3D model |
CN103503030A (en) * | 2012-03-23 | 2014-01-08 | 松下电器产业株式会社 | Image processing device for specifying depth of object present in real space by performing image processing, stereoscopic viewing device, integrated circuit, and program |
US20150169045A1 (en) * | 2012-07-23 | 2015-06-18 | Zte Corporation | 3D human-machine interaction method and system |
CN105677275A (en) * | 2015-12-31 | 2016-06-15 | 北京小鸟看看科技有限公司 | Interface layout method and wraparound interface system |
CN106940477A (en) * | 2017-03-14 | 2017-07-11 | 联想(北京)有限公司 | A kind of control method and electronic equipment |
CN108803876A (en) * | 2018-06-08 | 2018-11-13 | 华北水利水电大学 | Hydraulic engineering displaying exchange method based on augmented reality and system |
-
2019
- 2019-03-06 CN CN201910168623.2A patent/CN109933195B/en active Active
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103503030A (en) * | 2012-03-23 | 2014-01-08 | 松下电器产业株式会社 | Image processing device for specifying depth of object present in real space by performing image processing, stereoscopic viewing device, integrated circuit, and program |
US20150169045A1 (en) * | 2012-07-23 | 2015-06-18 | Zte Corporation | 3D human-machine interaction method and system |
CN103218125A (en) * | 2013-04-18 | 2013-07-24 | 广东欧珀移动通信有限公司 | Operation method and system for sliding menu and mobile terminal |
CN103324400A (en) * | 2013-07-15 | 2013-09-25 | 天脉聚源(北京)传媒科技有限公司 | Method and device for displaying menus in 3D model |
CN105677275A (en) * | 2015-12-31 | 2016-06-15 | 北京小鸟看看科技有限公司 | Interface layout method and wraparound interface system |
CN106940477A (en) * | 2017-03-14 | 2017-07-11 | 联想(北京)有限公司 | A kind of control method and electronic equipment |
CN108803876A (en) * | 2018-06-08 | 2018-11-13 | 华北水利水电大学 | Hydraulic engineering displaying exchange method based on augmented reality and system |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112256185A (en) * | 2020-10-23 | 2021-01-22 | 广东智源机器人科技有限公司 | Display method and device of 3D menu, processor and display equipment |
CN112256185B (en) * | 2020-10-23 | 2022-09-30 | 广东智源机器人科技有限公司 | Display method and device of 3D menu, processor and display equipment |
Also Published As
Publication number | Publication date |
---|---|
CN109933195B (en) | 2022-04-22 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP3223116B1 (en) | Multiplatform based experience generation | |
WO2021022967A1 (en) | Virtual object control method and apparatus, terminal, and storage medium | |
JP7387758B2 (en) | Interface display method, device, terminal, storage medium and computer program | |
CN107890664A (en) | Information processing method and device, storage medium, electronic equipment | |
CN103955308B (en) | Touch interaction with a curved display | |
WO2019205879A1 (en) | Method for realizing virtual scene conversion and related device | |
CN105096384B (en) | Adjust the method and device of virtual article position and attitude angle | |
US7043695B2 (en) | Object positioning and display in virtual environments | |
WO2014119098A1 (en) | Information processing device, terminal device, information processing method, and programme | |
WO2014119097A1 (en) | Information processing device, terminal device, information processing method, and programme | |
CN109685909A (en) | Display methods, device, storage medium and the electronic device of image | |
CN107930114A (en) | Information processing method and device, storage medium, electronic equipment | |
CN114089784B (en) | Unmanned aerial vehicle control method and system based on MR glasses | |
CN106445118A (en) | Virtual reality interaction method and apparatus | |
Capece et al. | Graphvr: A virtual reality tool for the exploration of graphs with htc vive system | |
US20230321535A1 (en) | Coordinate axis display method and apparatus applied to virtual environments, terminal, and medium | |
CN109701265A (en) | Remote desktop cursor mode switching method, system, client and remote server | |
Englmeier et al. | Spherical world in miniature: Exploring the tiny planets metaphor for discrete locomotion in virtual reality | |
CN106598228A (en) | Object vision locating and control technology in VR environment | |
CN109933195A (en) | The three-dimensional methods of exhibiting in interface and interactive system based on MR mixed reality technology | |
CN113190142B (en) | Cubic model-based 3D environment interaction method and device | |
WO2023236602A1 (en) | Display control method and device for virtual object, and storage medium and electronic device | |
CN109375866B (en) | Screen touch click response method and system for realizing same | |
CN112181139B (en) | Cooperative control interaction method for virtual reality and mixed reality | |
Bondarenko et al. | Latency Visualization Emulation Scheme for Interactive Cloud XR Gaming |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |