CN110096142A - A kind of intelligent interactive method based on virtual reality, device and storage medium - Google Patents
A kind of intelligent interactive method based on virtual reality, device and storage medium Download PDFInfo
- Publication number
- CN110096142A CN110096142A CN201910258185.9A CN201910258185A CN110096142A CN 110096142 A CN110096142 A CN 110096142A CN 201910258185 A CN201910258185 A CN 201910258185A CN 110096142 A CN110096142 A CN 110096142A
- Authority
- CN
- China
- Prior art keywords
- task
- real
- virtual reality
- time
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/01—Indexing scheme relating to G06F3/01
- G06F2203/012—Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Optics & Photonics (AREA)
- Human Computer Interaction (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The present invention relates to technical field of virtual reality, and in particular to the intelligent interactive method based on virtual reality.Intelligent interactive method of this kind based on virtual reality: location information of the user in virtual reality scenario is obtained in real time, real-time task route is planned according to the current location information of user, when getting the instruction for needing to guide in real time of user's sending, pop-up and real-time director information corresponding to real-time task route in virtual reality scenario, to guide user in real time.The problem of present invention solves route guiding existing in the prior art and fixes, and does not guide in real time, causes experiencer easily lost, and the different experiencer of starting point, and system cannot make correct guide according to real time status.
Description
Technical field
The present invention relates to technical field of virtual reality, and in particular to a kind of intelligent interactive method based on virtual reality, dress
It sets and storage medium.
Background technique
It with the fusion of various technologies, mutually promotes and develops, virtual reality (VR) technology is in space flight, military affairs, communication, doctor
The every field such as treatment, education, amusement, electric power, building and business have greatly development and application prospect.It is most in user
It may all be contact VR experience for the first time, therefore new hand's route guiding is indispensable, but most route refers at present
The guide for drawing middle direction is set, and will not be walked about according to the random of experiencer, real-time update route is guided.If not yet
There is real-time guide, experiencer can be easy to get lost, and the different experiencer of starting point, and system cannot be made according to current situation
It correctly guides out, provides and accurately guide.Especially in VR virtual emulation training, VR training and teaching is largely trained
Person is that contact VR, traditional route guide cannot assist trainer, not be well positioned to meet the demand of trainer for the first time.
Summary of the invention
The invention discloses a kind of intelligent interactive method based on virtual reality, device and storage mediums, existing to solve
There is route guiding present in technology to fix, do not guide in real time, causes experiencer easily lost, and the different experience of starting point
The problem of person, system cannot make correct guide according to real time status.
In order to achieve the above object, the present invention adopts the following technical scheme:
A kind of intelligent interactive method based on virtual reality: position letter of the user in virtual reality scenario is obtained in real time
Breath plans real-time task route according to the current location information of user, gets the instruction for needing to guide in real time of user's sending
When, pop-up and real-time director information corresponding to real-time task route in virtual reality scenario.
Further, the real-time location information for obtaining user in virtual reality scenario includes current according to user
X-axis, Y-axis and Z axis information determine the current real time position of user.
Further, the real-time task route includes being organized into execution sequence of the task, each task corresponding one
The corresponding director information of task that execution sequence is first in real-time task route is set real-time task road by a director information
Real-time director information corresponding to line.
Further, the real-time director information includes that scene prompt information, task location prompt information and main flow mention
Show information；The main flow prompt information includes the overview of overall task in virtual reality scenario, and the overall task includes number
A task based on program sequence；The task location prompt includes the task that execution sequence is first in real-time task route
Position indicating, mobile route are reminded, climbing it is mobile remind and can interaction point, can interactive areas prompt；The task location prompt is set
It is placed near task location, or is set to immediately ahead of user's head and is fixed in virtual reality scenario.
Further, the method for the planning real-time task route are as follows: the current position of comparison user and nearby not complete
At task positional distance, using the unfinished task nearest apart from user's real time position as being executed in real-time task route
The task that sequence is first determines the task that execution sequence is first in real-time task route further according to the sequence in overall task
Subsequent task.
Further, the interaction ray that real time monitoring user's control issues, being directed toward when the end of interaction ray can interactive areas
Or can interaction point when, control this can interactive areas or can interaction point be transformed into it is colored be highlighted, expression chosen this can
Interaction point can interactive areas；When interaction ray end from can interactive areas or can interaction point remove when, control this can interaction point or
Can the colour switching of interactive areas be highlighted at different colors or cancellation, indicate to cancel selected state, choosing can be re-started
It selects.
Further, when getting the instruction for needing to guide in real time of user's sending, shock pulse and voice prompting are issued
User is guided in real time.
Further, real time monitoring network state, after monitoring broken string or server closing, in virtual reality scenario
Network state is popped up to remind.
A kind of storage medium is stored with computer program on the storage medium, and the computer program is performed reality
The existing above-mentioned intelligent interactive method based on virtual reality.
A kind of intelligent interaction device based on virtual reality, including VR device, processor, storage device and be stored in described
On storage device and the program based on VR technology that can execute on the processor, the program based on VR technology are processed
Device realizes the above-mentioned intelligent interactive method based on virtual reality when executing.
Compared with prior art, the invention has the benefit that the intelligent interactive method of the invention based on virtual reality
By obtaining location information of the user in virtual reality scenario in real time, real-time task is planned according to the current location information of user
Route, when getting the instruction for needing to guide in real time of user's sending, pop-up and real-time task route in virtual reality scenario
Corresponding real-time director information, user can rapidly enter correct route and take correctly according to real-time director information
Operation overcomes the unicity that route guides in the prior art, can mention in any stage of experience for user to complete task
It is guided for dynamic suitable route.
Specific embodiment
The specific embodiments described herein are merely illustrative of the present invention, is not intended to limit the present invention.
A kind of intelligent interaction device based on virtual reality of the present embodiment, including but not limited to VR device, display, sound
Sound, sensor, positioning device and gesture identifying device；VR device includes but is not limited to VR host, head aobvious, earphone and handle, fixed
Position device is set to head and shows, for detecting the position for wearing the aobvious user of head；VR host and VR device, sensor, positioning fill
It sets, gesture identifying device communication connection, sound equipment is electrically connected with VR host, earphone and sound equipment communication connection, can be played in earphone
The sound that sound equipment issues；Sensor includes optical sensor, motion sensor etc., and sensor can change intelligence according to the variation of environment
The operating status of energy interactive device, for example, optical sensor includes ambient light sensor, ambient light sensor can be according to ambient light
Light and shade adjust the brightness of display screen, other sensors use conventional arrangement, are not listed one by one；Gesture identifying device is leap
Motion sensor, gesture identifying device are mounted on the position that can identify user's hand, it is preferable that pacify gesture identifying device
Fill the position of face user over the display；Above-mentioned VR device, display, sound equipment, sensor, positioning device and gesture identification dress
The specific structure set and specific connection relationship are using prior art realization, and details are not described herein.
Include processor and storage device in VR host, the program based on VR technology is stored in storage device, opens base
When the program of VR technology, processor upon receipt of the instructions, executes the program based on VR technology, generates virtual reality scenario
And the virtual reality scenario is sent to the aobvious middle display of head, user's wearing head is shown and earphone, into virtual reality scenario.
User can be interacted by gesture or handle with the intelligent interaction device.Gesture is stored in storage device
Library, user's both hands are located in the range that leap motion sensor can identify, the both hands of user make specific movement quilt
It is after the identification of leap motion sensor, the gesture is corresponding with the movement in gesture library, the corresponding system behaviour of identification gesture
Make, and completes corresponding operation；Some buttons are also equipped on handle, user can also be by pressing some buttons on fixed handle
Operation is made, such as real-time director information, tools menu and resetting menu can be recalled by lever knob, needs to check in real time
When director information, user can be such that real-time director information pops up with active control, after checking real-time director information, can determine scene
Information and main flow information, or according to task location prompt impulse in it is specified can interactive areas and can interaction point complete scene and appoint
Business.When being interacted using handle and the intelligent interaction device, handle can issue interactive ray, when the end of interaction ray is directed toward
Can interactive areas or can interaction point when, control this can interactive areas or can interaction point be transformed into it is colored be highlighted, indicate
Choose this can interaction point or can interactive areas；When interaction ray end from can interactive areas or can interaction point remove when, controlling this can
Interaction point or can the colour switching of interactive areas be highlighted at different colors or cancellation, indicate to cancel selected state, Ke Yichong
Newly selected.
In order to overcome route guiding excessively immobilization in the prior art, real-time guide not can be carried out, and not for starting point
The problem of the same user, system cannot make correct guide according to real time status, deposits in intelligent interaction device of the invention
The program based on VR technology of storage, the program are set when executing including several tasks based on program sequence, which can be with
Real-time guide is provided for user, i.e., is ordered as first task in real-time task route according to the determination of user's real time position,
Then it using the task as real-time task starting point, further according to the sequence of overall task in program, determines the subsequent task of the task, has
Body:
A kind of intelligent interactive method using above-mentioned apparatus, comprising the following steps:
(1) the current real time position of user is determined according to the current X-axis of user, Y-axis and Z axis information；
(2) real-time task route is planned according to the real time position of user: the current position of comparison user and nearby not complete
At task positional distance, using the unfinished task nearest apart from user's real time position as being executed in real-time task route
The task that sequence is first determines the task of execution sequence first in real-time task route further according to the sequence in overall task
Follow-up work；
(3) whether real-time monitoring user issues instruction, when getting the instruction for needing to guide in real time of user's sending,
Real-time director information corresponding with real-time task route is popped up in virtual reality scenario；Meanwhile monitoring network state in real time, when
After monitoring broken string or server closing, network state is popped up in virtual reality scenario and is reminded.
Wherein, overall task includes several tasks based on program sequence, the corresponding director information of each task；It is real
When task route be made of several tasks, by real-time task route execution sequence be first the corresponding director information of task
It is set as real-time director information corresponding to real-time task route.Real-time director information includes scene prompt information, task location
Prompt information and main flow prompt information；User can understand scene locating at present from scene prompt information, can be from master
Know that the overall task overview of entire virtual reality scenario, task location prompt for the real-time task route in process prompt information
Real-time director information corresponding to the task that middle execution sequence is first, user can know current need from task location prompt
The task situation to be completed, specifically include task location prompt, mobile route is reminded, climbing it is mobile remind and can interaction point, can
Interactive areas prompt, can interaction point or can interactive areas include but is not limited to various menus (tools menu, resetting menu etc.), task point
(such as climbing point, anchor point)；Task location prompt is set near task location, or is set to immediately ahead of user's head 3 meters
And it is fixed in virtual reality scenario.
When getting the instruction for needing to guide in real time of user's sending, it can not only pop up in virtual reality scenario and refer in real time
Fuse breath, and handle can issue shock pulse, occur voice prompting in earphone, further be guided in real time user.
Below for being damaged the virtual reality scenario of steel tower disassembly multiple person cooperational training, multiple users enter the void simultaneously
In quasi- reality scene, in the initial scene of the virtual reality scenario, there is user circle started in 3 meters of the front of each user
Face shows multiple function buttons in user interface, selects " starting to experience " button using interaction handle, rear to enter training setting
User interface, complete training setting after, the user interface for selection of getting inside the character that one is playing, wherein in role include commander, bracing wire person
With cutting person etc., after completing role selecting, commander convenes all personnel before the user interface of " task list ", by oral
Mode is told somebody what one's real intentions are safely and task explanation, and prompts all personnel that can recall by the key on interaction handle
The briefing interface of " current task "；Current link all personnel can see the task reminders of first task, start to appoint
Business；In follow-up work, all roles cooperate completion task, and during task, any one role can be by pressing
Button on dynamic interaction handle recalls real-time director information, such as bracing wire person presses in " tower body stress point is fixed " this task
Briefing occur in key on interaction handle, front: " current task: correctly anchoring pinpoints fixed inherently safe for selection
Suspension hook cable anchor, is then scheduled on stress point by rope ", lower section occurs: " completion " button.
The foregoing is merely better embodiments of the invention, and the invention is not limited to above embodiment, are implementing
The structural modification small there may be part in the process, if various changes or modifications of the invention are not departed from essence of the invention
Mind and range, and belong within the scope of claim and equivalent technologies of the invention, then the present invention is also intended to encompass these changes
And modification.
Claims (10)
1. a kind of intelligent interactive method based on virtual reality, which is characterized in that obtain user in real time in virtual reality scenario
Location information, real-time task route is planned according to the current location information of user, the needs for getting user's sending refer in real time
When the instruction drawn, pop-up and real-time director information corresponding to real-time task route in virtual reality scenario.
2. the intelligent interactive method according to claim 1 based on virtual reality, which is characterized in that the real-time acquisition is used
Location information of the family in virtual reality scenario includes determining that user is current according to the current X-axis of user, Y-axis and Z axis information
Real time position.
3. the intelligent interactive method according to claim 1 based on virtual reality, which is characterized in that the real-time task road
Line includes being organized into execution sequence of the task, and the corresponding director information of each task will execute in real-time task route
Sequence is set as real-time director information corresponding to real-time task route for the first corresponding director information of task.
4. the intelligent interactive method according to claim 3 based on virtual reality, which is characterized in that the real-time guide letter
Breath includes scene prompt information, task location prompt information and main flow prompt information；The main flow prompt information includes void
The overview of overall task in quasi- reality scene, the overall task include several tasks based on program sequence；The task position
Setting prompt includes the position indicating for the task that execution sequence is first in real-time task route, mobile route prompting, climbing movement
Remind and can interaction point, can interactive areas prompt；The task location prompt is set near task location, or is set to and is used account
Immediately ahead of portion and it is fixed in virtual reality scenario.
5. the intelligent interactive method according to claim 4 based on virtual reality, which is characterized in that the planning is appointed in real time
The method of business route are as follows: the positional distance of comparison user current position and neighbouring unfinished task, it will be apart from user's reality
When position nearest unfinished task be sequentially first as execution in real-time task route task, further according to overall task
In sequence determine real-time task route in execution sequence be first the subsequent task of task.
6. the intelligent interactive method according to claim 1 based on virtual reality, which is characterized in that real time monitoring user's control
Make the interaction ray issued, when the end of interaction ray be directed toward can interactive areas or can interaction point when, controlling this can interactive areas or can
Interaction point be transformed into it is colored be highlighted, expression has chosen this can interaction point or can interactive areas；When the end of interaction ray
End from can interactive areas or can interaction point remove when, control this can interaction point or can interactive areas colour switching at different color or
Cancellation is highlighted, and is indicated to cancel selected state, can be re-started selection.
7. the intelligent interactive method according to claim 1 based on virtual reality, which is characterized in that get user's sending
The instruction for needing to guide in real time when, issue shock pulse and voice prompting and user guided in real time.
8. the intelligent interactive method according to claim 1 based on virtual reality, which is characterized in that real time monitoring network shape
State pops up network state in virtual reality scenario and reminds after monitoring broken string or server closing.
9. a kind of storage medium, computer program is stored on the storage medium, which is characterized in that the computer program quilt
Such as the intelligent interactive method according to any one of claims 1 to 8 based on virtual reality is realized when execution.
10. a kind of intelligent interaction device based on virtual reality, which is characterized in that including VR device, processor, storage device and
It is stored in the program based on VR technology that can be executed on the storage device and on the processor, it is described based on VR technology
Such as the intelligent interactive method according to any one of claims 1 to 8 based on virtual reality is realized when program is executed by processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910258185.9A CN110096142A (en) | 2019-04-01 | 2019-04-01 | A kind of intelligent interactive method based on virtual reality, device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910258185.9A CN110096142A (en) | 2019-04-01 | 2019-04-01 | A kind of intelligent interactive method based on virtual reality, device and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110096142A true CN110096142A (en) | 2019-08-06 |
Family
ID=67444143
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910258185.9A Pending CN110096142A (en) | 2019-04-01 | 2019-04-01 | A kind of intelligent interactive method based on virtual reality, device and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110096142A (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104484523A (en) * | 2014-12-12 | 2015-04-01 | 西安交通大学 | Equipment and method for realizing augmented reality induced maintenance system |
| CN106774872A (en) * | 2016-12-09 | 2017-05-31 | 网易（杭州）网络有限公司 | Virtual reality system, virtual reality exchange method and device |
| WO2017171649A1 (en) * | 2016-03-30 | 2017-10-05 | Agency For Science, Technology And Research | Methods for providing task related information to a user, user assistance systems, and computer-readable media |
| CN108281077A (en) * | 2017-12-26 | 2018-07-13 | 丰羽教育科技（上海）有限公司 | A kind of virtual escape guiding method and system based on wearable device |
| CN108615427A (en) * | 2018-04-19 | 2018-10-02 | 广州特种机电设备检测研究院 | A kind of elevator laboratory teaching system and method based on virtual reality technology |
| CN109268010A (en) * | 2018-09-22 | 2019-01-25 | 太原理工大学 | A kind of long-range inspection interference method of virtual reality Mechanized |
-
2019
- 2019-04-01 CN CN201910258185.9A patent/CN110096142A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104484523A (en) * | 2014-12-12 | 2015-04-01 | 西安交通大学 | Equipment and method for realizing augmented reality induced maintenance system |
| WO2017171649A1 (en) * | 2016-03-30 | 2017-10-05 | Agency For Science, Technology And Research | Methods for providing task related information to a user, user assistance systems, and computer-readable media |
| CN106774872A (en) * | 2016-12-09 | 2017-05-31 | 网易（杭州）网络有限公司 | Virtual reality system, virtual reality exchange method and device |
| CN108281077A (en) * | 2017-12-26 | 2018-07-13 | 丰羽教育科技（上海）有限公司 | A kind of virtual escape guiding method and system based on wearable device |
| CN108615427A (en) * | 2018-04-19 | 2018-10-02 | 广州特种机电设备检测研究院 | A kind of elevator laboratory teaching system and method based on virtual reality technology |
| CN109268010A (en) * | 2018-09-22 | 2019-01-25 | 太原理工大学 | A kind of long-range inspection interference method of virtual reality Mechanized |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110021200A (en) | Teaching white silk examines integrated virtual reality Training Methodology, device and storage medium | |
| Yanco et al. | Analysis of human‐robot interaction at the darpa robotics challenge trials | |
| CN109131908A (en) | System and method for executing forced landing and landing | |
| CN106774872A (en) | Virtual reality system, virtual reality exchange method and device | |
| CN107656505A (en) | Use the methods, devices and systems of augmented reality equipment control man-machine collaboration | |
| US20070160961A1 (en) | Transportation simulator | |
| CN109859538A (en) | A kind of key equipment training system and method based on mixed reality | |
| CN112933591A (en) | Method and device for controlling game virtual character, storage medium and electronic equipment | |
| CN106483980B (en) | A kind of unmanned plane follows the control method of flight, apparatus and system | |
| JP6714967B2 (en) | Amusement machine | |
| CN108520667A (en) | A kind of high ferro training teaching system and method based on virtual reality | |
| CN107185231A (en) | Information processing method and device, storage medium, electronic equipment | |
| CN107741785B (en) | Remote guidance method and system for protecting front end safety | |
| CN110209276A (en) | Object selection method and device, electronic equipment, storage medium in virtual reality | |
| US11727824B2 (en) | System and method for teaching computer programming | |
| CN110148330A (en) | Around machine check training system before a kind of Aircraft based on virtual reality | |
| KR20190042783A (en) | Disaster Countermeasures Training method capable to make training scene and system thereof | |
| CN108355347A (en) | Interaction control method, device, electronic equipment and storage medium | |
| CN110084726A (en) | Multiple person cooperational training control method, device and storage medium based on virtual reality | |
| CN110196580A (en) | Assemble guidance method, system, server and storage medium | |
| CN115661412A (en) | Aero-engine auxiliary assembly system and method based on mixed reality | |
| CN109300528A (en) | A kind of cognitive rehabilitative training system and method | |
| CN106371455B (en) | A kind of intelligent interactive method and system | |
| WO2021077414A1 (en) | Interface display method, control system, computer readable storage medium, and unmanned aerial vehicle | |
| CN110096142A (en) | A kind of intelligent interactive method based on virtual reality, device and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190806 |