CN110044322A - A kind of display methods, device and the mobile terminal of virtual reality terminal - Google Patents
A kind of display methods, device and the mobile terminal of virtual reality terminal Download PDFInfo
- Publication number
- CN110044322A CN110044322A CN201810045356.5A CN201810045356A CN110044322A CN 110044322 A CN110044322 A CN 110044322A CN 201810045356 A CN201810045356 A CN 201810045356A CN 110044322 A CN110044322 A CN 110044322A
- Authority
- CN
- China
- Prior art keywords
- barrier
- virtual reality
- dual camera
- distance
- terminal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C3/00—Measuring distances in line of sight; Optical rangefinders
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
- G01S17/06—Systems determining position data of a target
- G01S17/46—Indirect determination of position data
- G01S17/48—Active triangulation systems, i.e. using the transmission and reflection of electromagnetic waves other than radio waves
Landscapes
- Physics & Mathematics (AREA)
- Electromagnetism (AREA)
- Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Computer Networks & Wireless Communication (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The present invention provides display methods, device and the mobile terminals of a kind of virtual reality terminal, wherein, display methods includes: to utilize preset dual camera location algorithm, virtual reality terminal is calculated at a distance from barrier, and when the distance is less than or equal to the first given threshold, the prompt information of dyspoiesis object is simultaneously shown on the display interface of virtual reality terminal.This method passes through the dual camera of virtual reality terminal, observation external environment and barrier in real time, location algorithm is taken the photograph according to observed image and using preset pair, virtual reality terminal is calculated at a distance from barrier, when determining that user may encounter barrier, generates prompt information and be presented on the display interface of virtual reality terminal.This method allows users to the case where intuitively learning the external environment locating for oneself in time, and reminds user in time, improves user experience, solves problem of the prior art.
Description
Technical field
The present invention relates to field of mobile communication, more particularly to display methods, device and the shifting of a kind of virtual reality terminal
Dynamic terminal.
Background technique
VR terminal is worn on head by user when using virtual reality (Virtual Reality, VR) terminal, this
Kind situation may be such that user is immersed in the visual effect of VR terminal, and user is caused to ignore in actual environment in use
Existing barrier may collide with barrier, and then influence user experience.Therefore, it is necessary to VR terminals to detect
Barrier in environment, and calculate barrier and user distance.The prior art can use infrared ray or ultrasonoscope calculates barrier
Hinder object at a distance from user, but shows the image of barrier without normal direction user.It is thus impossible to enough make the autonomous disturbance in judgement object of user
Whether have an impact to it.In addition, user can not also check locating actual environment at any time, user experience is influenced.
Summary of the invention
The present invention provides display methods, device and the mobile terminal of a kind of virtual reality terminal, to solve the prior art
Following problem: the prior art can not prompt the user with obstacle information in the form of intuitive, cause user possibly can not be timely
It makes a response to surrounding environment change, influences user experience.
To solve the above problems, on the one hand, the present invention provides a kind of display methods of virtual reality terminal, comprising: utilize
Preset dual camera location algorithm calculates the virtual reality terminal at a distance from barrier；It is less than or equal in the distance
When the first given threshold, the prompt information of the barrier is generated；By the prompt information in the aobvious of the virtual reality terminal
Show and is shown on interface.
Optionally, using dual camera location algorithm, the virtual reality terminal is calculated at a distance from the barrier, into
One step includes: whether the detection virtual reality terminal is subjected to displacement, and the case where the virtual reality terminal is subjected to displacement
Under, using dual camera location algorithm, the virtual reality terminal is calculated at a distance from the barrier.
Optionally, the dual camera location algorithm includes any one in following algorithm: algorithm 1: by calculating institute
Focus point of the dual camera on the barrier is stated to the length of the dual camera line distance, obtains the virtual reality
Terminal is at a distance from barrier；Algorithm 2: by position of the barrier in the dual camera visual field, the void is obtained
Quasi- non-real end is at a distance from the barrier；Algorithm 3: by calculating focus point of the dual camera on the barrier
With on the section of the formed plane of the dual camera imaging triangle size, obtain the virtual reality terminal with
The distance of the barrier.
Optionally, the prompt information of the barrier is generated, comprising: shoot to the barrier, and by shooting
The image of the barrier is as the prompt information.
Optionally, after being shown the prompt information on the display interface of the virtual reality terminal, also
It includes: detecting whether to receive the instruction information for ignoring the barrier, when received, then stops showing described image, and
Described image is saved.
Optionally, when the distance is less than or equal to given threshold, further includes: take pictures, obtain to the barrier
The image of the barrier；Whether consistent with the reference picture formerly saved described image is detected, if so, not generating the barrier
Hinder the prompt information of object；Otherwise, the prompt information of the barrier is generated.
Optionally, using dual camera location algorithm calculate the virtual reality terminal at a distance from the barrier it
Before, further includes: record the initial position of the barrier；According to the initial position of the barrier, the virtual reality is calculated
Distance value between terminal and the initial position；When the distance value is more than or equal to the second given threshold, using the algorithm 1
As dual camera location algorithm；When the distance value is less than second given threshold, judge the dual camera in institute
Whether the focus point and ground distance stated on barrier are less than third given threshold, if so, using the algorithm 2 as double camera shootings
Otherwise head location algorithm is used as dual camera location algorithm using the algorithm 3.
In addition, to achieve the above object, the present invention also provides a kind of display devices of virtual reality terminal, comprising: ranging
Module calculates the virtual reality terminal at a distance from barrier for using preset dual camera location algorithm；Prompt letter
Generation module is ceased, for generating the prompt information of the barrier when the distance is less than or equal to given threshold；Prompt information
Display module, for showing the prompt information on the display interface of the virtual reality terminal.
Optionally, the range finder module, is also used to: detecting whether the virtual reality terminal is subjected to displacement, and described
In the case that virtual reality terminal is subjected to displacement, using the preset dual camera location algorithm, the virtual reality is calculated
Terminal is at a distance from barrier.
In addition, a kind of mobile terminal, includes at least memory, processor, is stored with computer program on the memory,
It is characterized in that, the processor realizes the aobvious of above-mentioned virtual reality terminal when executing the computer program on the memory
The step of showing method.
The present invention provides display methods, device and the mobile terminals of a kind of virtual reality terminal, wherein display methods benefit
With preset dual camera location algorithm, calculates virtual reality terminal and be less than or equal at a distance from barrier, and in the distance
When given threshold, the prompt information of dyspoiesis object is simultaneously shown on the display interface of virtual reality terminal.This method utilizes
The dual camera of VR terminal can observe external environment and barrier in real time, according to preset dual camera location algorithm, calculate
VR terminal, when determining that user may encounter barrier, prompts user, and will be prompted to information at a distance from barrier
It is presented on the display interface of VR terminal, allows users to the case where intuitively learning the external environment locating for oneself in time,
And remind user in time, improve the user experience of VR terminal, solve the problems, such as the as follows of the prior art: existing skill
Art can not prompt the user with obstacle information in the form of more intuitive, cause user possibly can not be in time to surrounding environment change
It makes a response, influences user experience.
Detailed description of the invention
Fig. 1 is the flow chart of the display methods of virtual reality terminal in first embodiment of the invention；
Fig. 2 is the structural schematic diagram of the display device of virtual reality terminal in second embodiment of the invention；
Fig. 3 is the flow chart of the display methods of virtual reality terminal in third embodiment of the invention；
Fig. 4 is the schematic illustration of dual camera telemetry in third embodiment of the invention；
Fig. 5 is the critical localisation schematic diagram of image recognition method in third embodiment of the invention；
Fig. 6 is the schematic diagram of the imaging triangle of imaging surface area method in third embodiment of the invention；
Fig. 7 is the structural schematic diagram of the display device of virtual reality terminal in fourth embodiment of the invention.
Specific embodiment
In order to solve problems in the prior art: the prior art can not prompt the user with barrier letter in the form of more intuitive
Breath causes user possibly can not make a response in time to surrounding environment change, influences user experience.First embodiment of the invention mentions
A kind of display methods of virtual reality terminal is supplied, the flow chart of this method is as shown in Figure 1, include step S102 to S106:
S102 calculates virtual reality terminal at a distance from barrier using preset dual camera location algorithm.
VR terminal in the present embodiment, there are two cameras can observe outside by the two cameras for external tool
Environment confirms the barrier in external environment.In addition, based on observation of the dual camera to barrier, using preset algorithm,
Virtual reality terminal can also be calculated at a distance from barrier.
S104, when distance is less than or equal to the first given threshold, the prompt information of dyspoiesis object.
In the present embodiment, threshold value is set for not encountered by barrier when user being protected to wear VR terminal,
The size of the threshold value can flexibly be set according to demand.
In the present embodiment, the form of prompt information can there are many kinds of, can be by double obstructions chart pictures for taking the photograph shooting,
It can be the text prompt of generation, vibration can also be generated by VR terminal or make a sound, it can also be according to practical application
Need to be arranged the form of other prompt informations.In an exemplary embodiment of the present invention, set the form of prompt information as
Obstructions chart picture.
S106 will be prompted to information and be shown on the display interface of virtual reality terminal.
After generating prompt information, in order to learn VR terminal user in time, it nearby has barrier, needs will be prompted to
Information is shown on the display interface of terminal, and for user when wearing VR terminal, being not required to carry out other operations can be directly aobvious
Show and checks prompt information on interface.
The display methods of virtual reality terminal provided in this embodiment is calculated using preset dual camera location algorithm
Virtual reality terminal at a distance from barrier, and when the distance is less than or equal to given threshold, believe by the prompt of dyspoiesis object
It ceases and is shown on the display interface of virtual reality terminal.This method passes through the dual camera of VR terminal, can observe in real time
External environment and barrier, and VR terminal can be calculated at a distance from barrier according to preset dual camera location algorithm,
When determining that user may encounter barrier, user is prompted, and will be prompted to the display interface that information is presented on VR terminal
On, the case where intuitively learning the external environment locating for oneself in time is allowed users to, and mention user timely
It wakes up, improves the user experience of VR terminal.
Optionally, it in order to improve dual camera location algorithm service efficiency, needs to the feelings for calculating barrier and VR terminal
Condition carries out certain restriction, in the present embodiment, specifically: whether detection VR terminal is subjected to displacement, in case of displacement, then sharp
With preset dual camera location algorithm, VR terminal is calculated at a distance from barrier.It, may when detecting that VR terminal is subjected to displacement
It means that user adorns oneself with VR terminal and moving, just starts the barrier on real-time computing terminal and its moving direction at this time
Hinder the distance of object.
Optionally, in the present embodiment, in order to enable preset dual camera location algorithm is suitable for various types of barriers
Hinder object, to avoid user to damage due to can not observe external environment with barrier collision when using VR terminal as far as possible,
In specific implementation, dual camera location algorithm can be specifically included using any of following algorithm:
Algorithm 1, the distance that dual camera line is arrived by calculating focus point of the dual camera on barrier, it is whole to obtain VR
End is at a distance from barrier.
Above-mentioned algorithm refers specifically to: when the dual camera of VR terminal recognizes barrier, needing to focus on the barrier
On some point, the focus point and dual camera will form a triangle, and the distance of the focus point to dual camera line is real
It is exactly the height on one side of this triangle on border, and this side is the line between dual camera, due to dual camera
Distance is known, therefore is easier to calculate in such algorithm practical application.In addition, dual camera is on a barrier
It might have multiple focus points, therefore will form multiple triangles, so that multiple VR terminals and obstacle distance can be calculated
Value should take minimum value in these values and preset threshold value comparison in specific implementation, so as to accurate judgement use
Family is at a distance from barrier.
Algorithm 2, the position to break the barriers in the dual camera visual field, obtain virtual reality terminal and barrier away from
From.
In the actual environment, having some barriers may be that height is relatively low, for example, preventing vehicle pass-through on shopping mall
The ground pile that can be gone up and down.Start on mobile initial position in VR terminal, dual camera can see this within sweep of the eye
The entirety of a barrier, during VR terminal is mobile with user, when this barrier some dual camera view
When except wild range, it can speculate that this barrier is closer from the foot of user at this time, VR terminal can remind use at this time
Nearby there is barrier at family.
Algorithm 3, by the section that calculates focus point of the dual camera on barrier and the formed plane of dual camera
Imaging triangle size, obtain virtual reality terminal at a distance from barrier.
This algorithm specifically refers to: dual camera observes some barrier in actual environment in real time, in VR
On the mobile initial position of terminal, an initial focus point is had, this focus point and 3 points of dual camera can determine whether one
Plane, as VR terminal is mobile to the direction of this barrier, in double image head, which can constantly change.
Consider that barrier imaging in moving process is a planar graph, so in the tangential of this plane from imaging angle
On, the imaging of barrier can regard a line segment as, so this line segment and initial focus point also will form one three
It is angular, in the present embodiment by the triangle be known as be imaged triangle, and barrier different location imaging it is corresponding at
As triangle all can in the same plane, and this plane actually initial focus point and dual camera from spatial position
The section of plane determined by 3 points.In the present embodiment, can by calculate imaging triangle area, obtain VR terminal away from
With a distance from barrier.
In specific calculate, algorithms of different can be used according to the actual situation, guarantees that calculated distance meets practical feelings
Condition, so as to effectively avoid user and barrier from colliding.
When entering in threshold range at a distance from VR terminal and barrier, need to generate prompt information to remind user, by
VR terminal in the present invention has dual camera, and it is exactly to shoot to barrier that prompt information, which most directly generates mode,.Cause
This, in the present embodiment, prompt information can be the obstructions chart picture shot by dual camera.
After the image of barrier is shown to user, actually user's wearing VR may be had no effect on by this barrier
Equipment walking, user, which can choose, at this time ignores this prompt information.For example, if the barrier encountered is the row on road
Flood control sand bag, user can directly pass over when going near sandbag and walk on, and user can select to ignore in this case
This prompt information.In order to improve user experience, after the image for showing barrier is to user, VR terminal can also be detected whether
It receives user and ignores the instruction of the prompt information, if having received this instruction, stop on the display interface of VR terminal aobvious
Show the image of this barrier, and is saved.Wherein, the instruction of user can be there are many form, for example user shakes the head expression
Ignore the information, perhaps say one section it is specific if or before dual camera make a certain gestures, further include other VR
The form that terminal is able to detect and identifies.
User is when using VR terminal, and when its local environment has barrier and its distance enters threshold range, VR is whole
The dual camera at end can take pictures to barrier.In order not to cause unnecessary interruption using VR to user, the present embodiment is mentioned
In the method for confession, can to the image that shoots in this case with encounter same case before but when barrier is ignored in user's selection
Captured image compares, and by image-recognizing method, if assert that image is consistent or similar, illustrates to encounter at this time
Situation and the case where user ignores before, are relatively or identical, will not then generate prompt information at this time.Otherwise it is necessary to generating
Prompt information call user's attention barrier.Above-mentioned setting can reduce the case where interrupting user's normal use VR terminal, can
Significantly improve user experience.
In order to accurately calculate VR terminal at a distance from barrier, reasonable employment dual camera location algorithm is being calculated
Before VR terminal is at a distance from barrier, also to carry out following steps: record the initial position of barrier；According to the first of barrier
Beginning position, dual camera location algorithm used by determining.The process specifically includes: at the beginning of calculating virtual reality terminal and barrier
Distance value between beginning position, when calculated distance value is more than or equal to the second given threshold, using above-mentioned algorithm 1 as double
Camera location algorithm, that is before user wears the movement of virtual reality terminal, if user identifies in initial position
When the distance of the barrier arrived is greater than the second given threshold, determines that and distance is calculated using algorithm 1.
If the initial position before movement thinks user when calculated distance value is less than the second given threshold
Mobile initial position from barrier more recently condition, then need to judge focus point of the dual camera on barrier with
Whether ground distance is less than third given threshold, i.e., to see the barrier that dual camera identifies on initial position apart from ground
Height illustrate this barrier if focus point of the dual camera on barrier and ground distance are less than third given threshold
Hinder object small at a distance from dual camera compared with it at a distance from user foot, it is meant that user during the motion, first encounters barrier
Hinder object may be the foot of user, and the distance that algorithm 1 calculates at this time is not just inconsistent with the situation in actual environment, then will adopt
Use above-mentioned algorithm 2 as dual camera location algorithm.
In addition, if focus point of the dual camera on barrier and ground distance are greater than third given threshold, illustrate to hinder
The body for hindering the height of object to may result in user encounters barrier, but the height of barrier be not above again dual camera away from
Height from the ground, it is in this case not necessarily accurate using the calculating distance of algorithm 1, then above-mentioned 3 conduct of algorithm will be used
Dual camera location algorithm.
Barrier in the actual environment, because of its size shape difference, what is had may encounter the head of user, and what is had can
It can encounter certain a part of the body of user, barrier also may trip user.In the mobile initial bit of VR terminal
It sets, the characteristics of dual camera can shoot actual environment, determine each barrier, to determine to use dual camera ranging
Any algorithm in algorithm, so that guaranteeing that distance calculates meets reality.
Second embodiment of the invention provides a kind of display device of virtual reality terminal, and the apparatus structure schematic diagram is as schemed
Shown in 2, comprising: range finder module 10 calculates virtual reality terminal and barrier for using preset dual camera location algorithm
Distance；Prompt information generation module 20 is coupled with range finder module 10, is used for when above-mentioned distance is less than or equal to given threshold,
The prompt information of dyspoiesis object；Prompt information display module 30 is coupled with prompt information generation module 20, for will be prompted to letter
Breath is shown on the display interface of virtual reality terminal.
In the present embodiment, there are two cameras for the external tool of VR terminal, by the two cameras, can observe in real time outer
Portion's environment determines the position of the barrier in external environment.Range finder module can use preset dual camera location algorithm, meter
Virtual reality terminal is calculated at a distance from barrier.
In the present embodiment, threshold value is set for safety when user being protected to wear VR terminal, in range finder module
When calculated distance is less than threshold value, prompt information generation module can be used for generating the prompt information about barrier.Having
When body is realized, the form of prompt information can there are many kinds of, since VR terminal has dual camera, prompt information can be double take the photograph
The obstructions chart picture of shooting, is also possible to the text that user can be caused to pay attention to, can also be the vibration generated by VR terminal or
Specific sound is issued, the prompt information of other forms can also be set according to the needs of practical application.
After prompt information generation module generates prompt information, in order to learn user in time, it nearby has barrier,
Prompt information can be made to be shown on the display interface of VR terminal by prompt information display module, user does not need to carry out other
Operation, prompt information can be directly presented on the display interface of VR terminal.
In addition, needing to accurately use preset dual camera location algorithm to the feelings for calculating barrier and VR terminal
Condition carries out certain restriction, and in the present embodiment, range finder module can be also used for whether detection VR terminal moves.If VR terminal
It is subjected to displacement, may mean that user adorns oneself with VR terminal and moving, range finder module just starts to calculate in real time at this time
Terminal is at a distance from the barrier on its moving direction.
In the present embodiment, in order to the scope of application for enabling preset dual camera location algorithm cover it is various types of
Barrier, to avoid user making to collide with barrier using VR as far as possible, dual camera ranging used by range finder module is calculated
Method may include following algorithm any one or it is a variety of:
Algorithm 1, by calculate the focus point of the dual camera on barrier to dual camera line distance length,
VR terminal is obtained at a distance from barrier.
Above-mentioned algorithm specifically refers to: when the dual camera of VR terminal recognizes barrier, in order to calculate itself and barrier
Distance, dual camera needs to focus on some point of the barrier, and the focus point and dual camera form a triangle
Shape, the distance of focus point to dual camera line is exactly the height on one side of this triangle, and this side is actually double
Line between camera, calculate this apart from when be easier.In addition, dual camera might have on a barrier
Multiple focus points, therefore multiple triangles can be formed, so that the value of multiple VR terminals and obstacle distance can be calculated, specific
When realization, minimum value in these values and preset threshold value comparison are taken, so as to accurate judgement user and barrier
Distance.
Algorithm 2, the position to break the barriers in the dual camera visual field, calculate virtual reality terminal and barrier away from
From.
In the actual environment, having some barriers may be that height is relatively low, for example, one piece of ground tilted on pavement
Brick.Start on mobile initial position in VR terminal, it is interior in the field range of dual camera completely to see this barrier,
When in moving process this barrier some when except the field range of dual camera, it is known that this barrier can at this time
Can be closer from the foot of user, prompt information can be generated, at this time to remind user to have barrier in its vicinity.
Algorithm 3, by the section that calculates focus point of the dual camera on barrier and the formed plane of dual camera
Imaging triangle size, obtain virtual reality terminal at a distance from barrier.
This algorithm specifically refers to: dual camera observes some barrier in actual environment in real time, in VR
On the mobile initial position of terminal, an initial focus point is had, this focus point and 3 points of dual camera can determine whether one
Plane.As VR terminal is mobile to the direction of this barrier, in double image head, which can constantly change.
Consider from imaging angle, barrier imaging in moving process is several planar graphs, barrier it is formed these
As that can regard several line segments as in the tangential upper of this plane, these line segments be it is parallel, the imaging of barrier with initially
Focus point also will form several triangles, in the present embodiment by the triangle be known as be imaged triangle, these imaging three
Angular is similarity relation.These imaging triangles all can in the same plane, and this plane is from spatial position, really
Initial focus point with 3 points of dual camera determined by plane section.In the present embodiment, triangle can be imaged by calculating
The area of shape obtains distance of the VR terminal apart from barrier.
In specific implementation, algorithms of different can be used according to the actual situation, guarantee that calculated distance meets reality, from
And effectively avoid user's collision obstacle.
When entering in the range of given threshold at a distance from VR terminal and barrier, Yao Shengcheng prompt information is to remind use
Family, since the VR terminal in the present invention has dual camera, generating the most direct mode of prompt information is shooting barrier
Image.Therefore, in the present embodiment, prompt information generation module specifically can be used for shooting barrier, and will shooting
Barrier image as prompt information.
After the image of barrier is shown to user by prompt information display module, this possible barrier not shadow
It rings user and wears the walking of VR equipment, user, which can choose, at this time ignores this prompt information.For example, if barrier is on road
The food packaging being scattered, this barrier to user walking do not have an impact, user sees the prompt information of this barrier
When may select to be ignored.Therefore, in order to improve the user experience of VR terminal, make barrier in prompt information display module
Image show after, the instruction for detecting whether to receive and ignoring the barrier prompt information is also used in, if had received
This instruction, then prompt information display module makes the image of this barrier stop display, and is saved.In the present embodiment
In, the instruction of user can be there are many mode, for example the information is ignored in user's expression of shaking the head, or say one section it is specific if,
Or the combination an of certain gestures or above-mentioned each mode is made before dual camera, further including other VR terminals can
It detects and knows otherwise.
User is wearing the progress of VR terminal in use, when its local environment has barrier and its distance to enter threshold value model
It encloses, at this point, prompt information generation module can make dual camera take pictures barrier.In order not to use VR terminal to user
Process causes unnecessary interruption, and in display device provided in this embodiment, prompt information generation module be can be also used for: to this
The image of the secondary shooting obstructions chart picture captured close to barrier but when user's selection is ignored with certain VR terminal before
Compare, by image recognition, if two images are consistent or similarity degree is higher, illustrate the case where encountering at this time therewith
That situation that preceding user ignores is consistent or more close, then prompt information will not be generated, otherwise believes it is necessary to generate prompt
Breath reminds user.The above-mentioned function of prompt information generation module can reduce the case where interrupting user's normal use VR terminal, from
And significantly improve user experience.
In order to accurately calculate VR terminal at a distance from barrier, reasonable employment dual camera location algorithm, in this implementation
In example, range finder module be can be also used for: record the initial position of barrier, and according to the initial position of barrier, determination is adopted
Dual camera location algorithm.
Barrier in the actual environment, because its size shape is different, some barriers may meet user's
Head, some barriers may encounter the body of user, and barrier also may trip user.Start to move in VR terminal
Dynamic initial position, range finder module can allow dual camera to shoot actual environment, obtain the first of each barrier
Beginning position and image, it is quasi- to guarantee to calculate to determine using any or which kind algorithm in dual camera location algorithm
Really.
The display device of virtual reality terminal provided in this embodiment, range finder module passes through to be surveyed using preset dual camera
Away from algorithm, virtual reality terminal is calculated at a distance from barrier, and when the distance is less than or equal to given threshold, by prompt information
The prompt information of generation module dyspoiesis object, and so that it is shown in the display of virtual reality terminal by prompt information display module
On interface.The device may be implemented to observe external environment and barrier in real time, and according to preset dual camera location algorithm, meter
VR terminal is calculated at a distance from barrier, when determining that user may encounter barrier, user is prompted, and will be prompted to letter
Breath is presented on the display interface of VR terminal, allows users to the feelings for intuitively learning the external environment locating for oneself in time
Condition, and user is timely reminded, the user experience of VR terminal is significantly improved, solves the problems, such as the as follows of the prior art: is existing
There is technology that can not prompt the user with obstacle information in the form of more intuitive, causes user possibly can not be in time to ambient enviroment
Variation is made a response, and user experience is influenced.
Third embodiment of the invention provides a kind of display methods of virtual reality terminal, wherein the flow chart of this method
As shown in figure 3, including step S301 to S306:
S301 obtains VR terminal initial position and image.
Before user is using VR terminal, barrier and the safe distance of user can be preset, as judgement
Threshold value, when user uses VR terminal, user can observe the image of its local environment by the dual camera of VR terminal, and can
To be shot to current environment, to determine the image of initial position.According to the actual conditions of barrier in image, can determine
Which kind of algorithm is VR terminal is calculated at a distance from barrier using.The process specifically includes: calculating virtual reality terminal and barrier
Distance value between initial position, when calculated distance value is more than or equal to the second given threshold, using above-mentioned 1 conduct of algorithm
Dual camera location algorithm, that is before user wears the movement of virtual reality terminal, if user knows in initial position
When the distance for the barrier being clipped to is greater than the second given threshold, determines that and distance is calculated using algorithm 1.
If the initial position before movement thinks user when calculated distance value is less than the second given threshold
Mobile initial position from barrier more recently condition, then need to judge focus point of the dual camera on barrier with
Whether ground distance is less than third given threshold, i.e., to see the barrier that dual camera identifies on initial position apart from ground
Height illustrate this barrier if focus point of the dual camera on barrier and ground distance are less than third given threshold
Hinder object small at a distance from dual camera compared with it at a distance from user foot, it is meant that user during the motion, first encounters barrier
Hinder object may be the foot of user, and the distance that algorithm 1 calculates at this time is not just inconsistent with the situation in actual environment, then will adopt
Use above-mentioned algorithm 2 as dual camera location algorithm.
In addition, if focus point of the dual camera on barrier and ground distance are greater than third given threshold, illustrate to hinder
The body for hindering the height of object to may result in user encounters barrier, but the height of barrier be not above again dual camera away from
Height from the ground, it is in this case not necessarily accurate using the calculating distance of algorithm 1, then above-mentioned 3 conduct of algorithm will be used
Dual camera location algorithm.
Whether S302, detection VR terminal are subjected to displacement, if so, going to S303, otherwise go to S304.
In user's normal use VR terminal, for example, user, during watching VR video, VR terminal will be enabled and is displaced
Sensor, and external environment can be monitored in real time in dual camera, to determine whether that user has displacement.
S303 determines that VR terminal does not move.
In the state that VR terminal does not move, the dual camera of VR terminal can also observe ambient enviroment, and VR in real time
Terminal can also calculate at a distance from its barrier with ambient enviroment, to remind the issuable variation of user surrounding environment, protect
Demonstrate,prove its safety.
S304 records the location information of each barrier in moving process.
Dual camera can record the position letter of the barrier in user's local environment in VR terminal moving process in real time
It ceases, and shoots obstructions chart picture, provide basis with the specific of VR terminal for the accurate barrier that calculates.In S301 according to barrier
It, also will be in moving process, according to reality during VR is mobile on the basis of which kind of location algorithm initial position determination uses
Border situation determines the calculating which kind of algorithm to carry out VR and obstacle distance using.
S305 calculates VR terminal at a distance from barrier.
In the present embodiment, VR terminal is calculated at a distance from barrier using scheduled dual camera location algorithm, had
It, can be using one or more of following three kinds of methods when body is realized:
1, dual camera telemetry, this method schematic illustration are as shown in Figure 4.There are two cameras in left and right in VR terminal,
Two cameras can focus on a point on a barrier, this focus point can form a triangle with two cameras
Shape, take the line of dual camera as the bottom edge of the triangle, two angle θ on bottom edge1And θ2Obstacle can be observed by dual camera
Object obtains, while the spacing Y of dual camera is known constant, then passes through the trigonometric function derivation of equation, it is known that VR terminal and obstacle
The distance calculation formula of object are as follows:
As shown from the above formula, its bigger measuring and calculating distance of Y can be remoter.
2, image recognition method: user in initial position, barrier farther out from user's foot side, in the visual field model of dual camera
In enclosing, it can be seen that the overall picture of this barrier.When user is close to barrier, as shown in figure 5, some entrance of barrier
Blind spot has exceeded the field range of dual camera, in this case, it can be seen that barrier is closer from user.
3, imaging surface area method: camera imaging follows " remote small close big " rule, it is known that imaging of the barrier in camera
It is not only related with its own size, also and barrier and camera distance dependent.
On the mobile initial position of VR terminal, dual camera is observed some barrier in local environment,
There is an initial focus point, this focus point and dual camera can regard three points in space as, and can determine whether one at this 3 points
A plane, as VR terminal moves closer to this barrier, in dual camera, the barrier imaging can constantly change.
In fact, barrier imaging in moving process is several planar graphs, if these planar graphs are from cutting to look up
Dry line segment, this line segment and initial focus point can form multiple triangles, in the present embodiment by these triangles be known as at
As triangle.And different location imaging it is corresponding it is tangential on line segment and initial focus point be formed by triangle all can be
On same plane, and these line segments are all parallel, thus these imaging triangles be all it is similar, showing for triangle is imaged
It is intended to as shown in Figure 6.In addition, actually initial focus point images plane where imaging triangle with double from spatial position
The section of first 3 points of determined planes.Therefore in the present embodiment, the area of triangle can be imaged by calculating, obtain VR end
Hold the distance apart from barrier.
S306 generates prompt information and simultaneously shows when VR terminal is less than or equal to the first given threshold with obstacle distance.
When VR terminal and obstacle distance are less than or equal to given threshold, dual camera will individually intercept the obstructions chart
Picture, and the distance Z of obstacle distance VR terminal is marked on the screenshot, while the screenshot being presented on VR display interface.
In addition, the first given threshold in the present embodiment is identical as the first given threshold in first embodiment of the invention.
After being presented to the user the prompt information of barrier, user can judge according to the actual situation.If
User, which thinks barrier not, influences VR normal use, and instruction information can be issued to VR, ignores this prompt.For example, user can
To cause VR terminal to be shaken by shaking the head, terminal receives this instruction information, hides this screenshot while being saved, Zhi Houruo
When reaching threshold value, obstructions chart picture is consistent with the screenshot or similarity is higher, that is, can determine that the barrier can be ignored, at this moment
System will not prompt user.Otherwise, screenshot image will be shown always shows on picture in VR, at this point, dual camera is still being seen
External environment is surveyed, and real-time update VR terminal is at a distance from barrier, until VR terminal and obstacle distance are greater than given threshold,
The screenshot of barrier can just be stashed at this time.
The display methods for present embodiments providing a kind of virtual reality terminal, using preset dual camera location algorithm,
Virtual reality terminal is calculated at a distance from barrier, and when the distance is less than or equal to given threshold, dyspoiesis object is mentioned
Show information and is shown on the display interface of virtual reality terminal.This method utilizes the dual camera of VR terminal, can be real-time
External environment and barrier are observed, according to preset dual camera location algorithm, VR terminal is calculated at a distance from barrier, is sentencing
When barrier may be encountered by determining user, user is prompted, and will be prompted to information and be presented on the display interface of VR terminal,
The case where intuitively learning the external environment locating for oneself in time is allowed users to, and reminds user in time, is changed
Be apt to the user experience of VR terminal, solved the problems, such as the as follows of the prior art: the prior art can not in the form of more intuitive to
User prompts obstacle information, causes user possibly can not make a response in time to surrounding environment change, influences user experience.
In addition, to achieve the above object, fourth embodiment of the invention also provides a kind of display device of virtual reality terminal,
The schematic device as shown in fig. 7, comprises: VR module, for generating VR image；Dual camera module, for observing surrounding ring
Border and barrier；Displacement sensor module, for detecting the motion state of VR terminal；Barrier display module (is equivalent to this hair
The partial function of prompt information display module in bright second embodiment), computing module (is equivalent in second embodiment of the invention and surveys
Partial function away from module and prompt information generation module).
After displacement sensor detects that VR terminal is mobile, by dual camera module, obstacle position information is acquired, is calculated
Module is according to the distance between positional information calculation VR terminal barrier, after being less than or equal to given threshold, dual camera module
Obstructions chart picture is shown on the display interface of VR terminal and is presented to use by dyspoiesis object image, barrier display module
Family, so that user judges.
Although for illustrative purposes, the preferred embodiment of the present invention has been disclosed, those skilled in the art will recognize
It is various improve, increase and replace be also it is possible, therefore, the scope of the present invention should be not limited to the above embodiments.
Claims (10)
1. a kind of display methods of virtual reality terminal characterized by comprising
Using dual camera location algorithm, the virtual reality terminal is calculated at a distance from barrier；
When the distance is less than or equal to the first given threshold, the prompt information of the barrier is generated；
The prompt information is shown on the display interface of the virtual reality terminal.
2. display methods as described in claim 1, which is characterized in that utilize dual camera location algorithm, calculate described virtual
Non-real end further comprises at a distance from the barrier:
Detect whether the virtual reality terminal is subjected to displacement, and in the case where the virtual reality terminal is subjected to displacement, benefit
With the dual camera location algorithm, the virtual reality terminal is calculated at a distance from the barrier.
3. display methods as described in claim 1, which is characterized in that the dual camera location algorithm includes in following algorithm
Any one:
Algorithm 1: by calculating focus point of the dual camera on the barrier to the dual camera line distance
Length obtains the virtual reality terminal at a distance from barrier；
Algorithm 2: by position of the barrier in the dual camera visual field, obtain the virtual reality terminal with it is described
The distance of barrier；
Algorithm 3: by calculating focus point and the dual camera formed plane of the dual camera on the barrier
Section on imaging triangle size, obtain the virtual reality terminal at a distance from the barrier.
4. display methods as described in claim 1, which is characterized in that generate the prompt information of the barrier, comprising: to institute
It states barrier to be shot, and using the image of the barrier of shooting as the prompt information.
5. display methods as claimed in claim 4, which is characterized in that by the prompt information in the virtual reality terminal
Display interface on shown after, further includes:
It detects whether to receive the instruction information for ignoring the barrier, when received, then stops showing described image, and right
Described image is saved.
6. display methods as claimed in claim 5, which is characterized in that when the distance is less than or equal to given threshold, also wrap
It includes:
It takes pictures to the barrier, obtains the image of the barrier；
Detect whether described image is consistent with the reference picture formerly saved, if so, not generating the prompt letter of the barrier
Breath；Otherwise, the prompt information of the barrier is generated.
7. display methods as claimed in claim 3, which is characterized in that calculated using dual camera location algorithm described virtual existing
Before real terminal is at a distance from the barrier, further includes:
Record the initial position of the barrier；
According to the initial position of the barrier, the distance value between the virtual reality terminal and the initial position is calculated；
When the distance value is more than or equal to the second given threshold, dual camera location algorithm is used as using the algorithm 1；
When the distance value is less than second given threshold, focus point of the dual camera on the barrier is judged
Whether it is less than third given threshold with ground distance, if so, otherwise adopting using the algorithm 2 as dual camera location algorithm
Use the algorithm 3 as dual camera location algorithm.
8. a kind of display device of virtual reality terminal, the virtual reality terminal is equipped with dual camera, which is characterized in that packet
It includes:
Range finder module, for using preset dual camera location algorithm, calculate the virtual reality terminal and barrier away from
From；
Prompt information generation module, for when the distance is less than or equal to given threshold, generating the prompt letter of the barrier
Breath；
Prompt information display module, for showing the prompt information on the display interface of the virtual reality terminal
Show.
9. display device as claimed in claim 8, which is characterized in that the range finder module is also used to:
Detect whether the virtual reality terminal is subjected to displacement, and in the case where the virtual reality terminal is subjected to displacement, benefit
With the preset dual camera location algorithm, the virtual reality terminal is calculated at a distance from barrier.
10. a kind of mobile terminal includes at least memory, processor, is stored with computer program, feature on the memory
It is, the processor realizes void described in any one of claims 1 to 7 when executing the computer program on the memory
The step of display methods of quasi- non-real end.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810045356.5A CN110044322B (en) | 2018-01-17 | 2018-01-17 | Display method and device of virtual reality terminal and mobile terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810045356.5A CN110044322B (en) | 2018-01-17 | 2018-01-17 | Display method and device of virtual reality terminal and mobile terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110044322A true CN110044322A (en) | 2019-07-23 |
| CN110044322B CN110044322B (en) | 2022-03-22 |
Family
ID=67273494
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810045356.5A Active CN110044322B (en) | 2018-01-17 | 2018-01-17 | Display method and device of virtual reality terminal and mobile terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110044322B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111061361A (en) * | 2019-11-13 | 2020-04-24 | 联想(北京)有限公司 | Method and device for adjusting position of virtual screen |
| CN112468798A (en) * | 2020-11-27 | 2021-03-09 | 上海影创信息科技有限公司 | Processing method and system of virtual ranging mark and VR glasses thereof |
| CN114743433A (en) * | 2021-12-23 | 2022-07-12 | 中国科学院软件研究所 | Multi-channel alarm presenting method and device for simulating threats in flight training environment |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2005260884A (en) * | 2004-03-15 | 2005-09-22 | Kyocera Mita Corp | Communication terminal device |
| CN105705210A (en) * | 2013-09-30 | 2016-06-22 | 索尼电脑娱乐公司 | Camera based safety mechanisms for users of head mounted displays |
| CN106295581A (en) * | 2016-08-15 | 2017-01-04 | 联想(北京)有限公司 | Obstacle detection method, device and virtual reality device |
| CN106412297A (en) * | 2016-09-29 | 2017-02-15 | 努比亚技术有限公司 | Barrier warning method and device as well as mobile terminal |
| CN106556375A (en) * | 2015-09-25 | 2017-04-05 | 中兴通讯股份有限公司 | Alarm method and device |
| CN206193363U (en) * | 2016-11-23 | 2017-05-24 | 成都壹橙科技有限公司 | VR glasses with range finding function |
| US20170359569A1 (en) * | 2013-09-30 | 2017-12-14 | Sony Interactive Entertainment Inc. | Camera Based Safety Mechanisms for Users of Head Mounted Displays |
-
2018
- 2018-01-17 CN CN201810045356.5A patent/CN110044322B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2005260884A (en) * | 2004-03-15 | 2005-09-22 | Kyocera Mita Corp | Communication terminal device |
| CN105705210A (en) * | 2013-09-30 | 2016-06-22 | 索尼电脑娱乐公司 | Camera based safety mechanisms for users of head mounted displays |
| US20170359569A1 (en) * | 2013-09-30 | 2017-12-14 | Sony Interactive Entertainment Inc. | Camera Based Safety Mechanisms for Users of Head Mounted Displays |
| CN106556375A (en) * | 2015-09-25 | 2017-04-05 | 中兴通讯股份有限公司 | Alarm method and device |
| CN106295581A (en) * | 2016-08-15 | 2017-01-04 | 联想(北京)有限公司 | Obstacle detection method, device and virtual reality device |
| CN106412297A (en) * | 2016-09-29 | 2017-02-15 | 努比亚技术有限公司 | Barrier warning method and device as well as mobile terminal |
| CN206193363U (en) * | 2016-11-23 | 2017-05-24 | 成都壹橙科技有限公司 | VR glasses with range finding function |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111061361A (en) * | 2019-11-13 | 2020-04-24 | 联想(北京)有限公司 | Method and device for adjusting position of virtual screen |
| CN112468798A (en) * | 2020-11-27 | 2021-03-09 | 上海影创信息科技有限公司 | Processing method and system of virtual ranging mark and VR glasses thereof |
| CN114743433A (en) * | 2021-12-23 | 2022-07-12 | 中国科学院软件研究所 | Multi-channel alarm presenting method and device for simulating threats in flight training environment |
| CN114743433B (en) * | 2021-12-23 | 2023-03-24 | 中国科学院软件研究所 | Multi-channel alarm presenting method and device for simulating threats in flight training environment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110044322B (en) | 2022-03-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107836012B (en) | Projection image generation method and device, and mapping method between image pixel and depth value | |
| US20210112181A1 (en) | Image processing device, image processing method, and recording medium | |
| US8933886B2 (en) | Instruction input device, instruction input method, program, recording medium, and integrated circuit | |
| EP2993894B1 (en) | Image capturing method and electronic apparatus | |
| EP1981278A1 (en) | Automatic tracking device and automatic tracking method | |
| EP2991027B1 (en) | Image processing program, image processing method and information terminal | |
| CN104376154B (en) | A kind of Rigid Body Collision trajectory predictions display device | |
| CN108459597B (en) | Mobile electronic device and method for processing tasks in task area | |
| JP6497185B2 (en) | Autonomous mobile device and control method of autonomous mobile device | |
| CN106463032A (en) | Intrusion detection with directional sensing | |
| CN110044322A (en) | A kind of display methods, device and the mobile terminal of virtual reality terminal | |
| US10564250B2 (en) | Device and method for measuring flight data of flying objects using high speed video camera and computer readable recording medium having program for performing the same | |
| US20210327114A1 (en) | Image display system, non-transitory storage medium having stored therein image display program, display control apparatus, and image display method | |
| KR102190743B1 (en) | AUGMENTED REALITY SERVICE PROVIDING APPARATUS INTERACTING WITH ROBOT and METHOD OF THEREOF | |
| JP2006185109A (en) | Image measurement device and image measurement method | |
| WO2019165613A1 (en) | Control method for mobile device, device, and storage device | |
| EP3963548B1 (en) | A system and method for localisation using footprints | |
| JP7471497B2 (en) | IMAGE DISPLAY SYSTEM, IMAGE DISPLAY PROGRAM, DISPLAY CONTROL DEVICE, AND IMAGE DISPLAY METHOD | |
| CN114868102A (en) | Information processing apparatus, information processing method, and computer-readable recording medium | |
| CN110770739A (en) | Control method, device and control equipment based on image recognition | |
| JP7437930B2 (en) | Mobile objects and imaging systems | |
| KR20150028623A (en) | Method and apparatus for processing images | |
| US20120038750A1 (en) | Apparatus and method for displaying three-dimensional (3d) object | |
| JP6581280B1 (en) | Monitoring device, monitoring system, monitoring method, monitoring program | |
| US12029979B2 (en) | Image display system, non-transitory storage medium having stored therein image display program, display control apparatus, and image display method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |