Content of the invention
The embodiment of the present invention provides a kind of picture display process of virtual reality device and device, inclined in order to solve key frame
The problem moved.
The picture display process of virtual reality device provided in an embodiment of the present invention includes:
Receive picture and follow instruction, described picture is followed instruction and included main perspective picture in described virtual reality device
Primary importance in display screen;
Acquisition receives described picture when following instruction, the second position of described main perspective picture;
If described primary importance is inconsistent with the second position, described main perspective picture is moved to from the described second position
Described primary importance.
Optionally, described by described main perspective picture from after the described second position moves to described primary importance, also wrap
Include:
Obtain the spatial deviation information of described virtual reality device;
According to described spatial deviation information, adjust background frame and the described main view of holding that described virtual reality device shows
Angle picture is shown in the described first position in described display screen.
Optionally, described by described main perspective picture from after the described second position moves to described primary importance, also wrap
Include:
Receive stopping and follow instruction;
Obtain the spatial deviation information of described virtual reality device;
According to described spatial deviation information, adjust background frame and the described main perspective picture that described virtual reality device shows
Face, so that described main perspective picture is constant with respect to the position of described background frame.
Optionally, described reception stopping follow instruction after, described obtain described virtual reality device spatial information it
Before, also include:
Determine the differential seat angle between the border of described main perspective picture and the corresponding border of described background frame;
If the differential seat angle between the border of described main perspective picture and the border of described background frame is less than threshold value, adjust
Described background frame, with respect to the position of described display screen, makes the border of described background frame corresponding to described main perspective picture
Border is parallel.
Optionally, the described spatial deviation information obtaining described virtual reality device, comprising:
Obtain the first Eulerian angles in the first moment for the described virtual reality device, and second Eulerian angles in the second moment;
Determine the spatial deviation information of described virtual reality device according to described first Eulerian angles and described second Eulerian angles.
A kind of picture display device of virtual reality device, comprising:
Receiver module, follows instruction for receiving picture, and described picture is followed instruction and included main perspective picture described
Primary importance in the display screen of virtual reality device;
Locating module, when receiving described picture and follow instruction for obtaining, the second position of described main perspective picture;
Display module, if inconsistent for described primary importance and the second position, by described main perspective picture from described
The second position moves to described primary importance.
Optionally, described locating module, is additionally operable to obtain the spatial deviation information of described virtual reality device;
Described display module, is additionally operable to, according to described spatial deviation information, adjust the back of the body that described virtual reality device shows
Scape picture and keep described main perspective picture be shown in the described first position in described display screen.
Optionally, described receiver module, is additionally operable to reception stopping and follows instruction;
Described locating module, is additionally operable to obtain the spatial deviation information of described virtual reality device;
Described display module, is additionally operable to, according to described spatial deviation information, adjust the back of the body that described virtual reality device shows
Scape picture and described main perspective picture, so that described main perspective picture is constant with respect to the position of described background frame.
Optionally, described locating module, is additionally operable to determine the phase with described background frame for the border of described main perspective picture
Answer the differential seat angle between border;
Described display module, if the angle being additionally operable between the border of described main perspective picture and the border of described background frame
Degree difference is less than threshold value, then adjusts the position that described background frame is with respect to described display screen, make the border of described background frame with
The corresponding border of described main perspective picture is parallel.
Optionally, described locating module, specifically for:
Obtain the first Eulerian angles in the first moment for the described virtual reality device, and second Eulerian angles in the second moment;
Determine the spatial deviation information of described virtual reality device according to described first Eulerian angles and described second Eulerian angles.
In the embodiment of the present invention, user needs to check the content of key frame, or is entered with virtual reality device by key frame
During row interaction, send picture to virtual reality device and follow instruction, picture follows the primary importance that instruction includes key frame, should
Primary importance is the position in the display screen of virtual reality device.Virtual reality device receives after this picture follows instruction, that is,
Open picture follow the mode, and determine the second position that current main perspective picture is located.Here the second position is possibly virtual
Position in the display screen of real world devices is it is also possible to position outside display screen.If primary importance and the second position are not same
One position, then follow instruction according to above-mentioned picture, and key frame is moved from the second position to the direction of primary importance, until main
Visual angle picture shows in primary importance.So, when main perspective picture is not in the visual range of user, user is without swing head
Main perspective picture is found with the virtual reality device that movement is worn, only need to send instruction to virtual reality device, main perspective is drawn
Face is movable to the second position specified;Or although user can see main perspective picture, the position of main perspective picture is inclined
Its main perspective is drawn from the position that expected from user, during position, user need not rock head to adjust virtual reality device
Main perspective picture, after virtual reality device receives instruction, can be snapped to the second position by face automatically.Therefore, the present invention is implemented
Example can correct the position of main perspective picture when main perspective picture offsets, and solves the problems, such as that main perspective picture offsets.
Specific embodiment
In order that the object, technical solutions and advantages of the present invention are clearer, below in conjunction with accompanying drawing the present invention is made into
One step ground describes in detail it is clear that described embodiment is only present invention some embodiments, rather than whole enforcement
Example.Based on the embodiment in the present invention, those of ordinary skill in the art are obtained under the premise of not making creative work
All other embodiment, broadly falls into the scope of protection of the invention.
The embodiment of the present invention is applied to representing of some virtual reality content, including viewing 3d or 2d video (and non-panoramic
Video), carry out non-panoramic or immersion game using Bluetooth gamepad, read the word content such as webpage, display non-vr application
Program (such as wechat application program, Alipay application program, clock application program, suspended window application program, pop-up application program
Deng), or apply the startup interface in virtual reality device, such as it is used for main interface (home circle when starting virtual reality device
Face) calibration.Receiving after picture follows instruction, picture follow the mode is opened, main perspective picture and virtual reality device
Relative position between screen is fixed immediately, and generally, in picture follow the mode opening process, the operation of application cannot be by changing
The head control attitude becoming virtual reality device is realizing, and should otherwise carry out (such as: using Bluetooth handle, mouse, slide and touch
Template changes current application focus, thus carrying out interaction).It should be noted that because the embodiment of the present invention is not necessarily suitable for owning
Virtual reality content, if so when virtual reality device currently carries out some operations, can ignore the picture receiving with
With instruction, thus keeping current presentation behavior constant it is also possible to adopt this instruction, realize the operation of different modes.
Embodiments provide a kind of picture display process of virtual reality device, flow process such as Fig. 1 institute of the method
Show, method may include steps of:
S101, reception picture follow instruction, and described picture is followed instruction and included main perspective picture in described virtual reality
Primary importance in the display screen of equipment.
S102, obtain when receiving described picture and following instruction, the second position of described main perspective picture.
If the described primary importance of s103 is inconsistent with the second position, by described main perspective picture from the described second position
Move to described primary importance.
In the embodiment of the present invention, user needs to check the content of key frame, or is entered with virtual reality device by key frame
During row interaction, send picture to virtual reality device and follow instruction, picture follows the primary importance that instruction includes key frame, should
Primary importance is the position in the display screen of virtual reality device.Virtual reality device receives after this picture follows instruction, that is,
Open picture follow the mode, and determine the second position that current main perspective picture is located.Here the second position is possibly virtual
Position in the display screen of real world devices is it is also possible to position outside display screen.If primary importance and the second position are not same
One position, then follow instruction according to above-mentioned picture, and key frame is moved from the second position to the direction of primary importance, until main
Visual angle picture shows in primary importance.So, when main perspective picture is not in the visual range of user, user is without swing head
Main perspective picture is found with the virtual reality device that movement is worn, only need to send instruction to virtual reality device, main perspective is drawn
Face is movable to the second position specified;Or although user can see main perspective picture, the position of main perspective picture is inclined
Its main perspective is drawn from the position that expected from user, during position, user need not rock head to adjust virtual reality device
Main perspective picture, after virtual reality device receives instruction, can be snapped to the second position by face automatically.Therefore, the present invention is implemented
Example can correct the position of main perspective picture when main perspective picture offsets, and solves the problems, such as that main perspective picture offsets.
Display if Fig. 2 is the main perspective picture of virtual reality device provided in an embodiment of the present invention and background frame is illustrated
Figure, wherein, by wearing virtual reality device it can be seen that display screen, Fig. 2 includes two display screens in left and right to user, corresponding
Right and left eyes in user.Display screen is used for showing key frame and background frame, wherein, latticed in background frame i.e. such as Fig. 2
Picture, main perspective picture shows on background frame.In figure 3, main perspective picture is clock application program, the wherein tool of display
Hold in vivo for " 08:18am ".
When the display of main perspective picture is had on the display screen of virtual reality device, also have control button and occur, such as
Shown in Fig. 2, control button has wifi signal prompt control, equipment capacity prompt control, main perspective picture zoom in control, main perspective
Picture reduces control, main perspective picture anticlockwise control, main perspective picture right rotation control etc., wherein, some control buttons
Can interact, the main perspective picture zoom in control in such as Fig. 2, main perspective picture reduces control, main perspective picture anticlockwise control, master
Visual angle picture right rotation control;Some control buttons are served only for watching, and can not interact, the wifi signal prompt control in such as Fig. 2,
Equipment capacity prompt control.
If not opening picture follow the mode, when user rotates head, the picture that virtual reality device is shown can be triggered
Redraw system, for example, to upper left side rotary head portion, then the picture after repainting is as shown in Figure 3 for user.When user is to upper left side
When rotating head, background frame and main perspective picture all can redraw system, and now main perspective picture changes with respect to the position of display screen
Become, main perspective picture is shown in the lower right position of display screen, user only rotates head to the right, main perspective just can be made to draw
Face is shown in the center of display screen again.Further, if user increases to the angle in upper left side rotary head portion, main perspective
Picture even can remove display screen.Now, user needs big angle rotary head control attitude, looks about main view in virtual scene
Angle picture, this makes troubles to the use of user.The embodiment of the present invention is based on this problem, follows mould by opening picture
Main perspective picture is shown in display screen by formula at any time, facilitates user to use virtual reality device with any attitude.
After opening picture follow the mode, the specified location that main perspective picture is shown in display screen is primary importance, here
Primary importance can be the centre position of display screen it is also possible to according to different key frame contents, or need of different user
Ask, in the position such as the surface of display screen or lower left main perspective picture.In the embodiment of the present invention, main perspective picture specifically shows
Show that position and the size of main perspective picture are citing, be not limited.
Receive picture and follow instruction, and the second position that main perspective picture shows is inconsistent with primary importance, then will lead
Visual angle picture moves from the second position to the direction of primary importance.Here specific move mode can be to identify current main view
The direction of angle picture and the head control direction of virtual reality device, then move main perspective picture to display screen frame by frame gradually
Primary importance.Here moving process frame by frame has individual mental preparation mainly for allowing user, it is possible to achieve in fixing frame number
Complete movement from primary importance to the second position for the main perspective picture it is also possible to fixing angular velocity completes or other modes are realized,
Even can complete at once to be shown in the second position.
Meanwhile, can in display screen display the prompt box, point out user's picture follow the mode have been switched on, may be used simultaneously
To point out the method stopping follow the mode, prompting frame automatic hidden afterwards, this prompting frame can show, in the mode of fading in, the side of fading out
Formula hides it is also possible to other modes even show or hide immediately.Virtual reality device is generally also followed during prompting frame display
Head control direction.
By main perspective picture after primary importance shows, main perspective picture will be followed virtual reality device and together be moved.I.e.
After step s103, also include:
Obtain the spatial deviation information of described virtual reality device;
According to described spatial deviation information, adjust background frame and the described main view of holding that described virtual reality device shows
Angle picture is shown in the described first position in described display screen.
Now, obtain the spatial information of virtual reality device, the spatial information of virtual reality device here is using virtual
The Eulerian angles of real world devices represent.In embodiments of the present invention, spatial information is as shown in figure 4, define three orthogonal Eulers
Angular amount, parallel to the earth's core direction as y-axis centered on the cervical region of user, when user is when being rocked centered on cervical region,
The angle that will deviate from y-axis is designated as yaw angle;Centered on the cervical region of user parallel to virtual reality device transverse axis axle as x
Axle, when user is when being rocked centered on cervical region, the angle that will deviate from x-axis is designated as the angle of pitch;During cervical region with user is
The heart, and the axle being connected with the center of virtual reality device is z-axis, when user is when carrying out head and rocking centered on cervical region,
The angle that will deviate from z-axis is designated as roll angle.In embodiments of the present invention, virtual existing using three orthogonal Eulerian angles vectorials
The spatial information of real equipment, then the variable quantity of the spatial deviation Information Pull Eulerian angles of virtual reality device is representing.Therefore, obtain
Take the spatial deviation information of described virtual reality device, comprising:
Obtain the first Eulerian angles in the first moment for the described virtual reality device, and second Eulerian angles in the second moment;
Determine the spatial deviation information of described virtual reality device according to described first Eulerian angles and described second Eulerian angles.
For example, in the first moment, the first spatial information of virtual reality device can be designated as the first Eulerian angles (x1,
Y1, z1), after sensor obtains virtual reality device deflection, when obtaining its second space information, it is designated as the second Eulerian angles
(x2, y2, z2), then the spatial deviation information of virtual reality device is the knots modification of Eulerian angles, i.e. the second Eulerian angles and the first Europe
Draw the difference at angle.The deflection situation of virtual reality device can be quantified using Eulerian angles, be conveniently adjusted the position of main perspective picture, with
Main perspective picture is made to be shown in the primary importance of display screen always.
Because background frame has clearly upper and lower concept sometimes, if any visible ceiling and floor, therefore, in order to keep away
Exempt from user and produce spinning sensation, if main perspective picture can be relatively independent with background frame, repaint background frame,
According to the deflection situation of virtual reality device, show different background frames, and keep main perspective picture in first position
Display.That is, only allow main perspective picture follow virtual reality device in picture follow the mode moving, and background frame phase
Unchanged direction for real world.As utilized virtual reality device to watch 2d video as user, its background frame is a certain room
Between a face wall, 2d video shows on this metope.When virtual reality device is moved upward, background frame is plotted as this room
Between ceiling, and watch 2d video following virtual reality device movement, show on the ceiling.
It should be noted that background frame also can follow virtual reality device movement, such as background in the embodiment of the present invention
Picture is a width cartoon, and main perspective picture is the wechat application program being shown on this cartoon, when picture follow the mode is opened
After opening, the display in display screen of background frame and main perspective picture is all constant.
During picture follow the mode, user can select at any time stop main perspective picture follow, that is, step s103 it
Afterwards, also include:
Receive stopping and follow instruction;
Obtain the spatial deviation information of described virtual reality device;
According to described spatial deviation information, adjust background frame and the described main perspective picture that described virtual reality device shows
Face, so that described main perspective picture is constant with respect to the position of described background frame.
Now, the spatial information of virtual reality device represents also with the Eulerian angles of virtual reality device, utilizes meanwhile
The knots modification of Eulerian angles indicates the spatial deviation information of virtual reality device.After stopping picture follow the mode, main perspective picture
Constant with respect to the position of background frame, according to the deflection of virtual reality device, repaint main perspective picture and background frame,
Make main perspective picture according to the spatial deviation information of virtual reality device, show in the diverse location of display screen, or even removal
Display screen, keeps main perspective picture constant with the relative position of background frame simultaneously.For example, when user utilizes virtual reality
Equipment watches 2d video, and its background frame is a face wall in a certain room, and 2d video shows on this metope.When virtual reality sets
For when being moved upward, background frame is plotted as the ceiling in this room, and 2d video does not follow the movement of virtual reality device, still
Metope shows.
In embodiments of the present invention, the opening and closing of picture follow the mode can be realized by different modes.User Ke Tong
The button crossing setting on virtual reality device to realize following of main perspective picture, such as shown in figure 5, button 501 is located at
The middle part of the shell of virtual reality device, user's click keys once realize following of main perspective picture, that is, send picture
Follow instruction, when needing to close follow the mode, user need to click on this button once again.
Or, as shown in fig. 6, being provided with button 601 and button 602 in the side of virtual reality device, user is permissible
Realize the unlatching of picture follow the mode by pressing keys 601, realize following mould to virtual reality picture by pressing keys 602
The closing of formula.The realization opening and closing also can be realized by pressing Macintosh simultaneously, and such as push button 601 and button simultaneously
603 unlatchings realizing picture follow the mode, push button simultaneously 602 and button 603 realize the closing of picture follow the mode.Also may be used
With by push button 601, button 602 simultaneously and button 603 once realize main perspective picture follow the mode unlatching, again
Push button 601, button 602 simultaneously and button 603 realize main perspective picture follow the mode closing.
Or, as shown in fig. 7, realizing opening of the picture follow the mode to virtual reality device by stirring button 701
Open or close, button 701 is stirred forward, picture follow the mode is opened, and button 701 is stirred backward, picture follow the mode closes
Close.
Certainly, in the above embodiment of the present invention, the button operation mode that follow the mode is turned on and off is only for example, no
It is limited, the realization that follow the mode is turned on and off above-described several ways incessantly, remaining mode of operation that can realize
Also in the protection domain of the embodiment of the present invention, the button operation order such as realizing being turned on and off can be exchanged, and here is not done superfluous
State.
When virtual reality device receives stopping and follows instruction, main perspective picture does not move followed by virtual reality device
Dynamic, now, will obtain the spatial information of virtual reality device, i.e. the Eulerian angles of virtual reality device, and according to now virtual existing
The Eulerian angles of real equipment show main perspective picture on a display screen, by main perspective picture fixation at the corresponding visual angle of this Eulerian angles,
Fix the relative position of main perspective picture and background frame simultaneously.Optionally, because user's head attitude unavoidably has sometimes
Slight inclination, main perspective picture stops to carry out angle adjustment during picture follow the mode.Namely follow finger in reception stopping
After order, before the spatial information of the described virtual reality device of described acquisition, also include:
Determine the differential seat angle between the border of described main perspective picture and the corresponding border of described background frame;
If the differential seat angle between the border of described main perspective picture and the border of described background frame is less than threshold value, adjust
Described background frame, with respect to the position of described display screen, makes the border of described background frame corresponding to described main perspective picture
Border is parallel.
For example, as Fig. 8, virtual reality device when receive stop following specify when, the side of main perspective picture
There is differential seat angle between boundary and the border of background frame, need the relative position between fixing main perspective picture and background frame,
If now the differential seat angle between the border of main perspective picture and the border of background frame is less than 5 °, adjustment background frame is in display
Display in screen display such as Fig. 9 so as to border is parallel to the corresponding border of main perspective picture, after background frame adjustment.
Based on identical technology design, the embodiment of the present invention also provides a kind of picture display device of virtual reality device,
As shown in Figure 10, comprising:
Receiver module 1, follows instruction for receiving picture, and described picture is followed instruction and included main perspective picture described
Primary importance in the display screen of virtual reality device;
Locating module 2, when receiving described picture and follow instruction for obtaining, the second position of described main perspective picture;
Display module 3, if inconsistent for described primary importance and the second position, by described main perspective picture from described
The second position moves to described primary importance.
Optionally, described locating module 2, is additionally operable to obtain the spatial deviation information of described virtual reality device;
Described display module 3, is additionally operable to, according to described spatial deviation information, adjust the back of the body that described virtual reality device shows
Scape picture and keep described main perspective picture be shown in the described first position in described display screen.
Optionally, described receiver module 1, is additionally operable to reception stopping and follows instruction;
Described locating module 2, is additionally operable to obtain the spatial deviation information of described virtual reality device;
Described display module 3, is additionally operable to, according to described spatial deviation information, adjust the back of the body that described virtual reality device shows
Scape picture and described main perspective picture, so that described main perspective picture is constant with respect to the position of described background frame.
Optionally, described locating module 2, is additionally operable to determine the phase with described background frame for the border of described main perspective picture
Answer the differential seat angle between border;
Described display module 3, if between being additionally operable to border and the border of described background frame of described main perspective picture
Differential seat angle is less than threshold value, then adjust the position that described background frame is with respect to described display screen, make the border of described background frame
Parallel to the corresponding border of described main perspective picture.
Optionally, described locating module 2, specifically for:
Obtain the first Eulerian angles in the first moment for the described virtual reality device, and second Eulerian angles in the second moment;
Determine the spatial deviation information of described virtual reality device according to described first Eulerian angles and described second Eulerian angles.
The present invention is the flow process with reference to method according to embodiments of the present invention, equipment (system) and computer program
Figure and/or block diagram are describing.It should be understood that can be by each stream in computer program instructions flowchart and/or block diagram
Flow process in journey and/or square frame and flow chart and/or block diagram and/or the combination of square frame.These computer programs can be provided
The processor instructing general purpose computer, special-purpose computer, Embedded Processor or other programmable data processing device is to produce
A raw machine is so that produced for reality by the instruction of computer or the computing device of other programmable data processing device
The device of the function of specifying in present one flow process of flow chart or multiple flow process and/or one square frame of block diagram or multiple square frame.
These computer program instructions may be alternatively stored in and can guide computer or other programmable data processing device with spy
Determine in the computer-readable memory that mode works so that the instruction generation inclusion being stored in this computer-readable memory refers to
Make the manufacture of device, this command device realize in one flow process of flow chart or multiple flow process and/or one square frame of block diagram or
The function of specifying in multiple square frames.
These computer program instructions also can be loaded in computer or other programmable data processing device so that counting
On calculation machine or other programmable devices, execution series of operation steps to be to produce computer implemented process, thus in computer or
On other programmable devices, the instruction of execution is provided for realizing in one flow process of flow chart or multiple flow process and/or block diagram one
The step of the function of specifying in individual square frame or multiple square frame.
Although preferred embodiments of the present invention have been described, but those skilled in the art once know basic creation
Property concept, then can make other change and modification to these embodiments.So, claims are intended to be construed to including excellent
Select embodiment and fall into being had altered and changing of the scope of the invention.
Obviously, those skilled in the art can carry out the various changes and modification essence without deviating from the present invention to the present invention
God and scope.So, if these modifications of the present invention and modification belong to the scope of the claims in the present invention and its equivalent technologies
Within, then the present invention is also intended to comprise these changes and modification.