CN108989784A - Image display method, device, equipment and the storage medium of virtual reality device - Google Patents
Image display method, device, equipment and the storage medium of virtual reality device Download PDFInfo
- Publication number
- CN108989784A CN108989784A CN201810746852.3A CN201810746852A CN108989784A CN 108989784 A CN108989784 A CN 108989784A CN 201810746852 A CN201810746852 A CN 201810746852A CN 108989784 A CN108989784 A CN 108989784A
- Authority
- CN
- China
- Prior art keywords
- image
- eye
- left eye
- perspectives
- virtual reality
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Controls And Circuits For Display Device (AREA)
Abstract
The embodiment of the present invention provides image display method, device, equipment and the storage medium of a kind of virtual reality device, is related to computer application technology.Wherein, method includes: the two dimensional image for receiving terminal and sending；The two dimensional image is acquired with left eye visual angle and right-eye perspectives respectively, to obtain left eye multi-view image and right-eye perspectives image；According to the left eye multi-view image and the right-eye perspectives image, carries out virtual reality and show.Technical solution provided in an embodiment of the present invention can normally show two dimensional image in VR equipment.
Description
Technical field
The present embodiments relate to computer application technologies more particularly to a kind of image of virtual reality device to show
Method, apparatus, equipment and storage medium.
Background technique
VR (Virtual Reality, virtual reality) equipment is that a kind of to use VR technology export content to construct for user empty
Quasi- reality scene, to generate the electronic equipment of virtual vision and auditory effect, VR equipment can usually refer to wearable in user
The headset equipment on head.Currently, 3D film or 360 degree of cineramas can be watched in VR equipment.
Since VR equipment is all based on 3D scene, those 2D films can not in VR equipment normal play, this is just
User is caused not to be available VR equipment to watch many 2D films on the market, so that the application of VR equipment is limited.
Summary of the invention
The embodiment of the present invention provides image display method, device, equipment and the storage medium of a kind of virtual reality device, uses
To solve the problems, such as that VR equipment can not play two dimensional image in the prior art.
The present invention provides a kind of image display methods of virtual reality device, comprising:
Receive the two dimensional image that terminal is sent；
The two dimensional image is acquired with left eye visual angle and right-eye perspectives respectively, to obtain left eye multi-view image and the right side
Eye multi-view image；
According to the left eye multi-view image and the right-eye perspectives image, carries out virtual reality and show.
Optionally, described that the two dimensional image is acquired with left eye visual angle and right-eye perspectives respectively, to obtain left eye
Multi-view image and right-eye perspectives image, comprising:
Virtual reality scenario is created, there is the first painting canvas in the virtual reality scenario；
The two dimensional image is shown on first painting canvas, virtual scene image is obtained；
The virtual scene image is acquired with the left eye visual angle, obtains the left eye multi-view image；
The virtual scene image is acquired with the right-eye perspectives, obtains the right-eye perspectives image.
Optionally, the method further include:
Two virtual perspective cameras are created, to pass through a virtual perspective camera with the left eye visual angle to the virtual field
Scape image is acquired, and is acquired with the right-eye perspectives to the virtual scene image by another virtual perspective camera.
Optionally, the two dimensional image is shown on first painting canvas, obtains virtual scene image, comprising:
The corresponding buffer area of first painting canvas is written into the two dimensional image, to update the data in the buffer area；
The two dimensional image is read from the buffer area and the two dimensional image is shown on first painting canvas, is obtained
The virtual scene image.
Optionally, the method further include:
By Miracast technology, establishes and be wirelessly connected with the terminal；
First painting canvas is substituted to the second painting canvas of the Miracast technology default setting, so that subsequently through
The two dimensional image that Miracast connection receives is written into the corresponding buffer area of first painting canvas.
Optionally, it according to the left eye multi-view image and the right-eye perspectives image, carries out virtual reality and shows, comprising:
According to the optical parameter of the virtual reality device, to the left eye multi-view image and the right-eye perspectives image into
The anti-distortion processing of row；
Anti- distortion treated the left eye multi-view image and the right-eye perspectives image are shown.
The present invention also provides a kind of image display devices of virtual reality device, comprising:
Receiving module, for receiving the two dimensional image of terminal transmission；
Acquisition module, for being acquired respectively with left eye visual angle and right-eye perspectives to the two dimensional image, to obtain a left side
Eye multi-view image and right-eye perspectives image；
Display module, for carrying out virtual reality and showing according to the left eye multi-view image and the right-eye perspectives image.
Optionally, the acquisition module, is also used to:
Virtual reality scenario is created, there is the first painting canvas in the virtual reality scenario；
The two dimensional image is shown on first painting canvas, virtual scene image is obtained；
The virtual scene image is acquired with the left eye visual angle, obtains the left eye multi-view image；
The virtual scene image is acquired with the right-eye perspectives, obtains the right-eye perspectives image.
The present invention also provides a kind of virtual reality devices, comprising: processor and the memory being connected to the processor；
The memory is for storing one or more computer instruction；Wherein, one or more computer instruction
It is called and executed by processor to realize method described in any of the above embodiments.
The present invention also provides a kind of computer readable storage medium, the computer-readable recording medium storage has computer
Executable program；The computer executable program realizes method described in any of the above embodiments when executing.
Technical solution provided in an embodiment of the present invention, after the two dimensional image for receiving terminal transmission, respectively with different views
Angle is acquired it to obtain left eye multi-view image and right-eye perspectives image；Then according to left eye multi-view image and right-eye perspectives
Image carries out VR and shows；Because left eye multi-view image and right-eye perspectives image meet the display requirement of VR equipment, therefore two dimensional image
It can be normally shown in VR equipment.
The aspects of the invention or other aspects can more straightforwards in the following description.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is this hair
Bright some embodiments for those of ordinary skill in the art without creative efforts, can be with root
Other attached drawings are obtained according to these attached drawings.
Fig. 1 shows the flow diagram of the display methods of virtual reality device according to an embodiment of the invention；
Fig. 2 shows the structural block diagrams of the display device of virtual reality device according to an embodiment of the invention；
Fig. 3 shows the structural block diagram of virtual reality device according to an embodiment of the invention；
Fig. 4 shows the display picture of VR device display screen；
Fig. 5 shows the inside configuration structure block diagram of VR equipment.
Specific embodiment
In order to enable those skilled in the art to better understand the solution of the present invention, below in conjunction in the embodiment of the present invention
Attached drawing, technical scheme in the embodiment of the invention is clearly and completely described.
In some processes of the description in description and claims of this specification and above-mentioned attached drawing, contain according to
Multiple operations that particular order occurs, but it should be clearly understood that these operations can not be what appears in this article suitable according to its
Sequence is executed or is executed parallel, and serial number of operation such as 101,102 etc. is only used for distinguishing each different operation, serial number
It itself does not represent and any executes sequence.In addition, these processes may include more or fewer operations, and these operations can
To execute or execute parallel in order.It should be noted that the description such as " first " herein, " second ", is for distinguishing not
Same message, equipment, module etc., does not represent sequencing, does not also limit " first " and " second " and be different type.
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on
Embodiment in the present invention, those skilled in the art's every other implementation obtained without making creative work
Example, shall fall within the protection scope of the present invention.
Fig. 1 is the flow diagram for the picture processing method that one embodiment of the invention provides.This method packet as shown in Figure 1:
It includes:
1101, the two dimensional image that terminal is sent is received.
1102, the two dimensional image is acquired with left eye visual angle and right-eye perspectives respectively, to obtain left eye visual angle figure
Picture and right-eye perspectives image.
1103, it according to the left eye multi-view image and the right-eye perspectives image, carries out virtual reality and shows.
In above-mentioned 1101, terminal can be the electronic equipments such as mobile phone, tablet computer, desktop computer, MP4.Two dimensional image can
To be one page picture etc. in a frame video image, 2D operation interface image or the 2D lantern slide in 2D film video, this hair
Bright embodiment is not especially limited this.
In above-mentioned 1102, left eye visual angle and right-eye perspectives are for simulating mankind's eyes visual angle, with left eye visual angle and the right side
The collected left eye multi-view image in eye visual angle and right-eye perspectives image that is to say the content that user can see.Wherein, left eye regards
Feel in image and right vision image and show above-mentioned two dimensional image, due to the visual angle between left eye visual angle and right-eye perspectives
Difference, there are certain offsets for position in left vision image and right vision image for two dimensional image, such as: left vision image
In two dimensional image be biased to right side compared with the two dimensional image in right-eye perspectives image, the two dimensional image in right vision image is compared with left eye
Two dimensional image in visual pattern is biased to left side.
In above-mentioned 1103, can by left eye multi-view image and the right-eye perspectives image split screen display available VR equipment display screen
On.For example, left eye multi-view image and the right-eye perspectives image are attached to side by side in a plane, flat content is exported and is shown
To the display screen of VR equipment.The light of the left eye multi-view image shown on VR device display screen is passed in the left eye of user, VR
The light of the right-eye perspectives image shown on device display screen is passed in user's right eye, so that user is clearly visible X-Y scheme
Picture.
Technical solution provided in an embodiment of the present invention, after the two dimensional image for receiving terminal transmission, respectively with different views
Angle is acquired it to obtain left eye multi-view image and right-eye perspectives image；Then according to left eye multi-view image and right-eye perspectives
Image carries out VR and shows；Because left eye multi-view image and right-eye perspectives image meet the display requirement of VR equipment, therefore two dimensional image
It can be normally shown in VR equipment.
Further, on the spot in person in order to achieve the effect that, a virtual reality scenario can be created in advance, then by X-Y scheme
As being shown in virtual reality scenario, user is allowed to appreciate to immersion video or picture in virtual reality scenario.I.e.
Above-mentioned 1102 " it is described that the two dimensional image is acquired with left eye visual angle and right-eye perspectives respectively, to obtain left eye visual angle figure
Picture and right-eye perspectives image ", can also specifically realize with the following method:
1021, virtual reality scenario is created, there is the first painting canvas in the virtual reality scenario.
1022, the two dimensional image is shown on first painting canvas, obtains virtual scene image.
1023, the virtual scene image is acquired with the left eye visual angle, obtains the left eye multi-view image.
1024, the virtual scene image is acquired with the right-eye perspectives, obtains the right-eye perspectives image.
In above-mentioned 1021, virtual reality scenario can be virtual theater, virtual home movie theatre, Virtual Class or virtual meeting
Room, the present invention are not especially limited this.When creating virtual reality scenario, one is created in virtual reality scenario for showing
First painting canvas of two dimensional image.Position of first painting canvas in virtual reality scenario can be set according to actual needs, this hair
It is bright that this is not especially limited.Such as: when virtual reality scenario is virtual theater, it can be set in the motion picture projection region of virtual theater
Set the first painting canvas；When virtual reality scenario is Virtual Class, the first painting canvas can be set in the blackboard region of Virtual Class.
Wherein, the first painting canvas is not the canvas object on a practical significance, but one in virtual reality scenario
Virtual objects.
Virtual scene image in above-mentioned 1022 corresponds to the virtual reality field that the first painting canvas shows the two dimensional image
Scape.In above-mentioned 1023 and 1024, the virtual scene image is acquired with left eye visual angle, right-eye perspectives, that is to say with a left side
The virtual reality scenario that eye visual angle, right-eye perspectives show the two dimensional image to the first painting canvas is acquired, to obtain left eye
Multi-view image and right-eye perspectives image.
Left eye multi-view image and right-eye perspectives image can be obtained in 1022~1024 step through the above steps.Use void
Quasi- real world devices, the left eye of user see that left eye multi-view image, right eye see right-eye perspectives image；Images of left and right eyes multi-view image it
Between difference by user's brain identification after, three-dimensional sense can be generated.If virtual reality scenario is virtual theater, virtual reality is used
The user of equipment has kind and is sitting in the impression that 2D film is seen by cinema.
In above-mentioned technical proposal, virtual reality scenario is created in advance, and the first painting canvas is created in virtual reality scenario, it will be whole
The two dimensional image sent is held to be shown on the first painting canvas；Left eye multi-view image and right eye are collected by images of left and right eyes visual angle
Multi-view image, left eye multi-view image and right-eye perspectives image meet the display requirement of VR equipment, therefore can be normally displayed in VR and set
In standby, this not only realizes projection of the two dimensional image in VR equipment, moreover it is possible to make user's immersion in virtual reality scenario
Appreciate two dimensional image.
It, can be by the virtual perspective camera of two simulation mankind's eyes of creation come real in a kind of achievable technical solution
The acquisition of existing image.The method i.e. provided in an embodiment of the present invention may also include the steps of:
Create two virtual perspective cameras.
Wherein, two virtual perspective cameras simulate the left eye and right eye of the mankind, left-right situs respectively；Respectively with left eye visual angle
Image and right-eye perspectives image are acquired two dimensional image, to obtain left eye multi-view image and right-eye perspectives image.That is, passing through
The magazine virtual perspective camera of two virtual perspectives is acquired the virtual scene image with the left eye visual angle,
The virtual scene image is carried out with the right-eye perspectives by the magazine another virtual perspective camera of two virtual perspectives
Acquisition.Above-mentioned steps 1023 and 1024 are realized by two virtual perspective cameras.Specifically, two virtual perspective cameras are equal
Towards the first painting canvas setting in virtual reality scenario, to ensure all to show in left eye multi-view image and right-eye perspectives image
State two dimensional image.
What needs to be explained here is that: virtual perspective camera mentioned in this article is not the camera pair on a practical significance
As can simply be understood as a kind of auxiliary tool, the auxiliary tool is by software realization.Virtual perspective camera provides some auxiliary
Aid method, by being collected the variation of object come analogue camera visual angle.
Further, the embodiment of the present application provides above-mentioned steps 1022 and " shows the two dimensional image and draw described first
On cloth, virtual scene image is obtained " it may particularly include:
S1, the two dimensional image is written to the corresponding buffer area of first painting canvas, to update the number in the buffer area
According to；
S2, the two dimensional image is read from the buffer area and the two dimensional image is shown on first painting canvas,
Obtain the virtual scene image.
In general, above-mentioned buffer area is used to store the data of a two dimensional image.Therefore, new X-Y scheme can be received every time
When picture, the two dimensional image stored in the past is substituted by new two dimensional image.
In practical application, VR equipment and terminal can be based on the transmission of Miracast Wireless Display technology realization data.
Miracast technology is the projection that synchronizes using WiFiDisplay function realization equipment room, such as: Miracast can be used in mobile phone
Technology will be on its screen prjection to TV, projector or the same DST PLAYER for supporting Miracast.Utilize Miracast
Technology, user no longer need to find the wire rod and converter of various specifications, needn't also confirm for connecting correctly connecing for equipment
Head.In addition to this, the equipment such as smart phone, tablet computer, laptop, desktop computer need no longer design various connect
Mouthful, it can be connected with other output equipments, such as television set, set-top box (STB), projector, sound equipment, earphone, by multimedia
It is played on long-range audio-visual devices with the content of application service.
Specifically, the method provided in an embodiment of the present invention may also include that
1104, it by Miracast technology, establishes and is wirelessly connected with the terminal.
1105, first painting canvas is substituted to the second painting canvas of the Miracast technology default setting, so that subsequent logical
It crosses the two dimensional image that Miracast connection receives and is written into the corresponding buffer area of first painting canvas.
In above-mentioned 1104, VR equipment can establish wifi point-to-point (wifi p2p) with terminal and connect, wifi p2p connection nothing
It need to be by any network or hot spot, it can be achieved that short-range communication.
Since Miracast Wireless Display technology in the prior art is based on 2D mode, i.e., by 2D plane projection to 2D
In plane.And the scene in VR equipment is 3D scene, in order to which 2D plane projection is arrived by Miracast Wireless Display technology
In 3D scene, need the second painting canvas of the first painting canvas substitution Miracast technology default setting in virtual reality scenario.Its
In, what the second painting canvas referred to is display screen or display window etc..It that is to say, the first painting canvas in virtual reality scenario is substituted
Original 2D painting canvas (i.e. the second painting canvas) in Miracast worker thread.In this way, subsequent Miracast worker thread can be from
Two dimensional image is read in the corresponding buffer area of one painting canvas and the rendering of two dimensional image is carried out on the first painting canvas.
In view of in current VR equipment, the mode of display are as follows: human eye-lens-display screen.Human eye is seen aobvious by lens
Shown virtual scene in display screen.In order to eliminate the distortion of lens generation, left eye is regarded before needing to show on a display screen
Angle image and the right-eye perspectives image carry out anti-distortion processing.Step 1103 in technical solution i.e. provided in an embodiment of the present invention
" according to the left eye multi-view image and the right-eye perspectives image, carry out virtual reality and show " includes:
1031, according to the optical parameter of the VR equipment, to the left eye multi-view image and the right-eye perspectives image into
The anti-distortion processing of row.
1032, anti-distortion treated the left eye multi-view image and the right-eye perspectives image are shown.
Wherein, optical parameter includes focal length, optical center and the distortion factor of the left and right lens in VR equipment.Anti- distortion processing
Specific implementation can be found in corresponding contents in the prior art, this will not be detailed here.
In this way, the image that human eye is seen by lens will be normal.As shown in figure 4, a left side for the display screen 1 of VR equipment
Right two sides show left eye multi-view image 2 and right-eye perspectives image 3 respectively, show in first painting canvas in left eye multi-view image 2
5 content of two dimensional image shown in two dimensional image 4 and the first painting canvas in right-eye perspectives image 3 is consistent, only in left eye visual angle figure
As there is the difference in left-right direction, the position of the two dimensional image 4 in left eye multi-view image 2 between 2 and right-eye perspectives image 3
To the right, the position of the two dimensional image 5 in right-eye perspectives image 3 is to the left.
Specifically, left eye multi-view image and right-eye perspectives image can be displayed side by side in VR equipment in above-mentioned 1032
On display screen, so that the left eye of the left eye multi-view image face user of the display screen display of VR equipment is shown, VR equipment is shown
Show that the right eye of the right-eye perspectives image face user of screen display is shown.
Usually, video is made of a large amount of frames, and each frame is all a two dimensional image.Therefore, terminal can be according to certainly
Oneself playing sequence successively transmits each frame.When there is new two dimensional image to reach, need according to new two dimensional image
New left eye multi-view image and right-eye perspectives image are regenerated, is shown with carrying out VR.Specifically, provided in an embodiment of the present invention
The method, further includes:
1106, new two dimensional image is judged whether there is to reach；If so, then continuing using above steps based on new two dimension
Image obtains new left eye multi-view image and right-eye perspectives image and is shown with carrying out VR；If no, illustrating the 2D view in terminal
Frequency finishes, and can end automatically.
In view of many videos all carry synchronous audio.Therefore, the above method further include: receive the terminal and send
The audio data synchronous with the two dimensional image；By the audio data and the left eye multi-view image and right-eye perspectives image
Synchronize broadcasting.Terminal can send over the audio data synchronous with two dimensional image together with the two dimensional image.Decoding
It is exported after audio data to the loudspeaker or earphone of VR equipment, is written in the corresponding buffer area of the first painting canvas after video data decoding.
Due to having had 3D video play mode and 360 degree of video panorama play mode in current VR equipment, be
The use for not influencing other play mode, need to configure the mode switch function of VR equipment.Specifically, the embodiment of the present invention provides
Technical solution may also include the steps of:
1107, the pattern switching instruction of user's triggering is received；
1108, it is instructed according to the pattern switching, switches to 3D video play mode or 360 degree of video panoramas play mould
Formula.
User can be by the mode switch button in operation VR equipment or by watching the pattern switching on partial display attentively
Control be more than preset duration (can be arranged according to actual needs, such as: 2s) trigger mode switching command.Such as: in part
Fringe region (such as: the upper left corner, the upper right corner) setting of viewing area corresponds to the first control of 3D video play mode and right
It should be in the second control of 360 degree of video panorama play mode.When user wants to watch 3D video by VR equipment, user can be infused
Depending on first control 2s of the part to screening zone in virtual reality scenario, thus can the instruction of automatic trigger pattern switching, the mould
Corresponding play mode is carried in formula switching command.It should be noted that switching to 3D video play mode or 360 degree of views
After frequency panorama play mode, the 3D video image or 360 degree of video panorama images that terminal is sent are received, according to 3D video image
Or 360 degree of video panorama images build virtual reality scenario.
In addition, technical solution provided in an embodiment of the present invention may also include the steps of:
1109, the scaling instruction of user's triggering is received；
1120, display size of the two dimensional image in first painting canvas is adjusted according to the scaling instruction.
When it is implemented, zoom in control can be arranged in the upper right corner of the first painting canvas and reduce control, user can be by watching attentively
Zoom in control reduces control more than preset duration to trigger scaling instruction.If it is more than default for detecting that user watches zoom in control attentively
Duration then generates amplification instruction；If detecting that user watches attentively reduces control more than preset duration, diminution instruction is generated.Such as:
If scaling instruction instruction enhanced processing, is displayed in full screen the two dimensional image in first painting canvas；If scaling instruction instruction
Diminution processing, then half screen shows the two dimensional image in first painting canvas.
This programme will be described further for playing 2D video in VR equipment below:
401, terminal and VR equipment establish wifi p2p connection by Miracast technology.
402, start to play 2D film, frame image (the i.e. X-Y scheme that will currently show on display screen on the display screen of terminal
Picture) it is transferred to VR equipment.
403, VR equipment is according to the data of the corresponding buffer area of the first painting canvas of frame image update received.
404, VR equipment reads frame image from buffer area, and frame image is shown to the first painting canvas in virtual reality scenario
On, obtain virtual scene image.
405, virtual scene image is acquired to obtain left eye multi-view image by simulating the virtual perspective camera of left eye,
Virtual perspective camera by simulating right eye is acquired virtual scene image to obtain right-eye perspectives image.
406, according to the optical parameter of VR equipment, anti-distortion processing is carried out to left eye multi-view image and right-eye perspectives image,
Obtain treated the left eye multi-view image and the right-eye perspectives image of instead distorting.
407, will anti-distortion treated that the left eye multi-view image and the right-eye perspectives image or so are displayed side by side
On the display screen of VR equipment.
User is with VR equipment in this way, so that it may and left eye watches left eye multi-view image, and right eye watches right-eye perspectives image, into
And experience 3D effect.
408, VR equipment judges whether terminal transmits new frame image.
If so, repeating above-mentioned 403-407 then to obtain new left eye multi-view image and right eye based on new frame image
Multi-view image is shown with carrying out VR；If no, illustrating, the 2D video playing in terminal is finished, and can be ended automatically.
Fig. 2 is the structural block diagram for the image processing device that further embodiment of this invention provides.As shown in Fig. 2, described device
It include: receiving module 201, acquisition module 202 and display module 203.Wherein, receiving module 201 is used to receive terminal transmission
Two dimensional image；Acquisition module 202 is for being respectively acquired the two dimensional image with left eye visual angle and right-eye perspectives, to obtain
Left eye multi-view image and right-eye perspectives image；Display module 203 is used for according to the left eye multi-view image and the right-eye perspectives
Image carries out virtual reality and shows.
Technical solution provided in an embodiment of the present invention, after the two dimensional image for receiving terminal transmission, respectively with different views
Angle is acquired it to obtain left eye multi-view image and right-eye perspectives image；Then according to left eye multi-view image and right-eye perspectives
Image carries out VR and shows；Because left eye multi-view image and right-eye perspectives image meet the display requirement of VR equipment, therefore two dimensional image
It can be normally shown in VR equipment.
Further, the acquisition module 202 is also used to:
Virtual reality scenario is created, there is the first painting canvas in the virtual reality scenario；
The two dimensional image is shown on first painting canvas, virtual scene image is obtained；
The virtual scene image is acquired with the left eye visual angle, obtains the left eye multi-view image；
The virtual scene image is acquired with the right-eye perspectives, obtains the right-eye perspectives image.
In above-mentioned technical proposal, virtual reality scenario is created in advance, and part is created in virtual reality scenario to screening zone
That is the first painting canvas, the two dimensional image that terminal is sent are shown on the first painting canvas；Left eye is collected by right and left eyes visual angle
Multi-view image and right-eye perspectives image, left eye multi-view image and right-eye perspectives image meet the display requirement of VR equipment, therefore can
It is normally displayed in VR equipment, this not only realizes projection of the two-dimensional video in VR equipment, moreover it is possible to allow users to virtual
Immersion two-dimensional video is appreciated in reality scene.
Optionally, above-mentioned apparatus further includes creation module.The creation module is used to create two virtual perspective cameras,
To be acquired with the left eye visual angle to the virtual scene image by a virtual perspective camera, pass through another virtual view
Angle camera is acquired the virtual scene image with the right-eye perspectives.
Further, the acquisition module 202 is also used to:
The corresponding buffer area of first painting canvas is written into the two dimensional image, to update the data in the buffer area；
The two dimensional image is read from the buffer area and the two dimensional image is shown on first painting canvas, is obtained
The virtual scene image.
Further, device provided in an embodiment of the present invention may also include that link block and alternative module.Wherein, it connects
Module, for establishing and being wirelessly connected with the terminal by Miracast technology；Alternative module is for replacing first painting canvas
For the second painting canvas of the Miracast technology default setting, so that the two dimensional image received subsequently through Miracast connection
It is written into the corresponding buffer area of first painting canvas.
Further, above-mentioned display module 203 is also used to:
According to the optical parameter of the virtual reality device, to the left eye multi-view image and the right-eye perspectives image into
The anti-distortion processing of row；
Anti- distortion treated the left eye multi-view image and the right-eye perspectives image are shown.
Further, above-mentioned apparatus may also include that switching module.Wherein, the receiving module 201 is also used to receive user
The pattern switching of triggering instructs；The switching module is used to be instructed according to the pattern switching, switches to 3D video play mode
Or 360 degree of video panorama play mode.
Further, above-mentioned apparatus may also include that judgment module.The judgment module is for judging whether there is new two dimension
Image reaches；If so, then continuing to obtain new left eye multi-view image and right eye based on new two dimensional image using above steps
Multi-view image is shown with carrying out virtual reality
Further, above-mentioned apparatus may also include that playing module.Wherein, the receiving module 201 is also used to receive described
The audio data synchronous with the two dimensional image that terminal is sent；The playing module be also used to by the audio data with it is described
Left eye multi-view image and right-eye perspectives image synchronize broadcasting.
Further, above-mentioned apparatus may also include adjustment module.Wherein, the receiving module 201 is also used to receive user
The scaling of triggering instructs；The adjustment module is used to adjust the two dimensional image in first painting canvas according to scaling instruction
Interior display size.
Such as: if scaling instruction instruction enhanced processing, is displayed in full screen the two dimensional image in first painting canvas；If
Scaling instruction instruction diminution processing, then half screen shows the two dimensional image in first painting canvas.
It is apparent to those skilled in the art that for convenience and simplicity of description, the device of foregoing description
Specific work process, can be with reference to the corresponding contents in preceding method embodiment, details are not described herein.
Fig. 3 is a kind of virtual reality device for providing of further embodiment of this invention, the equipment include: processor 301 and
The memory 302 being connect with the processor 301；Wherein, the memory 302 refers to for storing one or more computer
It enables；Wherein, one or more computer instruction is called and executed by processor 301 to realize:
Receive the two dimensional image that terminal is sent；
The two dimensional image is acquired with left eye visual angle and right-eye perspectives respectively, to obtain left eye multi-view image and the right side
Eye multi-view image；
According to the left eye multi-view image and the right-eye perspectives image, carries out virtual reality and show.
What needs to be explained here is that: the processor 301 is when executing the instruction in memory 302, except function above
Except, it can also be achieved other functions, for details, reference can be made to the descriptions of previous embodiments.
In addition, the embodiment of the invention also provides a kind of computer readable storage medium for being stored with computer program, institute
State computer program and may be implemented when executing computer the image display method of the virtual reality device of any of the above-described embodiment
The step of or function.
Some embodiments of the invention provide VR equipment can for circumscribed wear display equipment or integral type wear it is aobvious
Show equipment, wherein circumscribed is worn display equipment needs and is used cooperatively with external treatment system (such as computer processing system).
Fig. 5 shows the inside configuration structure schematic diagram of VR equipment 100 in some embodiments.
Display unit 101 may include display panel, and the side in VR equipment 100 towards user's face is arranged in display panel
Surface can be an entire panel or to respectively correspond the left panel of user's left eye and right eye and right panel.Display panel can
Think that electroluminescent (EL) element, liquid crystal display or miniscope with similar structure or retina can directly be shown
Show or similar laser scan type display.
Virtual image optical unit 102 allows user to observe figure shown by display unit 101 by the virtual image of amplification
Picture.As the display image being output on display unit 101, can be from content reproducing device (Blu-ray Disc or DVD broadcasting
Device) or streaming media server provide virtual scene image or the reality scene shot using external camera 110 figure
Picture.In some embodiments, virtual image optical unit 102 may include lens unit, for example, spherical lens, non-spherical lens,
Fresnel Lenses etc..
Input operating unit 103 include at least one be used to execute input operation operating member, such as key, button,
Switch or other components with similar functions, are received user instructions by operating member, and are exported to control unit 107
Instruction.
State information acquisition unit 104 is used to obtain the status information that wearing wears the user of display equipment 100.State letter
Ceasing acquiring unit 104 may include various types of sensors, be used for itself detecting state information, and can pass through communication unit
105 obtain status information from external equipment (such as other multi-functional terminal ends of smart phone, watch and user's wearing).State letter
Cease the location information and/or posture information on the head of the available user of acquiring unit 104.State information acquisition unit 104 can
To include gyro sensor, acceleration transducer, global positioning system (GPS) sensor, geomagnetic sensor, Doppler effect
Sensor, infrared sensor, one or more in radio-frequency field intensity sensor.In addition, state information acquisition unit 104 obtains
The status information of the user of VR equipment 100 is taken, such as obtains the mode of operation of such as user (whether user, which dresses, is worn display and set
It is standby 100), the action state of user (it is such as static, walk, run and suchlike moving condition, the posture of hand or finger tip,
Eyes open or closed state, direction of visual lines, pupil size), the state of mind (user whether be immersed in the shown image of observation with
And suchlike) or even physiological status.
Communication unit 105 executes the coding with the communication process of external device (ED), modulation and demodulation processing and signal of communication
And decoding process.In addition, control unit 107 can send transmission data from communication unit 105 to external device (ED).Communication mode can
To be wired or wireless, such as mobile high definition link (MHL) or universal serial bus (USB), high-definition media interface
(HDMI), the mesh network of Wireless Fidelity (Wi-Fi), Bluetooth communication or low-power consumption bluetooth communication and IEEE802.11s standard
Deng.In addition, communication unit 105 can be according to wideband code division multiple access (W-CDMA), long term evolution (LTE) and similar standard operation
Cellular radio transceiver.
In some embodiments, VR equipment 100 can also include storage unit, and storage unit 106 is arranged to solid-state
The mass-memory unit of driver (SSD) etc..In some embodiments, storage unit 106 can store application program or various
The data of type.For example, user can store in storage unit 106 using the content that VR equipment 100 is watched.
In some embodiments, VR equipment 100 can also include control unit, and control unit 107 may include at computer
Manage unit (CPU) or other equipment with similar functions.In some embodiments, control unit 107, which can be used for executing, is deposited
The application program or control unit 107 that storage unit 106 stores can be also used for executing side disclosed in some embodiments of the application
The circuit of method, function and operation.
Image processing unit 108 is used to execute signal processing, such as related to the picture signal exported from control unit 107
Image quality correction, and by its conversion of resolution be the resolution ratio according to the screen of display unit 101.Then, display is driven
Moving cell 109 successively selects every row pixel of display unit 101, and successively scans every row pixel of display unit 101 line by line, because
And provide the picture element signal based on the picture signal through signal processing.
In some embodiments, VR equipment 100 can also include external camera.External camera 110 can be set in VR equipment
100 main body front surfaces, external camera 110 can be one or more.The available three-dimensional information of external camera 110, and
It is also used as range sensor.In addition, detection from object reflection signal position sensitive detector (PSD) or other
The range sensor of type can be used together with external camera 110.External camera 110 and range sensor can be used for detecting
Body position, posture and the shape of the user of VR equipment 100.In addition, user can be straight by external camera 110 under certain condition
Connect viewing or preview reality scene.
In some embodiments, VR equipment 100 can also include sound processing unit, and sound processing unit 111 can execute
At the sound quality correction or sound amplification of the voice signal exported from control unit 107 and the signal of input audio signal
Reason etc..Then, voice input/output unit 112 is output to the outside sound and input from microphone after acoustic processing
Sound.
It should be noted that structure or component in Fig. 1 shown in dotted line frame can independently of wear display equipment 100 it
Outside, for example, can be set in the outside manage system (such as computer system) in be used cooperatively with VR equipment 100；Alternatively, dotted line
Structure or component shown in frame can be set on 100 inside of VR equipment or surface.
The apparatus embodiments described above are merely exemplary, wherein described, unit can as illustrated by the separation member
It is physically separated with being or may not be, component shown as a unit may or may not be physics list
Member, it can it is in one place, or may be distributed over multiple network units.It can be selected according to the actual needs
In some or all of the modules achieve the purpose of the solution of this embodiment.Those of ordinary skill in the art are not paying creativeness
Labour in the case where, it can understand and implement.
Through the above description of the embodiments, those skilled in the art can be understood that each embodiment can
It realizes by means of software and necessary general hardware platform, naturally it is also possible to pass through hardware.Based on this understanding, on
Stating technical solution, substantially the part that contributes to existing technology can be embodied in the form of software products in other words, should
Computer software product may be stored in a computer readable storage medium, such as ROM/RAM, magnetic disk, CD, including several fingers
It enables and using so that a computer equipment (can be personal computer, server or the network equipment etc.) executes each implementation
Method described in certain parts of example or embodiment.
Finally, it should be noted that the above embodiments are merely illustrative of the technical solutions of the present invention, rather than its limitations；Although
Present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that: it still may be used
To modify the technical solutions described in the foregoing embodiments or equivalent replacement of some of the technical features；
And these are modified or replaceed, technical solution of various embodiments of the present invention that it does not separate the essence of the corresponding technical solution spirit and
Range.
Claims (10)
1. a kind of image display method of virtual reality device characterized by comprising
Receive the two dimensional image that terminal is sent；
The two dimensional image is acquired with left eye visual angle and right-eye perspectives respectively, to obtain left eye multi-view image and right eye view
Angle image；
According to the left eye multi-view image and the right-eye perspectives image, carries out virtual reality and show.
2. the method according to claim 1, wherein described respectively with left eye visual angle and right-eye perspectives to described two
Dimension image is acquired, to obtain left eye multi-view image and right-eye perspectives image, comprising:
Virtual reality scenario is created, there is the first painting canvas in the virtual reality scenario；
The two dimensional image is shown on first painting canvas, virtual scene image is obtained；
The virtual scene image is acquired with the left eye visual angle, obtains the left eye multi-view image；
The virtual scene image is acquired with the right-eye perspectives, obtains the right-eye perspectives image.
3. according to the method described in claim 2, it is characterized by further comprising:
Two virtual perspective cameras are created, to pass through a virtual perspective camera with the left eye visual angle to the virtual scene figure
As being acquired, the virtual scene image is acquired with the right-eye perspectives by another virtual perspective camera.
4. according to the method described in claim 2, it is characterized in that, showing the two dimensional image on first painting canvas,
Obtain virtual scene image, comprising:
The corresponding buffer area of first painting canvas is written into the two dimensional image, to update the data in the buffer area；
The two dimensional image is read from the buffer area and the two dimensional image is shown on first painting canvas, is obtained described
Virtual scene image.
5. according to the method described in claim 4, it is characterized by further comprising:
By Miracast technology, establishes and be wirelessly connected with the terminal；
The second painting canvas that first painting canvas is substituted to the Miracast technology default setting, so that subsequently through Miracast
The two dimensional image received is written into the corresponding buffer area of first painting canvas.
6. the method according to any one of claims 1 to 5, which is characterized in that according to the left eye multi-view image and institute
Right-eye perspectives image is stated, virtual reality is carried out and shows, comprising:
According to the optical parameter of the virtual reality device, the left eye multi-view image and the right-eye perspectives image are carried out anti-
Distortion processing；
Anti- distortion treated the left eye multi-view image and the right-eye perspectives image are shown.
7. a kind of image display device of virtual reality device characterized by comprising
Receiving module, for receiving the two dimensional image of terminal transmission；
Acquisition module, for being acquired respectively with left eye visual angle and right-eye perspectives to the two dimensional image, to obtain left eye view
Angle image and right-eye perspectives image；
Display module, for carrying out virtual reality and showing according to the left eye multi-view image and the right-eye perspectives image.
8. device according to claim 7, which is characterized in that the acquisition module is also used to:
Virtual reality scenario is created, there is the first painting canvas in the virtual reality scenario；
The two dimensional image is shown on first painting canvas, virtual scene image is obtained；
The virtual scene image is acquired with the left eye visual angle, obtains the left eye multi-view image；
The virtual scene image is acquired with the right-eye perspectives, obtains the right-eye perspectives image.
9. a kind of virtual reality device, which is characterized in that the equipment includes: processor and what is be connected to the processor deposit
Reservoir；
The memory is for storing one or more computer instruction；Wherein, one or more computer instruction is located
Reason device is called and is executed to realize such as method described in any one of claims 1 to 6.
10. a kind of computer readable storage medium, which is characterized in that the computer-readable recording medium storage has computer can
Execute program；
Such as method described in any one of claims 1 to 6 is realized when the computer executable program executes.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810746852.3A CN108989784A (en) | 2018-07-09 | 2018-07-09 | Image display method, device, equipment and the storage medium of virtual reality device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810746852.3A CN108989784A (en) | 2018-07-09 | 2018-07-09 | Image display method, device, equipment and the storage medium of virtual reality device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108989784A true CN108989784A (en) | 2018-12-11 |
Family
ID=64536497
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810746852.3A Pending CN108989784A (en) | 2018-07-09 | 2018-07-09 | Image display method, device, equipment and the storage medium of virtual reality device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108989784A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109714585A (en) * | 2019-01-24 | 2019-05-03 | 京东方科技集团股份有限公司 | Image transfer method and device, display methods and device, storage medium |
| CN110677689A (en) * | 2019-09-29 | 2020-01-10 | 杭州当虹科技股份有限公司 | VR video advertisement seamless insertion method based on user view angle |
| WO2023066054A1 (en) * | 2021-10-21 | 2023-04-27 | 中兴通讯股份有限公司 | Image processing method, cloud server, vr terminal and storage medium |
| CN116847127A (en) * | 2023-08-31 | 2023-10-03 | 元内核(北京)科技有限公司 | System, method and device for mixed image and encryption remote transmission |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130176397A1 (en) * | 2012-01-10 | 2013-07-11 | Disney Enterprises, Inc. | Optimized Stereoscopic Camera for Real-Time Applications |
| CN105657408A (en) * | 2015-12-31 | 2016-06-08 | 北京小鸟看看科技有限公司 | Method for implementing virtual reality scene and virtual reality apparatus |
| CN106375748A (en) * | 2016-09-07 | 2017-02-01 | 深圳超多维科技有限公司 | Method and apparatus for splicing three-dimensional virtual reality panoramic view, and electronic device |
| CN106445121A (en) * | 2016-09-08 | 2017-02-22 | 三星电子（中国）研发中心 | Virtual reality device and terminal interaction method and apparatus |
| CN108124150A (en) * | 2017-12-26 | 2018-06-05 | 歌尔科技有限公司 | Virtual reality wears display device and observes the method for real scene by it |
-
2018
- 2018-07-09 CN CN201810746852.3A patent/CN108989784A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130176397A1 (en) * | 2012-01-10 | 2013-07-11 | Disney Enterprises, Inc. | Optimized Stereoscopic Camera for Real-Time Applications |
| CN105657408A (en) * | 2015-12-31 | 2016-06-08 | 北京小鸟看看科技有限公司 | Method for implementing virtual reality scene and virtual reality apparatus |
| CN106375748A (en) * | 2016-09-07 | 2017-02-01 | 深圳超多维科技有限公司 | Method and apparatus for splicing three-dimensional virtual reality panoramic view, and electronic device |
| CN106445121A (en) * | 2016-09-08 | 2017-02-22 | 三星电子（中国）研发中心 | Virtual reality device and terminal interaction method and apparatus |
| CN108124150A (en) * | 2017-12-26 | 2018-06-05 | 歌尔科技有限公司 | Virtual reality wears display device and observes the method for real scene by it |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109714585A (en) * | 2019-01-24 | 2019-05-03 | 京东方科技集团股份有限公司 | Image transfer method and device, display methods and device, storage medium |
| CN110677689A (en) * | 2019-09-29 | 2020-01-10 | 杭州当虹科技股份有限公司 | VR video advertisement seamless insertion method based on user view angle |
| WO2023066054A1 (en) * | 2021-10-21 | 2023-04-27 | 中兴通讯股份有限公司 | Image processing method, cloud server, vr terminal and storage medium |
| CN116847127A (en) * | 2023-08-31 | 2023-10-03 | 元内核(北京)科技有限公司 | System, method and device for mixed image and encryption remote transmission |
| CN116847127B (en) * | 2023-08-31 | 2023-11-21 | 元内核(北京)科技有限公司 | System, method and device for mixed image and encryption remote transmission |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108337497B (en) | Virtual reality video/image format and shooting, processing and playing methods and devices | |
| CN105684074B (en) | Image display device, image display method, image output device, image output method, and image display system | |
| EP3130143B1 (en) | Stereo viewing | |
| CN106154707B (en) | virtual reality projection imaging method and system | |
| WO2017086263A1 (en) | Image processing device and image generation method | |
| CN105187816B (en) | Method and apparatus for the activity space of reasonable employment frame packing form | |
| CN107147899B (en) | CAVE display system and method adopting LED3D screen | |
| CN108989784A (en) | Image display method, device, equipment and the storage medium of virtual reality device | |
| US20160344999A1 (en) | SYSTEMS AND METHODs FOR PRODUCING PANORAMIC AND STEREOSCOPIC VIDEOS | |
| JP2011114867A (en) | Method for switching playback mode, method for switching output mode, and display apparatus and 3d image providing system using the same | |
| JP2016025633A (en) | Information processing apparatus, management device, information processing method, and program | |
| CN105872529A (en) | Virtual reality switching method and device of virtual reality head-mounted display | |
| JP2015125502A (en) | Image processor, image processing method, display unit, display method, computer program and image display system | |
| CA2933704A1 (en) | Systems and methods for producing panoramic and stereoscopic videos | |
| US10582184B2 (en) | Instantaneous 180-degree 3D recording and playback systems | |
| US20200162723A1 (en) | 3D Play System | |
| WO2022262839A1 (en) | Stereoscopic display method and apparatus for live performance, medium, and system | |
| JP2018505580A (en) | 3D image display method and head mounted device | |
| CN204681518U (en) | A kind of panorama image information collecting device | |
| JP2019512177A (en) | Device and related method | |
| US20160286195A1 (en) | Engine, system and method for providing three dimensional content and viewing experience for same | |
| CN108134928A (en) | VR display methods and device | |
| US20210058611A1 (en) | Multiviewing virtual reality user interface | |
| CN113676690A (en) | Method, device and storage medium for realizing video conference | |
| WO2023001113A1 (en) | Display method and electronic device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20201028 Address after: 261061 north of Yuqing East Street, east of Dongming Road, Weifang High tech Zone, Weifang City, Shandong Province (Room 502, Geer electronic office building) Applicant after: GoerTek Optical Technology Co.,Ltd. Address before: 266104 Laoshan Qingdao District North House Street investment service center room, Room 308, Shandong Applicant before: GOERTEK TECHNOLOGY Co.,Ltd. |
|
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: 261061 east of Dongming Road, north of Yuqing East Street, high tech Zone, Weifang City, Shandong Province (Room 502, Geer electronics office building) Applicant after: GoerTek Optical Technology Co.,Ltd. Address before: 261061 east of Dongming Road, north of Yuqing East Street, Weifang High tech Zone, Weifang City, Shandong Province (Room 502, Geer electronics office building) Applicant before: GoerTek Optical Technology Co.,Ltd. |
|
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181211 |