CN109725730A - Wear display equipment and its driving method, display system and its driving method - Google Patents
Wear display equipment and its driving method, display system and its driving method Download PDFInfo
- Publication number
- CN109725730A CN109725730A CN201910002874.3A CN201910002874A CN109725730A CN 109725730 A CN109725730 A CN 109725730A CN 201910002874 A CN201910002874 A CN 201910002874A CN 109725730 A CN109725730 A CN 109725730A
- Authority
- CN
- China
- Prior art keywords
- image
- data
- posture information
- posture
- display equipment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B27/0172—Head mounted characterised by optical features
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0179—Display position adjusting means not related to the information to be displayed
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/012—Head tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0179—Display position adjusting means not related to the information to be displayed
- G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/048—Indexing scheme relating to G06F3/048
- G06F2203/04806—Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Optics & Photonics (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
The invention discloses one kind to wear display equipment and its driving method, display system and its driving method, and wearing display equipment includes: posture detecting module, for obtaining the posture information for wearing display equipment in real time；Image processing module, obtain the data of the first image, corresponding first posture information of the first image and corresponding second posture information of the second image are determined according to the posture information that posture detecting module provides, and the data of the second image are determined according to the data of the first image, the first posture information and the second posture information；Display module is for successively showing the first image and the second image.The rendering of the second image is carried out by wearing display equipment, to reduce the data volume handled needed for primary processor, to guarantee normally show under high frame frequency and complex scene.
Description
Technical field
The present invention relates to field of display technology more particularly to one kind to wear display equipment and its driving method, display system
And its driving method.
Background technique
Virtual reality technology is a kind of computer simulation system that can be created with the experiencing virtual world, it utilizes computer
A kind of simulated environment is generated, is that a kind of Multi-source Information Fusion, interactive Three-Dimensional Dynamic what comes into a driver's and the system of entity behavior are imitative
Really it is immersed to user in the environment.
In the related technology, virtual reality technology mainly passes through primary processor and what is communicated with primary processor wears display
Equipment is realized.Primary processor carries out rendering to image according to the posture for wearing display equipment and handles with interleave, and will processing
Image afterwards, which is supplied to wear, shows that equipment is shown.But in the case where certain demonstration requires, complex scene, high frame per second are to figure
Transmitting as rendering with data has very high requirement, will receive the limitation of primary processor existing capabilities.When being rendered, if a frame
Data render scarce capacity, if picture material is more complex, render time is too long, and output frame rate is higher, the data of next frame
It will be dropped, so that wearing display equipment will show that image identical with previous frame data causes display abnormal.
Therefore, how to alleviate master processor processes scarce capacity to cause display abnormal is that those skilled in the art are urgently to be resolved
The technical issues of.
Summary of the invention
The embodiment of the present invention provides one kind and wears display equipment and its driving method, virtual reality display system and its driving
Method, to solve the problems, such as that shielding lower master processor processes scarce capacity in the related technology causes display abnormal.
The embodiment of the invention provides one kind to wear display equipment, comprising: posture detecting module, image processing module and aobvious
Show module；
The posture detecting module, for obtaining the posture information for wearing display equipment in real time；
Described image processing module, for obtaining the data of the first image, according to the institute of posture detecting module offer
It states posture information and determines corresponding first posture information of the first image and corresponding second posture information of the second image, and root
The number of second image is determined according to the data of the first image, first posture information and second posture information
According to；Wherein, the data of the first image are provided by the primary processor, second image be according to the first image into
The interleave image that row rendering obtains；
The display module, for successively showing the first image and second image.
In one possible implementation, it is shown in equipment in above-mentioned wear provided in an embodiment of the present invention, further includes:
Memory module；
The memory module is used to store at the data and described image of the first image that the primary processor provides
Manage the data for second image that module provides.
In one possible implementation, it is shown in equipment in above-mentioned wear provided in an embodiment of the present invention, the figure
As processing module is specifically used for:
The data of the first image are extracted from the memory module；
Confirm attitudes vibration data of second posture information relative to first posture information, wherein the appearance
State delta data includes: at least one of course angle variation, pitch angle variation and displacement in all directions；
The data of the first image are handled according to the attitudes vibration data, obtain the number of second image
According to.
In one possible implementation, it is shown in equipment in above-mentioned wear provided in an embodiment of the present invention, the figure
As processing module also particularly useful for:
According to the attitudes vibration data to the first image in the enterprising line displacement of corresponding direction, rotation and/or scaling
Processing；
The data of the first image after offset, rotation and/or scaling processing are cut beyond the part of predeterminable area
Processing, and data supplement is carried out to the image absent region in the predeterminable area.
In one possible implementation, it is shown in equipment in above-mentioned wear provided in an embodiment of the present invention, further includes:
Anti- distortion module；
The anti-distortion module is used to be distorted the data of the data of the first image and second image are counter
Processing, and data are supplied to the display module by treated.
In one possible implementation, it is shown in equipment in above-mentioned wear provided in an embodiment of the present invention, the appearance
State detecting module includes: one of Inertial Measurement Unit, optical sensor, positioning unit and camera distance measuring unit or combination.
On the other hand, the embodiment of the invention provides a kind of driving methods for wearing display equipment, comprising:
The posture detecting module wears the posture information for showing equipment described in obtaining in real time；
Described image processing module obtains the data of the first image, the posture provided according to the posture detecting module
Information determines corresponding first posture information of the first image and corresponding second posture information of the second image, and according to described
The data of first image, first posture information and second posture information determine the data of second image；Wherein,
The data of the first image are provided by the primary processor, and second image is render according to the first image
The interleave image arrived；
The display module successively shows the first image and second image.
In one possible implementation, in the above-mentioned driving method for wearing display equipment provided in an embodiment of the present invention
In, described image processing module obtains the data of the first image, the posture information provided according to the posture detecting module
Determine corresponding first posture information of the first image and corresponding second posture information of the second image, and according to described first
The data of image, first posture information and second posture information determine the data of second image, specifically include:
The data of the first image are extracted from the memory module；
Confirm attitudes vibration data of second posture information relative to first posture information, wherein the appearance
State delta data includes: at least one of course angle variation, pitch angle variation and displacement in all directions；
The data of the first image are handled according to the attitudes vibration data, obtain the number of second image
According to.
Another aspect, the embodiment of the invention provides a kind of virtual reality display systems, comprising: primary processor, Yi Jiyu
The primary processor communication connection wears display equipment as described in above-mentioned any embodiment；
The display equipment of wearing is for wearing the posture information of display equipment described in obtaining in real time, and by first figure
As corresponding first posture information is supplied to the primary processor；
The primary processor, first posture information provided for wearing display equipment according to, to described the
One image is rendered, and the data of the first image after rendering are supplied to and described wear display equipment.
In one possible implementation, in above-mentioned virtual reality display system method provided in an embodiment of the present invention
In, the primary processor shows that equipment carries out data transmission by data line or wirelessly with described wear.
In one possible implementation, in above-mentioned virtual reality display system method provided in an embodiment of the present invention
In, the primary processor includes: mobile terminal, PC terminal or cloud processor.
Another aspect, the embodiment of the invention provides a kind of driving methods of virtual reality display system, comprising:
The posture detecting module wears the posture information for showing equipment described in obtaining in real time；
First posture information that the primary processor is provided according to the posture detecting module renders first figure
The data of the first image after rendering are supplied to the memory module and described image processing module by the data of picture；
Described image processing module obtains the data of the first image, according to posture detecting module offer
Posture information determines corresponding first posture information of the first image and corresponding second posture information of the second image, and according to
The data of the first image, first posture information and second posture information determine the data of second image；
Wherein, the data of the first image are provided by the primary processor, and second image is to be carried out according to the first image
Render obtained interleave image；
The display module successively shows the first image and described second image.
The present invention has the beneficial effect that:
One kind provided in an embodiment of the present invention wears display equipment and its driving method, virtual reality display system and its drive
Dynamic method, it includes: posture detecting module, image processing module and display module that this, which wears display equipment,；The posture detects mould
Block, for obtaining the posture information for wearing display equipment in real time；Described image processing module, for obtaining the first image
Data determine corresponding first posture information of the first image according to the posture information that the posture detecting module provides
The second posture information corresponding with the second image, and according to the data of the first image, first posture information and described
Second posture information determines the data of second image；Wherein, the data of the first image are provided by the primary processor,
Second image is the interleave image rendered according to the first image；The display module, for successively showing
Show the first image and second image.It can be seen from the above, wearing display equipment can be provided according to primary processor the
The data of one image, the first posture information and the second posture information determine the data of the second image, i.e., by wearing display equipment
The rendering of interleave image is carried out, to reduce the data volume handled needed for primary processor, to guarantee in high frame frequency and complicated field
It can normally be shown under scape.
Detailed description of the invention
Fig. 1 is the structural schematic diagram provided in an embodiment of the present invention for wearing display equipment；
Fig. 2 is one of the structural schematic diagram provided in an embodiment of the present invention worn and shown when equipment carries out image procossing；
Fig. 3 is the second structural representation provided in an embodiment of the present invention worn when display equipment carries out image procossing；
Fig. 4 is the third structural representation provided in an embodiment of the present invention worn when display equipment carries out image procossing；
Fig. 5 is the method flow diagram of the driving method provided in an embodiment of the present invention for wearing display equipment；
Fig. 6 is the structural schematic diagram of virtual reality display system provided in an embodiment of the present invention；
Fig. 7 is the method flow diagram of the driving method of virtual reality display system provided in an embodiment of the present invention.
Specific embodiment
In order to alleviate the problem that master processor processes scarce capacity in the related technology causes display abnormal, the embodiment of the present invention
It provides one kind and wears display equipment and its driving method, virtual reality display system and its driving method.In order to make the present invention
Purposes, technical schemes and advantages it is clearer, the present invention will be describe below in further detail with reference to the accompanying drawings, it is clear that
The described embodiment is only a part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention,
All other embodiment obtained by those of ordinary skill in the art without making creative efforts, belongs to this hair
The range of bright protection.
The shapes and sizes of each component do not react actual proportions in attached drawing, and purpose is schematically illustrate the content of present invention.
The embodiment of the invention provides one kind to wear display equipment, as shown in Figure 1, comprising: posture detecting module 11, image
Processing module 12 and display module 13；
Posture detecting module 11, for obtaining the posture information for wearing display equipment in real time；
Image processing module 12 is believed for obtaining the data of the first image according to the posture that posture detecting module 11 provides
It ceases and determines corresponding first posture information of the first image and corresponding second posture information of the second image, and according to the first image
Data, the first posture information and the second posture information determine the data of the second image；Wherein, the data of the first image are by main process task
Device provides, and the second image is the interleave image rendered according to the first image；
Display module 13, for successively showing the first image and the second image.
Specifically, it is worn in display equipment provided in an embodiment of the present invention, posture detecting module may include: that inertia is surveyed
Measure one of unit, optical sensor, positioning unit and camera distance measuring unit or combination, can also be certainly other it is any can
The device for realizing posture detecting function, is not specifically limited herein.The image processing module may include: field-programmable gate array
Arrange (Field-Programmable Gate Array, FPGA), central processing unit (Central Processing Unit,
CPU), chip or microprocessor (Microcontroller Unit, MCU) etc. are handled, can also be other any energy certainly
The device for enough realizing image processing function, is not specifically limited herein.The display module can appoint for display screen, display panel etc.
What can be realized the display device of display function, such as may include liquid crystal display (LCD), organic light-emitting diode (OLED) display screen
(OLED), it is based on the display device etc. of liquid crystal on silicon (LCOS), is not specifically limited herein.
One kind provided in an embodiment of the present invention wears display equipment, and it includes: posture detecting module, figure that this, which wears display equipment,
As processing module and display module；Posture detecting module, for obtaining the posture information for wearing display equipment in real time；Image procossing
Module determines that the first image is corresponding according to the posture information that posture detecting module provides for obtaining the data of the first image
First posture information and corresponding second posture information of the second image, and according to the data of the first image, the first posture information and
Second posture information determines the data of the second image；Wherein, the data of the first image are provided by primary processor, and the second image is root
The interleave image rendered according to the first image；Display module, for successively showing the first image and the second image.By upper
It states it is found that wearing data, the first posture information and the second appearance for the first image that display equipment can be provided according to primary processor
State information determines the data of the second image, i.e., the rendering of interleave image is carried out by wearing display equipment, to reduce main place
The data volume handled needed for device is managed, to guarantee normally show under high frame frequency and complex scene.
It should be noted that wearing in display equipment provided in an embodiment of the present invention, this wears display equipment to posture
Information carries out real-time monitoring, can there is multiple posture informations within the time of a frame image rendering, and first in above-described embodiment
Worn according to posture information display equipment real-time attitude prediction the corresponding posture information when showing the first image, second
The corresponding posture information when showing the second image of the implementation attitude prediction of display equipment is worn according to posture information.
Wherein, it is worn in display equipment provided in an embodiment of the present invention, primary processor is relative to wearing display equipment
It is independently arranged, being independently arranged herein refers to being independently arranged functionally, and the physical location of specific primary processor can basis
Actual use situation is selected, such as can be placed in the chip for wearing display device, microprocessor, be can also be and is set
It sets in the terminal for wearing display device exterior, is not specifically limited herein.
Optionally, it is worn in display equipment provided in an embodiment of the present invention, as shown in Figure 1, this wears display equipment also
It include: memory module 14；
What the data and image processing module 12 of first image of the memory module 14 for storing primary processor offer provided
The data of second image.
Specifically, it is worn in display equipment provided in an embodiment of the present invention, is stored with primary processor in the memory module
The data of the first image provided, and the data for the second image that display equipment has rendered are worn, when being shown, according to pre-
If timing by store the second image of mould data show, loss of data can be led to avoid the real-time Transmission of factor evidence
Problem.Wherein, which may include: memory, hard disk, floppy disk and storage chip etc., and certainly, which may be used also
Think other it is any can be applied to this and wear display equipment, and there is store function device, be not specifically limited herein.
Optionally, it is worn in display equipment provided in an embodiment of the present invention, image processing module is specifically used for:
The data of the first image are extracted from memory module；
Confirm attitudes vibration data of second posture information relative to the first posture information, wherein attitudes vibration data packet
It includes: at least one of course angle variation, pitch angle variation and displacement in all directions；
It is handled according to data of the attitudes vibration data to the first image, obtains the data of the second image.
Wherein, attitudes vibration data be not limited only to course angle variation, pitch angle variation and the displacement in all directions this
Several parameters can also include other any parameters that can determine attitude data, be not specifically limited herein.
Specifically, it is worn in display equipment provided in an embodiment of the present invention, image processing module can be from memory module
Extract the data of the first image, and according to the second posture information relative to the first posture information attitudes vibration data to the first figure
The data of picture are handled, to obtain the data of the second image, specific treatment process is as shown in Fig. 2, wear display equipment
Posture such as face, pitching, flat turn, tiltedly turn, swing, scene corresponding content can be varied.Such as wear display equipment
Holding is faced, and scene remains unchanged；It wears display equipment to look up, then sight moves up, to should be seen that than original field on the upper side
Scape；It wears display equipment level to turn left, then sight is moved to the left, to should be seen that than original scene to the left；Wear display equipment
It moves forward, to the scene that should be seen that than amplifying originally, etc..
Optionally, it is provided in an embodiment of the present invention wear display equipment in, image processing module also particularly useful for:
According to attitudes vibration data to the first image in the enterprising line displacement of corresponding direction, rotation and/or scaling processing；
The data of the first image after offset, rotation and/or scaling processing are cut beyond the part of predeterminable area
Processing, and data supplement is carried out to the image absent region in predeterminable area.
Specifically, it is worn in display equipment provided in an embodiment of the present invention, as shown in Fig. 2, the first image when facing
Be placed exactly in predeterminable area, the first image is deviated, rotate and/or scaling processing after, (the black surround in predeterminable area
Region) there is image absent region and the part beyond predeterminable area, cutting will do it for the part beyond predeterminable area
(removing the corresponding data in the part), the data that will do it image to image absent region are supplemented.Wherein, data supplement is divided into
Two ways: one kind is that (the unrecognized absent region of human eye) will can be simply somebody's turn to do when the image absent region is smaller
The data in absent region are set as black pixel out, can simplify the process of data processing in this way, reduce data processing amount；It is another
It, can be according to the missing area kind for when the image absent region is larger (size that human eye can obviously identify absent region)
The data of the adjacent image boundary in domain carry out data supplement to lack part, such as are replicated adjacent boundary data to mend
The data of lack part are filled, or data supplement is carried out to lack part after handling the data of adjacent boundary.
Specifically, it is provided in an embodiment of the present invention wear display equipment in, with it is shown in Fig. 2 wear display equipment by
For facing the process for becoming looking up, the content that subsequent time is seen, for the scene more on the upper side than last moment.That is subsequent time
Scene content is moving down for last moment content, correspondingly, cutting after image is mobile to bottom data, to top data
It is supplemented, wherein dark squares representative reference map (i.e. the data of the first image).It is right to wear display equipment posture institute for others
The subsequent time content answered, all does corresponding image procossing for last moment content, such as: it wears display equipment level and turns right, field
Scape moves to left processing, and left image is cut out, and right data is supplemented；It wears display equipment to turn to bottom right, corresponding scene is done
Lower-left rotation processing is cut beyond corner data, and missing corner data are supplemented；It is right when wearing display equipment advance
Scene is answered to do enhanced processing, four weekly datas are cut；When wearing display equipment retrogressing, corresponding scene does diminution processing, surrounding
Data are supplemented.
It should be noted that being worn in display equipment provided in an embodiment of the present invention, when because wearing display equipment unit
Between (such as 120Hz corresponding time) moving distance or angle very little, the variation of corresponding scene is simultaneously little.After such as there is image change
Data cases are required supplementation with, supplementary data is mostly circumferential images, and surrounding is non-master field of regard, and mostly because lens generate larger shape
Become, so supplementary data is not easy to make one to generate uncomfortable perception, supplementary data such as can be answered ambient data with simple process
System, or processing is carried out to ambient data and obtains supplementary data.
Specifically, it is worn in display equipment provided in an embodiment of the present invention, to set shown in Fig. 3 and Fig. 4 to wearing display
The calculating of the standby offset for being translated or being generated when being rotated is illustrated:
Taking what is shown in fig. 3 as an example, measure the upward view angle α for wearing display equipment by sensor, d be preset design value (i.e.
For known quantity), so that sight movement value L is calculated according to the value of upward view angle α and d, according to sight movement value L to the first image
Data are translated.
It for shown in Fig. 4, is measured by sensor and wears display equipment Forward distance C and view angle theta, d is preset sets
Evaluation (as known quantity), needed for being calculated according to the size of the corresponding figure of the data of above-mentioned data and the first image
Interleave image size, can find out image amplification ratio, then will exceed part and cut out.
It should be noted that be the process that attitudes vibration data are calculated by taking the attitudes vibration of part as an example above,
The change procedure of his posture and the principle of above-described embodiment are identical, and this will not be detailed here.
Optionally, it is worn in display equipment provided in an embodiment of the present invention, as shown in Figure 1, further includes: the anti-module that distorts
15；
Anti- distortion module 15 is used to carrying out the data of the first image and the data of the second image into anti-distortion processing, and will place
Data after reason are supplied to display module 13.
Specifically, it is worn in display equipment provided in an embodiment of the present invention, partially wears display equipment and be provided with lens
Structure can generate distortion to display image, need to be arranged the anti-module that distorts to the first image to correct generated distortion
Data and the data of the second image carry out anti-distortion processing；If wearing display equipment certainly and being not provided with makes image generate distortion
Structure, then the data of image to be displayed are directly supplied to display module and shown by anti-distortion module that no setting is required.
Optionally, it is worn in display equipment provided in an embodiment of the present invention, posture detecting module includes: inertia measurement list
One of member, optical sensor, positioning unit and camera distance measuring unit or combination.It certainly can also include other for detecting appearance
The unit or component of state, are not specifically limited herein.
Based on the same inventive concept, as shown in figure 5, the embodiment of the invention also provides a kind of drivings for wearing display equipment
Method, comprising:
S501, posture detecting module obtain the posture information for wearing display equipment in real time；
S502, image processing module obtain the data of the first image, and the posture information provided according to posture detecting module is true
Fixed corresponding first posture information of first image and corresponding second posture information of the second image, and according to the number of the first image
The data of the second image are determined according to, the first posture information and the second posture information；Wherein, the data of the first image are by primary processor
It provides, the second image is the interleave image rendered according to the first image；
S503, display module successively show the first image and the second image.
Optionally, in the driving method provided in an embodiment of the present invention for wearing display equipment, image processing module is obtained
The data of first image, according to posture detecting module provide posture information determine corresponding first posture information of the first image and
Corresponding second posture information of second image, and it is true according to the data of the first image, the first posture information and the second posture information
The data of fixed second image, specifically include:
The data of the first image are extracted from memory module；
Confirm attitudes vibration data of second posture information relative to the first posture information, wherein attitudes vibration data packet
It includes: at least one of course angle variation, pitch angle variation and displacement in all directions；
It is handled according to data of the attitudes vibration data to the first image, obtains the data of the second image.
Wherein, the driving principle and specific embodiment of the driving method for wearing display equipment are worn with above-described embodiment
Show that the principle of equipment is identical with embodiment, therefore, which can be found in above-described embodiment
The specific embodiment for wearing display equipment is implemented, and details are not described herein.
Based on the same inventive concept, as shown in fig. 6, the embodiment of the invention also provides a kind of virtual reality display system,
Display equipment 1 is worn such as the offer of above-mentioned any embodiment including primary processor 2, and with what primary processor 2 communicated to connect；
Display equipment 1 is worn for obtaining the posture information for wearing display equipment in real time, and by the first image corresponding the
One posture information is supplied to primary processor 2；
Primary processor 2, the first posture information for providing according to display equipment 1 is worn, renders the first image,
And the data of the first image after rendering are supplied to and wear display equipment 1.
Specifically, in virtual reality display system provided in an embodiment of the present invention, the primary processor according to wear display
Equipment provide the first posture information the first image is rendered, the data of the first image after rendering are supplied to wear it is aobvious
Show equipment, by wear display equipment the second image (interleave image) is rendered, and primary processor not to interleave image into
Row rendering, processing data volume needed for reducing primary processor decrease primary processor and wear the number between display equipment
According to interaction, the loss of frame data is avoided to cause display abnormal.
Wherein, the working principle and specific embodiment of display equipment are worn, reference can be made to above-mentioned display equipment of wearing provides
Embodiment, details are not described herein.
Optionally, in virtual reality display system provided in an embodiment of the present invention, primary processor and display equipment is worn
By data line or wirelessly carry out data transmission.
Optionally, in virtual reality display system provided in an embodiment of the present invention, primary processor include: mobile terminal,
PC terminal or cloud processor.
Based on the same inventive concept, as shown in fig. 7, the embodiment of the invention also provides a kind of virtual reality display systems
Driving method, comprising:
S701, posture detecting module obtain the posture information for wearing display equipment in real time；
The first posture information that S702, primary processor are provided according to posture detecting module renders the data of the first image, will
The data of the first image after rendering are supplied to memory module and image processing module；
S703, image processing module obtain the data of the first image, and the posture information provided according to posture detecting module is true
Fixed corresponding first posture information of first image and corresponding second posture information of the second image, and according to the number of the first image
The data of the second image are determined according to, the first posture information and the second posture information；Wherein, the data of the first image are by primary processor
It provides, the second image is the interleave image rendered according to the first image；
S704, display module successively show the first image and the second image.
Wherein, the driving principle and specific embodiment and above-described embodiment of the driving method of the virtual reality display system
The principle of virtual reality display system is identical with embodiment, and therefore, the driving method of the virtual reality display system can be found in
The specific embodiment of virtual reality display system is implemented in above-described embodiment, and details are not described herein.
One kind provided in an embodiment of the present invention wears display equipment and its driving method, virtual reality display system and its drive
Dynamic method, it includes: posture detecting module, image processing module and display module that this, which wears display equipment,；The posture detects mould
Block, for obtaining the posture information for wearing display equipment in real time；Described image processing module, for obtaining the first image
Data determine corresponding first posture information of the first image according to the posture information that the posture detecting module provides
The second posture information corresponding with the second image, and according to the data of the first image, first posture information and described
Second posture information determines the data of second image；Wherein, the data of the first image are provided by the primary processor,
Second image is the interleave image rendered according to the first image；The display module, for successively showing
Show the first image and second image.It can be seen from the above, wearing display equipment can be provided according to primary processor the
The data of one image, the first posture information and the second posture information determine the data of the second image, i.e., by wearing display equipment
The rendering of interleave image is carried out, to reduce the data volume handled needed for primary processor, to guarantee in high frame frequency and complicated field
It can normally be shown under scape.
Obviously, various changes and modifications can be made to the invention without departing from essence of the invention by those skilled in the art
Mind and range.In this way, if these modifications and changes of the present invention belongs to the range of the claims in the present invention and its equivalent technologies
Within, then the present invention is also intended to include these modifications and variations.
Claims (12)
1. one kind wears display equipment characterized by comprising posture detecting module, image processing module and display module；
The posture detecting module, for obtaining the posture information for wearing display equipment in real time；
Described image processing module, for obtaining the data of the first image, according to the appearance of posture detecting module offer
State information determines corresponding first posture information of the first image and corresponding second posture information of the second image, and according to institute
Data, first posture information and second posture information for stating the first image determine the data of second image；Its
In, the data of the first image are provided by the primary processor, and second image is to carry out wash with watercolours according to the first image
Contaminate obtained interleave image；
The display module, for successively showing the first image and second image.
2. wearing display equipment as described in claim 1, which is characterized in that further include: memory module；
The memory module is used to store the data and described image processing mould for the first image that the primary processor provides
The data for second image that block provides.
3. wearing display equipment as claimed in claim 2, which is characterized in that described image processing module is specifically used for:
The data of the first image are extracted from the memory module；
Confirm attitudes vibration data of second posture information relative to first posture information, wherein the posture becomes
Changing data includes at least one of course angle variation, pitch angle variation and displacement in all directions；
The data of the first image are handled according to the attitudes vibration data, obtain the data of second image.
4. wearing display equipment as claimed in claim 3, which is characterized in that described image processing module also particularly useful for:
According to the attitudes vibration data to the first image in the enterprising line displacement of corresponding direction, rotation and/or scaling processing；
Cutting processing is carried out beyond the part of predeterminable area to the data of the first image after offset, rotation and/or scaling processing,
And data supplement is carried out to the image absent region in the predeterminable area.
5. according to any one of claims 1-4 wear display equipment, which is characterized in that further include: the anti-module that distorts；
The anti-distortion module is used to the data of the first image and the data of second image carrying out anti-distortion processing,
And data are supplied to the display module by treated.
6. according to any one of claims 1-4 wear display equipment, which is characterized in that the posture detecting module includes:
One of Inertial Measurement Unit, optical sensor, positioning unit and camera distance measuring unit or combination.
7. a kind of driving method as claimed in any one of claims 1 to 6 for wearing display equipment characterized by comprising
The posture detecting module wears the posture information for showing equipment described in obtaining in real time；
Described image processing module obtains the data of the first image, the posture information provided according to the posture detecting module
Determine corresponding first posture information of the first image and corresponding second posture information of the second image, and according to described first
The data of image, first posture information and second posture information determine the data of second image；Wherein, described
The data of first image are provided by the primary processor, and second image is rendered to obtain according to the first image
Interleave image；
The display module successively shows the first image and second image.
8. wearing the driving method of display equipment as claimed in claim 7, which is characterized in that described image processing module obtains
The data of first image determine the first image corresponding the according to the posture information that the posture detecting module provides
One posture information and corresponding second posture information of the second image, and according to the data of the first image, first posture
Information and second posture information determine the data of second image, specifically include:
The data of the first image are extracted from the memory module；
Confirm attitudes vibration data of second posture information relative to first posture information, wherein the posture becomes
Changing data includes: at least one of course angle variation, pitch angle variation and displacement in all directions；
The data of the first image are handled according to the attitudes vibration data, obtain the data of second image.
9. a kind of virtual reality display system, which is characterized in that communicated to connect including primary processor, and with the primary processor
As claimed in any one of claims 1 to 6 wear display equipment；
The display equipment of wearing is for wearing the posture information of display equipment described in obtaining in real time, and by the first image pair
First posture information answered is supplied to the primary processor；
The primary processor, first posture information provided for wearing display equipment according to, to first figure
As being rendered, and the data of the first image after rendering are supplied to and described wear display equipment.
10. virtual reality display system as claimed in claim 9, which is characterized in that the primary processor with it is described wear it is aobvious
Show equipment by data line or wirelessly carries out data transmission.
11. virtual reality display system as claimed in claim 9, which is characterized in that the primary processor includes: mobile whole
End, PC terminal or cloud processor.
12. a kind of driving method of such as described in any item virtual reality display systems of claim 9-11, which is characterized in that packet
It includes:
The posture detecting module wears the posture information for showing equipment described in obtaining in real time；
First posture information that the primary processor is provided according to the posture detecting module, renders the first image
The data of the first image after rendering are supplied to the memory module and described image processing module by data；
Described image processing module obtains the data of the first image, the posture provided according to the posture detecting module
Information determines corresponding first posture information of the first image and corresponding second posture information of the second image, and according to described
The data of first image, first posture information and second posture information determine the data of second image；Wherein,
The data of the first image are provided by the primary processor, and second image is render according to the first image
The interleave image arrived；
The display module successively shows the first image and described second image.
Priority Applications (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910002874.3A CN109725730B (en) | 2019-01-02 | 2019-01-02 | Head-mounted display device and driving method thereof, display system and driving method thereof |
| US16/756,597 US11275248B2 (en) | 2019-01-02 | 2019-11-28 | Head mounted display apparatus, virtual reality display system and driving method thereof |
| PCT/CN2019/121574 WO2020140657A1 (en) | 2019-01-02 | 2019-11-28 | Head mounted display apparatus, virtual reality display system and driving method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910002874.3A CN109725730B (en) | 2019-01-02 | 2019-01-02 | Head-mounted display device and driving method thereof, display system and driving method thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109725730A true CN109725730A (en) | 2019-05-07 |
| CN109725730B CN109725730B (en) | 2023-05-26 |
Family
ID=66298628
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910002874.3A Active CN109725730B (en) | 2019-01-02 | 2019-01-02 | Head-mounted display device and driving method thereof, display system and driving method thereof |
Country Status (3)
| Country | Link |
|---|---|
| US (1) | US11275248B2 (en) |
| CN (1) | CN109725730B (en) |
| WO (1) | WO2020140657A1 (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110427149A (en) * | 2019-07-31 | 2019-11-08 | 维沃移动通信有限公司 | The operating method and terminal of terminal |
| CN110876052A (en) * | 2019-09-03 | 2020-03-10 | 北京爱博同心医学科技有限公司 | Augmented reality image processing method and device and augmented reality image display equipment |
| WO2020140657A1 (en) * | 2019-01-02 | 2020-07-09 | Boe Technology Group Co., Ltd. | Head mounted display apparatus, virtual reality display system and driving method thereof |
| TWI836631B (en) * | 2022-08-10 | 2024-03-21 | 大陸商立訊精密科技(南京)有限公司 | Reminding method of head-mounted device and head-mounted device |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US12014030B2 (en) | 2021-08-18 | 2024-06-18 | Bank Of America Corporation | System for predictive virtual scenario presentation |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106998409A (en) * | 2017-03-21 | 2017-08-01 | 华为技术有限公司 | A kind of image processing method, head-mounted display and rendering apparatus |
| CN107680047A (en) * | 2017-09-05 | 2018-02-09 | 北京小鸟看看科技有限公司 | A kind of virtual reality scenario rendering intent, image processor and wear display device |
| CN108983968A (en) * | 2018-06-22 | 2018-12-11 | 湖南商学院 | A kind of image big data intersection control routine and method based on virtual reality |
| CN109375764A (en) * | 2018-08-28 | 2019-02-22 | 北京凌宇智控科技有限公司 | A kind of head-mounted display, cloud server, VR system and data processing method |
Family Cites Families (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR101589188B1 (en) * | 2008-11-20 | 2016-01-28 | 삼성디스플레이 주식회사 | Display device |
| US9479682B2 (en) * | 2011-05-18 | 2016-10-25 | Sharp Kabushiki Kaisha | Video signal processing device and display apparatus |
| KR101964861B1 (en) | 2012-06-29 | 2019-04-02 | 삼성전자주식회사 | Cameara apparatus and method for tracking object of the camera apparatus |
| US10228562B2 (en) * | 2014-02-21 | 2019-03-12 | Sony Interactive Entertainment Inc. | Realtime lens aberration correction from eye tracking |
| US9984505B2 (en) * | 2014-09-30 | 2018-05-29 | Sony Interactive Entertainment Inc. | Display of text information on a head-mounted display |
| US9940541B2 (en) * | 2015-07-15 | 2018-04-10 | Fyusion, Inc. | Artificially rendering images using interpolation of tracked control points |
| US9744449B2 (en) * | 2014-12-22 | 2017-08-29 | Sony Interactive Entertainment Inc. | Peripheral devices having dynamic weight distribution to convey sense of weight in HMD environments |
| US10482670B2 (en) | 2014-12-30 | 2019-11-19 | Qingdao Goertek Technology Co., Ltd. | Method for reproducing object in 3D scene and virtual reality head-mounted device |
| US10775878B2 (en) * | 2015-04-10 | 2020-09-15 | Sony Interactive Entertainment Inc. | Control of personal space content presented via head mounted display |
| JP6439935B2 (en) * | 2015-05-07 | 2018-12-19 | パナソニックＩｐマネジメント株式会社 | Display control method, head-mounted display, and program |
| WO2017180990A1 (en) * | 2016-04-14 | 2017-10-19 | The Research Foundation For The State University Of New York | System and method for generating a progressive representation associated with surjectively mapped virtual and physical reality image data |
| US10681326B2 (en) * | 2016-05-19 | 2020-06-09 | AVAGO TECHNOLOGlES INTERNATIONAL SALES PTE. LIMITED | 360 degree video system with coordinate compression |
| JP2020106636A (en) * | 2018-12-27 | 2020-07-09 | セイコーエプソン株式会社 | Head mounted type display device |
| JP2020106635A (en) * | 2018-12-27 | 2020-07-09 | セイコーエプソン株式会社 | Head mounted type display device and display control method of head mounted type display device |
| CN109725730B (en) | 2019-01-02 | 2023-05-26 | 京东方科技集团股份有限公司 | Head-mounted display device and driving method thereof, display system and driving method thereof |
-
2019
- 2019-01-02 CN CN201910002874.3A patent/CN109725730B/en active Active
- 2019-11-28 WO PCT/CN2019/121574 patent/WO2020140657A1/en active Application Filing
- 2019-11-28 US US16/756,597 patent/US11275248B2/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106998409A (en) * | 2017-03-21 | 2017-08-01 | 华为技术有限公司 | A kind of image processing method, head-mounted display and rendering apparatus |
| CN107680047A (en) * | 2017-09-05 | 2018-02-09 | 北京小鸟看看科技有限公司 | A kind of virtual reality scenario rendering intent, image processor and wear display device |
| CN108983968A (en) * | 2018-06-22 | 2018-12-11 | 湖南商学院 | A kind of image big data intersection control routine and method based on virtual reality |
| CN109375764A (en) * | 2018-08-28 | 2019-02-22 | 北京凌宇智控科技有限公司 | A kind of head-mounted display, cloud server, VR system and data processing method |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2020140657A1 (en) * | 2019-01-02 | 2020-07-09 | Boe Technology Group Co., Ltd. | Head mounted display apparatus, virtual reality display system and driving method thereof |
| US11275248B2 (en) | 2019-01-02 | 2022-03-15 | Beijing Boe Optoelectronics Technology Co., Ltd. | Head mounted display apparatus, virtual reality display system and driving method thereof |
| CN110427149A (en) * | 2019-07-31 | 2019-11-08 | 维沃移动通信有限公司 | The operating method and terminal of terminal |
| CN110427149B (en) * | 2019-07-31 | 2021-10-19 | 维沃移动通信有限公司 | Terminal operation method and terminal |
| CN110876052A (en) * | 2019-09-03 | 2020-03-10 | 北京爱博同心医学科技有限公司 | Augmented reality image processing method and device and augmented reality image display equipment |
| TWI836631B (en) * | 2022-08-10 | 2024-03-21 | 大陸商立訊精密科技(南京)有限公司 | Reminding method of head-mounted device and head-mounted device |
Also Published As
| Publication number | Publication date |
|---|---|
| US11275248B2 (en) | 2022-03-15 |
| CN109725730B (en) | 2023-05-26 |
| US20210208398A1 (en) | 2021-07-08 |
| WO2020140657A1 (en) | 2020-07-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109725730A (en) | Wear display equipment and its driving method, display system and its driving method | |
| CN106502427B (en) | Virtual reality system and scene presenting method thereof | |
| US20170192236A1 (en) | Method of Adapting a Virtual Reality Helmet | |
| CN109743626B (en) | Image display method, image processing method and related equipment | |
| US20220076373A1 (en) | Foveated rendering using eye motion | |
| US10999412B2 (en) | Sharing mediated reality content | |
| CN106598252A (en) | Image display adjustment method and apparatus, storage medium and electronic device | |
| CN108762492A (en) | Method, apparatus, equipment and the storage medium of information processing are realized based on virtual scene | |
| US20180374258A1 (en) | Image generating method, device and computer executable non-volatile storage medium | |
| US20200241731A1 (en) | Virtual reality vr interface generation method and apparatus | |
| CN108090942B (en) | Three-dimensional rendering method and apparatus for eyes of user | |
| WO2021197370A1 (en) | Light field display method and system, storage medium and display panel | |
| CN106708270A (en) | Display method and apparatus for virtual reality device, and virtual reality device | |
| CN108076208B (en) | Display processing method and device and terminal | |
| WO2019104548A1 (en) | Image display method, smart glasses and storage medium | |
| WO2021238423A1 (en) | Image processing method, near-eye display device, computer device and storage medium | |
| JP2020532797A (en) | Generating a new frame with rendered and unrendered content from the previous perspective | |
| JP6250025B2 (en) | I / O device, I / O program, and I / O method | |
| CN103905808A (en) | Device and method used for three-dimension display and interaction. | |
| CN110728749B (en) | Virtual three-dimensional image display system and method | |
| TW201935188A (en) | Tracking system, tracking method for real-time rendering an image and non-transitory computer-readable medium | |
| US10296098B2 (en) | Input/output device, input/output program, and input/output method | |
| TW202205851A (en) | Light transmitting display system, image output method thereof and processing device thereof | |
| CN107203257A (en) | A kind of head pose compensation method and relevant device | |
| JP6563802B2 (en) | Head mounted display for transportation inspection and head mounted display program for transportation inspection |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |