CN106658170A - Method and device for reducing virtual reality latency - Google Patents
Method and device for reducing virtual reality latency Download PDFInfo
- Publication number
- CN106658170A CN106658170A CN201611187048.3A CN201611187048A CN106658170A CN 106658170 A CN106658170 A CN 106658170A CN 201611187048 A CN201611187048 A CN 201611187048A CN 106658170 A CN106658170 A CN 106658170A
- Authority
- CN
- China
- Prior art keywords
- image information
- unit
- sub
- resolution
- block
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/10—Geometric effects
- G06T15/20—Perspective computation
- G06T15/205—Image-based rendering
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440263—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
Abstract
The invention discloses a method and a device for reducing virtual reality latency. By adopting an asynchronous time warp technology, image information corresponding to a current frame is directly sent to a display unit and directly displayed when rendering of the current frame is completed, and image information corresponding to the rendered last frame is acquired and sent to the display unit when rendering of the current frame is not completed, so that the phenomenon of picture flutter appearing when rendering of the current frame is not completed is effectively eliminated. Besides, corresponding compensation frame information is determined according to first image information and second image information, and the compensation frame information is interpolated between two frames of images, so that the refresh rate of a screen is improved, pictures are clearer and smoother, and the user experience is effectively improved.
Description
Technical field
The present invention relates to computer technology security fields, more particularly to a kind of to reduce method and the dress that virtual reality postpones
Put.
Background technology
With the rise of virtual reality technology, the visual field that people are entered gradually of VR products.Currently, VR upsurges are in quick-fried
Early stage is sent out, it is to be solved that VR products have many technological deficiencies, such as dizzy sense is too strong, i.e., user uses a period of time VR product
After occur dizziness, nausea, even vomiting etc. symptom.Trace it to its cause, this is because vision brain is to the cognitive asynchronous of motion
Cause, basic reason is exactly the impact of " delay " that be subject in VR.
VR is whole set of system set, including sensor gathered data, transmission data, engine process, final display output,
Among these any one step is likely to form delay." delay " said herein refers in particular to " Motion-To-Photon
The Latency photon of motion (postpone) ", refer to from user movement start to respective picture be shown on screen the time spent in.
Latency issue is the ultimate challenge that VR is faced, and certainly this is also that VR integrally needs to tackle the major problem.Postpone not only to affect to use
Family is experienced, and What is more, can cause user because inadaptable the symptoms such as vomiting occur, thus finds out and produce time delay this problem
Root and solution are very crucial.
The content of the invention
For this reason, it may be necessary to the technological means that a kind of reduction virtual reality postpones is provided, it is long to solve the VR product delay times,
Cause poor user experience, the problem of dizziness, nausea, the symptom such as even easily occur.
For achieving the above object, the device that a kind of reduction virtual reality postpones is inventor provided, described device includes number
According to collecting unit, rendering unit, judging unit, processing unit, display unit, compensation frame determining unit, insertion unit；
The data acquisition unit is used to obtain image information；
The rendering unit is used to render the first image information；
The judging unit is completed for judging whether the first image information renders, if then processing unit is used for first
Image information sends to display unit and directly displays, and described first image information is current frame image information；Otherwise processing unit
For the second frame image information to be sent to display unit, second image information is that present frame previous frame and rendering is completed
Image information；
The compensation frame determining unit is used to determine corresponding compensation frame according to the first image information and the second image information
Information；
The insertion unit is used to compensation frame information is inserted between the first image information and the second image information；
The display unit is used to show the first image information or the second image information, and compensates frame letter for showing
Breath.
Further, described device also includes image segmentation unit and resolution ratio determining unit；
Described image cutting unit is used to be divided into some sub-blocks, the sub-block also to include central sub-block current frame image
Around sub-block, the surrounding of the centrally located sub-block of the surrounding sub-block；
The resolution ratio determining unit is used to determine first resolution and second resolution, and the second resolution is less than the
One resolution ratio；
The rendering unit be used to obtaining the first image information and carrying out render including：
Rendering unit is used to render the image information of central sub-block using first resolution, and differentiates using second
Rate is rendered to the image information of sub-block around.
Further, the halved row of 3 row 3 of the current frame image amount to 9 sub-blocks, then during the sub-block of the row of the 2nd row the 2nd is
Centre sub-block, other sub-blocks are surrounding sub-block.
Further, the first resolution determines that the second resolution is first according to the resolution ratio of display unit
The 50%～75% of resolution ratio.
Further, the display unit is OLED display screen.
Inventor additionally provides a kind of method that reduction virtual reality postpones, and methods described is applied to reduction virtual reality and prolongs
Slow device, described device includes data acquisition unit, rendering unit, judging unit, processing unit, display unit, compensation frame
Determining unit, insertion unit；The method comprising the steps of：
Data acquisition unit obtains image information；
Rendering unit is rendered to the first image information；
Judging unit judges whether the first image information renders to be completed, if then processing unit sends the first image information
Directly display to display unit, described first image information is current frame image information；Otherwise processing unit is by the second two field picture
Information is sent to display unit, and second image information is present frame previous frame and has rendered the image information for completing；
Compensation frame determining unit determines corresponding compensation frame information according to the first image information and the second image information；
Insertion unit will compensate frame information and insert between the first image information and the second image information；
Display unit shows successively the first image information, compensation frame image information and the second image information.
Further, described device also includes image segmentation unit and resolution ratio determining unit；Methods described includes：
Current frame image is divided into some sub-blocks, the sub-block also to include central sub-block and surrounding by image segmentation unit
Block, the surrounding of the centrally located sub-block of the surrounding sub-block；
Resolution ratio determining unit determines first resolution and second resolution, and the second resolution is differentiated less than first
Rate；
Rendering unit the first image information is carried out rendering including：
Rendering unit is rendered using first resolution to the image information of central sub-block, and second resolution is to surrounding
The image information of sub-block is rendered.
Further, the halved row of 3 row 3 of the current frame image amount to 9 sub-blocks, then during the sub-block of the row of the 2nd row the 2nd is
Centre sub-block, other sub-blocks are surrounding sub-block.
Further, the first resolution determines that the second resolution is first according to the resolution ratio of display unit
The 50%～75% of resolution ratio.
Further, the display unit is OLED display screen.
The method and apparatus that reduction virtual reality described in above-mentioned technical proposal postpones, using asynchronous time twisting technique,
Directly the corresponding image information of present frame is sent to into display unit when present frame is rendered and completed to directly display, present frame is not rendered
When completing, then obtain the corresponding image information of the previous frame for having rendered and be sent to display unit, effectively prevent due to the non-wash with watercolours of present frame
Dye completes the phenomenon for float occur.Additionally, the present invention is corresponding with the determination of the second image information always according to the first image information
Compensation frame information, and by compensation frame information be inserted between two field pictures to lift the refresh rate of screen, make picture more clear
Clear smoothness, effectively increases Consumer's Experience.
Description of the drawings
The schematic diagram of the device that Fig. 1 postpones for the reduction virtual reality that an embodiment of the present invention is related to；
The flow chart of the method that Fig. 2 postpones for the reduction virtual reality that an embodiment of the present invention is related to；
Fig. 3 is the flow chart of the method that the reduction virtual reality that another embodiment of the invention is related to postpones；
Fig. 4 is the flow chart of the method that the reduction virtual reality that another embodiment of the invention is related to postpones；
Description of reference numerals：
101st, data acquisition unit；
102nd, rendering unit；
103rd, judging unit；
104th, processing unit；
105th, display unit；
106th, frame determining unit is compensated；
107th, unit is inserted；
108th, image segmentation unit；
109th, resolution ratio determining unit.
Specific embodiment
To describe the technology contents of technical scheme, structural feature in detail, purpose and effect being realized, below in conjunction with concrete reality
Apply example and coordinate accompanying drawing to be explained in detail.
Fig. 1 is referred to, the schematic diagram of the device that the reduction virtual reality described in an embodiment of the present invention postpones.The dress
The time delay that can be used for shortening VR products is put, user's sensory experience is improved.Described device include data acquisition unit 101,
Rendering unit 102, judging unit 103, processing unit 104, display unit 105, compensation frame determining unit 106, insertion unit
107；
The data acquisition unit 101 is used to obtain image information；
The rendering unit 102 is used to render the first image information；
The judging unit 103 is completed for judging whether the first image information renders, if then processing unit 104 is used for
First image information is sent to display unit 105 and is directly displayed, described first image information is current frame image information；Otherwise
Processing unit 104 is used to the second frame image information is sent to display unit 105, and second image information is one on present frame
Frame and the image information for completing has been rendered；
The compensation frame determining unit 106 is used to determine corresponding compensation according to the first image information and the second image information
Frame information；
The insertion unit 107 is used to compensation frame information is inserted between the first image information and the second image information；
The display unit 105 is used to show the first image information or the second image information, and compensates frame for showing
Information.
When using the device for reducing virtual reality delay, first data acquisition unit 101 obtains image information.The number
It is the electronic component with image collecting function according to collecting unit, can is imageing sensor etc..The image information of collection is fortune
Moving picture information, including multiple image.
Then 102 pairs of the first image informations of rendering unit are rendered.Described first image information is current frame image letter
Breath, present frame is this two field picture for being processed, and belongs to a part for data acquisition unit acquired image information.
In VR products, need to render image information, and then the image information after rendering is sent to into display unit and shown
Show, so as to virtual reality scenario is presented to into user.
In the present embodiment, described device also includes image segmentation unit 108 and resolution ratio determining unit 109.It is described
Image segmentation unit 108 is used to be divided into some sub-blocks, the sub-block also to include central sub-block and surrounding current frame image
Block, the surrounding of the centrally located sub-block of the surrounding sub-block；The resolution ratio determining unit 109 is used to determine first resolution and the
Two resolution ratio, the second resolution is less than first resolution.The rendering unit 102 is used for the first image information of acquisition and goes forward side by side
Row render including：Rendering unit 102 is used to render the image information of central sub-block using first resolution, and adopts the
Two resolution ratio are rendered to the image information of sub-block around.The first resolution according to the resolution ratio of display unit determine,
The second resolution is the 50%～75% of first resolution.So, complete resolution ratio is still retained in central sub-block (aobvious
Show the resolution ratio of unit 100%) rendered in the case of, the effect that user is perceived can't occur significant change, while
Surrounding sub-block is rendered using low resolution, and the amount of images rendered required for can effectively reducing shortens time delay.
Further, the halved row of 3 row 3 of the current frame image amount to 9 sub-blocks, then during the sub-block of the row of the 2nd row the 2nd is
Centre sub-block, other sub-blocks are surrounding sub-block.Certainly, the determination of image is divided quantity and central sub-block can be according to actual need
Determine, for example in certain embodiments, it is also possible to present image is divided into into 4 rows 4 and arranges 16 sub-blocks of total, with middle 4
Used as central sub-block, remaining is surrounding sub-block to the area that sub-block is surrounded.
Then judging unit 103 judges whether the first image information renders and completes, if then processing unit 104 is by the first figure
Directly display as information is sent to display unit 105；Otherwise processing unit 104 sends the second frame image information to display unit
105.If current frame image information is rendered to fail to complete in time, it may appear that float phenomenon, to user bad experience is brought.
To solve this problem, the second image information will be called out to show again, while adding motion change, keep frame per second.It is described
Second image information is present frame previous frame and has rendered the image information for completing.
In order to lift image refresh rate, strengthen Consumer's Experience, in the present embodiment, the basis of compensation frame determining unit 106
First image information and the second image information determine corresponding compensation frame information；Then insert unit 107 to insert frame information is compensated
Enter between the first image information and the second image information；Display unit 105 shows the first image information or the second image information, with
And display compensation frame information.Refresh rate is exactly the screen number of times that each second, picture was refreshed, i.e., per second to show how many width images,
The unit of refreshing frequency is hertz (Hz), and in general, the higher the better for refreshing frequency, and image is more stable, the impact to eyes
Also it is less.The screen of existing main flow is 60Hz, and that is exactly 16.67ms per frame；If lifted to 90Hz, that is exactly per frame
11.11ms。
Hypothesis refresh rate is 60Hz, is not to represent just to have the delay of 16.67ms per frame, but says that screen picture is every
16.67ms just updates once, if present frame cannot complete to render in 16.67ms, such as present frame is rendered has spent 17ms, that
Next frame will be dragged to be submitted to.Delay at this time has reformed into 16.67*2=33.33ms (to be needed after 33.33ms
Can just show and refresh current frame image information).It is not to represent just to have prolonging for 11.11ms per frame if refresh rate is 90Hz
Late, but say screen picture per 11.11ms update once.As can be seen here, screen refresh rate is lifted and is greatly reduced to 90Hz
Delay time.
In order to lift screen refresh rate, the present invention adopts interleave frequency doubling technology dynamic mapping system, in two traditional frame figures
A frame movement compensating frame is inserted as between, common 60Hz refresh rates are promoted to into 90Hz.So, motion picture becomes apparent from stream
Freely, so as to the effect for reaching the ghost for removing previous frame image, improving dynamic definition, human eye is down in image hangover and is difficult to feel
The degree known.Specifically, movement compensating frame can adopt related algorithm to pass through upper the one of current frame image information and present frame
Frame image information is obtained by frame prediction.After the completion of compensation frame prediction, display unit shows successively the second image information, compensation
Frame information, the first image information.
In the present embodiment, the display unit is OLED display screen.Traditional display screen is usually LCD display,
LCD has smear in motion, and pixel is converted to another value from a value needs more than ten milliseconds, and during the switching of the pixel of OLED
Between below 1 millisecond.LCD display is substituted using OLED display screen, time delay can be effectively reduced.
In certain embodiments, rendering, showing to image information for convenience, described device also includes buffer unit.
Further, display unit shares same buffer unit with rendering unit, and GPU is directly rendered in buffer unit,
The picture for making renewal shows by 1 frame, quick to trigger.Set up respectively compared to display unit and rendering unit corresponding
The mode of buffer unit, this programme can be prevented effectively from the time that image information is transmitted between two buffer units, effectively contracting
Short delay.
And inventor additionally provides a kind of method that reduction virtual reality postpones, and refers to Fig. 2, methods described include with
Lower step：
Initially enter step S201 data acquisition unit and obtain image information.The data acquisition unit is to adopt with image
The electronic component of collection function, can be imageing sensor etc..The image information of collection is moving-picture information, including multiframe figure
Picture.
Then the first image information is rendered into step S202 rendering unit.Described first image information is current
Frame image information, present frame is this two field picture for being processed, and belongs to data acquisition unit acquired image information
A part.In VR products, need to render image information, and then it is single that the image information after rendering is sent to into display
Unit is shown, so as to virtual reality scenario is presented to into user.
Fig. 4 is referred to, in the present embodiment, described device also includes image segmentation unit and resolution ratio determining unit.
Rendering for image information specifically can be accomplished by：Step S401 image segmentation unit is initially entered by present frame
Into some sub-blocks, the sub-block also includes central sub-block and surrounding sub-block to image segmentation, the centrally located sub-block of the surrounding sub-block
Surrounding；Then determine first resolution and second resolution into step S402 resolution ratio determining unit, described second differentiates
Rate is less than first resolution；Then into step S403 rendering unit the image information of central sub-block is entered using first resolution
Row is rendered, and the image information of sub-block around is rendered using second resolution.The first resolution is single according to showing
The resolution ratio of unit determines that the second resolution is the 50%～75% of first resolution.So, still retain in central sub-block
In the case that complete resolution ratio (resolution ratio of display unit 100%) is rendered, the effect that user is perceived can't be sent out
Raw significant change, while surrounding sub-block is rendered using low resolution, the picture number rendered required for can effectively reducing
Amount, shortens time delay.To the second image information and rendering and the wash with watercolours to the first image information to other frame image informations
Dye is similar, and here is omitted.
Further, the halved row of 3 row 3 of the current frame image amount to 9 sub-blocks, then during the sub-block of the row of the 2nd row the 2nd is
Centre sub-block, other sub-blocks are surrounding sub-block.Certainly, the determination of image is divided quantity and central sub-block can be according to actual need
Determine, for example in certain embodiments, it is also possible to present image is divided into into 4 rows 4 and arranges 16 sub-blocks of total, with middle 4
Used as central sub-block, remaining is surrounding sub-block to the area that sub-block is surrounded.
Then judge whether the first image information renders into step S203 judging unit to complete, if then entering step
First image information is sent to display unit and is directly displayed by S204 processing units；Step S205 processing unit is otherwise entered by the
Two frame image informations are sent to display unit.If current frame image information is rendered to fail to complete in time, it may appear that float
Phenomenon, to user bad experience is brought.To solve this problem, the second image information will be called out to show again, while plus
Upper motion change, keeps frame per second.Second image information is present frame previous frame and has rendered the image information for completing.
In order to lift image refresh rate, strengthen Consumer's Experience, refer to Fig. 3, methods described is further comprising the steps of：First
Corresponding compensation frame information is determined according to the first image information and the second image information into step S301 compensation frame determining unit；
Then entering step S302 insertion unit will compensate between frame information the first image information of insertion and the second image information；And it is laggard
Enter step S303 display unit and show the first image information or the second image information, and show compensation frame information.Refresh rate is just
It is the screen number of times that each second, picture was refreshed, i.e., per second to show how many width images, the unit of refreshing frequency is hertz (Hz),
In general, the higher the better for refreshing frequency, and image is more stable, and the impact to eyes is also less.The screen of existing main flow is
60Hz, that is exactly 16.67ms per frame；If lifted to 90Hz, that is exactly 11.11ms per frame.
Hypothesis refresh rate is 60Hz, is not to represent just to have the delay of 16.67ms per frame, but says that screen picture is every
16.67ms just updates once, if present frame cannot complete to render in 16.67ms, such as present frame is rendered has spent 17ms, that
Next frame will be dragged to be submitted to.Delay at this time has reformed into 16.67*2=33.33ms (to be needed after 33.33ms
Can just show and refresh current frame image information).It is not to represent just to have prolonging for 11.11ms per frame if refresh rate is 90Hz
Late, but say screen picture per 11.11ms update once.As can be seen here, screen refresh rate is lifted and is greatly reduced to 90Hz
Delay time.
In order to lift screen refresh rate, the present invention adopts interleave frequency doubling technology dynamic mapping system, in two traditional frame figures
A frame movement compensating frame is inserted as between, common 60Hz refresh rates are promoted to into 90Hz.So, motion picture becomes apparent from stream
Freely, so as to the effect for reaching the ghost for removing previous frame image, improving dynamic definition, human eye is down in image hangover and is difficult to feel
The degree known.Specifically, movement compensating frame can adopt related algorithm to pass through upper the one of current frame image information and present frame
Frame image information is obtained by frame prediction.After the completion of compensation frame prediction, display unit shows successively the second image information, compensation
Frame information, the first image information.
In the present embodiment, the display unit is OLED display screen.Traditional display screen is usually LCD display,
LCD has smear in motion, and pixel is converted to another value from a value needs more than ten milliseconds, and during the switching of the pixel of OLED
Between below 1 millisecond.LCD display is substituted using OLED display screen, time delay can be effectively reduced.
In certain embodiments, rendering, showing to image information for convenience, described device also includes buffer unit.
Further, display unit shares same buffer unit with rendering unit, and GPU is directly rendered in buffer unit,
The picture for making renewal shows by 1 frame, quick to trigger.Set up respectively compared to display unit and rendering unit corresponding
The mode of buffer unit, this programme can be prevented effectively from the time that image information is transmitted between two buffer units, effectively contracting
Short delay.
The method and apparatus that reduction virtual reality described in above-mentioned technical proposal postpones, using asynchronous time twisting technique,
Directly the corresponding image information of present frame is sent to into display unit when present frame is rendered and completed to directly display, present frame is not rendered
When completing, then obtain the corresponding image information of the previous frame for having rendered and be sent to display unit, effectively prevent due to the non-wash with watercolours of present frame
Dye completes the phenomenon for float occur.Additionally, the present invention is corresponding with the determination of the second image information always according to the first image information
Compensation frame information, and by compensation frame information be inserted between two field pictures to lift the refresh rate of screen, make picture more clear
Clear smoothness, effectively increases Consumer's Experience.
It should be noted that herein, such as first and second or the like relational terms are used merely to a reality
Body or operation make a distinction with another entity or operation, and not necessarily require or imply these entities or deposit between operating
In any this actual relation or order.And, term " including ", "comprising" or its any other variant are intended to
Nonexcludability is included, so that a series of process, method, article or terminal device including key elements not only includes those
Key element, but also including other key elements being not expressly set out, or also include for this process, method, article or end
The intrinsic key element of end equipment.In the absence of more restrictions, limited by sentence " including ... " or " including ... "
Key element, it is not excluded that also there is other key element in the process including the key element, method, article or terminal device.This
Outward, herein, " it is more than ", " being less than ", " exceeding " etc. are interpreted as not including this number；" more than ", " below ", " within " etc. understand
It is to include this number.
Those skilled in the art are it should be appreciated that the various embodiments described above can be provided as method, device or computer program product
Product.These embodiments can be using complete hardware embodiment, complete software embodiment or with reference to the embodiment in terms of software and hardware
Form.All or part of step in the method that the various embodiments described above are related to can be instructed by program correlation hardware come
Complete, described program can be stored in the storage medium that computer equipment can read, for performing the various embodiments described above side
All or part of step described in method.The computer equipment, including but not limited to：Personal computer, server, general-purpose computations
Machine, special-purpose computer, the network equipment, embedded device, programmable device, intelligent mobile terminal, intelligent home device, Wearable
Smart machine, vehicle intelligent equipment etc.；Described storage medium, including but not limited to：RAM, ROM, magnetic disc, tape, CD, sudden strain of a muscle
Deposit, USB flash disk, portable hard drive, storage card, memory stick, webserver storage, network cloud storage etc..
The various embodiments described above are with reference to the method according to embodiment, equipment (system) and computer program
Flow chart and/or block diagram are describing.It should be understood that can by computer program instructions flowchart and/or block diagram in it is every
The combination of one flow process and/or square frame and flow chart and/or the flow process in block diagram and/or square frame.These computers can be provided
Programmed instruction is to the processor of computer equipment producing a machine so that by the finger of the computing device of computer equipment
Order is produced for realizing what is specified in one flow process of flow chart or one square frame of multiple flow processs and/or block diagram or multiple square frames
The device of function.
These computer program instructions may be alternatively stored in the computer that computer equipment can be guided to work in a specific way and set
In standby readable memory so that the instruction being stored in the computer equipment readable memory produces the manufacture for including command device
Product, the command device is realized in one flow process of flow chart or one square frame of multiple flow processs and/or block diagram or multiple square frame middle fingers
Fixed function.
These computer program instructions also can be loaded on computer equipment so that performed on a computing device a series of
Operating procedure to produce computer implemented process, so as to the instruction for performing on a computing device provide for realize in flow process
The step of function of specifying in one flow process of figure or one square frame of multiple flow processs and/or block diagram or multiple square frames.
Although being described to the various embodiments described above, those skilled in the art once know basic wound
The property made concept, then can make other change and modification to these embodiments, so embodiments of the invention are the foregoing is only,
Not thereby the scope of patent protection of the present invention, the equivalent structure that every utilization description of the invention and accompanying drawing content are made are limited
Or equivalent flow conversion, or other related technical fields are directly or indirectly used in, the patent of the present invention is included in the same manner
Within protection domain.
Claims (10)
1. it is a kind of to reduce the device that virtual reality postpones, it is characterised in that described device includes data acquisition unit, renders list
Unit, judging unit, processing unit, display unit, compensation frame determining unit, insertion unit；
The data acquisition unit is used to obtain image information；
The rendering unit is used to render the first image information；
The judging unit is completed for judging whether the first image information renders, if then processing unit is used for the first image
Information sends to display unit and directly displays, and described first image information is current frame image information；Otherwise processing unit is used for
Second frame image information is sent to display unit, second image information is present frame previous frame and has rendered the figure for completing
As information；
The compensation frame determining unit is used to determine corresponding compensation frame information according to the first image information and the second image information；
The insertion unit is used to compensation frame information is inserted between the first image information and the second image information；
The display unit is used to show the first image information or the second image information, and compensates frame information for showing.
2. it is as claimed in claim 1 to reduce the device that virtual reality postpones, it is characterised in that described device is also including image point
Cut unit and resolution ratio determining unit；
Described image cutting unit is used to be divided into some sub-blocks, the sub-block also to include central sub-block and week current frame image
Defensive wall block, the surrounding of the centrally located sub-block of the surrounding sub-block；
The resolution ratio determining unit is used to determine first resolution and second resolution that the second resolution to be less than first point
Resolution；
The rendering unit be used to obtaining the first image information and carrying out render including：
Rendering unit is used to render the image information of central sub-block using first resolution, and using second resolution pair
The image information of surrounding sub-block is rendered.
3. it is as claimed in claim 2 to reduce the device that virtual reality postpones, it is characterised in that the current frame image is halved
The row of 3 row 3 amount to 9 sub-blocks, then the sub-block of the row of the 2nd row the 2nd is central sub-block, and other sub-blocks are surrounding sub-block.
4. it is as claimed in claim 2 to reduce the device that virtual reality postpones, it is characterised in that the first resolution is according to aobvious
The resolution ratio for showing unit determines that the second resolution is the 50%～75% of first resolution.
5. it is as claimed in claim 1 to reduce the device that virtual reality postpones, it is characterised in that the display unit is aobvious for OLED
Display screen.
6. it is a kind of to reduce the method that virtual reality postpones, it is characterised in that methods described is applied to reduce what virtual reality postponed
Device, described device includes that data acquisition unit, rendering unit, judging unit, processing unit, display unit, compensation frame determine
Unit, insertion unit；The method comprising the steps of：
Data acquisition unit obtains image information；
Rendering unit is rendered to the first image information；
Judging unit judges whether the first image information renders to be completed, if then processing unit sends the first image information to aobvious
Show that unit is directly displayed, described first image information is current frame image information；Otherwise processing unit is by the second frame image information
Send to display unit, second image information is present frame previous frame and has rendered the image information for completing；
Compensation frame determining unit determines corresponding compensation frame information according to the first image information and the second image information；
Insertion unit will compensate frame information and insert between the first image information and the second image information；
Display unit shows the first image information, compensation frame image information and the second image information.
7. it is as claimed in claim 6 to reduce the method that virtual reality postpones, it is characterised in that described device is also including image point
Cut unit and resolution ratio determining unit；Methods described includes：
Current frame image is divided into some sub-blocks, the sub-block also to include central sub-block and surrounding sub-block by image segmentation unit,
The surrounding of the centrally located sub-block of the surrounding sub-block；
Resolution ratio determining unit determines first resolution and second resolution, and the second resolution is less than first resolution；
Rendering unit the first image information is carried out rendering including：
Rendering unit is rendered using first resolution to the image information of central sub-block, and second resolution is to sub-block around
Image information rendered.
8. it is as claimed in claim 7 to reduce the method that virtual reality postpones, it is characterised in that the current frame image is halved
The row of 3 row 3 amount to 9 sub-blocks, then the sub-block of the row of the 2nd row the 2nd is central sub-block, and other sub-blocks are surrounding sub-block.
9. it is as claimed in claim 7 to reduce the method that virtual reality postpones, it is characterised in that the first resolution is according to aobvious
The resolution ratio for showing unit determines that the second resolution is the 50%～75% of first resolution.
10. it is as claimed in claim 6 to reduce the method that virtual reality postpones, it is characterised in that the display unit is OLED
Display screen.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611187048.3A CN106658170A (en) | 2016-12-20 | 2016-12-20 | Method and device for reducing virtual reality latency |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611187048.3A CN106658170A (en) | 2016-12-20 | 2016-12-20 | Method and device for reducing virtual reality latency |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106658170A true CN106658170A (en) | 2017-05-10 |
Family
ID=58834226
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611187048.3A Pending CN106658170A (en) | 2016-12-20 | 2016-12-20 | Method and device for reducing virtual reality latency |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106658170A (en) |
Cited By (25)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108289175A (en) * | 2018-02-05 | 2018-07-17 | 黄淮学院 | A kind of low latency virtual reality display methods and display system |
| CN108632598A (en) * | 2018-05-25 | 2018-10-09 | 小派科技（上海）有限责任公司 | Reduce the method and device of VR equipment MTP delays |
| CN108921951A (en) * | 2018-07-02 | 2018-11-30 | 京东方科技集团股份有限公司 | Virtual reality image display methods and its device, virtual reality device |
| CN109167989A (en) * | 2018-10-19 | 2019-01-08 | 广州土圭垚信息科技有限公司 | A kind of VR method for processing video frequency and system |
| CN109545122A (en) * | 2019-01-02 | 2019-03-29 | 京东方科技集团股份有限公司 | The compensation method and compensation device, display system that VR is shown |
| CN109658326A (en) * | 2017-10-11 | 2019-04-19 | 深圳市中兴微电子技术有限公司 | A kind of image display method and apparatus, computer readable storage medium |
| GB2568476A (en) * | 2017-11-15 | 2019-05-22 | Advanced Risc Mach Ltd | Method of image production |
| CN109819232A (en) * | 2019-02-19 | 2019-05-28 | 京东方科技集团股份有限公司 | A kind of image processing method and image processing apparatus, display device |
| CN109874003A (en) * | 2019-02-28 | 2019-06-11 | 京东方科技集团股份有限公司 | VR display control method, VR display control unit and display device |
| CN110709803A (en) * | 2017-11-14 | 2020-01-17 | 深圳市柔宇科技有限公司 | Data processing method and device |
| CN110855972A (en) * | 2019-11-21 | 2020-02-28 | Oppo广东移动通信有限公司 | Image processing method, electronic device, and storage medium |
| CN111601077A (en) * | 2020-05-08 | 2020-08-28 | 杭州海康威视数字技术股份有限公司 | Data frame rendering method and device |
| US10779011B2 (en) * | 2017-07-31 | 2020-09-15 | Qualcomm Incorporated | Error concealment in virtual reality system |
| CN111679739A (en) * | 2020-06-04 | 2020-09-18 | 京东方科技集团股份有限公司 | Readable storage medium, virtual reality device and control method and control device thereof |
| CN111752520A (en) * | 2020-06-28 | 2020-10-09 | Oppo广东移动通信有限公司 | Image display method, image display device, electronic equipment and computer readable storage medium |
| CN111836117A (en) * | 2019-04-15 | 2020-10-27 | 深信服科技股份有限公司 | Method and device for sending supplementary frame data and related components |
| CN113132714A (en) * | 2019-12-31 | 2021-07-16 | 精工爱普生株式会社 | Circuit device, electronic apparatus, and moving object |
| CN113140173A (en) * | 2020-01-17 | 2021-07-20 | 华为技术有限公司 | Display driver, display control circuit system, electronic device, display driver control method, and display control circuit system |
| CN113596569A (en) * | 2021-07-22 | 2021-11-02 | 歌尔光学科技有限公司 | Image processing method, apparatus and computer-readable storage medium |
| CN113689815A (en) * | 2021-08-23 | 2021-11-23 | Tcl华星光电技术有限公司 | Drive circuit and display device |
| US11217004B2 (en) * | 2017-04-17 | 2022-01-04 | Intel Corporation | Graphics system with additional context |
| CN113946400A (en) * | 2021-10-29 | 2022-01-18 | 四川长虹教育科技有限公司 | Method for reducing Windows end writing delay on intelligent interactive large screen |
| CN113971633A (en) * | 2021-10-25 | 2022-01-25 | 深圳蓝普视讯科技有限公司 | Flip chip space pixel arrangement structure, pixel multiplexing method, system, device and storage medium |
| CN114125301A (en) * | 2021-11-29 | 2022-03-01 | 卡莱特云科技股份有限公司 | Virtual reality technology shooting delay processing method and device |
| WO2022227902A1 (en) * | 2021-04-27 | 2022-11-03 | Oppo广东移动通信有限公司 | Video processing method and apparatus, electronic device, and readable storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105530533A (en) * | 2014-10-21 | 2016-04-27 | 霍尼韦尔国际公司 | Low latency augmented reality display |
| CN105872698A (en) * | 2016-03-31 | 2016-08-17 | 宇龙计算机通信科技(深圳)有限公司 | Playing method, playing system and virtual reality terminal |
| CN105892683A (en) * | 2016-04-29 | 2016-08-24 | 上海乐相科技有限公司 | Display method and target equipment |
| CN105898338A (en) * | 2015-12-18 | 2016-08-24 | 乐视致新电子科技（天津）有限公司 | Panorama video play method and device |
-
2016
- 2016-12-20 CN CN201611187048.3A patent/CN106658170A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105530533A (en) * | 2014-10-21 | 2016-04-27 | 霍尼韦尔国际公司 | Low latency augmented reality display |
| CN105898338A (en) * | 2015-12-18 | 2016-08-24 | 乐视致新电子科技（天津）有限公司 | Panorama video play method and device |
| CN105872698A (en) * | 2016-03-31 | 2016-08-17 | 宇龙计算机通信科技(深圳)有限公司 | Playing method, playing system and virtual reality terminal |
| CN105892683A (en) * | 2016-04-29 | 2016-08-24 | 上海乐相科技有限公司 | Display method and target equipment |
Cited By (42)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11217004B2 (en) * | 2017-04-17 | 2022-01-04 | Intel Corporation | Graphics system with additional context |
| US10779011B2 (en) * | 2017-07-31 | 2020-09-15 | Qualcomm Incorporated | Error concealment in virtual reality system |
| CN109658326A (en) * | 2017-10-11 | 2019-04-19 | 深圳市中兴微电子技术有限公司 | A kind of image display method and apparatus, computer readable storage medium |
| CN110709803A (en) * | 2017-11-14 | 2020-01-17 | 深圳市柔宇科技有限公司 | Data processing method and device |
| US11062492B2 (en) | 2017-11-15 | 2021-07-13 | Arm Limited | Method of image production |
| GB2568476B (en) * | 2017-11-15 | 2020-02-19 | Advanced Risc Mach Ltd | Method of image production |
| GB2568476A (en) * | 2017-11-15 | 2019-05-22 | Advanced Risc Mach Ltd | Method of image production |
| CN108289175A (en) * | 2018-02-05 | 2018-07-17 | 黄淮学院 | A kind of low latency virtual reality display methods and display system |
| CN108632598A (en) * | 2018-05-25 | 2018-10-09 | 小派科技（上海）有限责任公司 | Reduce the method and device of VR equipment MTP delays |
| CN108921951B (en) * | 2018-07-02 | 2023-06-20 | 京东方科技集团股份有限公司 | Virtual reality image display method and device and virtual reality equipment |
| CN108921951A (en) * | 2018-07-02 | 2018-11-30 | 京东方科技集团股份有限公司 | Virtual reality image display methods and its device, virtual reality device |
| CN109167989B (en) * | 2018-10-19 | 2020-08-21 | 广州土圭垚信息科技有限公司 | VR video processing method and system |
| CN109167989A (en) * | 2018-10-19 | 2019-01-08 | 广州土圭垚信息科技有限公司 | A kind of VR method for processing video frequency and system |
| US11302280B2 (en) | 2019-01-02 | 2022-04-12 | Beijing Boe Optoelectronics Technology Co., Ltd. | Compensation method and compensation device for VR display and display device |
| CN109545122A (en) * | 2019-01-02 | 2019-03-29 | 京东方科技集团股份有限公司 | The compensation method and compensation device, display system that VR is shown |
| WO2020140808A1 (en) * | 2019-01-02 | 2020-07-09 | 京东方科技集团股份有限公司 | Vr display compensation method and compensation device, and display device |
| CN109819232B (en) * | 2019-02-19 | 2021-03-26 | 京东方科技集团股份有限公司 | Image processing method, image processing device and display device |
| CN109819232A (en) * | 2019-02-19 | 2019-05-28 | 京东方科技集团股份有限公司 | A kind of image processing method and image processing apparatus, display device |
| US11341655B2 (en) | 2019-02-19 | 2022-05-24 | Beijing Boe Optoelectronics Technology Co., Ltd. | Image processing method, image processing apparatus and display device |
| CN109874003A (en) * | 2019-02-28 | 2019-06-11 | 京东方科技集团股份有限公司 | VR display control method, VR display control unit and display device |
| CN109874003B (en) * | 2019-02-28 | 2021-09-14 | 京东方科技集团股份有限公司 | VR display control method, VR display control device and display device |
| CN111836117B (en) * | 2019-04-15 | 2022-08-09 | 深信服科技股份有限公司 | Method and device for sending supplementary frame data and related components |
| CN111836117A (en) * | 2019-04-15 | 2020-10-27 | 深信服科技股份有限公司 | Method and device for sending supplementary frame data and related components |
| CN110855972A (en) * | 2019-11-21 | 2020-02-28 | Oppo广东移动通信有限公司 | Image processing method, electronic device, and storage medium |
| CN110855972B (en) * | 2019-11-21 | 2021-07-27 | Oppo广东移动通信有限公司 | Image processing method, electronic device, and storage medium |
| CN113132714A (en) * | 2019-12-31 | 2021-07-16 | 精工爱普生株式会社 | Circuit device, electronic apparatus, and moving object |
| CN113132714B (en) * | 2019-12-31 | 2023-09-08 | 精工爱普生株式会社 | Circuit device, electronic apparatus, and moving object |
| US11935489B2 (en) | 2020-01-17 | 2024-03-19 | Huawei Technologies Co., Ltd. | Display driver and control method, display control circuit system, and electronic device |
| CN113140173A (en) * | 2020-01-17 | 2021-07-20 | 华为技术有限公司 | Display driver, display control circuit system, electronic device, display driver control method, and display control circuit system |
| CN111601077A (en) * | 2020-05-08 | 2020-08-28 | 杭州海康威视数字技术股份有限公司 | Data frame rendering method and device |
| CN111679739B (en) * | 2020-06-04 | 2024-04-09 | 京东方科技集团股份有限公司 | Readable storage medium, virtual reality device, control method and control device thereof |
| CN111679739A (en) * | 2020-06-04 | 2020-09-18 | 京东方科技集团股份有限公司 | Readable storage medium, virtual reality device and control method and control device thereof |
| CN111752520A (en) * | 2020-06-28 | 2020-10-09 | Oppo广东移动通信有限公司 | Image display method, image display device, electronic equipment and computer readable storage medium |
| WO2022227902A1 (en) * | 2021-04-27 | 2022-11-03 | Oppo广东移动通信有限公司 | Video processing method and apparatus, electronic device, and readable storage medium |
| CN113596569A (en) * | 2021-07-22 | 2021-11-02 | 歌尔光学科技有限公司 | Image processing method, apparatus and computer-readable storage medium |
| CN113689815A (en) * | 2021-08-23 | 2021-11-23 | Tcl华星光电技术有限公司 | Drive circuit and display device |
| CN113971633B (en) * | 2021-10-25 | 2022-12-06 | 深圳蓝普视讯科技有限公司 | Flip chip spatial pixel multiplexing method, system, device and storage medium |
| CN113971633A (en) * | 2021-10-25 | 2022-01-25 | 深圳蓝普视讯科技有限公司 | Flip chip space pixel arrangement structure, pixel multiplexing method, system, device and storage medium |
| CN113946400A (en) * | 2021-10-29 | 2022-01-18 | 四川长虹教育科技有限公司 | Method for reducing Windows end writing delay on intelligent interactive large screen |
| CN113946400B (en) * | 2021-10-29 | 2023-04-25 | 四川长虹教育科技有限公司 | Method for reducing Windows end writing delay on intelligent interaction large screen |
| CN114125301B (en) * | 2021-11-29 | 2023-09-19 | 卡莱特云科技股份有限公司 | Shooting delay processing method and device for virtual reality technology |
| CN114125301A (en) * | 2021-11-29 | 2022-03-01 | 卡莱特云科技股份有限公司 | Virtual reality technology shooting delay processing method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106658170A (en) | Method and device for reducing virtual reality latency | |
| CN106296566B (en) | A kind of virtual reality mobile terminal dynamic time frame compensation rendering system and method | |
| CN110460831B (en) | Display method, device, equipment and computer readable storage medium | |
| CN108921951A (en) | Virtual reality image display methods and its device, virtual reality device | |
| CN108876700B (en) | Method and circuit for improving VR display effect | |
| CN110704768B (en) | Webpage rendering method and device based on graphics processor | |
| CN111784609B (en) | Image dynamic range compression method, device and computer readable storage medium | |
| CN109887065B (en) | Image rendering method and device | |
| CN109920040A (en) | Show scene process method and apparatus, storage medium | |
| CN108282648A (en) | A kind of VR rendering intents, device, Wearable and readable storage medium storing program for executing | |
| CN112596843B (en) | Image processing method, device, electronic equipment and computer readable storage medium | |
| US20200265587A1 (en) | Image processing method, image processing apparatus and display device | |
| WO2022089046A1 (en) | Virtual reality display method and device, and storage medium | |
| CN111292236B (en) | Method and computing system for reducing aliasing artifacts in foveal gaze rendering | |
| CN110324601A (en) | Rendering method, computer product and display device | |
| WO2013054619A1 (en) | Image processing device, image processing method, and program | |
| CN112130790A (en) | Picture refreshing method and device and computer readable storage medium | |
| CN112102172A (en) | Image processing method, image processing apparatus, display system, and storage medium | |
| CN109845282A (en) | Image processing method and transmitting device, image display method and storage medium | |
| CN113839998B (en) | Image data transmission method, apparatus, device, storage medium, and program product | |
| US20140306958A1 (en) | Stereoscopic rendering system | |
| CN109933383A (en) | Adjust the method and apparatus of game APP operation frame per second | |
| CN106407009A (en) | Picture display method and device | |
| CN113315999A (en) | Virtual reality optimization method, device, equipment and storage medium | |
| CN113101158A (en) | VR-based binocular video fusion training method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170510 |
|
| RJ01 | Rejection of invention patent application after publication |