CN115601488A - Rendering image delay compensation method and device, display equipment and storage medium - Google Patents

Rendering image delay compensation method and device, display equipment and storage medium Download PDF

Info

Publication number
CN115601488A
CN115601488A CN202211338782.0A CN202211338782A CN115601488A CN 115601488 A CN115601488 A CN 115601488A CN 202211338782 A CN202211338782 A CN 202211338782A CN 115601488 A CN115601488 A CN 115601488A
Authority
CN
China
Prior art keywords
period
target
correction
correction time
delay compensation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202211338782.0A
Other languages
Chinese (zh)
Inventor
尹左水
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Goertek Techology Co Ltd
Original Assignee
Goertek Techology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Goertek Techology Co Ltd filed Critical Goertek Techology Co Ltd
Priority to CN202211338782.0A priority Critical patent/CN115601488A/en
Publication of CN115601488A publication Critical patent/CN115601488A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/005—General purpose rendering architectures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/80—Geometric correction
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30244—Camera pose

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Graphics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Image Generation (AREA)

Abstract

The invention belongs to the technical field of image display, and discloses a rendering image delay compensation method, a device, display equipment and a storage medium. The method comprises the following steps: when the period correction time of each target synchronization period is reached and the image rendering is completed, acquiring the pose information of the equipment; correcting rendering images rendered in each target synchronous period according to the equipment pose information, and recording correction duration information; determining a target delay compensation time length according to the correction time length information; and generating an image correction strategy according to the target delay compensation duration so as to reduce the delay time of image display. By the mode, the shortest delay compensation time is realized, so that the picture displayed to a user finally is delayed to be shorter and is closer to the position of the user, and the dynamic adjustment of the target delay compensation time length can be realized.

Description

Rendering image delay compensation method and device, display equipment and storage medium
Technical Field
The present invention relates to the field of image display technologies, and in particular, to a method and an apparatus for compensating a delay of a rendered image, a display device, and a storage medium.
Background
The current mainstream VR rendering is based on ATW technology to achieve the purpose of frame rate compensation and delayed rendering. The method comprises delay compensation and frame interpolation, wherein the delay compensation is shown in figure 1, the refreshing period of a screen is T, under normal conditions, a GPU can respectively render pictures of left and right eyes, the delay is 1T-2T from rendering to complete display of images on the screen, after a delay compensation mechanism is used, the pose information of equipment is obtained at the T0 moment before the images are displayed, the rendered content is subjected to position compensation, and therefore the delay is changed into T0+ T. However, the position compensation obtained by this method is a fixed time duration and cannot be dynamically adjusted based on the actual operating state and processing speed of the system.
The above is only for the purpose of assisting understanding of the technical aspects of the present invention, and does not represent an admission that the above is prior art.
Disclosure of Invention
The invention mainly aims to provide a rendering image delay compensation method, a rendering image delay compensation device, a display device and a storage medium, and aims to solve the technical problem that the motion compensation setting of an image in the prior art cannot be dynamically adjusted based on the actual running state and the processing speed of a system.
To achieve the above object, the present invention provides a method for compensating for delay in rendering an image, the method comprising the steps of:
when the period correction time of each target synchronization period is reached and the image rendering is completed, acquiring the pose information of the equipment;
correcting rendered images rendered by each target in a synchronous period according to the pose information of the equipment, and recording correction duration information;
determining a target delay compensation time length according to the correction time length information;
and generating an image correction strategy according to the target delay compensation duration so as to reduce the delay time of image display.
Optionally, the acquiring, when the cycle correction time of each target synchronization cycle is reached and the image rendering is completed, the apparatus pose information includes:
acquiring vertical synchronization period information and correction time information;
determining a period correction time corresponding to each vertical synchronization period according to the vertical synchronization period information and the correction time information;
and obtaining the equipment pose information corresponding to each target synchronization period according to the period correction time corresponding to each vertical synchronization period.
Optionally, the obtaining of the device pose information corresponding to each target synchronization period according to the period correction time corresponding to each vertical synchronization period includes:
determining a target synchronization period according to the vertical synchronization period information;
when the period correction time of each target synchronization period is reached, judging whether an image rendering process corresponding to each vertical synchronization period is finished or not;
when the image rendering process corresponding to each target synchronization period is completed, acquiring the period pose information of each target synchronization period;
and determining the pose information of the equipment according to the period pose information of each target synchronization period.
Optionally, the determining a target delay compensation duration according to the correction duration information includes:
acquiring a period sequencing sequence of each vertical synchronization period;
determining the number of initial reference periods and reference periods according to the period sorting sequence;
selecting a plurality of reference cycles from the cycle sequencing sequence according to the initial reference cycle and the number of the reference cycles;
determining a period correction time length corresponding to each target synchronization period according to the correction time length information;
taking the period correction duration corresponding to each reference period as a reference correction duration;
and determining a target delay compensation time length according to each reference correction time length.
Optionally, before acquiring the device pose information when the period correction time of each target synchronization period is reached and the image rendering is completed, the method further includes:
acquiring a preset initial correction time corresponding to an initial synchronization period in each target synchronization period;
and determining the period correction time of each target synchronization period according to the period sorting sequence and the preset initial correction time.
Optionally, the determining the period correction time of each target synchronization period according to the period sorting order and the preset initial correction time includes:
determining an initial period correction time interval according to the correction duration information and the preset initial correction time;
acquiring the period duration of each vertical synchronization period;
and determining the period correction time of each target synchronization period according to the initial period correction time interval, the period duration and a preset interval duration threshold.
Optionally, the determining the cycle correction time of each target synchronization cycle according to the cycle correction time interval, the cycle duration and the preset interval duration threshold includes:
determining a reference interval time interval according to the period time length and the preset interval time length threshold;
and sequentially determining the period correction time corresponding to each target synchronization period according to the reference interval time interval and the initial period correction time interval and the period sorting sequence.
In addition, to achieve the above object, the present invention further provides a rendering image delay compensation apparatus, including:
the pose acquisition module is used for acquiring equipment pose information when the period correction time of each target synchronization period is reached and the image rendering is completed;
the time length recording module is used for correcting the rendered image which is rendered in each target synchronous period according to the equipment pose information and recording the correction time length information;
the compensation determining module is used for determining a target delay compensation duration according to the correction duration information;
and the strategy generation module is used for generating an image correction strategy according to the target delay compensation duration so as to reduce the delay time of image display.
Further, to achieve the above object, the present invention also proposes a display apparatus comprising: a memory, a processor and a rendered image delay compensation program stored on the memory and executable on the processor, the rendered image delay compensation program configured to implement the steps of the rendered image delay compensation method as described above.
Furthermore, to achieve the above object, the present invention further provides a storage medium having a rendering image delay compensation program stored thereon, which when executed by a processor implements the steps of the rendering image delay compensation method as described above.
When the period correction time of each target synchronization period is reached and the image rendering is completed, acquiring the pose information of equipment; correcting the rendered image rendered in each target synchronous period according to the equipment pose information, and recording correction duration information; determining a target delay compensation duration according to the correction duration information; and generating an image correction strategy according to the target delay compensation duration so as to reduce the delay time of image display. By the method, the target delay compensation time length is accurately determined according to the correction time length information of the corrected and rendered images based on the multiple target synchronous periods, so that the target delay compensation time length is controlled to be corrected in all periods, and the image correction strategy generated by the target delay compensation time length can make the delay compensation time shortest, so that the picture delay displayed to a user finally is shorter, the picture is closer to the position of the user, and the dynamic adjustment of the target delay compensation time length can be realized.
Drawings
Fig. 1 is a schematic structural diagram of a display device in a hardware operating environment according to an embodiment of the present invention;
FIG. 2 is a flowchart illustrating a method for delay compensation of rendered images according to a first embodiment of the present invention;
FIG. 3 is a schematic diagram illustrating an ATW technique according to an embodiment of the method for delay compensation of rendered images of the present invention;
FIG. 4 is a schematic diagram illustrating a schematic diagram of an embodiment of a method for delay compensation of rendered images according to the present invention;
FIG. 5 is a flowchart illustrating a method for delay compensation of rendered images according to a second embodiment of the present invention;
FIG. 6 is a block diagram illustrating a first embodiment of a device for delay compensation of rendered images according to the present invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
Referring to fig. 1, fig. 1 is a schematic structural diagram of a display device in a hardware operating environment according to an embodiment of the present invention.
As shown in fig. 1, the display apparatus may include: a processor 1001, such as a Central Processing Unit (CPU), a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. The communication bus 1002 is used to implement connection communication among these components. The user interface 1003 may include a Display screen (Display), an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a Wireless interface (e.g., a Wireless-Fidelity (Wi-Fi) interface). The Memory 1005 may be a Random Access Memory (RAM) Memory, or a Non-Volatile Memory (NVM), such as a disk Memory. The memory 1005 may alternatively be a storage device separate from the processor 1001.
Those skilled in the art will appreciate that the configuration shown in fig. 1 does not constitute a limitation of the display device and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.
As shown in fig. 1, a memory 1005, which is a storage medium, may include therein an operating system, a network communication module, a user interface module, and a rendering image delay compensation program.
In the display device shown in fig. 1, the network interface 1004 is mainly used for data communication with a network server; the user interface 1003 is mainly used for data interaction with a user; the processor 1001 and the memory 1005 of the display device of the present invention may be provided in the display device, and the display device calls the rendering image delay compensation program stored in the memory 1005 through the processor 1001 and performs the rendering image delay compensation method provided by the embodiment of the present invention.
An embodiment of the present invention provides a method for compensating a delay of a rendered image, and referring to fig. 2, fig. 2 is a schematic flowchart of a first embodiment of the method for compensating a delay of a rendered image according to the present invention.
In this embodiment, the method for compensating for delay in rendering an image includes the following steps:
step S10: and when the period correction time of each target synchronization period is reached and the image rendering is finished, acquiring the pose information of the equipment.
It should be noted that an execution subject of this embodiment is a display device, and may also be a processor or a chip on the display device, or other devices that can implement this function, which is not limited in this embodiment. The display device may be VR glasses, any virtual reality device, or other display devices, which is not limited in this embodiment.
It should be understood that, as shown in fig. 3, the current image rendering and delay compensation method is based on ATW technology to achieve the purpose of frame rate compensation and delay rendering. The method comprises delay compensation and frame interpolation, wherein the delay compensation is shown in figure 1, the refreshing period of a screen is T, under normal conditions, a GPU can respectively render pictures of left and right eyes, the delay is 1T-2T from rendering to complete display of images on the screen, after a delay compensation mechanism is used, the pose information of equipment is obtained at the T0 moment before the images are displayed, the rendered content is subjected to position compensation, and therefore the delay is changed into T0+ T. The scheme of the embodiment accurately determines the target delay compensation duration based on the correction duration information of the corrected rendered images in a plurality of target synchronization periods, so that the target delay compensation duration control completes correction in all periods, and the image correction strategy generated by adopting the target delay compensation duration can make the delay compensation time shortest, so that the picture delay finally displayed to a user is shorter and closer to the position of the user, and the target delay compensation duration can be dynamically adjusted, so that the final delay duration can be dynamically changed and shorter.
In a specific implementation, the target synchronization period refers to a selected plurality of consecutive vertical synchronization periods in all of the vertical synchronization periods. The number of specific target synchronization cycles may be any positive integer greater than or equal to 1, which is not limited in this embodiment.
The period correction time is a time at which the position correction of the rendered image is started in each target synchronization period set or calculated in advance. During the process of rendering an image by the graphics processor, the position and posture of the user may change between the rendering start time and the rendering end time, so that the rendered image corresponds to the position of the user at the rendering start time, and the position of the user at the rendering end time changes, so that position correction is required to match the rendered image with the current position of the user.
It should be understood that the device pose information refers to the position and attitude information of the display device at the time of the cycle correction.
Further, in order to accurately acquire the device pose information, step S10 includes: acquiring vertical synchronization period information and correction time information; determining a period correction time corresponding to each vertical synchronization period according to the vertical synchronization period information and the correction time information; and obtaining the equipment pose information corresponding to each target synchronization period according to the period correction time corresponding to each vertical synchronization period.
In a specific implementation, the vertical synchronization period information refers to relevant information such as a corresponding time and a sequence of each frame period in a current display picture or a picture to be displayed, and specifically, a time period from each frame to a next frame picture is a vertical synchronization period.
The correction time information refers to a time at which correction of the rendered image is started corresponding to each vertical synchronization period calculated or stored in advance.
It should be understood that, determining the cycle correction time corresponding to each vertical synchronization cycle according to the vertical synchronization cycle information and the correction time information means: and determining the corresponding relation between each vertical synchronization period and each period correction time according to the vertical synchronization period information and the correction time information.
In specific implementation, obtaining the device pose information corresponding to each target synchronization period according to the period correction time corresponding to each vertical synchronization period means: and screening according to the period correction time corresponding to each vertical synchronization period to obtain the period correction time corresponding to the target synchronization period, and then acquiring the pose information of the equipment.
Through the method, the corresponding relation between each vertical synchronization period and the period correction time is determined based on the vertical synchronization information and the correction time information which are acquired in advance, so that the device pose information corresponding to each period correction time can be accurately acquired.
Further, in order to accurately obtain the device pose information, the method for obtaining the device pose information corresponding to each target synchronization period according to the period correction time corresponding to each vertical synchronization period includes: determining a target synchronization period according to the vertical synchronization period information; when the period correction time of each target synchronization period is reached, judging whether the image rendering process corresponding to each vertical synchronization period is finished or not; when the image rendering process corresponding to each target synchronization period is completed, acquiring the period pose information of each target synchronization period; and determining the pose information of the equipment according to the period pose information of each target synchronization period.
The target synchronization period is a preset number of consecutive vertical synchronization periods selected from the vertical synchronization periods as the target synchronization period. The preset number can be any positive integer. The target synchronization period may be a preset number of vertical synchronization periods starting at the current time, or may be a continuous preset number of vertical synchronization periods starting at any time point.
It should be understood that, when the cycle correction time of each target synchronization cycle is reached, determining whether the image rendering process corresponding to each vertical synchronization cycle is completed refers to: and recording a system clock, and when recognizing the period correction time reaching each target synchronization period, firstly judging whether the rendered image is processed by the GPU and is ready to be output.
In specific implementation, after it is judged that rendering of one frame of image corresponding to each target synchronization period is completed, the pose information of the device at the period correction time of each target synchronization period is acquired as period pose information, and the period pose information is summarized to obtain integrated device pose information.
It should be noted that, if the GPU rendering of the current frame is not completed at the cycle correction time of the current target synchronization cycle, the previous frame of rendered image is used for correction.
By the method, the target synchronization period is selected based on the vertical synchronization period, and the period pose information corresponding to the period correction time of each target synchronization period is acquired, so that the device pose information can be accurately acquired, and the delay time can be more accurately reduced.
Step S20: and correcting the rendered image rendered by each target in the synchronous period according to the pose information of the equipment, and recording correction time length information.
It should be noted that after the device pose information is obtained, position correction is performed to correct the position of the obtained rendering image, and after the position correction of the rendering image is completed, a time period from the start of the correction to the completion of the correction of each rendering image is recorded, that is, correction duration information.
Step S30: and determining the target delay compensation time length according to the correction time length information.
It should be understood that, after the correction duration information is determined, the maximum value of all the reference correction durations is selected as the target delay compensation duration according to the correction duration information.
Step S40: and generating an image correction strategy according to the target delay compensation duration so as to reduce the delay time of image display.
In specific implementation, after the target delay compensation duration is determined, an image correction strategy is generated according to the target delay compensation duration, so that the correction starting time of image correction starting of all the remaining vertical synchronization periods in the image display and rendering task is set to be T-M-V, wherein T is each vertical synchronization period, M is a preset interval duration threshold, and V is the target delay compensation duration. That is, the time when each period starts to correct the rendered image is set to be the position of the next vertical synchronization period starting time before the preset interval time threshold and the target delay compensation time, so that the final rendered image can be corrected, the difference between the final displayed rendered image and the actual position of the user is smaller, and the delay time is shorter. Fig. 4 is a schematic diagram of the scheme of this embodiment, where vsync is the vertical synchronization time. Delay time = image correction consumption time (target delay compensation time or correction time) v0+ minimum threshold M (time from vsync time); the periodic correction time is as follows: tn; the screen refresh cycle: and T.
In the embodiment, when the period correction time of each target synchronization period is reached and the image rendering is completed, the pose information of the equipment is acquired; correcting the rendered image rendered in each target synchronous period according to the equipment pose information, and recording correction duration information; determining a target delay compensation time length according to the correction time length information; and generating an image correction strategy according to the target delay compensation duration so as to reduce the delay time of image display. By the method, the target delay compensation time length is accurately determined according to the correction time length information of the corrected rendered image based on the target synchronization periods, so that the target delay compensation time length is controlled to finish correction in all periods, and the image correction strategy generated by the target delay compensation time length can make the delay compensation time shortest, so that the picture delay displayed to a user finally is shorter, the picture delay is closer to the position of the user, and the target delay compensation time length can be dynamically adjusted.
Referring to fig. 3, fig. 3 is a flowchart illustrating a rendering image delay compensation method according to a second embodiment of the present invention.
Based on the first embodiment, the method for compensating for delay of rendering image in this embodiment includes, in the step S30:
step S301: and acquiring the cycle sequencing sequence of each vertical synchronization cycle.
It should be noted that the cycle sequencing order refers to the sequence and time order of each vertical synchronization cycle.
Step S302: and determining the number of initial reference periods and reference periods according to the period sorting sequence.
It should be understood that, after the period sorting order is determined, the initial reference period and the reference period number are selected, where the reference period number is the preset number. The initial reference period is a predetermined designated vertical synchronization period, which may be any one of the vertical synchronization periods.
Step S303: and selecting a plurality of reference periods from the period sorting sequence according to the initial reference period and the number of the reference periods.
In a specific implementation, selecting a plurality of reference cycles from the cycle sorting order according to the starting reference cycle and the number of reference cycles means: and starting from the initial reference period, selecting the vertical synchronization periods with the reference period number according to the period sorting sequence as the reference period.
Step S304: and determining the period correction time length corresponding to each target synchronization period according to the correction time length information.
It should be noted that, after the correction duration information is determined, the time length of the correction rendering image corresponding to each target synchronization period is determined according to the correction duration information, that is, the period correction duration.
Step S305: and taking the cycle correction time length corresponding to each reference cycle as a reference correction time length.
It should be understood that, after the period correction duration of each target synchronization period is determined, the period correction duration corresponding to the reference period is selected as the reference city duration.
Step S306: and determining a target delay compensation time length according to each reference correction time length.
In specific implementation, after the reference correction duration is determined, the maximum value of all the reference correction durations is selected as the target delay compensation duration according to the reference correction duration.
Further, in order to accurately determine the cycle correction time of each target synchronization cycle, step S306 includes: acquiring a preset initial correction time corresponding to an initial synchronization period in each target synchronization period; and determining the period correction time of each target synchronization period according to the period sorting sequence and the preset initial correction time.
It should be noted that the start synchronization period refers to a first synchronization period in the target synchronization periods preset by the user according to the period sorting order. The preset initial correction time refers to the correction time corresponding to the initial synchronization period.
It should be understood that, determining the cycle correction time of each target synchronization cycle according to the cycle sequencing order and the preset starting correction time refers to: the method comprises the steps of firstly determining a preset initial correction time and an initial synchronization period, then calculating the period correction time of the target synchronization period of the next rank in a period sequencing sequence based on the initial synchronization period, and then calculating the period correction time of the target synchronization period of the next rank based on the period correction time of the target synchronization period of the previous rank by analogy.
By the method, the period correction time corresponding to each target synchronization period is determined based on the initial synchronization period and the preset initial correction time, so that the target delay compensation time can be calculated more accurately.
Further, in order to accurately determine the period correction time of each target synchronization period, the step of determining the period correction time of each target synchronization period according to the period sorting order and the preset initial correction time includes: determining an initial period correction time interval according to the correction duration information and the preset initial correction time; acquiring the period duration of each vertical synchronization period; and determining the period correction time of each target synchronization period according to the initial period correction time interval, the period duration and a preset interval duration threshold.
In one embodiment, taking FIG. 4 as an example, during the initial synchronization period T n Is T 0 The correction time interval of the initial period is T 0 +V 0 . Then, the preset period duration of each vertical synchronization period, i.e. T, is obtained 1 -T 0 And may be denoted as T. And finally, determining the period correction time of each target synchronization period according to the initial period correction time interval and the period duration and in combination with a preset interval duration threshold. The preset interval duration threshold is a preset time length, namely a buffer time period forcibly reserved before the next sync moment.
By the method, the period correction time of the next period is calculated based on the initial period correction time interval, and the period correction times of all target synchronization periods can be calculated by analogy.
Further, in order to accurately calculate the period correction time of each target synchronization period, the step of determining the period correction time of each target synchronization period according to the period correction time interval, the period duration and the preset interval duration threshold includes: determining a reference interval time interval according to the period time length and the preset interval time length threshold; and sequentially determining the period correction time corresponding to each target synchronization period according to the reference interval time interval and the initial period correction time interval and the period sorting sequence.
It should be noted that, in the reference interval time interval determined according to the period duration and the preset interval duration threshold, the reference interval time interval is set to be T-M.
It should be understood that, sequentially determining the cycle correction time corresponding to each target synchronization cycle according to the cycle sorting order according to the reference interval time interval and the starting cycle correction time interval refers to: calculating T 0 +V 0 Whether it is in the interval from T-M to T. If so, then T is used 0 Time T as pose acquisition n That is, the cycle correction time of the target synchronization cycle of the next order is set to T 0 Time of day (c). If T is 0 +V 0 <T-M, then T n ＝T 0 + X. If T is 0 +V 0 >T, then T n ＝T 0 + X. Wherein X is defined asUnit scale set first, i.e. when T 0 +V 0 When the time interval is not in the interval from T-M to T, T1 is set as T 0 + X, i.e. when T is in the last cis position n +V 0 When the current time is not within the interval from T-M to T, the next consequent T is added n+1 Is set to T n +X。
By the method, the starting time of the period correction time can be continuously updated in all the target synchronization periods, so that the finally obtained target delay is lower.
The embodiment obtains the cycle sequencing sequence of each vertical synchronization cycle; determining the number of initial reference periods and reference periods according to the period sorting sequence; selecting a plurality of reference cycles from the cycle sequencing sequence according to the initial reference cycle and the number of the reference cycles; determining a period correction time length corresponding to each target synchronization period according to the correction time length information; taking the period correction duration corresponding to each reference period as a reference correction duration; and determining a target delay compensation time length according to each reference correction time length. By the method, the plurality of reference periods are firstly determined based on the period sorting sequence of each vertical synchronization period, and then the target delay compensation time length is determined based on the reference correction time length corresponding to the reference period, so that the delay compensation time length is adjusted based on the correction speed and the consumed time of a plurality of continuous synchronization periods actually processed by the display equipment, the delay time can be adjusted according to the actual processing speed of the display equipment, and the delay time is reduced.
Furthermore, an embodiment of the present invention further provides a storage medium, where a rendering image delay compensation program is stored, and when executed by a processor, the rendering image delay compensation program implements the steps of the rendering image delay compensation method as described above.
Since the storage medium adopts all technical solutions of all the embodiments described above, at least all the beneficial effects brought by the technical solutions of the embodiments described above are achieved, and are not described in detail herein.
Referring to fig. 4, fig. 4 is a block diagram illustrating a first embodiment of a device for delay compensation of rendered images according to the present invention.
As shown in fig. 4, the apparatus for compensating for delay in rendering an image according to an embodiment of the present invention includes:
and the pose acquisition module 10 is configured to acquire the device pose information when the period correction time of each target synchronization period is reached and the image rendering is completed.
And the duration recording module 20 is configured to correct the rendered image rendered in each target synchronous period according to the device pose information, and record correction duration information.
And a compensation determining module 30, configured to determine a target delay compensation duration according to the correction duration information.
And the strategy generating module 40 is configured to generate an image rectification strategy according to the target delay compensation duration to reduce the delay time of image display.
In the embodiment, when the period correction time of each target synchronization period is reached and the image rendering is completed, the pose information of the equipment is acquired; correcting the rendered image rendered in each target synchronous period according to the equipment pose information, and recording correction duration information; determining a target delay compensation duration according to the correction duration information; and generating an image correction strategy according to the target delay compensation duration so as to reduce the delay time of image display. By the method, the target delay compensation time length is accurately determined according to the correction time length information of the corrected and rendered images based on the multiple target synchronous periods, so that the target delay compensation time length is controlled to be corrected in all periods, and the image correction strategy generated by the target delay compensation time length can make the delay compensation time shortest, so that the picture delay displayed to a user finally is shorter, the picture is closer to the position of the user, and the dynamic adjustment of the target delay compensation time length can be realized.
In an embodiment, the pose acquisition module 10 is further configured to acquire vertical synchronization period information and correction time information; determining a period correction time corresponding to each vertical synchronization period according to the vertical synchronization period information and the correction time information; and obtaining the equipment pose information corresponding to each target synchronization period according to the period correction time corresponding to each vertical synchronization period.
In an embodiment, the pose acquisition module 10 is further configured to determine a target synchronization period according to the vertical synchronization period information; when the period correction time of each target synchronization period is reached, judging whether an image rendering process corresponding to each vertical synchronization period is finished or not; when the image rendering process corresponding to each target synchronization period is completed, acquiring the period pose information of each target synchronization period; and determining the pose information of the equipment according to the period pose information of each target synchronization period.
In an embodiment, the compensation determining module 30 is further configured to obtain a cycle sequencing order of each vertical synchronization cycle; determining the number of initial reference periods and reference periods according to the period sorting sequence; selecting a plurality of reference periods from the period sorting sequence according to the starting reference period and the number of the reference periods; determining a period correction time length corresponding to each target synchronization period according to the correction time length information; taking the period correction duration corresponding to each reference period as a reference correction duration; and determining a target delay compensation time length according to each reference correction time length.
In an embodiment, the pose acquisition module 10 is further configured to acquire a preset initial correction time corresponding to an initial synchronization period in each target synchronization period; and determining the period correction time of each target synchronization period according to the period sequencing sequence and the preset initial correction time.
In an embodiment, the pose acquisition module 10 is further configured to determine an initial period correction time interval according to the correction duration information and the preset initial correction time; acquiring the period duration of each vertical synchronization period; and determining the period correction time of each target synchronization period according to the initial period correction time interval, the period duration and a preset interval duration threshold.
In an embodiment, the pose acquisition module 10 is further configured to determine a reference interval time interval according to the period duration and the preset interval duration threshold; and sequentially determining the period correction time corresponding to each target synchronization period according to the reference interval time interval and the initial period correction time interval and the period sorting sequence.
It should be understood that the above is only an example, and the technical solution of the present invention is not limited in any way, and in a specific application, a person skilled in the art may set the technical solution as needed, and the present invention is not limited in this respect.
It should be noted that the above-mentioned work flows are only illustrative and do not limit the scope of the present invention, and in practical applications, those skilled in the art may select some or all of them according to actual needs to implement the purpose of the solution of the present embodiment, and the present invention is not limited herein.
In addition, the technical details that are not described in detail in this embodiment may refer to the method for compensating for the delay of the rendered image according to any embodiment of the present invention, and are not described herein again.
Further, it is to be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrases "comprising one of 8230; \8230;" 8230; "does not exclude the presence of additional like elements in a process, method, article, or system that comprises the element.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
Through the description of the foregoing embodiments, it is clear to those skilled in the art that the method of the foregoing embodiments may be implemented by software plus a necessary general hardware platform, and certainly may also be implemented by hardware, but in many cases, the former is a better implementation. Based on such understanding, the technical solutions of the present invention or portions thereof that contribute to the prior art may be embodied in the form of a software product, where the computer software product is stored in a storage medium (e.g. a Read Only Memory (ROM)/RAM, a magnetic disk, and an optical disk), and includes several instructions for enabling a terminal device (which may be a mobile phone, a computer, a server, or a network device, etc.) to execute the method according to the embodiments of the present invention.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.

Claims (10)

1. A method for delay compensation of a rendered image, the method comprising:
when the period correction time of each target synchronization period is reached and the image rendering is completed, acquiring the pose information of the equipment;
correcting the rendered image rendered in each target synchronous period according to the equipment pose information, and recording correction duration information;
determining a target delay compensation time length according to the correction time length information;
and generating an image correction strategy according to the target delay compensation duration so as to reduce the delay time of image display.
2. The method of claim 1, wherein the obtaining device pose information when the cycle correction time of each target synchronization cycle is reached and the image rendering is completed comprises:
acquiring vertical synchronization period information and correction time information;
determining cycle correction time corresponding to each vertical synchronization cycle according to the vertical synchronization cycle information and the correction time information;
and obtaining the equipment pose information corresponding to each target synchronization period according to the period correction time corresponding to each vertical synchronization period.
3. The method of claim 2, wherein obtaining the device pose information corresponding to each target synchronization period according to the period correction time corresponding to each vertical synchronization period comprises:
determining a target synchronization period according to the vertical synchronization period information;
when the period correction time of each target synchronization period is reached, judging whether the image rendering process corresponding to each vertical synchronization period is finished or not;
when the image rendering process corresponding to each target synchronization period is completed, acquiring the period pose information of each target synchronization period;
and determining the pose information of the equipment according to the period pose information of each target synchronization period.
4. The method of claim 1, wherein determining a target delay compensation duration based on the corrective duration information comprises:
acquiring a period sequencing sequence of each vertical synchronization period;
determining the number of initial reference periods and reference periods according to the period sorting sequence;
selecting a plurality of reference cycles from the cycle sequencing sequence according to the initial reference cycle and the number of the reference cycles;
determining a period correction time length corresponding to each target synchronization period according to the correction time length information;
taking the period correction duration corresponding to each reference period as a reference correction duration;
and determining a target delay compensation time length according to each reference correction time length.
5. The method of claim 4, wherein before acquiring device pose information when the cycle correction time of each target synchronization cycle is reached and image rendering is completed, further comprising:
acquiring a preset initial correction time corresponding to an initial synchronization period in each target synchronization period;
and determining the period correction time of each target synchronization period according to the period sequencing sequence and the preset initial correction time.
6. The method of claim 5, wherein said determining a cycle correction time for each target synchronization cycle based on said cycle sequencing order and said preset starting correction time comprises:
determining an initial period correction time interval according to the correction duration information and the preset initial correction time;
acquiring the period duration of each vertical synchronization period;
and determining the period correction time of each target synchronization period according to the initial period correction time interval, the period duration and a preset interval duration threshold.
7. The method of claim 6, wherein determining the cycle correction time for each target synchronization cycle based on the cycle correction time interval, the cycle duration, and a preset interval duration threshold comprises:
determining a reference interval time interval according to the period time length and the preset interval time length threshold;
and sequentially determining the period correction time corresponding to each target synchronization period according to the reference interval time interval and the initial period correction time interval and the period sorting sequence.
8. A rendering image delay compensation apparatus, comprising:
the pose acquisition module is used for acquiring equipment pose information when the period correction time of each target synchronization period is reached and the image rendering is finished;
the time length recording module is used for correcting the rendered image which is rendered in each target synchronous period according to the equipment pose information and recording the correction time length information;
the compensation determining module is used for determining a target delay compensation time length according to the correction time length information;
and the strategy generation module is used for generating an image correction strategy according to the target delay compensation duration so as to reduce the delay time of image display.
9. A display device, characterized in that the display device comprises: a memory, a processor, and a rendered image delay compensation program stored on the memory and executable on the processor, the rendered image delay compensation program configured to implement the rendered image delay compensation method of any one of claims 1 to 7.
10. A storage medium having a rendering image delay compensation program stored thereon, the rendering image delay compensation program implementing the rendering image delay compensation method according to any one of claims 1 to 7 when executed by a processor.
CN202211338782.0A 2022-10-28 2022-10-28 Rendering image delay compensation method and device, display equipment and storage medium Pending CN115601488A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211338782.0A CN115601488A (en) 2022-10-28 2022-10-28 Rendering image delay compensation method and device, display equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211338782.0A CN115601488A (en) 2022-10-28 2022-10-28 Rendering image delay compensation method and device, display equipment and storage medium

Publications (1)

Publication Number Publication Date
CN115601488A true CN115601488A (en) 2023-01-13

Family

ID=84850548

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211338782.0A Pending CN115601488A (en) 2022-10-28 2022-10-28 Rendering image delay compensation method and device, display equipment and storage medium

Country Status (1)

Country Link
CN (1) CN115601488A (en)

Similar Documents

Publication Publication Date Title
CN106296566B (en) A kind of virtual reality mobile terminal dynamic time frame compensation rendering system and method
CN109992232B (en) Image updating method, device, terminal and storage medium
JP6894976B2 (en) Image smoothness improvement method and equipment
CN108241213A (en) Head-mounted display and its control method
CN109920040B (en) Display scene processing method and device and storage medium
WO2018050001A1 (en) Method and device for generating animation data
CN106919360B (en) Head posture compensation method and device
CN109741463B (en) Rendering method, device and equipment of virtual reality scene
CN113225427B (en) Image display method and terminal equipment
CN109819232B (en) Image processing method, image processing device and display device
WO2019153723A1 (en) Video frame display method and device, television and storage medium
CN112230776A (en) Virtual reality display method, device and storage medium
CN107682730B (en) Layer superposition processing method, layer superposition processing device and video processor
JP3599728B2 (en) Game emulator program
US10242479B2 (en) Information processing device and information processing method
CN114783355A (en) LED display method and device, electronic equipment and readable storage medium
CN115601488A (en) Rendering image delay compensation method and device, display equipment and storage medium
EP1947602A1 (en) Information processing device, graphic processor, control processor, and information processing method
US20160216839A1 (en) Display device and electronic device including the same
CN111063309A (en) Method for refreshing irregular graph conflict, storage device and display terminal
CN115002542A (en) Frame rate adjusting method and device, computer readable storage medium and terminal
US11302280B2 (en) Compensation method and compensation device for VR display and display device
CN113485544A (en) Frame rate adjustment method, system, device and storage medium for augmented reality device
JPH09116827A (en) Reduction video signal processing circuit
CN114155151A (en) Image drawing method, device, equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination