CN117524073A - Super high definition image display jitter compensation method, system and storage medium - Google Patents

Super high definition image display jitter compensation method, system and storage medium Download PDF

Info

Publication number
CN117524073A
CN117524073A CN202410022629.XA CN202410022629A CN117524073A CN 117524073 A CN117524073 A CN 117524073A CN 202410022629 A CN202410022629 A CN 202410022629A CN 117524073 A CN117524073 A CN 117524073A
Authority
CN
China
Prior art keywords
display device
data
ultra
high definition
display
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202410022629.XA
Other languages
Chinese (zh)
Other versions
CN117524073B (en
Inventor
戴志明
曾银海
邱堂兵
王超
李勇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Lan Pu Video Technology Co ltd
Original Assignee
Shenzhen Lan Pu Video Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Lan Pu Video Technology Co ltd filed Critical Shenzhen Lan Pu Video Technology Co ltd
Priority to CN202410022629.XA priority Critical patent/CN117524073B/en
Publication of CN117524073A publication Critical patent/CN117524073A/en
Application granted granted Critical
Publication of CN117524073B publication Critical patent/CN117524073B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00Control of display operating conditions
    • G09G2320/06Adjustment of display parameters

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

The invention discloses a method, a system and a storage medium for compensating display jitter of an ultra-high definition image, which belong to the technical field of image processing, and the anchoring information between display equipment and the head of a viewer is determined by acquiring first position information of the display equipment and second position information of the head of the viewer; acquiring display parameter information of a display device and image information of an ultra-high definition image, and displaying the ultra-high definition image on the display device based on the anchoring information; acquiring first jitter offset data of a display device in a first time and second jitter offset data of a head of a viewer, and determining offset difference data based on the first jitter offset data and the second jitter offset data; the ultra-high definition image displayed on the display device is subjected to jitter compensation based on the offset difference data. The initial display of the ultra-high definition image is determined through the anchoring information, and the jitter compensation scheme is determined based on the relative displacement between the display device and the head of the viewer, so that the viewing effect of the viewer in the jitter state is improved.

Description

Super high definition image display jitter compensation method, system and storage medium
Technical Field
The invention relates to the technical field of image processing, in particular to a method, a system and a storage medium for compensating display jitter of an ultra-high definition image.
Background
With the continuous development of image processing technology and display technology, ultra-high definition image display is becoming an important display technology. The ultra-high definition image has higher resolution and more pixels, so that a finer and more realistic picture is presented. Ultra-high definition provides a greater number of pixels and higher image definition than high definition, enabling viewers to better capture changes in detail and color.
When the ultra-high definition image is displayed on the display equipment such as the smart phone, the smart tablet and the like, the viewer and the display equipment cannot always keep a fixed distance and an angle, and particularly when relative displacement is generated between the display equipment and the head of the viewer, the display effect of the original displayed ultra-high definition image is not changed, but the visual experience of the viewer is also affected due to relative shake.
Therefore, how to provide a method for compensating the display jitter of an ultra-high definition image, which improves the visual experience of a viewer through jitter compensation, is a technical problem to be solved by those skilled in the art.
Disclosure of Invention
Therefore, the invention provides a method, a system and a storage medium for compensating the display jitter of an ultra-high definition image, which are used for solving the related technical problems in the prior art.
In order to achieve the above object, the present invention provides the following technical solutions:
according to a first aspect of the present invention, there is provided an ultra-high definition image display shake compensation method, comprising:
acquiring first position information of the display device and second position information of the head of the viewer, and determining anchoring information between the display device and the head of the viewer;
acquiring display parameter information of a display device and image information of an ultra-high definition image, and displaying the ultra-high definition image on the display device based on the anchoring information;
acquiring first jitter offset data of a display device in a first time and second jitter offset data of a head of a viewer, and determining offset difference data based on the first jitter offset data and the second jitter offset data;
the ultra-high definition image displayed on the display device is subjected to jitter compensation based on the offset difference data.
Further, wherein acquiring the first position information of the display device and the second position information of the head of the viewer, determining the anchor information between the display device and the head of the viewer, comprises:
acquiring first position information of a display device, wherein the first position information comprises X-axis data and Y-axis data of the display device;
acquiring second position information of the head of the viewer, the second position information including X-axis, Y-axis and angle data relative to the first position information;
determining initial distance information between the display device and the viewer's head;
anchor information between the display device and the head of the viewer is determined based on the initial distance information and the second position information.
Further, wherein acquiring display parameter information of a display device and image information of an ultra-high definition image, displaying the ultra-high definition image on the display device based on the anchor information, comprises:
acquiring display parameter information of display equipment;
acquiring display pixel value information of the ultra-high definition image, and determining the optimal resolution of the display device based on the display pixel value information of the ultra-high definition image;
and adjusting the display size of the ultra-high definition image on the display device based on the anchoring information.
Further, wherein adjusting the display size of the ultra-high definition image on the display device based on the anchor information includes:
acquiring the original display size of the ultra-high definition image on the display device;
determining a display adjustment factor based on the anchor information;
and determining the adjusted display size of the adjusted ultra-high definition image on the display device based on the display adjustment coefficient and the original display size.
Further, wherein obtaining first jitter offset data of the display device and second jitter offset data of the viewer's head at a first time, determining offset difference data based on the first and second jitter offset data, comprises:
acquiring first jitter offset data of the display device relative to first position information in a first time;
acquiring second jitter offset data of the head of the viewer relative to second position information in the first time;
a difference between the first jitter offset data and the second jitter offset data is calculated as offset difference data.
Further, wherein calculating a difference between the first jitter offset data and the second jitter offset data as offset difference data includes:
obtaining a first offset difference of the viewer's head relative to the display device in the X-axis;
obtaining a second offset difference of the viewer's head relative to the display device in the Y-axis;
obtaining an angular change of the viewer's head relative to the display device as a third offset difference;
obtaining a fourth offset difference in distance of the viewer's head relative to the display device;
offset difference data is determined based on the first offset difference, the second offset difference, the third offset difference, and the fourth offset difference.
Further, wherein determining offset difference data based on the first offset difference, the second offset difference, the third offset difference, and the fourth offset difference comprises:
acquiring a display adjustment coefficient;
determining first following compensation data of the ultra-high definition image in the X-axis direction based on the first offset difference value;
determining second follow-up compensation data of the ultra-high definition image in the Y-axis direction based on the second offset difference value;
determining third follow-up compensation data of the ultra-high definition image in angle based on the third offset difference value;
determining fourth follow-up compensation data of the ultra-high definition image in distance based on the fourth offset difference;
jitter compensation data is determined based on the first, second, third and fourth follow compensation data.
Further, the method further comprises the following steps:
acquiring background image information and main image information in an ultra-high definition image, and determining peripheral edge pixel points of the background image;
determining connected pixel points of the background image and the main image in multiple directions;
performing jitter compensation on image display according to the jitter compensation data by the ultra-high definition image, and monitoring the boundaries of the jitter compensation data relative to connected pixel points in multiple directions in real time;
and stopping jitter compensation when the jitter compensation data exceeds the boundary of the connected pixels in any direction.
According to a second aspect of the present invention, there is provided an ultra-high definition image display shake compensation system comprising:
an anchor determining module for acquiring first position information of the display device and second position information of the head of the viewer, and determining anchor information between the display device and the head of the viewer;
the display determining module is used for acquiring display parameter information of the display equipment and image information of the ultra-high definition image, and displaying the ultra-high definition image on the display equipment based on the anchoring information;
an offset calculation module, configured to obtain first jitter offset data of a display device in a first time and second jitter offset data of a head of a viewer, and determine offset difference data based on the first jitter offset data and the second jitter offset data;
and a jitter compensation module for performing jitter compensation on the ultra-high definition image displayed on the display device based on the offset difference data.
According to a third aspect of the present invention, there is provided a computer readable storage medium storing computer instructions for causing a processor to execute the super-high definition image display shake compensation method as described above.
The invention has the following advantages:
the application provides a method, a system and a storage medium for compensating display jitter of an ultra-high definition image, wherein anchoring information between a display device and a head of a viewer is determined by acquiring first position information of the display device and second position information of the head of the viewer; acquiring display parameter information of a display device and image information of an ultra-high definition image, and displaying the ultra-high definition image on the display device based on the anchoring information; acquiring first jitter offset data of a display device in a first time and second jitter offset data of a head of a viewer, and determining offset difference data based on the first jitter offset data and the second jitter offset data; the ultra-high definition image displayed on the display device is subjected to jitter compensation based on the offset difference data. According to the method and the device, the display image of the ultra-high definition image on the display device is determined through the anchoring information between the display device and the head of the viewer, the follow-up type jitter compensation scheme is determined based on the relative displacement between the display device and the head of the viewer, and the viewing effect of the viewer in the jitter state is improved.
In order to better explain the technical effects of the present application, the following describes the technical solution of the present application with reference to the specific embodiments.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below. It will be apparent to those of ordinary skill in the art that the drawings in the following description are exemplary only and that other implementations can be obtained from the extensions of the drawings provided without inventive effort.
The structures, proportions, sizes, etc. shown in the present specification are shown only for the purposes of illustration and description, and are not intended to limit the scope of the invention, which is defined by the claims, so that any structural modifications, changes in proportions, or adjustments of sizes, which do not affect the efficacy or the achievement of the present invention, should fall within the ambit of the technical disclosure.
FIG. 1 is a flow chart of a method for compensating display jitter of ultra-high definition images;
FIG. 2 is a flowchart illustrating steps for determining anchor information according to the present invention;
FIG. 3 is a flowchart showing steps for determining display parameters of an ultra high definition image according to the present invention;
FIG. 4 is a flowchart illustrating steps for determining offset difference data according to the present invention;
fig. 5 is a block diagram of an ultra-high definition image display shake compensation system according to the present invention.
Detailed Description
Other advantages and advantages of the present invention will become apparent to those skilled in the art from the following detailed description, which, by way of illustration, is to be read in connection with certain specific embodiments, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
In order to solve the problem of the prior art that the displacement is generated between the head of the viewer and the display device, so that the displayed ultra-high definition image is visually dithered, according to a first aspect of the present invention, there is provided an ultra-high definition image display dithering compensation method, as shown in fig. 1, comprising the steps of:
in step 100, acquiring first position information of a display device and second position information of a head of a viewer, and determining anchoring information between the display device and the head of the viewer;
in step 200, obtaining display parameter information of a display device and image information of an ultra-high definition image, and displaying the ultra-high definition image on the display device based on the anchoring information;
in step 300, first jitter offset data of a display device in a first time and second jitter offset data of a head of a viewer are acquired, and offset difference data is determined based on the first jitter offset data and the second jitter offset data;
in step 400, a dither compensation is performed on an ultra-high definition image displayed on a display device based on offset difference data.
Based on the specific step 100 of the above embodiment, it should be noted that: anchoring information between the display device and the head of the viewer is determined by determining the coordinate position of the display device and the coordinate position of the head of the viewer, while based on the relative displacement between the display device and the head of the viewer. By determining the anchor information, the display device can set the display parameters of the ultra-high definition image on the display device based on the anchor information, and at the same time, when the relative shake is generated between the display device and the head of the viewer, the display device can compensate the shake generated by the ultra-high definition image in the display process based on the relevant parameters determined by the anchor information. The method comprises the following steps:
as shown in fig. 2, in step 100, the first position information of the display device and the second position information of the head of the viewer are acquired, and the anchoring information between the display device and the head of the viewer is determined, which includes the following specific steps:
step 101, acquiring first position information of a display device, wherein the first position information comprises X-axis and Y-axis data of the display device; the display device in the embodiment of the application may be a portable intelligent display device such as a smart phone, a smart tablet, a smart watch, or a non-portable display device such as a projector. When the first position information of the display device is acquired, a coordinate system is established by using a display plane of the display device, a center point of the display device is used as a coordinate origin, and the transverse direction of a display picture is an X axis and the longitudinal direction of the display picture is a Y axis, so that in an initial state, X-axis data and Y-axis data of the display device, namely, data of the transverse width, the longitudinal width and the like of the display device can be determined.
Step 102, obtaining second position information of the head of the viewer, wherein the second position information comprises X-axis, Y-axis and angle data relative to the first position information; in this step, it should be noted that, in general, the head of the viewer is viewed toward the display device, taking the axis perpendicular to the display device as the Z axis, and projecting the X axis and Y axis data of the head of the viewer into the coordinate system through the mapping relationship, and the face of the viewer is not completely parallel to the display plane of the display device, so that the face of the viewer forms a certain angle with the coordinate system, and is recorded as the initial angle data α. Meanwhile, based on the noted X-axis, Y-axis and angle data α, the difference value is compared with the X-axis and Y-axis data of the display device, so as to obtain second position information of the head of the viewer, and in the second position information, the X-axis data is as follows:
wherein,for X-axis data in the first position information, < >>X-axis data for a viewer's head;
the Y-axis data are as follows:
wherein,for Y-axis data in the first position information, < >>Y-axis data for the viewer's head;
therefore, the second position information of the head of the viewer in the coordinate system with respect to the first position information, that is, the X-axis, Y-axis, and angle data α in the second position information is obtained by the above calculation formula.
Step 103, determining initial distance information between the display device and the head of the viewer; as noted in step 102 above, with the axis perpendicular to the display device as the Z-axis, the distance of the viewer's head from the display device may be monitored by a camera or other sensor (e.g., an infrared sensor) on the display device, thus yielding Z-axis data in the second location information as the initial distance information.
Step 104, determining anchor information between the display device and the viewer's head based on the initial distance information and the second position information. Therefore, after the above steps 102 and 103, a plurality of data information of the head of the viewer with respect to the display device, specifically, X-axis data, Y-axis data, and angle data α in the second position information, and initial distance information of the head of the viewer with respect to the display device in the Z-axis are obtained, and these information are summarized as initial anchor information.
As described above, in the embodiment of the present application, the display device displays the ultra-high definition image to be displayed on the screen according to the original data of the ultra-high definition image, and the state of the anchor information is determined as the initial viewing state of the viewer. When a relative displacement occurs between the head of the viewer and the display device, a shake compensation display is performed on the ultra-high definition image on the display device based on the change of the anchor information.
Based on the specific step 100 of the above embodiment, further, in step 200, display parameter information of the display device and image information of the ultra-high definition image are acquired, and the ultra-high definition image is displayed on the display device based on the anchor information, as shown in fig. 3, including the steps of:
step 201, obtaining display parameter information of a display device; in this step, the display parameters of the display device include parameter information such as a display color gamut, a display resolution, and a display brightness, so as to facilitate adjustment of the display parameters according to the characteristics of the ultra-high definition image.
Step 202, obtaining display pixel value information of an ultra-high definition image, and determining the optimal resolution of the display device based on the display pixel value information of the ultra-high definition image; specifically, first, image data information of the ultra-high definition image, such as pixel value information to be displayed, is acquired, display parameter information of the display device has been determined in step 201, and based on the display parameter information and the information of the ultra-high definition image, the ultra-high definition image is displayed with an optimal resolution, so as to improve viewing experience of a viewer.
And step 203, adjusting the display size of the ultra-high definition image on the display device based on the anchoring information. In the above step, in the case where the initial anchor information has been determined, the ultra-high definition image is initially displayed in the display screen size of the display device, and the display size of the ultra-high definition image is adjusted when a shake displacement occurs between the head of the viewer and the display device, particularly when the distance between the head of the viewer and the display device in the Z-axis varies. Illustratively, when the distance between the head of the viewer and the display device becomes large and exceeds the initial distance information, the ultra-high definition image becomes large to be displayed; and the ultra-high definition image is displayed smaller when the distance between the head of the viewer and the display device becomes smaller and smaller than the initial distance information.
In step 203, adjusting a display size of the ultra high definition image on the display device based on the anchor information, comprising:
acquiring the original display size of the ultra-high definition image on the display device; in the present embodiment, the ultra high definition image is displayed on the display device with the optimal display resolution, and in general, the display size of the ultra high definition image is adapted to the display screen size of the display device.
Determining a display adjustment factor based on the anchor information; in this step, the X-axis data, Y-axis data, Z-axis data, and angle data α in the initial anchor information, at this time, the ultra-high definition image is adapted to the size of the display screen of the display device for display, and the display adjustment coefficient is determined by the above anchor information as follows:
wherein ρ is a display adjustment coefficient,weight of X-axis data in the second position information, < >>Weight of Y-axis data in the second position information, +.>Is the weight of the Z-axis data in the second position information.
Wherein the angle data α is used to define an angular change between the head of the viewer and the display device, and no adjustment of the display is made, regardless of the change in the second position information, when the angular change between the head of the viewer and the display device exceeds a threshold value. Illustratively, the initial angle data α is 30 °, the threshold value is set to 60 °, and when the angle of the head of the viewer to the display device is 60 ° or more, the ultra-high definition image in the display device displays the initial size regardless of the change in the X-axis data, the Y-axis data, and the Z-axis data in the second position information.
Further, an adjusted display size of the adjusted ultra-high definition image on the display device is determined based on the display adjustment factor and the original display size. Based on the above embodiment, the anchoring information determines the display adjustment coefficient, and when the distance between the head of the viewer and the display device in the Z-axis is changed, the adjustment is performed according to the display adjustment coefficient and the original display size of the ultra-high definition image, specifically:
wherein,for a change in distance between the viewer's head and the display device, ρ is a display adjustment factor,for the original display size of the ultra high definition image, < >>The display size is adjusted for the ultra-high definition image.
In step 300, where first jitter offset data of a display device at a first time and second jitter offset data of a viewer's head are acquired, offset difference data is determined based on the first jitter offset data and the second jitter offset data, as shown in fig. 4, comprising the steps of:
step 301, obtaining first jitter offset data of a display device relative to first position information in a first time; in this embodiment of the present application, the first time is limited in a short time, for example, 0.3S, so that the jitter compensation can have a faster response speed, and the compensation effect is improved. Specifically, when the display device is dithered, it is offset with respect to the first position information in the established coordinate system, including X-axis offset data and Y-axis offset data, denoted as first dithered offset data.
Step 302, obtaining second jitter offset data of the head of the viewer relative to second position information in a first time; likewise, in the embodiment of the present application, when the head of the viewer is dithered, the head of the viewer is offset with respect to the second position information in the established coordinate system, including X-axis offset data, Y-axis offset data, Z-axis offset data, and angle offset data, which are denoted as second dithering offset data.
In step 303, a difference between the first jitter offset data and the second jitter offset data is calculated as offset difference data. Based on the information described in the above steps 301 and 302, in which the first shake offset data of the first position information on the display device and the second shake offset data of the second position information on the head of the viewer have been described, the visual shake offset of the ultra-high definition image can be determined by calculating the difference data of the first shake offset data and the second shake offset data, and specifically further comprising the steps of:
in the step, first offset difference value of the head of the viewer relative to the display device in the X axis is obtained, first offset data of the first position information in the X axis is obtained, then offset data of the second position information in the X axis is obtained, and difference value operation is carried out to obtain the first offset difference value of the head of the viewer relative to the display device in the X axis.
And in the same way, in the step, firstly, the offset data of the first position information in the Y axis is acquired, then the offset data of the second position information in the Y axis is acquired, and then the difference operation is carried out, so that the second offset difference value of the head of the viewer in the Y axis relative to the display device is obtained.
Acquiring the angle change of the head of the viewer relative to the display device as a third offset difference value, wherein in the step, the angle between the display device and the face plane of the viewer can be recorded in real time through the camera, and the angle change difference value relative to the original angle data alpha is used as the third offset difference value; the third offset difference calculated in this step is primarily indicative of the angle between the viewer's head relative to the display device and no adjustment is made to the display of the ultra-high definition image when the threshold is exceeded.
Obtaining a fourth offset difference value of the head of the viewer relative to the display device in distance, and in the same way, firstly obtaining offset data of the second position information in the Z axis, and then carrying out difference value operation with the original distance data in the Z axis to obtain a fourth offset difference value of the head of the viewer relative to the display device in the Z axis;
determining offset difference data based on the first offset difference, the second offset difference, the third offset difference, and the fourth offset difference, specifically as follows:
acquiring a display adjustment coefficient; in the step in this embodiment, the adjustment coefficient is displayed as an initial determination value ρ;
determining first following compensation data of the ultra-high-definition image in the X-axis direction based on a first offset difference value, specifically, taking an absolute value of a product of the first offset difference value and a display adjustment coefficient rho as the first following compensation data, and adjusting the display position of the ultra-high-definition image on the X-axis of display equipment according to the first following compensation data;
determining second following compensation data of the ultra-high-definition image in the Y-axis direction based on a second offset difference value, wherein the absolute value of the product of the second offset difference value and a display adjustment coefficient rho is used as the second following compensation data, and then adjusting the display position of the ultra-high-definition image on the Y-axis of the display device according to the second following compensation data;
determining third follow-up compensation data of the ultra-high definition image in angle based on the third offset difference value; the third offset difference calculated in this step is primarily indicative of the angle between the viewer's head relative to the display device and no adjustment is made to the display of the ultra-high definition image when the threshold is exceeded.
Determining fourth following compensation data of the ultra-high definition image in distance based on a fourth offset difference value, specifically, taking an absolute value of a product of the fourth offset difference value, an original display size and a display adjustment coefficient rho as the fourth following compensation data, and adjusting the display size of the ultra-high definition image on a Z axis of display equipment according to the fourth following compensation data, specifically, when the fourth offset difference value is a negative number, reducing the ultra-high definition image, and when the fourth offset difference value is a positive number, increasing the ultra-high definition image;
in summary, the position or the size of the ultra-high definition image on the X-axis, the Y-axis, and the Z-axis may be adjusted by determining the shake compensation data based on the first, second, third, and fourth following compensation data, so as to implement shake compensation.
In the above steps, the shake compensation display of the ultra-high definition image on the display device is realized, but if the display boundary of the image exceeds the boundary of the display device, it is necessary to set to ensure that the display of the key information in the ultra-high definition image is not affected. Thus, it further comprises:
acquiring background image information and main image information in an ultra-high definition image, and determining peripheral edge pixel points of the background image; in a specific embodiment, firstly, a region which is emphasized in the ultra-high definition image, such as a person image, is determined, and the region is divided into a person image and a background, wherein the person image is main image information and the background is background image information, so that the complete display of the person image needs to be ensured during display.
Determining connected pixel points of the background image and the main image in multiple directions; in this step, the boundary between the background image and the main image, in particular, the position of the connected pixel point is determined, and the connected pixel point is marked.
Performing jitter compensation on image display according to the jitter compensation data by the ultra-high definition image, and monitoring the boundaries of the jitter compensation data relative to connected pixel points in multiple directions in real time;
and stopping jitter compensation when the jitter compensation data exceeds the boundary of the connected pixels in any direction. Specifically, when the shake compensation is required to be performed on the ultra-high definition image on the X axis, the position of the connected pixel point on the X axis is required to be ensured to be completely displayed on the display device, defects are not caused, and when the shake compensation is performed on the Y axis and the Z axis in the same way, the complete display of the main image on the display device is required to be ensured, so that the connected pixel point is ensured not to exceed the boundary of the display screen on the display device.
The embodiment of the application provides an ultra-high definition image display jitter compensation method, which comprises the steps of determining anchoring information between a display device and a head of a viewer by acquiring first position information of the display device and second position information of the head of the viewer; acquiring display parameter information of a display device and image information of an ultra-high definition image, and displaying the ultra-high definition image on the display device based on the anchoring information; acquiring first jitter offset data of a display device in a first time and second jitter offset data of a head of a viewer, and determining offset difference data based on the first jitter offset data and the second jitter offset data; the ultra-high definition image displayed on the display device is subjected to jitter compensation based on the offset difference data. According to the method and the device, the display image of the ultra-high definition image on the display device is determined through the anchoring information between the display device and the head of the viewer, the follow-up type jitter compensation scheme is determined based on the relative displacement between the display device and the head of the viewer, and the viewing effect of the viewer in the jitter state is improved.
According to a second aspect of the present invention, there is provided an ultra-high definition image display shake compensation system, as shown in fig. 5, comprising:
an anchor determining module 01, configured to acquire first position information of the display device and second position information of the head of the viewer, and determine anchor information between the display device and the head of the viewer;
a display determining module 02 for acquiring display parameter information of a display device and image information of an ultra-high definition image, and displaying the ultra-high definition image on the display device based on the anchor information;
an offset calculation module 03, configured to acquire first jitter offset data of the display device at a first time and second jitter offset data of the head of the viewer, and determine offset difference data based on the first jitter offset data and the second jitter offset data;
and the jitter compensation module 04 is used for performing jitter compensation on the ultra-high definition image displayed on the display device based on the offset difference data.
According to a third aspect of the present invention, there is provided a computer readable storage medium storing computer instructions for causing a processor to execute the above-described super-high definition image display shake compensation method.
In the several embodiments provided in this application, it should be understood that the disclosed systems and methods may be implemented in other ways. The system embodiment described above is merely illustrative, for example, the division of units is merely a logical function division, and there may be other division manners in actual implementation, such as: multiple units or components may be combined or may be integrated into another system, or some features may be omitted, or not performed. In addition, the various components shown or discussed may be coupled or directly coupled or communicatively coupled to each other via some interface, whether indirectly coupled or communicatively coupled to devices or units, whether electrically, mechanically, or otherwise.
The units described above as separate components may or may not be physically separate, and components shown as units may or may not be physical units; can be located in one place or distributed to a plurality of network units; some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
In addition, each functional unit in each embodiment of the present invention may be integrated in one processing unit, or each unit may be separately used as one unit, or two or more units may be integrated in one unit; the integrated units may be implemented in hardware or in hardware plus software functional units.
Those of ordinary skill in the art will appreciate that: all or part of the steps for implementing the above method embodiments may be implemented by hardware related to program instructions, and the foregoing program may be stored in a computer readable storage medium, where the program, when executed, performs steps including the above method embodiments; and the aforementioned storage medium includes: a mobile storage device, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a magnetic disk or an optical disk, or the like, which can store program codes.
Alternatively, the above-described integrated units of the present invention may be stored in a computer-readable storage medium if implemented in the form of software functional modules and sold or used as separate products. Based on such understanding, the technical solution of the embodiments of the present invention may be essentially or, in part, contributing to the prior art, embodied in the form of a software product stored in a storage medium, including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the methods described in the embodiments of the present invention. And the aforementioned storage medium includes: a removable storage device, ROM, RAM, magnetic or optical disk, or other medium capable of storing program code.

Claims (9)

1. An ultra-high definition image display shake compensation method, characterized by comprising the steps of:
acquiring first position information of the display device and second position information of the head of the viewer, and determining anchoring information between the display device and the head of the viewer;
acquiring display parameter information of a display device and image information of an ultra-high definition image, and displaying the ultra-high definition image on the display device based on the anchoring information;
acquiring first jitter offset data of a display device in a first time and second jitter offset data of a head of a viewer, and determining offset difference data based on the first jitter offset data and the second jitter offset data;
performing jitter compensation on the ultra-high definition image displayed on the display device based on the offset difference data;
wherein acquiring the first position information of the display device and the second position information of the head of the viewer, determining the anchor information between the display device and the head of the viewer, comprises:
acquiring first position information of a display device, wherein the first position information comprises X-axis data and Y-axis data of the display device;
acquiring second position information of the head of the viewer, the second position information including X-axis, Y-axis and angle data relative to the first position information;
determining initial distance information between the display device and the viewer's head;
anchor information between the display device and the head of the viewer is determined based on the initial distance information and the second position information.
2. The ultra-high definition image display shake compensation method according to claim 1, wherein acquiring display parameter information of a display device and image information of an ultra-high definition image, displaying the ultra-high definition image on the display device based on the anchor information, comprises:
acquiring display parameter information of display equipment;
acquiring display pixel value information of the ultra-high definition image, and determining the optimal resolution of the display device based on the display pixel value information of the ultra-high definition image;
and adjusting the display size of the ultra-high definition image on the display device based on the anchoring information.
3. The method of claim 2, wherein adjusting the display size of the ultra-high definition image on the display device based on the anchor information comprises:
acquiring the original display size of the ultra-high definition image on the display device;
determining a display adjustment factor based on the anchor information;
and determining the adjusted display size of the adjusted ultra-high definition image on the display device based on the display adjustment coefficient and the original display size.
4. The ultra-high definition image display shake compensation method of claim 3, wherein acquiring first shake offset data of the display device at a first time and second shake offset data of the head of the viewer, determining offset difference data based on the first shake offset data and the second shake offset data, comprises:
acquiring first jitter offset data of the display device relative to first position information in a first time;
acquiring second jitter offset data of the head of the viewer relative to second position information in the first time;
a difference between the first jitter offset data and the second jitter offset data is calculated as offset difference data.
5. The ultra-high definition image display shake compensation method according to claim 4, wherein calculating a difference between the first shake offset data and the second shake offset data as offset difference data comprises:
obtaining a first offset difference of the viewer's head relative to the display device in the X-axis;
obtaining a second offset difference of the viewer's head relative to the display device in the Y-axis;
obtaining an angular change of the viewer's head relative to the display device as a third offset difference;
obtaining a fourth offset difference in distance of the viewer's head relative to the display device;
offset difference data is determined based on the first offset difference, the second offset difference, the third offset difference, and the fourth offset difference.
6. The ultra high definition image display shake compensation method of claim 5, wherein determining offset difference data based on the first offset difference, the second offset difference, the third offset difference, and the fourth offset difference comprises:
acquiring a display adjustment coefficient;
determining first following compensation data of the ultra-high definition image in the X-axis direction based on the first offset difference value;
determining second follow-up compensation data of the ultra-high definition image in the Y-axis direction based on the second offset difference value;
determining third follow-up compensation data of the ultra-high definition image in angle based on the third offset difference value;
determining fourth follow-up compensation data of the ultra-high definition image in distance based on the fourth offset difference;
jitter compensation data is determined based on the first, second, third and fourth follow compensation data.
7. The ultra-high definition image display shake compensation method according to claim 1, further comprising:
acquiring background image information and main image information in an ultra-high definition image, and determining peripheral edge pixel points of the background image;
determining connected pixel points of the background image and the main image in multiple directions;
performing jitter compensation on image display according to the jitter compensation data by the ultra-high definition image, and monitoring the boundaries of the jitter compensation data relative to connected pixel points in multiple directions in real time;
and stopping jitter compensation when the jitter compensation data exceeds the boundary of the connected pixels in any direction.
8. An ultra-high definition image display shake compensation system, comprising:
an anchor determining module for acquiring first position information of the display device and second position information of the head of the viewer, and determining anchor information between the display device and the head of the viewer;
the display determining module is used for acquiring display parameter information of the display equipment and image information of the ultra-high definition image, and displaying the ultra-high definition image on the display equipment based on the anchoring information;
an offset calculation module, configured to obtain first jitter offset data of a display device in a first time and second jitter offset data of a head of a viewer, and determine offset difference data based on the first jitter offset data and the second jitter offset data;
a shake compensation module for performing shake compensation on the ultra-high definition image displayed on the display device based on the offset difference data;
wherein the method for acquiring the first position information of the display device and the second position information of the head of the viewer, determining the anchoring information between the display device and the head of the viewer, comprises:
acquiring first position information of a display device, wherein the first position information comprises X-axis data and Y-axis data of the display device;
acquiring second position information of the head of the viewer, the second position information including X-axis, Y-axis and angle data relative to the first position information;
determining initial distance information between the display device and the viewer's head;
anchor information between the display device and the head of the viewer is determined based on the initial distance information and the second position information.
9. A computer readable storage medium storing computer instructions for causing a processor to implement the method of super-high definition image display shake compensation according to any one of claims 1 to 7 when executed.
CN202410022629.XA 2024-01-08 2024-01-08 Super high definition image display jitter compensation method, system and storage medium Active CN117524073B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202410022629.XA CN117524073B (en) 2024-01-08 2024-01-08 Super high definition image display jitter compensation method, system and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202410022629.XA CN117524073B (en) 2024-01-08 2024-01-08 Super high definition image display jitter compensation method, system and storage medium

Publications (2)

Publication Number Publication Date
CN117524073A true CN117524073A (en) 2024-02-06
CN117524073B CN117524073B (en) 2024-04-12

Family

ID=89748118

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202410022629.XA Active CN117524073B (en) 2024-01-08 2024-01-08 Super high definition image display jitter compensation method, system and storage medium

Country Status (1)

Country Link
CN (1) CN117524073B (en)

Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102798982A (en) * 2012-08-31 2012-11-28 深圳超多维光电子有限公司 Stereo display equipment and stereo display control method
CN103376892A (en) * 2012-04-24 2013-10-30 联想(北京)有限公司 Method, device and terminal device for controlling display of display interface
CN103885593A (en) * 2014-03-14 2014-06-25 深圳市中兴移动通信有限公司 Handheld terminal and screen anti-shake method and device of handheld terminal
US20170064157A1 (en) * 2015-08-26 2017-03-02 Intel Corporation Camera-assisted display motion compensation
CN107204044A (en) * 2016-03-17 2017-09-26 深圳多哚新技术有限责任公司 A kind of picture display process and relevant device based on virtual reality
CN108769528A (en) * 2018-06-15 2018-11-06 Oppo广东移动通信有限公司 Image compensation method and device, computer readable storage medium and electronic equipment
CN209542965U (en) * 2019-03-12 2019-10-25 苏州车萝卜汽车电子科技有限公司 Image stabilization head up display
WO2019237977A1 (en) * 2018-06-15 2019-12-19 Oppo广东移动通信有限公司 Image compensation method, computer readable storage medium and electronic device
CN110784651A (en) * 2019-11-15 2020-02-11 维沃移动通信有限公司 Anti-shake method and electronic equipment
CN113891061A (en) * 2021-11-19 2022-01-04 深圳市易快来科技股份有限公司 Naked eye 3D display method and display equipment
CN114765663A (en) * 2021-01-14 2022-07-19 北京小米移动软件有限公司 Anti-shake processing method and device, mobile device and storage medium
CN114779477A (en) * 2022-06-17 2022-07-22 江苏泽景汽车电子股份有限公司 Display picture compensation method and device, electronic equipment and storage medium
CN116257205A (en) * 2023-01-17 2023-06-13 浙江炽云科技有限公司 Image jitter compensation method and device, head-up display equipment, carrier and medium

Patent Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103376892A (en) * 2012-04-24 2013-10-30 联想(北京)有限公司 Method, device and terminal device for controlling display of display interface
CN102798982A (en) * 2012-08-31 2012-11-28 深圳超多维光电子有限公司 Stereo display equipment and stereo display control method
CN103885593A (en) * 2014-03-14 2014-06-25 深圳市中兴移动通信有限公司 Handheld terminal and screen anti-shake method and device of handheld terminal
US20170064157A1 (en) * 2015-08-26 2017-03-02 Intel Corporation Camera-assisted display motion compensation
CN107204044A (en) * 2016-03-17 2017-09-26 深圳多哚新技术有限责任公司 A kind of picture display process and relevant device based on virtual reality
WO2019237977A1 (en) * 2018-06-15 2019-12-19 Oppo广东移动通信有限公司 Image compensation method, computer readable storage medium and electronic device
CN108769528A (en) * 2018-06-15 2018-11-06 Oppo广东移动通信有限公司 Image compensation method and device, computer readable storage medium and electronic equipment
CN209542965U (en) * 2019-03-12 2019-10-25 苏州车萝卜汽车电子科技有限公司 Image stabilization head up display
CN110784651A (en) * 2019-11-15 2020-02-11 维沃移动通信有限公司 Anti-shake method and electronic equipment
CN114765663A (en) * 2021-01-14 2022-07-19 北京小米移动软件有限公司 Anti-shake processing method and device, mobile device and storage medium
CN113891061A (en) * 2021-11-19 2022-01-04 深圳市易快来科技股份有限公司 Naked eye 3D display method and display equipment
CN114779477A (en) * 2022-06-17 2022-07-22 江苏泽景汽车电子股份有限公司 Display picture compensation method and device, electronic equipment and storage medium
WO2023240918A1 (en) * 2022-06-17 2023-12-21 江苏泽景汽车电子股份有限公司 Display picture compensation method and apparatus, and electronic device and storage medium
CN116257205A (en) * 2023-01-17 2023-06-13 浙江炽云科技有限公司 Image jitter compensation method and device, head-up display equipment, carrier and medium

Also Published As

Publication number Publication date
CN117524073B (en) 2024-04-12

Similar Documents

Publication Publication Date Title
US7764307B2 (en) Remote instruction system, computer readable medium for remote instruction system and method
CN109743626B (en) Image display method, image processing method and related equipment
US9159135B2 (en) Systems, methods, and computer program products for low-latency warping of a depth map
US9398278B2 (en) Graphical display system with adaptive keystone mechanism and method of operation thereof
US20090169058A1 (en) Method and device for adjusting output frame
US8570403B2 (en) Face image replacement system and method implemented by portable electronic device
US20090244066A1 (en) Multi parallax image generation apparatus and method
CN112017222A (en) Video panorama stitching and three-dimensional fusion method and device
JP7101269B2 (en) Pose correction
CN113556464B (en) Shooting method and device and electronic equipment
EP2728544B1 (en) De-warping processing method for digital images
US20120106868A1 (en) Apparatus and method for image correction
CN109271123B (en) Picture display method and picture display device
KR20130081439A (en) Apparatus and method for displaying camera view area in a portable terminal
CN117524073B (en) Super high definition image display jitter compensation method, system and storage medium
CN108027646B (en) Anti-shaking method and device for terminal display
CN111371987B (en) Image processing method and device, electronic equipment and computer readable storage medium
CN114390186A (en) Video shooting method and electronic equipment
CN113519152A (en) Roll compensation and blur reduction in closely synchronized Optical Image Stabilization (OIS)
CN115049572A (en) Image processing method, image processing device, electronic equipment and computer readable storage medium
US11328494B2 (en) Image processing apparatus, image processing method, and storage medium
JP2014160998A (en) Image processing system, image processing method, image processing program and recording medium
WO2015158953A1 (en) Transformations for image stabilization and refocus
JP2019080145A (en) Video display device and adjustment device of the same
CN113327228B (en) Image processing method and device, terminal and readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant