CN108027646B - A terminal display anti-shake method and device - Google Patents

Abstract

A terminal display anti-shake method and device relate to the technical field of image stabilization and are used for solving the problem that a screen generated in the process of realizing display anti-shake has black edges. The RAM of the terminal (80, 90) includes a display memory buffer for storing a buffer image having a greater number of pixels in a horizontal direction and a greater number of pixels in a vertical direction than the number of pixels in the horizontal direction and the greater number of pixels in the vertical direction, respectively, of a display of the terminal (80, 90) in which a currently displayed image is a portion of the buffer image, the method comprising: the terminal (80, 90) acquires the amount of relative movement (201) of the terminal (80, 90) and the eyes of the user using the terminal (80, 90); and the terminal (80, 90) acquires an image to be displayed in the cache image according to the position relation and the relative motion amount between the current display image and the cache image, the image to be displayed is an image to be displayed in the display after the relative motion amount is compensated, and the number of pixels in the horizontal direction and the vertical direction of the image to be displayed is respectively the same as that of the pixels in the horizontal direction and the vertical direction of the display (202).

Description

A terminal display anti-shake method and device

technical field

The present invention relates to the technical field of image stabilization, and in particular, to a terminal display anti-shake method and device.

Background technique

When the terminal plays a video, if the terminal shakes (for example, when a user using the terminal rides a vehicle), it will affect the stability of the user using the terminal watching the video. At present, in order to improve the stability of the user watching videos when the terminal shakes, the terminal uses the built-in motion sensor to obtain the motion amount of the terminal, determines the displacement compensation amount of the terminal according to the acquired motion amount of the terminal, and adjusts the displacement compensation amount according to the displacement compensation amount. The image displayed on the screen of the terminal is compensated (for example, if it is obtained that the terminal moves to the left by one millimeter, the image displayed on the screen of the terminal is moved to the right by one millimeter), so as to minimize the impact of the image displayed on the screen of the terminal. The amount of exercise improves the stability of users watching videos.

The disadvantage of this method is that when the image displayed on the screen of the terminal is compensated according to the amount of motion of the terminal, the image displayed on the screen will appear black borders, that is, there is no displayed image in a part of one side of the screen, and the image displayed on the other side exceeds The case of the screen boundary (for example, if the image displayed on the screen of the terminal is moved to the right by 5 pixels, a blank space of 5 pixels will appear on the left side of the screen).

SUMMARY OF THE INVENTION

Embodiments of the present invention provide a terminal display anti-shake method and device, which are used to solve the problem of black borders on the screen generated during the process of implementing display anti-shake.

To achieve the above object, the embodiments of the present invention adopt the following technical solutions:

A first aspect provides a terminal display anti-shake method, the terminal includes a RAM and a display, the RAM includes a display memory buffer, the display memory buffer is used to store a cached image, and the number of pixels in the horizontal direction of the cached image is larger than that of the display in the horizontal direction. The number of pixels, the number of pixels in the vertical direction of the cached image is greater than the number of pixels in the vertical direction of the display, and the current displayed image in the display is a part of the cached image, and the method includes: the terminal acquires the terminal and the relative movement of the eyes of a user using the terminal; The terminal obtains the image to be displayed in the cached image according to the positional relationship between the currently displayed image and the cached image and the relative motion. The image to be displayed is the image to be displayed on the display after the relative motion is compensated. The number of pixels in the horizontal direction of the image to be displayed The same as the number of pixels in the horizontal direction of the display, the number of pixels in the vertical direction of the image to be displayed is the same as the number of pixels in the vertical direction of the display.

In the method provided by the embodiment of the present invention, after the terminal obtains the relative movement amount of the eyes of the terminal and the user using the terminal, it can obtain the relative movement amount in the cache image according to the positional relationship between the currently displayed image and the cached image and the relative movement amount and compensate the relative movement amount. Since the number of pixels in the horizontal direction of the cached image is greater than the number of pixels in the horizontal direction of the display, the number of pixels in the vertical direction of the cached image is greater than the number of pixels in the vertical direction of the display, so that the number of pixels in the horizontal direction of the to-be-displayed image is The number of pixels in the horizontal direction of the display can be the same as the number of pixels in the horizontal direction of the display, and the number of pixels in the vertical direction of the image to be displayed can be the same as the number of pixels in the vertical direction of the display.

With reference to the first aspect, in a first possible implementation manner, the relative movement amount includes a relative displacement movement amount and/or a relative angular movement amount.

In this case, displacement compensation may be performed on the image displayed on the display, and angle compensation may be performed on the image displayed on the display.

In combination with the first possible implementation manner of the first aspect, in the second possible implementation manner, the terminal acquires the image to be displayed in the cached image according to the positional relationship between the currently displayed image and the cached image and the relative motion, including: When the movement amount is the displacement movement amount of the user's eyes relative to the terminal, and the displacement movement amount of the user's eyes relative to the terminal is the displacement movement amount along the x-axis direction or the displacement movement amount along the y-axis direction, the terminal will cache the data in the image with the current value. The image composed of N pixels in the display image corresponding to one-to-one is determined as the image to be displayed, wherein the coordinate value of any pixel in the image to be displayed in the cached image is higher than that in the currently displayed image. The coordinate value of the pixel corresponding to the pixel in the cached image is larger than the target value, the target value is the value of the displacement movement of the user's eyes relative to the terminal, and N is a positive integer; or, when the relative movement is the relative movement of the user's eyes relative to the terminal When the angular motion amount is , the terminal determines the image obtained by rotating the currently displayed image by the target angle as the image to be displayed, and the target angle is the value of the angular motion amount of the user's eyes relative to the terminal; or, when the relative motion amount is the user's eyes relative to the terminal When the displacement movement amount and the angular movement amount of the user's eyes relative to the terminal, and the displacement movement amount of the user's eyes relative to the terminal is the displacement movement amount along the x-axis direction or the displacement movement amount along the y-axis direction, the terminal will cache the The image composed of N pixels corresponding to the N pixels in the currently displayed image is determined as the intermediate image, and the terminal determines the image obtained by rotating the intermediate image by the target angle as the image to be displayed, wherein any arbitrary value in the intermediate image is determined as the image to be displayed. The coordinate value of a pixel in the cached image is larger than the coordinate value of the pixel corresponding to the pixel in the currently displayed image in the cached image by the target value, and the target value is the value of the displacement movement of the user's eyes relative to the terminal, The target angle is the value of the angular movement of the user's eyes relative to the terminal, and N is a positive integer.

In combination with the first possible implementation manner of the first aspect, in a third possible implementation manner, the terminal acquires the image to be displayed in the cached image according to the positional relationship and relative motion between the currently displayed image and the cached image, including: When the movement amount is the displacement movement amount of the user's eyes relative to the terminal, and the displacement movement amount of the user's eyes relative to the terminal is the displacement movement amount along the z-axis direction, the terminal determines the first position according to the positional relationship between the currently displayed image and the cached image and the relative movement amount. image, the terminal processes the first image to obtain a second image and determines that the second image is an image to be displayed; or, when the relative movement amount is the displacement movement amount of the user's eyes relative to the terminal and the angular movement amount of the user's eyes relative to the terminal, and When the displacement movement amount of the user's eyes relative to the terminal is the displacement movement amount along the z-axis direction, the terminal determines the first image according to the positional relationship between the currently displayed image and the cached image and the relative movement amount, and the terminal processes the first image to obtain the second image. , the terminal determines the image obtained by rotating the second image by the target angle as the image to be displayed, and the target angle is the value of the angular motion of the user's eyes relative to the terminal; wherein, when the value of the relative motion indicates that the user's eyes are far away from the terminal, the first An image is the image of the center part of the currently displayed image, and the terminal processes the first image so that the terminal enlarges the first image; or, when the value of the relative motion indicates that the user's eyes are close to the terminal, the currently displayed image is the center part of the first image. image, the terminal processes the first image so that the terminal reduces the first image.

With reference to any one of the first possible implementation manner to the third possible implementation manner of the first aspect, in a fourth possible implementation manner, the relative angular movement amount includes the user's eyes relative to the terminal in a three-dimensional direction angular movement.

With reference to the first aspect and any one of the first possible implementation manner to the fourth possible implementation manner of the first aspect, in a fifth possible implementation manner, the terminal obtains the eyes of the terminal and the user who uses the terminal The relative movement amount includes: the terminal adopts the iris technology or the sclera technology to detect the movement of the user's eyes relative to the terminal, and obtains the relative movement amount of the user's eyes relative to the terminal.

Since the iris technology or the sclera technology has higher recognition accuracy than the face recognition technology, the accuracy of the determined relative movement amount can be improved.

A second aspect provides a terminal, the terminal includes a RAM and a display, the RAM includes a display memory buffer, the display memory buffer is used to store a cached image, the number of pixels in the horizontal direction of the cached image is greater than the number of pixels in the horizontal direction of the display, and the cache The number of pixels in the vertical direction of the image is greater than the number of pixels in the vertical direction of the display, and the currently displayed image in the display is a part of the cached image. motion amount; a second acquisition unit, configured to acquire the image to be displayed in the cached image according to the positional relationship between the currently displayed image and the cached image and the relative motion amount, the to-be-displayed image is the image to be displayed in the display after the relative motion amount is compensated, and the to-be-displayed image is to be displayed The number of pixels in the horizontal direction of the displayed image is the same as the number of pixels in the horizontal direction of the display, and the number of pixels in the vertical direction of the image to be displayed is the same as the number of pixels in the vertical direction of the display.

Since each unit in the terminal is used to execute the above method, the beneficial effects of the terminal can be referred to the beneficial effects described in the method section.

With reference to the second aspect, in a first possible implementation manner, the relative movement amount includes a relative displacement movement amount and/or a relative angular movement amount.

In this case, displacement compensation may be performed on the image displayed on the display, and angle compensation may be performed on the image displayed on the display.

In combination with the first possible implementation manner of the second aspect, in the second possible implementation manner, the second acquisition unit is specifically configured to: when the relative motion amount is the displacement motion amount of the user's eyes relative to the terminal, and the user's eyes When the displacement movement amount relative to the terminal is the displacement movement amount along the x-axis direction or the displacement movement amount along the y-axis direction, the N pixels in the cached image corresponding to the N pixels in the currently displayed image are composed of The image is determined to be the image to be displayed, wherein the coordinate value of any pixel in the image to be displayed in the cached image is larger than the coordinate value of the pixel corresponding to the pixel in the currently displayed image in the cached image by the target value , the target value is the value of the displacement movement amount of the user's eyes relative to the terminal, and N is a positive integer; or, when the relative movement amount is the angular movement amount of the user's eyes relative to the terminal, determine the image obtained by rotating the currently displayed image by the target angle For the image to be displayed, the target angle is the value of the angular movement of the user's eyes relative to the terminal; or, when the relative movement is the displacement movement of the user's eyes relative to the terminal and the angular movement of the user's eyes relative to the terminal, and the user's eyes When the displacement movement amount relative to the terminal is the displacement movement amount along the x-axis direction or the displacement movement amount along the y-axis direction, the N pixels in the cached image corresponding to the N pixels in the currently displayed image are composed of The image is determined as the intermediate image, and the image obtained after the intermediate image is rotated by the target angle is determined as the image to be displayed, wherein the coordinate value of any pixel in the intermediate image in the cached image is higher than that in the currently displayed image. The coordinate value of the corresponding pixel in the cached image is larger than the target value, the target value is the value of the displacement movement of the user's eyes relative to the terminal, the target angle is the value of the angular movement of the user's eyes relative to the terminal, and N is a positive integer.

In combination with the first possible implementation manner of the second aspect, in a third possible implementation manner, the second acquisition unit is specifically used for: when the relative motion amount is the displacement motion amount of the user's eyes relative to the terminal, and the user's eyes When the displacement movement amount relative to the terminal is the displacement movement amount along the z-axis direction, the first image is determined according to the positional relationship between the currently displayed image and the cached image and the relative movement amount, the first image is processed to obtain the second image, and the second image is determined. is the image to be displayed; or, when the relative movement amount is the displacement movement amount of the user's eyes relative to the terminal and the angular movement amount of the user's eyes relative to the terminal, and the displacement movement amount of the user's eyes relative to the terminal is the displacement movement amount along the z-axis direction , determine the first image according to the positional relationship and relative motion between the currently displayed image and the cached image, process the first image to obtain the second image, and determine the image obtained by rotating the second image by the target angle as the image to be displayed. is the value of the angular motion of the user's eyes relative to the terminal; wherein, when the value of the relative motion indicates that the user's eyes are far away from the terminal, the first image is the image of the center part of the currently displayed image, and the first image is processed to enlarge the first image. or, when the value of the relative movement amount indicates that the user's eyes are close to the terminal, the currently displayed image is the image in the center part of the first image, and the first image is processed to reduce the first image.

With reference to any one of the first possible implementation manner to the third possible implementation manner of the second aspect, in a fourth possible implementation manner, the relative angular movement amount includes the user's eyes relative to the terminal in a three-dimensional direction angular movement.

With reference to the second aspect and any one of the first possible implementation manner to the fourth possible implementation manner of the second aspect, in the fifth possible implementation manner, the first obtaining unit is specifically configured to: adopt The iris technology or the sclera technology detects the movement of the user's eyes relative to the terminal, and obtains the relative movement amount of the user's eyes relative to the terminal.

Since the iris technology or the sclera technology has higher recognition accuracy than the face recognition technology, the accuracy of the determined relative movement amount can be improved.

A third aspect provides a terminal, the terminal includes a RAM and a display, the RAM includes a display memory buffer, the display memory buffer is used to store a cached image, the number of pixels in the horizontal direction of the cached image is greater than the number of pixels in the horizontal direction of the display, and the cache The number of pixels in the vertical direction of the image is greater than the number of pixels in the vertical direction of the display. The currently displayed image in the display is a part of the cached image. The terminal includes: a memory and a processor; the memory is used for storing code, and the processor executes the following according to the code. Action: Obtain the relative motion of the eyes of the terminal and the user using the terminal; obtain the image to be displayed in the cached image according to the positional relationship between the currently displayed image and the cached image and the relative motion. For an image to be displayed, the number of pixels in the horizontal direction of the image to be displayed is the same as the number of pixels in the horizontal direction of the display, and the number of pixels in the vertical direction of the image to be displayed is the same as the number of pixels in the vertical direction of the display.

Since each device in the terminal is used to execute the above method, the beneficial effects of the terminal can be referred to the beneficial effects described in the method section.

With reference to the third aspect, in a first possible implementation manner, the relative movement amount includes a relative displacement movement amount and/or a relative angular movement amount.

In this case, displacement compensation may be performed on the image displayed on the display, and angle compensation may be performed on the image displayed on the display.

With reference to the first possible implementation manner of the third aspect, in the second possible implementation manner, the processor is specifically configured to: when the relative movement amount is the displacement movement amount of the user's eyes relative to the terminal, and the user's eyes are relative to the terminal When the displacement movement amount of the terminal is the displacement movement amount along the x-axis direction or the displacement movement amount along the y-axis direction, the image composed of N pixels in the cached image corresponding to the N pixels in the currently displayed image is stored. It is determined to be an image to be displayed, wherein the coordinate value of any pixel in the image to be displayed in the cached image is larger than the coordinate value of the pixel corresponding to the pixel in the currently displayed image in the cached image by the target value. The value is the value of the displacement movement amount of the user's eyes relative to the terminal, and N is a positive integer; or, when the relative movement amount is the angular movement amount of the user's eyes relative to the terminal, the image obtained by rotating the currently displayed image by the target angle is determined as the waiting To display the image, the target angle is the value of the angular movement of the user's eyes relative to the terminal; or, when the relative movement is the displacement movement of the user's eyes relative to the terminal and the angular movement of the user's eyes relative to the terminal, and the user's eyes are relative to the terminal. When the displacement movement amount of the terminal is the displacement movement amount along the x-axis direction or the displacement movement amount along the y-axis direction, the image composed of N pixels in the cached image corresponding to the N pixels in the currently displayed image is stored. It is determined as an intermediate image, and the image obtained by rotating the intermediate image by the target angle is determined as the image to be displayed, wherein the coordinate value of any pixel in the intermediate image in the cached image is higher than that in the currently displayed image corresponding to the pixel. The coordinate value of the pixel in the cached image is larger than the target value, the target value is the value of the displacement movement of the user's eyes relative to the terminal, the target angle is the value of the angular movement of the user's eyes relative to the terminal, and N is a positive integer.

With reference to the first possible implementation manner of the third aspect, in the third possible implementation manner, the processor is specifically configured to: when the relative movement amount is the displacement movement amount of the user's eyes relative to the terminal, and the user's eyes are relative to the terminal When the displacement movement amount of the terminal is the displacement movement amount along the z-axis direction, the first image is determined according to the positional relationship between the currently displayed image and the cached image and the relative movement amount, the first image is processed to obtain the second image, and the second image is determined as the waiting image. display an image; or, when the relative movement amount is the displacement movement amount of the user's eyes relative to the terminal and the angular movement amount of the user's eyes relative to the terminal, and the displacement movement amount of the user's eyes relative to the terminal is the displacement movement amount along the z-axis direction, The first image is determined according to the positional relationship and relative motion between the currently displayed image and the cached image, the second image is obtained by processing the first image, and the image obtained by rotating the second image by the target angle is determined as the image to be displayed, and the target angle is the user's The value of the angular motion of the eye relative to the terminal; wherein, when the value of the relative motion indicates that the user's eyes are far away from the terminal, the first image is the image of the center part of the currently displayed image, and the first image is processed to enlarge the first image; Alternatively, when the value of the relative movement amount indicates that the user's eyes are close to the terminal, the currently displayed image is the image in the center portion of the first image, and the first image is processed to reduce the size of the first image.

With reference to any one of the first possible implementation manner to the third possible implementation manner of the third aspect, in a fourth possible implementation manner, the relative angular movement amount includes the user's eyes relative to the terminal in a three-dimensional direction angular movement.

With reference to the third aspect and any one of the first possible implementation manner to the fourth possible implementation manner of the third aspect, in the fifth possible implementation manner, the processor is specifically configured to: adopt the iris technology Or the scleral technology detects the movement of the user's eye relative to the terminal, and obtains the relative movement amount of the user's eye relative to the terminal.

Since the iris technology or the sclera technology has higher recognition accuracy than the face recognition technology, the accuracy of the determined relative movement amount can be improved.

In a fourth aspect, a computer-readable storage medium storing one or more programs is provided, wherein the one or more programs include instructions, and the instructions, when executed by a terminal, cause the terminal to perform any one of the methods provided in the first aspect.

The computer-readable storage medium is used for the terminal to implement the above method, and therefore, for the beneficial effects, please refer to the beneficial effects described in the method section.

Description of drawings

In order to explain the embodiments of the present invention or the technical solutions in the prior art more clearly, the following briefly introduces the accompanying drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present invention. For those of ordinary skill in the art, other drawings can also be obtained according to these drawings without creative efforts.

FIG. 1 is a schematic diagram of the composition of a terminal according to an embodiment of the present invention;

FIG. 2 is a flowchart of a terminal display anti-shake method according to an embodiment of the present invention;

3 is a schematic diagram of the size relationship between a cached image and a currently displayed image provided by an embodiment of the present invention;

4-a is a schematic diagram of a positional relationship between a currently displayed image and a cached image according to an embodiment of the present invention;

4-b is a schematic diagram of a positional relationship between an image to be displayed and a cached image according to an embodiment of the present invention;

5 is a schematic diagram of a positional relationship between a currently displayed image and a first image according to an embodiment of the present invention;

6-a is a schematic diagram of a positional relationship between a currently displayed image and a cached image according to an embodiment of the present invention;

6-b is a schematic diagram of an image displayed in a display provided by an embodiment of the present invention;

7-a is a schematic diagram of a positional relationship between a currently displayed image and a rotated currently displayed image according to an embodiment of the present invention;

FIG. 7-b is a schematic diagram of a positional relationship between another currently displayed image and a rotated currently displayed image according to an embodiment of the present invention;

7-c is a schematic diagram of a positional relationship between another currently displayed image and a rotated currently displayed image provided by an embodiment of the present invention;

FIG. 8 is a schematic diagram of the composition of a terminal according to an embodiment of the present invention;

FIG. 9 is a schematic diagram of the composition of another terminal according to an embodiment of the present invention.

Detailed ways

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

As shown in FIG. 1 , it is a schematic diagram of the composition of a terminal, and the method provided by the embodiment of the present invention can be applied to the terminal. The terminal includes hardware and software. The software includes the operating system, middleware, display anti-shake module, and application programs. The operating system includes the sensor data processing module and Framebuffer. The hardware includes the central processing unit (Central Processing Unit). Unit, referred to as CPU), graphics processor (GraphicsProcessing Unit, referred to as GPU), display, memory, and sensors. The current method for anti-shake content displayed on the terminal includes: a sensor acquires the motion data of the terminal, and transmits the motion data to the sensor data processing module. After the sensor data processing module processes the motion data, it transmits the processed motion data to Display anti-shake module, the display anti-shake module uses the display anti-shake algorithm to calculate the motion data processed by the sensor data processing module to determine the compensation amount of the content displayed by the terminal, and the Framebuffer displays the image data in the memory on the display according to the compensation amount. middle.

An embodiment of the present invention provides a display anti-shake method for a terminal. The terminal includes a random access memory (Random-Access Memory, RAM for short) and a display, and the RAM includes a display memory buffer, and the display memory buffer is used for For storing a cached image, the number of pixels in the horizontal direction of the cached image is greater than the number of pixels in the horizontal direction of the display, and the number of pixels in the vertical direction of the cached image is greater than the number of pixels in the vertical direction of the display, and the display The currently displayed image in is a part of the cached image, as shown in Figure 2, the method includes:

201. The terminal acquires the relative movement amount of the eyes of the terminal and a user using the terminal.

Wherein, the terminal in the embodiment of the present invention may be a mobile phone, a virtual reality (Virtual Reality, VR for short) device, an augmented reality (Augmented Reality, AR) device, a tablet computer, a smart watch, a projection device, and other devices when users watch images and the human eye may transmit jitter to the display device.

In the embodiment of the present invention, the image displayed on the display of the terminal may be a video image, a game screen, and web page content, which is not limited in the embodiment of the present invention.

When the method provided by the embodiment of the present invention is specifically implemented, the trigger condition for the terminal to perform step 201 may be that the screen of the terminal is lit.

Among them, the display memory buffer is used to cache the data of a complete frame of image (specifically including the position and gray value of each pixel in the image, etc.), when the terminal displays the image, the image has been drawn in the display memory buffer After that, the data in the display memory buffer can be managed by Framebuffer.

In this embodiment of the present invention, the number of pixels in the horizontal direction and the number of pixels in the vertical direction of the cached image may be determined according to the number of pixels in the horizontal direction and the number of pixels in the vertical direction of the display of the terminal, and the number of pixels in the horizontal direction and the number of pixels in the vertical direction of the cached image The number of pixels in the direction is greater than the number of pixels in the horizontal direction and the number of pixels in the vertical direction of the display, respectively.

Exemplarily, as shown in FIG. 3 , area 1 represents the display of the terminal, and the number of pixels in the horizontal direction is X ₁ , the number of pixels in the vertical direction is Y ₁ , and the area 2 represents the cache image, and the number of pixels in the horizontal direction is X 1 . ₂ , the number of pixels in the vertical direction is Y ₂ , where X ₂ is greater than X ₁ , and Y ₂ is greater than Y ₁ .

Optionally, the relative movement amount includes a relative displacement movement amount and/or a relative angular movement amount.

In this case, displacement compensation may be performed on the image displayed on the display, and angle compensation may be performed on the image displayed on the display.

Optionally, when step 201 is specifically implemented, it includes: the terminal uses iris technology or scleral technology to detect the movement of the user's eyes relative to the terminal, and obtains the relative movement of the user's eyes relative to the terminal. amount of exercise.

Specifically, the terminal can use the front camera of the terminal to acquire multiple frames of foreground images, and identify the iris (or sclera) in the foreground image through the iris technology (or sclera technology), according to the iris (or sclera) in the multiple frames of foreground images. The position and rotation angle determine the relative movement amount of the user's eyes relative to the terminal.

Since the iris technology or the sclera technology has higher recognition accuracy than the face recognition technology, the accuracy of the determined relative movement amount can be improved.

In addition, the terminal can also perform three-dimensional modeling of the user's eyes based on the depth sensor technology (such as structured light, laser sensor, etc.) Distance and other information to accurately calculate relative motion.

202. The terminal acquires an image to be displayed in the cached image according to the positional relationship between the currently displayed image and the cached image and the relative motion amount, where the to-be-displayed image is obtained after compensating for the relative motion amount, For the image to be displayed in the display, the number of pixels in the horizontal direction of the image to be displayed is the same as the number of pixels in the horizontal direction of the display, and the number of pixels in the vertical direction of the image to be displayed is the same as the number of pixels in the vertical direction of the display. the same number of pixels.

It should be noted that, when the terminal obtains the relative motion, since the image displayed by the terminal on the display has been drawn in the display memory buffer before being displayed on the display, the terminal can quickly determine the image to be displayed, and quickly Displays the image to be displayed.

Specifically, when the relative displacement amounts are different motion amounts, the execution methods of step 202 are also different. The following five cases are used as examples to introduce the realization methods of step 202:

Mode 1: When the relative movement amount is the displacement movement amount of the user's eyes relative to the terminal, and the displacement movement amount of the user's eyes relative to the terminal is the displacement movement amount along the x-axis direction or along the y-axis direction When the displacement movement amount is , the terminal determines an image composed of N pixels in the cached image that correspond to N pixels in the currently displayed image as the to-be-displayed image, wherein the The coordinate value of any pixel in the image to be displayed in the cached image is larger than the coordinate value of the pixel corresponding to the pixel in the currently displayed image in the cached image by a target value, and the target The value is the value of the displacement movement amount of the user's eyes relative to the terminal, and N is a positive integer.

Wherein, the plane where the x-y vertical coordinate system is located and the plane where the display is located are the same plane or a parallel plane.

In the specific implementation of the first method, a pixel in the currently displayed image can be used as the first reference pixel, the coordinates of the first reference pixel are increased by the target value to obtain the second reference pixel, and then according to the first reference pixel The position in the currently displayed image, the image to be displayed is obtained from the cached image based on the second reference pixel point, the position of the second reference pixel point in the to-be-displayed image is the same as the position of the first reference pixel point in the currently displayed image .

Exemplarily, based on the example described in FIG. 3, referring to FIG. 4-a, A is the first reference pixel point, and its coordinate value in the cached image is (x, y), if the value of the displacement movement amount is [w ₁ , 0], then add [w ₁ , 0] to the first reference pixel to obtain the second reference pixel A', see Figure 4-b, the coordinate value of A' in the cached image is (x+w ₁ , y), if A is the first pixel point in the horizontal direction in the current display image, and is the first pixel point in the vertical direction, then the terminal can use A' as the benchmark to determine X ₁ pixel point in the horizontal direction, The image formed by Y ₁ pixels in the vertical direction is the image to be displayed. In this example, the currently displayed image is the image in the area 1 in FIG. 4-a, and the image to be displayed is the area 1 in FIG. 4-b. The image in , w ₁ in this example is a positive value.

It should be noted that the target value in the embodiment of the present invention can be represented by [w ₁ , w ₂ ], where w ₁ and w ₂ represent the relative displacement motion along the x-axis and y-axis, respectively, and w ₁ and w ₂ are both The direction of the relative displacement movement amount (positive or negative along the corresponding axis) can be distinguished by the sign carried. Certainly, the values in the method for representing the target value may also be in other sequences, which are not specifically limited in this embodiment of the present invention. The embodiments of the present invention only illustrate a method for expressing the target value, and other methods may also be used to express the target value in fact.

Method 2: When the relative movement amount is the displacement movement amount of the user's eyes relative to the terminal, and the displacement movement amount of the user's eyes relative to the terminal is the displacement movement amount along the z-axis direction, the The terminal determines a first image according to the positional relationship between the currently displayed image and the cached image and the relative motion, the terminal processes the first image to obtain a second image, and determines that the second image is the Image to be displayed.

Wherein, when the value of the relative movement amount indicates that the user's eyes are far away from the terminal, the first image is the image of the central part of the currently displayed image, and the terminal processes the first image as the the terminal zooms in on the first image; or, when the value of the relative movement amount indicates that the user's eyes are close to the terminal, the currently displayed image is an image of the central part of the first image, and the terminal has The first image is processed so that the terminal reduces the first image.

In the specific implementation of the _second method, the number _of pixels k ₁ in the horizontal direction and the number _of pixels in the vertical direction _{k 2} can be converted according to the relative motion amount. The ratio is the same as the ratio of the number of pixels in the horizontal direction and the number of pixels in the vertical direction in the currently displayed image. Based on the currently displayed image, the cached image is obtained by k ₁ pixel in the left and right directions of the currently displayed image, up and down. The image with more than k ₂ pixels in each direction is used as the first image, and then the first image is reduced to the second image, and the number of pixels in the horizontal direction and the number of pixels in the vertical direction of the second image are respectively the same as the number of pixels in the horizontal direction of the display. The same as the number of pixels in the vertical direction.

Exemplarily, as shown in FIG. 5 , when k ₁ =2, k ₂ =3, the determined positional relationship between the first image and the currently displayed image may be referred to in FIG. 5 .

Wherein, the method of converting k ₁ and k ₂ according to the relative motion amount may be: determine a preset value, the preset value corresponds to a pixel point in the horizontal direction, and k ₁ is equal to the result of dividing the relative motion amount by the preset value after rounding The value of k ₂ is determined according to the ratio of k ₂ to k ₁ .

Mode 3: when the relative movement amount is the angular movement amount of the user's eyes relative to the terminal, the terminal determines the image obtained by rotating the currently displayed image by the target angle as the to-be-displayed image, and the The target angle is the value of the angular movement amount of the user's eyes relative to the terminal.

Optionally, the relative angular movement amount includes an angular movement amount of the user's eyes relative to the terminal in a three-dimensional direction.

Exemplarily, based on the example described in FIG. 3 , the image in area 1 in FIG. 6-a is the currently displayed image, and the angular motion obtained by the terminal is the counterclockwise rotation of the user's eyes around the z-axis relative to the terminal. When s ₁ °, the terminal can rotate the currently displayed image counterclockwise around the z-axis by s ₁ ° to display, and the image displayed on the display is shown in Figure 6-b.

In addition, the relative angular movement amount obtained by the terminal may also be an angle at which the user's eyes rotate relative to the terminal around the x-axis and the y-axis. Exemplarily, Figures 7-a, 7-b and 7-c respectively show the images displayed in the display after the currently displayed image is rotated around the z-axis, the y-axis and the x-axis, wherein Figures 7-a, In Fig. 7-b and Fig. 7-c, the image displayed in the display is the common part of the currently displayed image and the rotated currently displayed image.

It should be noted that, the target angle in the embodiment of the present invention may be represented by [s ₁ , s ₂ , s ₃ ], where s ₁ , s ₂ and s ₃ respectively represent around the x-axis, around the y-axis and around the According to the relative angular motion of the z-axis, s ₁ , s ₂ and s ₃ can all distinguish the direction of the relative angular motion (clockwise or counterclockwise around the corresponding axis) by the sign carried. Certainly, the values in the method for representing the target angle may also be in other sequences, which are not specifically limited in this embodiment of the present invention. In the embodiment of the present invention, only a method for expressing the target angle is exemplified, and in fact, other methods may also be used for expressing.

Mode 4: When the relative movement amount is the displacement movement amount of the user's eyes relative to the terminal, the angular movement amount of the user's eyes relative to the terminal, and the displacement of the user's eyes relative to the terminal When the movement amount is the displacement movement amount along the z-axis direction, the terminal determines the first image according to the positional relationship between the currently displayed image and the cached image and the relative movement amount, and the terminal processes the first image A second image is obtained, and the terminal determines an image obtained by rotating the second image by a target angle as the to-be-displayed image, where the target angle is a value of the angular motion of the user's eyes relative to the terminal.

The process of determining the second image may refer to the second mode, and the method of rotating the second image may refer to the third mode, which will not be repeated here.

Mode 5: When the relative movement amount is the displacement movement amount of the user's eyes relative to the terminal and the angular movement amount of the user's eyes relative to the terminal, and the displacement movement amount of the user's eyes relative to the terminal is When the displacement movement amount along the x-axis direction or the displacement movement amount along the y-axis direction, the terminal will be composed of N pixel points in the cached image that correspond one-to-one with the N pixel points in the currently displayed image. The image of the intermediate image is determined as the intermediate image, and the terminal determines the image obtained by rotating the intermediate image by the target angle as the image to be displayed, wherein the coordinates of any pixel in the intermediate image in the cached image The value is larger than the coordinate value of the pixel corresponding to the pixel in the currently displayed image in the cached image by a target value, and the target value is the value of the displacement movement of the user's eyes relative to the terminal , the target angle is the value of the angular movement of the user's eyes relative to the terminal, and N is a positive integer.

The process of determining the intermediate image may be determined by the method for determining the image to be displayed in the first mode, and the method for rotating the intermediate image may refer to the third mode, which will not be repeated here.

In this embodiment of the present invention, when the relative motion includes displacement motions in multiple dimensions, the image to be displayed may be determined according to the displacement motions in multiple dimensions in sequence, and the same is true when the relative motions include angular motions in multiple dimensions.

203. The terminal displays the image to be displayed on the display.

The method provided by the embodiment of the present invention can be applied in various life scenarios. Exemplarily, in the application scenario where the user takes the subway (or bus), if the user is browsing pictures, due to the shaking of the subway (or bus), This will cause relative movement between the user's eyes and the user's terminal, so that the user cannot browse pictures stably. In this case, the terminal can obtain the relative movement amount, and display the image to be displayed on the display after determining it.

In the method provided by the embodiment of the present invention, after the terminal obtains the relative movement amount of the eyes of the terminal and the user using the terminal, it can obtain the relative movement amount in the cache image according to the positional relationship between the currently displayed image and the cached image and the relative movement amount and compensate the relative movement amount. Since the number of pixels in the horizontal direction of the cached image is greater than the number of pixels in the horizontal direction of the display, the number of pixels in the vertical direction of the cached image is greater than the number of pixels in the vertical direction of the display, so that the number of pixels in the horizontal direction of the to-be-displayed image is The number of pixels in the horizontal direction of the display can be the same as the number of pixels in the horizontal direction of the display, and the number of pixels in the vertical direction of the image to be displayed can be the same as the number of pixels in the vertical direction of the display.

An embodiment of the present invention further provides a terminal 80, the terminal 80 includes a RAM and a display, the RAM includes a display memory buffer, the display memory buffer is used to store a cached image, and the pixels in the horizontal direction of the cached image The number is greater than the number of pixels in the horizontal direction of the display, the number of pixels in the vertical direction of the cached image is greater than the number of pixels in the vertical direction of the display, and the currently displayed image in the display is a part of the cached image, As shown in FIG. 8 , the terminal 80 includes:

a first obtaining unit 801, configured to obtain the relative movement amount of the eyes of the terminal 80 and the user using the terminal 80;

The second acquiring unit 802 is configured to acquire an image to be displayed in the cached image according to the positional relationship between the currently displayed image and the cached image and the relative motion amount, where the to-be-displayed image is the result of performing a calculation on the relative motion amount. After compensation, for the image to be displayed in the display, the number of pixels in the horizontal direction of the image to be displayed is the same as the number of pixels in the horizontal direction of the display, and the number of pixels in the vertical direction of the image to be displayed is the same as the number of pixels in the vertical direction of the display. The number of pixels in the vertical direction is the same.

Optionally, the relative movement amount includes a relative displacement movement amount and/or a relative angular movement amount.

Optionally, the second obtaining unit 802 is specifically configured to:

When the relative movement amount is the displacement movement amount of the user's eyes relative to the terminal 80, N pixels in the cached image corresponding to N pixels in the currently displayed image are composed of The image to be displayed is determined to be the image to be displayed, wherein the coordinate value of any pixel in the image to be displayed in the cached image is higher than that of the pixel corresponding to the pixel in the currently displayed image. The coordinate value in the cached image is larger than the target value, the target value is the value of the displacement movement amount of the user's eyes relative to the terminal 80, and N is a positive integer; or,

When the relative movement amount is the angular movement amount of the user's eyes relative to the terminal 80, the image obtained by rotating the currently displayed image by a target angle is determined as the to-be-displayed image, and the target angle is the The value of the angular movement amount of the user's eyes relative to the terminal 80; or,

When the relative movement amount is the displacement movement amount of the user's eyes relative to the terminal 80 and the angular movement amount of the user's eyes relative to the terminal 80, the cached image is compared with the currently displayed image. The image composed of the N pixels in the one-to-one correspondence is determined as the intermediate image, and the image obtained after the intermediate image is rotated by the target angle is determined as the image to be displayed, wherein the image in the intermediate image is determined as the image to be displayed. The coordinate value of any pixel in the cached image is larger than the coordinate value of the pixel corresponding to the pixel in the currently displayed image in the cached image by a target value, and the target value is the user The value of the displacement movement amount of the user's eyes relative to the terminal 80, the target angle is the value of the angular movement amount of the user's eyes relative to the terminal 80, and N is a positive integer;

Wherein, the displacement movement amount of the user's eyes relative to the terminal 80 is the displacement movement amount along the x-axis direction or the displacement movement amount along the y-axis direction.

Optionally, the second obtaining unit 802 is specifically configured to:

When the relative movement amount is the displacement movement amount of the user's eyes relative to the terminal 80, the first image is determined according to the positional relationship between the currently displayed image and the cached image and the relative movement amount, and the first image is determined according to the relative movement amount. An image is processed to obtain a second image, and the second image is determined as the to-be-displayed image; or,

When the relative movement amount is the displacement movement amount of the user's eyes relative to the terminal 80 and the angular movement amount of the user's eyes relative to the terminal 80, according to the position of the currently displayed image and the cached image The relationship and the relative motion amount determine the first image, process the first image to obtain a second image, and determine the image obtained by rotating the second image by a target angle as the to-be-displayed image, and the target angle is the value of the angular movement amount of the user's eyes relative to the terminal 80;

Wherein, the displacement movement amount of the user's eyes relative to the terminal 80 is the displacement movement amount along the z-axis direction;

When the value of the relative movement amount indicates that the user's eyes are far away from the terminal 80, the first image is an image of the central part of the currently displayed image, and the first image is processed to enlarge the first image or, when the value of the relative movement amount indicates that the user's eyes are close to the terminal 80, the currently displayed image is the image of the central part of the first image, and the first image is processed to be reduced the first image.

Optionally, the relative angular movement amount includes an angular movement amount of the user's eyes relative to the terminal 80 in a three-dimensional direction.

Optionally, the first obtaining unit 801 is specifically configured to: use iris technology or scleral technology to detect the movement of the user's eyes relative to the terminal 80, and obtain the relative movement of the user's eyes relative to the terminal 80. amount of exercise.

The first acquisition unit 801 may specifically include a front camera and a processor of the terminal, wherein the front camera is used to acquire multiple frames of foreground images, and the processor is used to obtain the position and rotation angle of the iris (or sclera) in the multiple frames of foreground images. etc. to determine the relative movement amount of the user's eyes relative to the terminal.

Actions performed by each unit in the terminal provided in the embodiment of the present invention are consistent with the method provided in the embodiment of the present invention. Therefore, for the beneficial effects of the terminal in the embodiment of the present invention, reference may be made to the method in the embodiment of the present invention. The beneficial effects will not be repeated here.

An embodiment of the present invention further provides a terminal 90, the terminal 90 includes a RAM and a display, the RAM includes a display memory buffer, the display memory buffer is used to store a cached image, and the pixels in the horizontal direction of the cached image The number is greater than the number of pixels in the horizontal direction of the display, the number of pixels in the vertical direction of the cached image is greater than the number of pixels in the vertical direction of the display, and the currently displayed image in the display is a part of the cached image, As shown in FIG. 9 , the terminal 90 includes: a memory 901 and a processor 902;

The memory 901 is used to store codes, and the processor 902 performs the following actions according to the codes:

acquiring the relative movement amount of the eyes of the terminal 90 and the user using the terminal 90;

The to-be-displayed image is acquired from the cached image according to the positional relationship between the currently displayed image and the cached image and the relative motion amount. For the displayed image, the number of pixels in the horizontal direction of the image to be displayed is the same as the number of pixels in the horizontal direction of the display, and the number of pixels in the vertical direction of the image to be displayed is the same as the number of pixels in the vertical direction of the display.

Optionally, the relative movement amount includes a relative displacement movement amount and/or a relative angular movement amount.

Optionally, the processor 902 is specifically configured to:

When the relative movement amount is the displacement movement amount of the user's eyes relative to the terminal 90, N pixels in the cached image corresponding to N pixels in the currently displayed image are composed of The image to be displayed is determined to be the image to be displayed, wherein the coordinate value of any pixel in the image to be displayed in the cached image is higher than that of the pixel corresponding to the pixel in the currently displayed image. The coordinate value in the cached image is larger than the target value, the target value is the value of the displacement movement amount of the user's eyes relative to the terminal 90, and N is a positive integer; or,

When the relative movement amount is the angular movement amount of the user's eyes relative to the terminal 90, the image obtained by rotating the currently displayed image by a target angle is determined as the to-be-displayed image, and the target angle is the The value of the angular movement amount of the user's eyes relative to the terminal 90; or,

When the relative movement amount is the displacement movement amount of the user's eyes relative to the terminal 90 and the angular movement amount of the user's eyes relative to the terminal 90, the cached image is compared with the currently displayed image. The image composed of the N pixels in the one-to-one correspondence is determined as the intermediate image, and the image obtained after the intermediate image is rotated by the target angle is determined as the image to be displayed, wherein the image in the intermediate image is determined as the image to be displayed. The coordinate value of any pixel in the cached image is larger than the coordinate value of the pixel corresponding to the pixel in the currently displayed image in the cached image by a target value, and the target value is the user The value of the displacement movement amount of the user's eyes relative to the terminal 90, the target angle is the value of the angular movement amount of the user's eyes relative to the terminal 90, and N is a positive integer;

Wherein, the displacement movement amount of the user's eyes relative to the terminal 90 is the displacement movement amount along the x-axis direction or the displacement movement amount along the y-axis direction.

Optionally, the processor 902 is specifically configured to:

When the relative movement amount is the displacement movement amount of the user's eyes relative to the terminal 90, the first image is determined according to the positional relationship between the currently displayed image and the cached image and the relative movement amount, and the first image is determined according to the relative movement amount. An image is processed to obtain a second image, and the second image is determined as the to-be-displayed image; or,

When the relative movement amount is the displacement movement amount of the user's eyes relative to the terminal 90 and the angular movement amount of the user's eyes relative to the terminal 90, according to the position of the currently displayed image and the cached image The relationship and the relative motion amount determine the first image, process the first image to obtain a second image, and determine the image obtained by rotating the second image by a target angle as the to-be-displayed image, and the target angle is the value of the angular movement amount of the user's eyes relative to the terminal 90;

Wherein, the displacement movement amount of the user's eyes relative to the terminal 90 is the displacement movement amount along the z-axis direction;

When the value of the relative movement amount indicates that the user's eyes are far away from the terminal 90, the first image is an image of the center part of the currently displayed image, and the first image is processed to enlarge the first image or, when the value of the relative movement amount indicates that the user's eyes are close to the terminal 90, the currently displayed image is the image of the central part of the first image, and the first image is processed to be reduced the first image.

Optionally, the relative angular movement amount includes an angular movement amount of the user's eyes relative to the terminal 90 in a three-dimensional direction.

Optionally, the processor 902 is specifically configured to: detect the movement of the user's eyes relative to the terminal 90 by using the iris technology or the sclera technology, and obtain the relative movement of the user's eyes relative to the terminal 90 . amount of exercise.

The first obtaining unit 801 and the second obtaining unit 802 in the terminal 80 may be the processor 902 in the terminal 90 . Other units in the terminal 80 may be embedded in or independent of the processor of the terminal 80 in the form of hardware, or may be stored in the memory of the terminal 80 in the form of software, so that the processor can call and execute the operations corresponding to the above units. The processor may be a central processing unit (Central Processing Unit, CPU for short), a specific integrated circuit (Application Specific Integrated Circuit, ASIC for short), or one or more integrated circuits configured to implement the embodiments of the present invention.

Actions performed by each device in the terminal provided in the embodiment of the present invention are consistent with the method provided in the embodiment of the present invention. Therefore, for the beneficial effects of the terminal in the embodiment of the present invention, reference may be made to the method in the embodiment of the present invention. The beneficial effects will not be repeated here.

Embodiments of the present invention also provide a computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by a terminal, cause the terminal to execute the method according to the above.

The computer-readable storage medium is used for the terminal to implement the above method, and its beneficial effects can be found in the beneficial effects of the method section, which will not be repeated here.

In the several embodiments provided in this application, it should be understood that the disclosed apparatus and method may be implemented in other manners. For example, the apparatus embodiments described above are only illustrative. For example, the division of the modules is only a logical function division. In actual implementation, there may be other division methods. For example, multiple modules or components may be combined or Can be integrated into another system, or some features can be ignored, or not implemented.

The modules described as separate components may or may not be physically separated, and the components shown as modules may or may not be physical modules, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.

In addition, each functional module in each embodiment of the present invention may be integrated into one processing module, or two or more modules may be integrated into one module. The above-mentioned integrated modules can be implemented in the form of hardware, or can be implemented in the form of hardware plus software function modules.

The above-mentioned integrated modules implemented in the form of software functional modules may be stored in a computer-readable storage medium. The above-mentioned software function modules are stored in a storage medium, and include several instructions to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to execute some steps of the methods described in various embodiments of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory, ROM for short), RAM, magnetic disk or optical disk and other media that can store program codes.

Claims (16)

1. An anti-shake method for a terminal display, wherein the terminal includes a Random Access Memory (RAM) and a display, the RAM includes a display memory buffer area, the display memory buffer area is used for storing a cache image, the number of pixels of the cache image in the horizontal direction is greater than that of the display in the horizontal direction, the number of pixels of the cache image in the vertical direction is greater than that of the display in the vertical direction, and a currently displayed image in the display is a part of the cache image, the method comprising:

the terminal acquires the relative movement amount of eyes of the terminal and a user using the terminal;

the terminal acquires an image to be displayed in the cache image according to the position relation between the current display image and the cache image and the relative motion amount, wherein the image to be displayed is an image to be displayed in the display after the relative motion amount is compensated, the number of pixels of the image to be displayed in the horizontal direction is the same as that of pixels of the display in the horizontal direction, and the number of pixels of the image to be displayed in the vertical direction is the same as that of pixels of the display in the vertical direction;

wherein the terminal acquires the relative movement amount of the terminal and the eyes of a user using the terminal, and comprises the following steps:

the terminal detects the movement of the user's eyes relative to the terminal using iris or sclera techniques and acquires the amount of relative movement of the user's eyes relative to the terminal.

2. The method of claim 1, wherein the amount of relative motion comprises an amount of relative displacement motion and/or an amount of relative angular motion.

3. The method according to claim 2, wherein the terminal acquires the image to be displayed in the buffer image according to the position relationship between the current display image and the buffer image and the relative motion amount, and comprises:

when the relative movement amount is the displacement movement amount of the eyes of the user relative to the terminal, the terminal determines an image formed by N pixel points in the cache image, which correspond to N pixel points in the current display image in a one-to-one manner, as the image to be displayed, wherein a coordinate value of any pixel point in the image to be displayed in the cache image is larger than a coordinate value of a pixel point corresponding to the pixel point in the current display image in the cache image by a target value, the target value is a value of the displacement movement amount of the eyes of the user relative to the terminal, and N is a positive integer; or,

when the relative motion amount is the angular motion amount of the eyes of the user relative to the terminal, the terminal determines an image obtained after the current display image is rotated by a target angle as the image to be displayed, wherein the target angle is the value of the angular motion amount of the eyes of the user relative to the terminal; or,

when the relative motion amount is the displacement motion amount of the user's eyes relative to the terminal and the angular motion amount of the user's eyes relative to the terminal, the terminal determines an image composed of N pixel points in the cache image, which correspond to N pixel points in the current display image one by one, as an intermediate image, and the terminal determines an image obtained after the intermediate image is rotated by a target angle as the image to be displayed, wherein a coordinate value of any one pixel point in the intermediate image in the cache image is larger than a coordinate value of the pixel point corresponding to the pixel point in the current display image in the cache image by a target value, the target value is a value of the displacement motion amount of the user's eyes relative to the terminal, and the target angle is a value of the angular motion amount of the user's eyes relative to the terminal, n is a positive integer;

wherein the amount of displacement motion of the user's eyes relative to the terminal is either along the x-axis direction or along the y-axis direction.

4. The method according to claim 2, wherein the terminal acquires the image to be displayed in the buffer image according to the position relationship between the current display image and the buffer image and the relative motion amount, and comprises:

when the relative movement amount is the displacement movement amount of the eyes of the user relative to the terminal, the terminal determines a first image according to the position relation between the current display image and the cache image and the relative movement amount, and the terminal processes the first image to obtain a second image and determines the second image as the image to be displayed; or,

when the relative motion amount is the displacement motion amount of the eyes of the user relative to the terminal and the angular motion amount of the eyes of the user relative to the terminal, the terminal determines a first image according to the position relation between the current display image and the cache image and the relative motion amount, the terminal processes the first image to obtain a second image, the terminal determines an image obtained after the second image is rotated by a target angle as the image to be displayed, and the target angle is the value of the angular motion amount of the eyes of the user relative to the terminal;

wherein a displacement movement amount of the user's eyes relative to the terminal is a displacement movement amount along a z-axis direction;

when the value of the relative motion amount indicates that the eyes of the user are far away from the terminal, the first image is an image of the central part of the currently displayed image, and the terminal processes the first image to enlarge the first image for the terminal; or, when the value of the relative motion amount indicates that the eyes of the user approach the terminal, the currently displayed image is an image of a central portion of the first image, and the terminal processes the first image so that the terminal reduces the first image.

5. The method according to any of claims 2-4, wherein the amount of relative angular movement comprises an amount of angular movement of the user's eyes in three dimensions relative to the terminal.

6. A terminal, wherein the terminal comprises a random access memory RAM and a display, the RAM comprising a display memory buffer for storing a buffer image, the number of pixels in the horizontal direction of the buffer image being greater than the number of pixels in the horizontal direction of the display, the number of pixels in the vertical direction of the buffer image being greater than the number of pixels in the vertical direction of the display, and a currently displayed image in the display being a portion of the buffer image, the terminal comprising:

a first acquisition unit configured to acquire a relative movement amount of the terminal and eyes of a user using the terminal;

a second obtaining unit, configured to obtain, from the cache image, an image to be displayed according to the position relationship between the current display image and the cache image and the relative motion amount, where the image to be displayed is an image to be displayed in the display after compensating for the relative motion amount, and a number of pixels in a horizontal direction of the image to be displayed is the same as a number of pixels in a horizontal direction of the display, and a number of pixels in a vertical direction of the image to be displayed is the same as a number of pixels in a vertical direction of the display;

the first obtaining unit is specifically configured to:

and detecting the movement of the eyes of the user relative to the terminal by adopting an iris technology or a sclera technology, and acquiring the relative movement amount of the eyes of the user relative to the terminal.

7. A terminal according to claim 6, characterized in that the amount of relative movement comprises an amount of relative displacement movement and/or an amount of relative angular movement.

8. The terminal according to claim 7, wherein the second obtaining unit is specifically configured to:

when the relative movement amount is the displacement movement amount of the eyes of the user relative to the terminal, determining an image composed of N pixel points in the cache image, which correspond to N pixel points in the current display image in a one-to-one manner, as the image to be displayed, wherein a coordinate value of any pixel point in the image to be displayed in the cache image is larger than a coordinate value of a pixel point in the current display image, which corresponds to the pixel point, in the cache image by a target value, the target value is a value of the displacement movement amount of the eyes of the user relative to the terminal, and N is a positive integer; or,

when the relative motion amount is the angular motion amount of the eyes of the user relative to the terminal, determining an image obtained after the current display image is rotated by a target angle as the image to be displayed, wherein the target angle is the value of the angular motion amount of the eyes of the user relative to the terminal; or,

when the relative movement amount is the displacement movement amount of the eyes of the user relative to the terminal and the angular movement amount of the eyes of the user relative to the terminal, determining an image composed of N pixel points in the cache image, which correspond to N pixel points in the current display image in a one-to-one manner, as an intermediate image, and determining an image obtained after the intermediate image is rotated by a target angle as the image to be displayed, wherein a coordinate value of any pixel point in the intermediate image in the cache image is larger than a coordinate value of the pixel point in the current display image, which corresponds to the pixel point, in the cache image by a target value, the target value is a value of the displacement movement amount of the eyes of the user relative to the terminal, and the target angle is a value of the angular movement amount of the eyes of the user relative to the terminal, n is a positive integer;

wherein the amount of displacement motion of the user's eyes relative to the terminal is either along the x-axis direction or along the y-axis direction.

9. The terminal according to claim 7, wherein the second obtaining unit is specifically configured to:

when the relative movement amount is the displacement movement amount of the eyes of the user relative to the terminal, determining a first image according to the position relation between the current display image and the cache image and the relative movement amount, processing the first image to obtain a second image, and determining the second image as the image to be displayed; or,

when the relative motion amount is the displacement motion amount of the eyes of the user relative to the terminal and the angular motion amount of the eyes of the user relative to the terminal, determining a first image according to the position relation between the current display image and the cache image and the relative motion amount, processing the first image to obtain a second image, and determining the image obtained after the second image is rotated by a target angle as the image to be displayed, wherein the target angle is the value of the angular motion amount of the eyes of the user relative to the terminal;

wherein a displacement movement amount of the user's eyes relative to the terminal is a displacement movement amount along a z-axis direction;

when the value of the relative motion amount indicates that the eyes of the user are far away from the terminal, the first image is an image of the central part of the currently displayed image, and the first image is processed to be enlarged; or, when the value of the relative motion amount indicates that the user's eyes are close to the terminal, the currently displayed image is an image of a central portion of the first image, and the first image is processed to be reduced.

10. A terminal according to any of claims 7-9, wherein said amount of relative angular movement comprises an amount of angular movement of the user's eyes in three dimensions relative to the terminal.

11. A terminal, wherein the terminal comprises a random access memory RAM and a display, the RAM comprising a display memory buffer for storing a buffer image, the number of pixels in the horizontal direction of the buffer image being greater than the number of pixels in the horizontal direction of the display, the number of pixels in the vertical direction of the buffer image being greater than the number of pixels in the vertical direction of the display, and a currently displayed image in the display being a portion of the buffer image, the terminal comprising: a memory and a processor;

the memory is configured to store code, and the processor performs the following actions in accordance with the code:

acquiring the relative movement amount of eyes of the terminal and a user using the terminal;

acquiring an image to be displayed in the cache image according to the position relationship between the current display image and the cache image and the relative motion amount, wherein the image to be displayed is an image to be displayed in the display after the relative motion amount is compensated, the number of pixels of the image to be displayed in the horizontal direction is the same as that of the display in the horizontal direction, and the number of pixels of the image to be displayed in the vertical direction is the same as that of the display in the vertical direction;

wherein the processor is specifically configured to:

and detecting the movement of the eyes of the user relative to the terminal by adopting an iris technology or a sclera technology, and acquiring the relative movement amount of the eyes of the user relative to the terminal.

12. A terminal according to claim 11, characterized in that the amount of relative movement comprises an amount of relative displacement movement and/or an amount of relative angular movement.

13. The terminal of claim 12, wherein the processor is specifically configured to:

when the relative movement amount is the displacement movement amount of the eyes of the user relative to the terminal, determining an image composed of N pixel points in the cache image, which correspond to N pixel points in the current display image in a one-to-one manner, as the image to be displayed, wherein a coordinate value of any pixel point in the image to be displayed in the cache image is larger than a coordinate value of a pixel point in the current display image, which corresponds to the pixel point, in the cache image by a target value, the target value is a value of the displacement movement amount of the eyes of the user relative to the terminal, and N is a positive integer; or,

when the relative motion amount is the angular motion amount of the eyes of the user relative to the terminal, determining an image obtained after the current display image is rotated by a target angle as the image to be displayed, wherein the target angle is the value of the angular motion amount of the eyes of the user relative to the terminal; or,

when the relative movement amount is the displacement movement amount of the eyes of the user relative to the terminal and the angular movement amount of the eyes of the user relative to the terminal, determining an image composed of N pixel points in the cache image, which correspond to N pixel points in the current display image in a one-to-one manner, as an intermediate image, and determining an image obtained after the intermediate image is rotated by a target angle as the image to be displayed, wherein a coordinate value of any pixel point in the intermediate image in the cache image is larger than a coordinate value of the pixel point in the current display image, which corresponds to the pixel point, in the cache image by a target value, the target value is a value of the displacement movement amount of the eyes of the user relative to the terminal, and the target angle is a value of the angular movement amount of the eyes of the user relative to the terminal, n is a positive integer;

wherein the amount of displacement motion of the user's eyes relative to the terminal is either along the x-axis direction or along the y-axis direction.

14. The terminal of claim 12, wherein the processor is specifically configured to:

when the relative movement amount is the displacement movement amount of the eyes of the user relative to the terminal, determining a first image according to the position relation between the current display image and the cache image and the relative movement amount, processing the first image to obtain a second image, and determining the second image as the image to be displayed; or,

when the relative motion amount is the displacement motion amount of the eyes of the user relative to the terminal and the angular motion amount of the eyes of the user relative to the terminal, determining a first image according to the position relation between the current display image and the cache image and the relative motion amount, processing the first image to obtain a second image, and determining the image obtained after the second image is rotated by a target angle as the image to be displayed, wherein the target angle is the value of the angular motion amount of the eyes of the user relative to the terminal;

wherein a displacement movement amount of the user's eyes relative to the terminal is a displacement movement amount along a z-axis direction;

when the value of the relative motion amount indicates that the eyes of the user are far away from the terminal, the first image is an image of the central part of the currently displayed image, and the first image is processed to be enlarged; or, when the value of the relative motion amount indicates that the user's eyes are close to the terminal, the currently displayed image is an image of a central portion of the first image, and the first image is processed to be reduced.

15. The terminal of any of claims 12-14, wherein the amount of relative angular motion comprises an amount of angular motion of the user's eyes in three dimensions relative to the terminal.

16. A computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a terminal, cause the terminal to perform the method of any of claims 1-5.

Images