CN108027646B - Anti-shaking method and device for terminal display - Google Patents
Anti-shaking method and device for terminal display Download PDFInfo
- Publication number
- CN108027646B CN108027646B CN201680009578.0A CN201680009578A CN108027646B CN 108027646 B CN108027646 B CN 108027646B CN 201680009578 A CN201680009578 A CN 201680009578A CN 108027646 B CN108027646 B CN 108027646B
- Authority
- CN
- China
- Prior art keywords
- image
- terminal
- relative
- eyes
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 80
- 238000006073 displacement reaction Methods 0.000 claims description 107
- 210000003786 sclera Anatomy 0.000 claims description 17
- 230000006641 stabilisation Effects 0.000 abstract description 2
- 238000011105 stabilization Methods 0.000 abstract description 2
- 210000000554 iris Anatomy 0.000 description 14
- 238000010586 diagram Methods 0.000 description 13
- 230000009286 beneficial effect Effects 0.000 description 10
- 230000000694 effects Effects 0.000 description 2
- 230000003190 augmentative effect Effects 0.000 description 1
- 230000004424 eye movement Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
A terminal display anti-shake method and device relate to the technical field of image stabilization and are used for solving the problem that a screen generated in the process of realizing display anti-shake has black edges. The RAM of the terminal (80, 90) includes a display memory buffer for storing a buffer image having a greater number of pixels in a horizontal direction and a greater number of pixels in a vertical direction than the number of pixels in the horizontal direction and the greater number of pixels in the vertical direction, respectively, of a display of the terminal (80, 90) in which a currently displayed image is a portion of the buffer image, the method comprising: the terminal (80, 90) acquires the amount of relative movement (201) of the terminal (80, 90) and the eyes of the user using the terminal (80, 90); and the terminal (80, 90) acquires an image to be displayed in the cache image according to the position relation and the relative motion amount between the current display image and the cache image, the image to be displayed is an image to be displayed in the display after the relative motion amount is compensated, and the number of pixels in the horizontal direction and the vertical direction of the image to be displayed is respectively the same as that of the pixels in the horizontal direction and the vertical direction of the display (202).
Description
Technical Field
The invention relates to the technical field of image stabilization, in particular to a terminal display anti-shake method and device.
Background
When a terminal plays a video, if the terminal has jitter (for example, when a user using the terminal is riding in a vehicle), the stability of the video viewed by the user using the terminal is affected. At present, in order to improve the stability of a video watched by a user in the presence of shake of a terminal, the terminal acquires the amount of motion of the terminal by using a built-in motion sensor, determines a displacement compensation amount of the terminal according to the acquired amount of motion of the terminal, and compensates an image displayed on a screen of the terminal according to the displacement compensation amount (for example, if the terminal is acquired to move one millimeter to the left, the image displayed on the screen of the terminal is moved one millimeter to the right), so that the amount of motion of the image displayed on the screen of the terminal is reduced as much as possible, and the stability of the video watched by the user is improved.
This method has a disadvantage that when the image displayed on the screen of the terminal is compensated according to the amount of movement of the terminal, the image displayed on the screen is black, that is, there is no image displayed in a part of the area of one side of the screen, and the image displayed on the other side exceeds the boundary of the screen (for example, the image displayed on the screen of the terminal is moved to the right by 5 pixels, and a blank of 5 pixels appears on the left side of the screen).
Disclosure of Invention
The embodiment of the invention provides a terminal display anti-shake method and device, which are used for solving the problem that a screen generates black edges in the process of realizing display anti-shake.
In order to achieve the above purpose, the embodiment of the invention adopts the following technical scheme:
in a first aspect, an anti-shake method for a terminal display is provided, where the terminal includes a RAM and a display, the RAM includes a display memory buffer area, the display memory buffer area is used to store a cache image, the number of pixels in the horizontal direction of the cache image is greater than the number of pixels in the horizontal direction of the display, the number of pixels in the vertical direction of the cache image is greater than the number of pixels in the vertical direction of the display, and a currently displayed image in the display is a part of the cache image, and the method includes: the method comprises the steps that the terminal obtains the relative movement amount of eyes of a terminal and a user using the terminal; the terminal acquires an image to be displayed in the cache image according to the position relation and the relative motion amount of the current display image and the cache image, the image to be displayed is an image to be displayed in the display after the relative motion amount is compensated, the number of pixels in the horizontal direction of the image to be displayed is the same as that in the horizontal direction of the display, and the number of pixels in the vertical direction of the image to be displayed is the same as that in the vertical direction of the display.
According to the method provided by the embodiment of the invention, after the terminal acquires the relative movement amount of the eyes of the terminal and the user using the terminal, the image to be displayed after compensating the relative movement amount can be acquired in the cache image according to the position relation between the current display image and the cache image and the relative movement amount, because the number of pixels in the horizontal direction of the cache image is greater than that in the horizontal direction of the display, and the number of pixels in the vertical direction of the cache image is greater than that in the vertical direction of the display, the number of pixels in the horizontal direction of the image to be displayed can be the same as that in the horizontal direction of the display, and the number of pixels in the vertical direction of the image to be displayed can be the same as that in the vertical direction of the display, so that when the display displays the image to be displayed, black borders cannot appear in the display.
With reference to the first aspect, in a first possible implementation manner, the amount of relative movement includes an amount of relative displacement movement and/or an amount of relative angle movement.
In this case, the image displayed on the display may be subjected to the displacement compensation, or the image displayed on the display may be subjected to the angle compensation.
With reference to the first possible implementation manner of the first aspect, in a second possible implementation manner, the acquiring, by the terminal, the image to be displayed in the cache image according to the position relationship and the relative motion amount between the current display image and the cache image includes: when the relative movement amount is the movement amount of the eyes of the user relative to the terminal, and the movement amount of the eyes of the user relative to the terminal is the movement amount of the displacement along the x-axis direction or the movement amount of the displacement along the y-axis direction, the terminal determines an image formed by N pixel points in the cache image, which correspond to the N pixel points in the current display image in a one-to-one mode, as an image to be displayed, wherein the coordinate value of any pixel point in the image to be displayed in the cache image is larger than the coordinate value of the pixel point in the current display image, which corresponds to the pixel point, in the cache image by a target value, the target value is the movement amount of the eyes of the user relative to the terminal, and N is a; or when the relative movement amount is the angular movement amount of the eyes of the user relative to the terminal, the terminal determines an image obtained by rotating the current display image by a target angle as an image to be displayed, and the target angle is the value of the angular movement amount of the eyes of the user relative to the terminal; or when the relative movement amount is the displacement movement amount of the eyes of the user relative to the terminal and the angular movement amount of the eyes of the user relative to the terminal, and the displacement movement amount of the eyes of the user relative to the terminal is the displacement movement amount along the x-axis direction or the displacement movement amount along the y-axis direction, the terminal determines an image consisting of N pixel points in the cache image and corresponding to N pixel points in the current display image as an intermediate image, and determines an image obtained by rotating the intermediate image by a target angle as an image to be displayed, wherein the coordinate value of any pixel point in the intermediate image in the cache image is larger than the coordinate value of the pixel point corresponding to the pixel point in the current display image in the cache image by a target value, the target value is the value of the displacement movement amount of the eyes of the user relative to the terminal, and the target angle is the value of the angular movement amount of the eyes of the user, n is a positive integer.
With reference to the first possible implementation manner of the first aspect, in a third possible implementation manner, the acquiring, by the terminal, the image to be displayed in the cache image according to the position relationship and the relative motion amount between the current display image and the cache image includes: when the relative movement amount is the movement amount of the eyes of the user relative to the terminal, and the movement amount of the eyes of the user relative to the terminal is the movement amount of the displacement along the z-axis direction, the terminal determines a first image according to the position relation between the current display image and the cache image and the relative movement amount, and the terminal processes the first image to obtain a second image and determines the second image as an image to be displayed; or when the relative movement amount is the displacement movement amount of the eyes of the user relative to the terminal and the angular movement amount of the eyes of the user relative to the terminal, and the displacement movement amount of the eyes of the user relative to the terminal is the displacement movement amount along the z-axis direction, the terminal determines a first image according to the position relation and the relative movement amount of the current display image and the cache image, the terminal processes the first image to obtain a second image, the terminal determines the image obtained after the second image is rotated by a target angle as the image to be displayed, and the target angle is the value of the angular movement amount of the eyes of the user relative to the terminal; when the value of the relative movement amount indicates that the eyes of the user are far away from the terminal, the first image is an image of the central part of the currently displayed image, and the terminal processes the first image into a terminal enlarged first image; alternatively, when the value of the relative movement amount indicates that the user's eyes are close to the terminal, the currently displayed image is an image of the center portion of the first image, and the terminal processes the first image to reduce the first image to the terminal.
With reference to any one of the first possible implementation manner to the third possible implementation manner of the first aspect, in a fourth possible implementation manner, the relative angular motion amount includes an angular motion amount of the user's eyes in a three-dimensional direction with respect to the terminal.
With reference to the first aspect and any one of the first possible implementation manner to the fourth possible implementation manner of the first aspect, in a fifth possible implementation manner, the acquiring, by a terminal, a relative movement amount of the terminal and an eye of a user using the terminal includes: the terminal detects the movement of the user's eyes relative to the terminal using iris or sclera techniques and acquires the amount of relative movement of the user's eyes relative to the terminal.
Compared with the face recognition technology, the iris technology or the sclera technology has higher recognition precision, so that the precision of the determined relative movement amount can be improved.
In a second aspect, a terminal is provided, where the terminal includes a RAM and a display, the RAM includes a display memory buffer area, the display memory buffer area is used for storing a cache image, the number of pixels in a horizontal direction of the cache image is greater than the number of pixels in a horizontal direction of the display, the number of pixels in a vertical direction of the cache image is greater than the number of pixels in a vertical direction of the display, and a currently displayed image in the display is a part of the cache image, and the terminal includes: a first acquisition unit configured to acquire a relative movement amount of eyes of a terminal and a user using the terminal; and the second acquisition unit is used for acquiring an image to be displayed in the cache image according to the position relation and the relative motion amount between the current display image and the cache image, wherein the image to be displayed is an image to be displayed in the display after the relative motion amount is compensated, the number of pixels in the horizontal direction of the image to be displayed is the same as that of the pixels in the horizontal direction of the display, and the number of pixels in the vertical direction of the image to be displayed is the same as that of the pixels in the vertical direction of the display.
As each unit in the terminal is configured to execute the method, the beneficial effects of the terminal can be seen from the beneficial effects described in the method section.
With reference to the second aspect, in a first possible implementation manner, the amount of relative movement includes an amount of relative displacement movement and/or an amount of relative angle movement.
In this case, the image displayed on the display may be subjected to the displacement compensation, or the image displayed on the display may be subjected to the angle compensation.
With reference to the first possible implementation manner of the second aspect, in a second possible implementation manner, the second obtaining unit is specifically configured to: when the relative movement amount is the movement amount of the eyes of the user relative to the terminal, and the movement amount of the eyes of the user relative to the terminal is the movement amount of the displacement along the x-axis direction or the movement amount of the displacement along the y-axis direction, determining an image formed by N pixel points in the cache image, which correspond to the N pixel points in the current display image in a one-to-one mode, as an image to be displayed, wherein the coordinate value of any pixel point in the image to be displayed in the cache image is larger than the coordinate value of the pixel point in the current display image, which corresponds to the pixel point, in the cache image by a target value, the target value is the value of the movement amount of the eyes of the user relative to the terminal, and N; or when the relative movement amount is the angular movement amount of the eyes of the user relative to the terminal, determining an image obtained by rotating the current display image by a target angle as an image to be displayed, wherein the target angle is the value of the angular movement amount of the eyes of the user relative to the terminal; or when the relative movement amount is the displacement movement amount of the eyes of the user relative to the terminal and the angular movement amount of the eyes of the user relative to the terminal, and the displacement movement amount of the eyes of the user relative to the terminal is the displacement movement amount along the x-axis direction or the displacement movement amount along the y-axis direction, determining an image consisting of N pixel points in the cache image and corresponding to N pixel points in the current display image one by one as an intermediate image, and determining an image obtained after the intermediate image is rotated by a target angle as an image to be displayed, wherein the coordinate value of any pixel point in the intermediate image in the cache image is larger than the coordinate value of the pixel point corresponding to the pixel point in the current display image in the cache image by a target value, the target value is the displacement movement amount of the eyes of the user relative to the terminal, and the target angle is the value of the angular movement amount of the eyes of the, n is a positive integer.
With reference to the first possible implementation manner of the second aspect, in a third possible implementation manner, the second obtaining unit is specifically configured to: when the relative movement amount is the movement amount of the eyes of the user relative to the terminal and the movement amount of the eyes of the user relative to the terminal is the movement amount of the displacement along the z-axis direction, determining a first image according to the position relation between the current display image and the cache image and the relative movement amount, processing the first image to obtain a second image and determining the second image as an image to be displayed; or when the relative movement amount is the displacement movement amount of the eyes of the user relative to the terminal and the angular movement amount of the eyes of the user relative to the terminal, and the displacement movement amount of the eyes of the user relative to the terminal is the displacement movement amount along the z-axis direction, determining a first image according to the position relation and the relative movement amount of the current display image and the cache image, processing the first image to obtain a second image, and determining the image obtained by rotating the second image by a target angle as an image to be displayed, wherein the target angle is the value of the angular movement amount of the eyes of the user relative to the terminal; when the value of the relative movement amount indicates that the eyes of the user are far away from the terminal, the first image is an image of the central part of the currently displayed image, and the first image is processed into an enlarged first image; alternatively, when the value of the relative movement amount indicates that the eyes of the user are close to the terminal, the currently displayed image is an image of a center portion of the first image, and the first image is processed to be a reduced first image.
With reference to any one of the first possible implementation manner to the third possible implementation manner of the second aspect, in a fourth possible implementation manner, the relative angular motion amount includes an angular motion amount of the user's eyes in a three-dimensional direction with respect to the terminal.
With reference to the second aspect and any one of the first possible implementation manner to the fourth possible implementation manner of the second aspect, in a fifth possible implementation manner, the first obtaining unit is specifically configured to: the iris technology or the sclera technology is adopted to detect the movement of the eyes of the user relative to the terminal, and the relative movement amount of the eyes of the user relative to the terminal is obtained.
Compared with the face recognition technology, the iris technology or the sclera technology has higher recognition precision, so that the precision of the determined relative movement amount can be improved.
In a third aspect, a terminal is provided, where the terminal includes a RAM and a display, the RAM includes a display memory buffer area, the display memory buffer area is used to store a cache image, a number of pixels in a horizontal direction of the cache image is greater than a number of pixels in a horizontal direction of the display, a number of pixels in a vertical direction of the cache image is greater than a number of pixels in a vertical direction of the display, and a currently displayed image in the display is a part of the cache image, and the terminal includes: a memory and a processor; the memory is used for storing code, and the processor executes the following actions according to the code: acquiring the relative movement amount of eyes of a terminal and a user using the terminal; and acquiring an image to be displayed in the cache image according to the position relation and the relative motion amount of the current display image and the cache image, wherein the image to be displayed is an image to be displayed in the display after the relative motion amount is compensated, the number of pixels in the horizontal direction of the image to be displayed is the same as that in the horizontal direction of the display, and the number of pixels in the vertical direction of the image to be displayed is the same as that in the vertical direction of the display.
Since the various components in the terminal are used to perform the above-described method, the advantageous effects of the terminal can be seen in the advantageous effects described in the method section.
With reference to the third aspect, in a first possible implementation manner, the amount of relative movement includes an amount of relative displacement movement and/or an amount of relative angle movement.
In this case, the image displayed on the display may be subjected to the displacement compensation, or the image displayed on the display may be subjected to the angle compensation.
With reference to the first possible implementation manner of the third aspect, in a second possible implementation manner, the processor is specifically configured to: when the relative movement amount is the movement amount of the eyes of the user relative to the terminal, and the movement amount of the eyes of the user relative to the terminal is the movement amount of the displacement along the x-axis direction or the movement amount of the displacement along the y-axis direction, determining an image formed by N pixel points in the cache image, which correspond to the N pixel points in the current display image in a one-to-one mode, as an image to be displayed, wherein the coordinate value of any pixel point in the image to be displayed in the cache image is larger than the coordinate value of the pixel point in the current display image, which corresponds to the pixel point, in the cache image by a target value, the target value is the value of the movement amount of the eyes of the user relative to the terminal, and N; or when the relative movement amount is the angular movement amount of the eyes of the user relative to the terminal, determining an image obtained by rotating the current display image by a target angle as an image to be displayed, wherein the target angle is the value of the angular movement amount of the eyes of the user relative to the terminal; or when the relative movement amount is the displacement movement amount of the eyes of the user relative to the terminal and the angular movement amount of the eyes of the user relative to the terminal, and the displacement movement amount of the eyes of the user relative to the terminal is the displacement movement amount along the x-axis direction or the displacement movement amount along the y-axis direction, determining an image consisting of N pixel points in the cache image and corresponding to N pixel points in the current display image one by one as an intermediate image, and determining an image obtained after the intermediate image is rotated by a target angle as an image to be displayed, wherein the coordinate value of any pixel point in the intermediate image in the cache image is larger than the coordinate value of the pixel point corresponding to the pixel point in the current display image in the cache image by a target value, the target value is the displacement movement amount of the eyes of the user relative to the terminal, and the target angle is the value of the angular movement amount of the eyes of the, n is a positive integer.
With reference to the first possible implementation manner of the third aspect, in a third possible implementation manner, the processor is specifically configured to: when the relative movement amount is the movement amount of the eyes of the user relative to the terminal and the movement amount of the eyes of the user relative to the terminal is the movement amount of the displacement along the z-axis direction, determining a first image according to the position relation between the current display image and the cache image and the relative movement amount, processing the first image to obtain a second image and determining the second image as an image to be displayed; or when the relative movement amount is the displacement movement amount of the eyes of the user relative to the terminal and the angular movement amount of the eyes of the user relative to the terminal, and the displacement movement amount of the eyes of the user relative to the terminal is the displacement movement amount along the z-axis direction, determining a first image according to the position relation and the relative movement amount of the current display image and the cache image, processing the first image to obtain a second image, and determining the image obtained by rotating the second image by a target angle as an image to be displayed, wherein the target angle is the value of the angular movement amount of the eyes of the user relative to the terminal; when the value of the relative movement amount indicates that the eyes of the user are far away from the terminal, the first image is an image of the central part of the currently displayed image, and the first image is processed into an enlarged first image; alternatively, when the value of the relative movement amount indicates that the eyes of the user are close to the terminal, the currently displayed image is an image of a center portion of the first image, and the first image is processed to be a reduced first image.
With reference to any one of the first possible implementation manner to the third possible implementation manner of the third aspect, in a fourth possible implementation manner, the relative angular motion amount includes an angular motion amount of an eye of the user in a three-dimensional direction with respect to the terminal.
With reference to the third aspect and any one of the first possible implementation manner to the fourth possible implementation manner of the third aspect, in a fifth possible implementation manner, the processor is specifically configured to: the iris technology or the sclera technology is adopted to detect the movement of the eyes of the user relative to the terminal, and the relative movement amount of the eyes of the user relative to the terminal is obtained.
Compared with the face recognition technology, the iris technology or the sclera technology has higher recognition precision, so that the precision of the determined relative movement amount can be improved.
In a fourth aspect, there is provided a computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a terminal, cause the terminal to perform any of the methods provided by the first aspect.
The computer readable storage medium is used for the terminal to implement the method, and therefore, the beneficial effects of the method can be seen in the beneficial effects described in the method section.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic composition diagram of a terminal according to an embodiment of the present invention;
fig. 2 is a flowchart of a terminal display anti-shaking method according to an embodiment of the present invention;
fig. 3 is a schematic diagram illustrating a size relationship between a cached image and a currently displayed image according to an embodiment of the present invention;
FIG. 4-a is a schematic diagram illustrating a positional relationship between a currently displayed image and a cached image according to an embodiment of the present invention;
fig. 4-b is a schematic diagram of a positional relationship between an image to be displayed and a cached image according to an embodiment of the present invention;
FIG. 5 is a schematic diagram illustrating a position relationship between a current display image and a first image according to an embodiment of the present invention;
FIG. 6-a is a schematic diagram illustrating a positional relationship between a currently displayed image and a cached image according to an embodiment of the present invention;
FIG. 6-b is a schematic diagram of an image displayed in a display according to an embodiment of the present invention;
FIG. 7-a is a schematic diagram illustrating a position relationship between a currently displayed image and a rotated currently displayed image according to an embodiment of the present invention;
FIG. 7-b is a schematic diagram illustrating a position relationship between a current display image and a rotated current display image according to an embodiment of the present invention;
FIG. 7-c is a schematic diagram illustrating a position relationship between a current display image and a rotated current display image according to an embodiment of the present invention;
fig. 8 is a schematic composition diagram of a terminal according to an embodiment of the present invention;
fig. 9 is a schematic composition diagram of another terminal according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
As shown in fig. 1, which is a schematic composition diagram of a terminal, the method provided in the embodiment of the present invention may be applied to the terminal. The terminal comprises a hardware part and a software part, wherein the software part specifically comprises an operating system, a middleware, a display anti-shake module, an application program and the like, the operating system specifically comprises a sensor data Processing module, a Framebuffer and the like, and the hardware part specifically comprises a Central Processing Unit (CPU), a Graphic Processing Unit (GPU), a display, a memory, a sensor and the like. The current method for anti-shaking the content displayed by the terminal includes: the method comprises the steps that a sensor acquires motion data of a terminal and transmits the motion data to a sensor data processing module, the sensor data processing module processes the motion data and transmits the processed motion data to a display anti-shaking module, the display anti-shaking module calculates the motion data processed by the sensor data processing module by adopting a display anti-shaking algorithm to determine compensation amount of content displayed by the terminal, and a Framebuffer displays image data in a memory in a display according to the compensation amount.
An embodiment of the present invention provides an anti-shaking method for terminal display, where the terminal includes a Random-Access Memory (RAM for short) and a display, the RAM includes a display Memory buffer area, the display Memory buffer area is used to store a cache image, the number of pixels in the horizontal direction of the cache image is greater than the number of pixels in the horizontal direction of the display, the number of pixels in the vertical direction of the cache image is greater than the number of pixels in the vertical direction of the display, and a currently displayed image in the display is a part of the cache image, as shown in fig. 2, the method includes:
201. the terminal acquires the relative movement amount of the terminal and the eyes of a user using the terminal.
The terminal in the embodiment of the present invention may be a mobile phone, a Virtual Reality (VR) device, an Augmented Reality (AR) device, a tablet computer, a smart watch, a projection device, and other display devices that a user may send jitter to the device and the eyes when watching an image.
The image displayed on the display of the terminal in the embodiment of the present invention may be a video image, a game screen, web page content, and the like, which is not limited in this embodiment of the present invention.
In the method provided by the embodiment of the present invention, in a specific implementation, the trigger condition for the terminal to execute step 201 may be that the screen of the terminal is lighted.
The display memory buffer is used for caching data (specifically including the position and the gray value of each pixel point in the image) of a frame of complete image, when the terminal displays the image, the image is already drawn in the display memory buffer, and the data in the display memory buffer can be managed through Framebuffer.
In the embodiment of the present invention, the number of pixels in the horizontal direction and the number of pixels in the vertical direction of the cache image may be determined according to the number of pixels in the horizontal direction and the number of pixels in the vertical direction of a display of the terminal, and the number of pixels in the horizontal direction and the number of pixels in the vertical direction of the cache image are respectively greater than the number of pixels in the horizontal direction and the number of pixels in the vertical direction of the display.
Illustratively, as shown in FIG. 3, region 1 represents the display of the terminal with a horizontal pixel count of X1The number of pixels in the vertical direction is Y1Region 2 represents a buffer image, and the number of pixels in the horizontal direction is X2The number of pixels in the vertical direction is Y2Wherein X is2Greater than X1,Y2Greater than Y1。
Optionally, the amount of relative movement comprises an amount of relative displacement movement and/or an amount of relative angular movement.
In this case, the image displayed on the display may be subjected to the displacement compensation, or the image displayed on the display may be subjected to the angle compensation.
Optionally, when the step 201 is implemented specifically, the step includes: the terminal detects the movement of the user's eyes relative to the terminal using iris or sclera techniques and acquires the amount of relative movement of the user's eyes relative to the terminal.
Specifically, the terminal may acquire a plurality of frames of foreground images by using a front-facing camera of the terminal, identify an iris (or sclera) in the foreground images by using an iris technology (or sclera technology), and determine the relative movement amount of the eyes of the user with respect to the terminal according to the positions, rotation angles and the like of the irises (or sclera) in the plurality of frames of foreground images.
Compared with the face recognition technology, the iris technology or the sclera technology has higher recognition precision, so that the precision of the determined relative movement amount can be improved.
In addition, the terminal can also perform three-dimensional modeling on the eyes of the user based on the technology of the depth sensor (such as structured light, a laser sensor and the like), and accurately calculate the relative movement amount through information of the eye movement of the user, distance information of the eyes of the user and the terminal, and the distance between the two eyes of the user.
202. And the terminal acquires an image to be displayed in the cache image according to the position relationship between the current display image and the cache image and the relative motion amount, wherein the image to be displayed is an image to be displayed in the display after the relative motion amount is compensated, the number of pixels of the image to be displayed in the horizontal direction is the same as that of the display in the horizontal direction, and the number of pixels of the image to be displayed in the vertical direction is the same as that of the display in the vertical direction.
It should be noted that, when the terminal acquires the relative motion amount, since the image displayed on the display by the terminal is already drawn in the display memory buffer before being displayed on the display, the terminal can quickly determine the image to be displayed and quickly display the image to be displayed.
Specifically, when the relative displacement amounts are different movement amounts, the execution manner of step 202 is also different, and the implementation manner of step 202 is described below by taking five cases as an example:
the first method is as follows: when the relative movement amount is the movement amount of the eyes of the user relative to the terminal, and the movement amount of the eyes of the user relative to the terminal is the movement amount of the displacement along the x-axis direction or the movement amount of the displacement along the y-axis direction, the terminal determines an image composed of N pixel points in the cache image, which are in one-to-one correspondence with the N pixel points in the current display image, as the image to be displayed, wherein a coordinate value of any one pixel point in the image to be displayed in the cache image is larger than a coordinate value of the pixel point in the current display image, which corresponds to the pixel point, in the cache image by a target value, the target value is the value of the movement amount of the eyes of the user relative to the terminal, and N is a positive integer.
Wherein, the plane of the x-y vertical coordinate system and the plane of the display are the same plane or parallel planes.
In the first implementation mode, one pixel point in the currently displayed image can be used as a first reference pixel point, a target value is added to the coordinate of the first reference pixel point to obtain a second reference pixel point, then the image to be displayed is obtained in the cache image by taking the second reference pixel point as a reference according to the position of the first reference pixel point in the currently displayed image, and the position of the second reference pixel point in the image to be displayed is the same as the position of the first reference pixel point in the currently displayed image.
Illustratively, based on the example described in fig. 3, referring to fig. 4-a, a is a first reference pixel point, whose coordinate value in the buffered image is (x, y), if the value of the displacement motion amount is [ w [ ]1,0]Then increase the first reference pixel point by [ w1,0]To obtain a second reference pixel point A ', see FIG. 4-b, the coordinate value of A' in the cache image is (x + w)1Y), if a is the first pixel point in the horizontal direction and the first pixel point in the vertical direction in the current display image, the terminal may determine X in the horizontal direction based on a1Y of each pixel point and vertical direction1The image composed of the pixel points is the image to be displayed, in this example, the current display image is the image in the area 1 in fig. 4-a, the image to be displayed is the image in the area 1 in fig. 4-b, and w in this example1Positive values.
It should be noted that the target value in the embodiment of the present invention may be represented by [ w ]1,w2]Is shown in the specification, wherein w1And w2Representing the amount of relative displacement motion, w, along the x-axis and y-axis, respectively1And w2The direction of the amount of relative displacement motion (positive or negative along the respective axis) can be distinguished by the sign of the carry. Of course, the values in the method for representing the target value may have other sequences, and this is not particularly limited in the embodiment of the present invention. In the embodiment of the present invention, only one method for representing the target value is illustrated, and actually, other methods may be used for representing the target value.
The second method comprises the following steps: when the relative movement amount is the movement amount of the eyes of the user relative to the terminal, and the movement amount of the eyes of the user relative to the terminal is the movement amount of the displacement along the z-axis direction, the terminal determines a first image according to the position relation between the current display image and the cache image and the relative movement amount, and the terminal processes the first image to obtain a second image and determines the second image as the image to be displayed.
Wherein when the value of the amount of relative motion indicates that the user's eyes are far away from the terminal, the first image is an image of a central portion of the currently displayed image, and the terminal processes the first image so that the terminal enlarges the first image; or, when the value of the relative motion amount indicates that the eyes of the user approach the terminal, the currently displayed image is an image of a central portion of the first image, and the terminal processes the first image so that the terminal reduces the first image.
In the second embodiment, the number of pixels k in one horizontal direction may be converted according to the amount of relative motion1And the number of pixels k in the vertical direction2The greater the amount of relative motion, k1And k2The larger, k1And k2The ratio of the current pixel number to the current pixel number is the same as the ratio of the current pixel number to the current pixel number in the horizontal direction and the current pixel number in the vertical direction, and k more pixels than the current pixel number in the left-right direction are obtained from the cache image by taking the current pixel number as a reference1Number of pixels, and k in the vertical direction2The image of the number of pixels is taken as a first image, and then the first image is reduced to a second image of which the number of pixels in the horizontal direction and the number of pixels in the vertical direction are respectively the same as those of the display.
Illustratively, as shown in FIG. 5, when k is1=2,k2When the image is 3, the determined position relationship between the first image and the currently displayed image can be referred to in fig. 5.
Wherein k is converted according to the amount of relative motion1And k2The method of (1) may be: determining a preset value corresponding to a pixel point in a horizontal direction, k1Is equal to the integral value, k, of the result of dividing the relative movement amount by the preset value2According to k2And k is1The ratio of (a) to (b) is determined.
The third method comprises the following steps: when the relative movement amount is the angular movement amount of the eyes of the user relative to the terminal, the terminal determines an image obtained after the current display image is rotated by a target angle as the image to be displayed, and the target angle is the value of the angular movement amount of the eyes of the user relative to the terminal.
Optionally, the relative angular movement amount includes an angular movement amount of the user's eyes in a three-dimensional direction with respect to the terminal.
Illustratively, based on the example described in FIG. 3, the image in region 1 in FIG. 6-a is the currently displayed image, and the amount of angular motion acquired by the terminal is such that the user's eye has been rotated counterclockwise by s about the z-axis relative to the terminal1The terminal may rotate the currently displayed image counterclockwise around the z-axis by s °1Display is performed and the image displayed in the display is as shown in fig. 6-b.
In addition, the relative angular movement amount acquired by the terminal may also be an angle at which the user's eyes rotate about the x-axis and the y-axis with respect to the terminal. 7-a, 7-b, and 7-c show images displayed in the display after the currently displayed image is rotated about the z-axis, y-axis, and x-axis, respectively, wherein the images displayed in the display in FIGS. 7-a, 7-b, and 7-c are common portions of the currently displayed image and the rotated currently displayed image.
It should be noted that the target angle in the embodiment of the present invention may be represented by [ s ]1,s2,s3]Is represented by, wherein s1、s2And s3Representing the amount of relative angular movement, s, about the x-axis, about the y-axis and about the z-axis, respectively1、s2And s3The direction of the relative angular motion amount (clockwise or counterclockwise about the respective axis) can be distinguished by the sign of the carry. Of course, the values in the method for representing the target angle may have other sequences, and this is not particularly limited in the embodiment of the present invention. The embodiment of the invention also only exemplifies a method for representing the target angle, and other methods can be actually used for representing.
The method is as follows: when the relative movement amount is the displacement movement amount of the eyes of the user relative to the terminal and the angular movement amount of the eyes of the user relative to the terminal, and the displacement movement amount of the eyes of the user relative to the terminal is the displacement movement amount along the z-axis direction, the terminal determines a first image according to the position relation between the current display image and the cache image and the relative movement amount, the terminal processes the first image to obtain a second image, the terminal determines the image obtained after the second image is rotated by a target angle as the image to be displayed, and the target angle is the value of the angular movement amount of the eyes of the user relative to the terminal.
The process of determining the second image may be referred to as a mode two, and the method of rotating the second image may be referred to as a mode three, which is not described herein again.
The fifth mode is as follows: when the relative movement amount is the movement amount of the user's eyes relative to the terminal and the angular movement amount of the user's eyes relative to the terminal, and the movement amount of the user's eyes relative to the terminal is the movement amount of the displacement along the x-axis direction or the movement amount of the displacement along the y-axis direction, the terminal determines an image composed of N pixel points in the cache image corresponding to N pixel points in the current display image one by one as an intermediate image, and determines an image obtained by rotating the intermediate image by a target angle as the image to be displayed, wherein a coordinate value of any one pixel point in the intermediate image in the cache image is larger than a coordinate value of the pixel point corresponding to the pixel point in the current display image in the cache image by a target value, and the target value is the movement amount of the user's eyes relative to the terminal, the target angle is a value of an angular movement amount of the user's eyes relative to the terminal, and N is a positive integer.
The process of determining the intermediate image may be determined by a method of determining an image to be displayed in the first mode, and a method of rotating the intermediate image may be referred to as a third mode, which is not described herein again.
In the embodiment of the present invention, when the relative movement amount includes a displacement movement amount in multiple dimensions, the image to be displayed may be sequentially determined according to the displacement movement amount in multiple dimensions, and the same applies when the relative movement amount includes an angle movement amount in multiple dimensions.
203. And the terminal displays the image to be displayed in the display.
The method provided by the embodiment of the invention can be applied to various living scenes, for example, in an application scene that a user takes a subway (or a bus), if the user browses pictures, due to the shaking of the subway (or the bus), the relative motion can be generated between the eyes of the user and the terminal of the user, so that the user can not stably browse the pictures.
According to the method provided by the embodiment of the invention, after the terminal acquires the relative movement amount of the eyes of the terminal and the user using the terminal, the image to be displayed after compensating the relative movement amount can be acquired in the cache image according to the position relation between the current display image and the cache image and the relative movement amount, because the number of pixels in the horizontal direction of the cache image is greater than that in the horizontal direction of the display, and the number of pixels in the vertical direction of the cache image is greater than that in the vertical direction of the display, the number of pixels in the horizontal direction of the image to be displayed can be the same as that in the horizontal direction of the display, and the number of pixels in the vertical direction of the image to be displayed can be the same as that in the vertical direction of the display, so that when the display displays the image to be displayed, black borders cannot appear in the display.
An embodiment of the present invention further provides a terminal 80, where the terminal 80 includes a RAM and a display, the RAM includes a display memory buffer area, the display memory buffer area is used to store a cache image, a number of pixels of the cache image in a horizontal direction is greater than a number of pixels of the display in a horizontal direction, a number of pixels of the cache image in a vertical direction is greater than a number of pixels of the display in a vertical direction, and a current display image in the display is a part of the cache image, as shown in fig. 8, the terminal 80 includes:
a first acquisition unit 801 for acquiring the amount of relative movement of the terminal 80 and the eyes of a user using the terminal 80;
a second obtaining unit 802, configured to obtain, from the cache image, an image to be displayed according to the position relationship between the current display image and the cache image and the relative motion amount, where the image to be displayed is an image to be displayed in the display after compensating for the relative motion amount, a number of pixels in a horizontal direction of the image to be displayed is the same as a number of pixels in a horizontal direction of the display, and a number of pixels in a vertical direction of the image to be displayed is the same as the number of pixels in the vertical direction of the display.
Optionally, the amount of relative movement comprises an amount of relative displacement movement and/or an amount of relative angular movement.
Optionally, the second obtaining unit 802 is specifically configured to:
when the relative movement amount is the movement amount of the user's eyes relative to the terminal 80, determining an image composed of N pixel points in the cache image corresponding to the N pixel points in the current display image one to one as the image to be displayed, wherein a coordinate value of any one pixel point in the image to be displayed in the cache image is larger than a coordinate value of a pixel point corresponding to the pixel point in the current display image in the cache image by a target value, the target value is a value of the movement amount of the user's eyes relative to the terminal 80, and N is a positive integer; or,
when the relative movement amount is the angular movement amount of the eyes of the user relative to the terminal 80, determining an image obtained after the current display image is rotated by a target angle as the image to be displayed, wherein the target angle is the value of the angular movement amount of the eyes of the user relative to the terminal 80; or,
when the relative movement amount is the displacement movement amount of the user's eyes relative to the terminal 80 and the angular movement amount of the user's eyes relative to the terminal 80, determining an image composed of N pixel points in the cache image, which correspond to N pixel points in the current display image one by one, as an intermediate image, and determining an image obtained after the intermediate image is rotated by a target angle, as the image to be displayed, wherein a coordinate value of any one pixel point in the intermediate image in the cache image is larger than a coordinate value of a pixel point in the current display image, which corresponds to the pixel point, in the cache image by a target value, the target value is a value of the displacement movement amount of the user's eyes relative to the terminal 80, and the target angle is a value of the angular movement amount of the user's eyes relative to the terminal 80, n is a positive integer;
wherein the amount of displacement motion of the user's eyes relative to the terminal 80 is either the amount of displacement motion along the x-axis direction or the amount of displacement motion along the y-axis direction.
Optionally, the second obtaining unit 802 is specifically configured to:
when the relative movement amount is the displacement movement amount of the eyes of the user relative to the terminal 80, determining a first image according to the position relationship between the current display image and the cache image and the relative movement amount, processing the first image to obtain a second image, and determining the second image as the image to be displayed; or,
when the relative motion amount is the displacement motion amount of the user's eyes relative to the terminal 80 and the angular motion amount of the user's eyes relative to the terminal 80, determining a first image according to the position relationship between the current display image and the cache image and the relative motion amount, processing the first image to obtain a second image, and determining an image obtained by rotating the second image by a target angle as the image to be displayed, wherein the target angle is the value of the angular motion amount of the user's eyes relative to the terminal 80;
wherein a displacement movement amount of the user's eyes with respect to the terminal 80 is a displacement movement amount along a z-axis direction;
when the value of the relative-motion amount indicates that the user's eyes are far from the terminal 80, the first image is an image of a central portion of the currently displayed image, and the first image is processed to be enlarged; alternatively, when the value of the relative movement amount indicates that the user's eyes are close to the terminal 80, the currently displayed image is an image of a center portion of the first image, and the first image is processed to be reduced.
Optionally, the amount of relative angular movement comprises an amount of angular movement of the user's eyes in three dimensions relative to the terminal 80.
Optionally, the first obtaining unit 801 is specifically configured to: motion of the user's eye relative to the terminal 80 is detected using iris or sclera techniques and the amount of relative motion of the user's eye relative to the terminal 80 is obtained.
The first obtaining unit 801 may specifically include a front-facing camera of the terminal, and a processor, where the front-facing camera is configured to obtain multiple frames of foreground images, and the processor is configured to determine a relative movement amount of the user's eye with respect to the terminal according to a position and a rotation angle of an iris (or a sclera) in the multiple frames of foreground images.
Actions executed by each unit in the terminal provided in the embodiment of the present invention are consistent with the method provided in the embodiment of the present invention, and therefore, the beneficial effects of the terminal in the embodiment of the present invention can refer to the beneficial effects described in the method in the embodiment of the present invention, and are not described herein again.
An embodiment of the present invention further provides a terminal 90, where the terminal 90 includes a RAM and a display, the RAM includes a display memory buffer area, the display memory buffer area is used to store a cache image, a number of pixels of the cache image in a horizontal direction is greater than a number of pixels of the display in a horizontal direction, a number of pixels of the cache image in a vertical direction is greater than a number of pixels of the display in a vertical direction, a current display image in the display is a part of the cache image, as shown in fig. 9, and the terminal 90 includes: a memory 901 and a processor 902;
the memory 901 is used for storing code according to which the processor 902 performs the following actions:
acquiring the relative movement amount of the terminal 90 and the eyes of the user using the terminal 90;
and acquiring an image to be displayed in the cache image according to the position relationship between the current display image and the cache image and the relative motion amount, wherein the image to be displayed is an image to be displayed in the display after the relative motion amount is compensated, the number of pixels of the image to be displayed in the horizontal direction is the same as that of the display in the horizontal direction, and the number of pixels of the image to be displayed in the vertical direction is the same as that of the display in the vertical direction.
Optionally, the amount of relative movement comprises an amount of relative displacement movement and/or an amount of relative angular movement.
Optionally, the processor 902 is specifically configured to:
when the relative movement amount is the movement amount of the user's eyes relative to the terminal 90, determining an image composed of N pixel points in the cache image corresponding to the N pixel points in the current display image one to one as the image to be displayed, wherein a coordinate value of any one pixel point in the image to be displayed in the cache image is larger than a coordinate value of a pixel point in the current display image corresponding to the pixel point in the cache image by a target value, the target value is a value of the movement amount of the user's eyes relative to the terminal 90, and N is a positive integer; or,
when the relative movement amount is the angular movement amount of the eyes of the user relative to the terminal 90, determining an image obtained by rotating the current display image by a target angle as the image to be displayed, wherein the target angle is the value of the angular movement amount of the eyes of the user relative to the terminal 90; or,
when the relative motion amount is a displacement motion amount of the user's eyes relative to the terminal 90 and an angular motion amount of the user's eyes relative to the terminal 90, determining an image composed of N pixel points in the cache image, which correspond to N pixel points in the current display image one by one, as an intermediate image, and determining an image obtained after the intermediate image is rotated by a target angle, as the image to be displayed, wherein a coordinate value of any one pixel point in the intermediate image in the cache image is larger than a coordinate value of a pixel point in the current display image, which corresponds to the pixel point, in the cache image by a target value, the target value is a value of the displacement motion amount of the user's eyes relative to the terminal 90, and the target angle is a value of the angular motion amount of the user's eyes relative to the terminal 90, n is a positive integer;
wherein the amount of displacement motion of the user's eyes relative to the terminal 90 is either the amount of displacement motion along the x-axis direction or the amount of displacement motion along the y-axis direction.
Optionally, the processor 902 is specifically configured to:
when the relative movement amount is the displacement movement amount of the eyes of the user relative to the terminal 90, determining a first image according to the position relationship between the current display image and the cache image and the relative movement amount, processing the first image to obtain a second image, and determining the second image as the image to be displayed; or,
when the relative motion amount is the displacement motion amount of the user's eyes relative to the terminal 90 and the angular motion amount of the user's eyes relative to the terminal 90, determining a first image according to the position relationship between the current display image and the cache image and the relative motion amount, processing the first image to obtain a second image, and determining an image obtained by rotating the second image by a target angle as the image to be displayed, wherein the target angle is the value of the angular motion amount of the user's eyes relative to the terminal 90;
wherein a displacement movement amount of the user's eye with respect to the terminal 90 is a displacement movement amount along a z-axis direction;
when the value of the relative-motion amount indicates that the user's eyes are far from the terminal 90, the first image is an image of a central portion of the currently displayed image, and the first image is processed to be enlarged; alternatively, when the value of the relative movement amount indicates that the user's eyes are close to the terminal 90, the currently displayed image is an image of a central portion of the first image, and the first image is processed to be reduced.
Optionally, the relative angular movement amount comprises an amount of angular movement of the user's eyes in three dimensions relative to the terminal 90.
Optionally, the processor 902 is specifically configured to: the motion of the user's eye relative to the terminal 90 is detected using iris or sclera techniques and the amount of relative motion of the user's eye relative to the terminal 90 is obtained.
The first acquiring unit 801 and the second acquiring unit 802 in the terminal 80 may be a processor 902 in the terminal 90. Other units in the terminal 80 may be embedded in a hardware form or may be independent from a processor of the terminal 80, or may be stored in a software form in a memory of the terminal 80, so that the processor may call and execute operations corresponding to the above units, where the processor may be a Central Processing Unit (CPU), an Application Specific Integrated Circuit (ASIC), or one or more Integrated circuits configured to implement the embodiments of the present invention.
Actions executed by each device in the terminal provided in the embodiment of the present invention are consistent with the method provided in the embodiment of the present invention, and therefore, the beneficial effects of the terminal in the embodiment of the present invention can refer to the beneficial effects described in the method in the embodiment of the present invention, and are not described herein again.
Embodiments of the present invention also provide a computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a terminal, cause the terminal to perform the method according to the above.
The computer-readable storage medium is used for the terminal to implement the method, and the beneficial effects of the computer-readable storage medium refer to the beneficial effects of the method part, which are not described herein again.
In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the modules is merely a logical division, and in actual implementation, there may be other divisions, for example, multiple modules or components may be combined or integrated into another system, or some features may be omitted, or not implemented.
The modules described as separate parts may or may not be physically separate, and parts displayed as modules may or may not be physical modules, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional modules in the embodiments of the present invention may be integrated into one processing module, or two or more modules may be integrated into one module. The integrated module can be realized in a hardware form, and can also be realized in a form of hardware and a software functional module.
The integrated module implemented in the form of a software functional module may be stored in a computer-readable storage medium. The software functional module is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute some steps of the methods according to the embodiments of the present invention. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a RAM, a magnetic disk, or an optical disk.
Claims (16)
1. An anti-shake method for a terminal display, wherein the terminal includes a Random Access Memory (RAM) and a display, the RAM includes a display memory buffer area, the display memory buffer area is used for storing a cache image, the number of pixels of the cache image in the horizontal direction is greater than that of the display in the horizontal direction, the number of pixels of the cache image in the vertical direction is greater than that of the display in the vertical direction, and a currently displayed image in the display is a part of the cache image, the method comprising:
the terminal acquires the relative movement amount of eyes of the terminal and a user using the terminal;
the terminal acquires an image to be displayed in the cache image according to the position relation between the current display image and the cache image and the relative motion amount, wherein the image to be displayed is an image to be displayed in the display after the relative motion amount is compensated, the number of pixels of the image to be displayed in the horizontal direction is the same as that of pixels of the display in the horizontal direction, and the number of pixels of the image to be displayed in the vertical direction is the same as that of pixels of the display in the vertical direction;
wherein the terminal acquires the relative movement amount of the terminal and the eyes of a user using the terminal, and comprises the following steps:
the terminal detects the movement of the user's eyes relative to the terminal using iris or sclera techniques and acquires the amount of relative movement of the user's eyes relative to the terminal.
2. The method of claim 1, wherein the amount of relative motion comprises an amount of relative displacement motion and/or an amount of relative angular motion.
3. The method according to claim 2, wherein the terminal acquires the image to be displayed in the buffer image according to the position relationship between the current display image and the buffer image and the relative motion amount, and comprises:
when the relative movement amount is the displacement movement amount of the eyes of the user relative to the terminal, the terminal determines an image formed by N pixel points in the cache image, which correspond to N pixel points in the current display image in a one-to-one manner, as the image to be displayed, wherein a coordinate value of any pixel point in the image to be displayed in the cache image is larger than a coordinate value of a pixel point corresponding to the pixel point in the current display image in the cache image by a target value, the target value is a value of the displacement movement amount of the eyes of the user relative to the terminal, and N is a positive integer; or,
when the relative motion amount is the angular motion amount of the eyes of the user relative to the terminal, the terminal determines an image obtained after the current display image is rotated by a target angle as the image to be displayed, wherein the target angle is the value of the angular motion amount of the eyes of the user relative to the terminal; or,
when the relative motion amount is the displacement motion amount of the user's eyes relative to the terminal and the angular motion amount of the user's eyes relative to the terminal, the terminal determines an image composed of N pixel points in the cache image, which correspond to N pixel points in the current display image one by one, as an intermediate image, and the terminal determines an image obtained after the intermediate image is rotated by a target angle as the image to be displayed, wherein a coordinate value of any one pixel point in the intermediate image in the cache image is larger than a coordinate value of the pixel point corresponding to the pixel point in the current display image in the cache image by a target value, the target value is a value of the displacement motion amount of the user's eyes relative to the terminal, and the target angle is a value of the angular motion amount of the user's eyes relative to the terminal, n is a positive integer;
wherein the amount of displacement motion of the user's eyes relative to the terminal is either along the x-axis direction or along the y-axis direction.
4. The method according to claim 2, wherein the terminal acquires the image to be displayed in the buffer image according to the position relationship between the current display image and the buffer image and the relative motion amount, and comprises:
when the relative movement amount is the displacement movement amount of the eyes of the user relative to the terminal, the terminal determines a first image according to the position relation between the current display image and the cache image and the relative movement amount, and the terminal processes the first image to obtain a second image and determines the second image as the image to be displayed; or,
when the relative motion amount is the displacement motion amount of the eyes of the user relative to the terminal and the angular motion amount of the eyes of the user relative to the terminal, the terminal determines a first image according to the position relation between the current display image and the cache image and the relative motion amount, the terminal processes the first image to obtain a second image, the terminal determines an image obtained after the second image is rotated by a target angle as the image to be displayed, and the target angle is the value of the angular motion amount of the eyes of the user relative to the terminal;
wherein a displacement movement amount of the user's eyes relative to the terminal is a displacement movement amount along a z-axis direction;
when the value of the relative motion amount indicates that the eyes of the user are far away from the terminal, the first image is an image of the central part of the currently displayed image, and the terminal processes the first image to enlarge the first image for the terminal; or, when the value of the relative motion amount indicates that the eyes of the user approach the terminal, the currently displayed image is an image of a central portion of the first image, and the terminal processes the first image so that the terminal reduces the first image.
5. The method according to any of claims 2-4, wherein the amount of relative angular movement comprises an amount of angular movement of the user's eyes in three dimensions relative to the terminal.
6. A terminal, wherein the terminal comprises a random access memory RAM and a display, the RAM comprising a display memory buffer for storing a buffer image, the number of pixels in the horizontal direction of the buffer image being greater than the number of pixels in the horizontal direction of the display, the number of pixels in the vertical direction of the buffer image being greater than the number of pixels in the vertical direction of the display, and a currently displayed image in the display being a portion of the buffer image, the terminal comprising:
a first acquisition unit configured to acquire a relative movement amount of the terminal and eyes of a user using the terminal;
a second obtaining unit, configured to obtain, from the cache image, an image to be displayed according to the position relationship between the current display image and the cache image and the relative motion amount, where the image to be displayed is an image to be displayed in the display after compensating for the relative motion amount, and a number of pixels in a horizontal direction of the image to be displayed is the same as a number of pixels in a horizontal direction of the display, and a number of pixels in a vertical direction of the image to be displayed is the same as a number of pixels in a vertical direction of the display;
the first obtaining unit is specifically configured to:
and detecting the movement of the eyes of the user relative to the terminal by adopting an iris technology or a sclera technology, and acquiring the relative movement amount of the eyes of the user relative to the terminal.
7. A terminal according to claim 6, characterized in that the amount of relative movement comprises an amount of relative displacement movement and/or an amount of relative angular movement.
8. The terminal according to claim 7, wherein the second obtaining unit is specifically configured to:
when the relative movement amount is the displacement movement amount of the eyes of the user relative to the terminal, determining an image composed of N pixel points in the cache image, which correspond to N pixel points in the current display image in a one-to-one manner, as the image to be displayed, wherein a coordinate value of any pixel point in the image to be displayed in the cache image is larger than a coordinate value of a pixel point in the current display image, which corresponds to the pixel point, in the cache image by a target value, the target value is a value of the displacement movement amount of the eyes of the user relative to the terminal, and N is a positive integer; or,
when the relative motion amount is the angular motion amount of the eyes of the user relative to the terminal, determining an image obtained after the current display image is rotated by a target angle as the image to be displayed, wherein the target angle is the value of the angular motion amount of the eyes of the user relative to the terminal; or,
when the relative movement amount is the displacement movement amount of the eyes of the user relative to the terminal and the angular movement amount of the eyes of the user relative to the terminal, determining an image composed of N pixel points in the cache image, which correspond to N pixel points in the current display image in a one-to-one manner, as an intermediate image, and determining an image obtained after the intermediate image is rotated by a target angle as the image to be displayed, wherein a coordinate value of any pixel point in the intermediate image in the cache image is larger than a coordinate value of the pixel point in the current display image, which corresponds to the pixel point, in the cache image by a target value, the target value is a value of the displacement movement amount of the eyes of the user relative to the terminal, and the target angle is a value of the angular movement amount of the eyes of the user relative to the terminal, n is a positive integer;
wherein the amount of displacement motion of the user's eyes relative to the terminal is either along the x-axis direction or along the y-axis direction.
9. The terminal according to claim 7, wherein the second obtaining unit is specifically configured to:
when the relative movement amount is the displacement movement amount of the eyes of the user relative to the terminal, determining a first image according to the position relation between the current display image and the cache image and the relative movement amount, processing the first image to obtain a second image, and determining the second image as the image to be displayed; or,
when the relative motion amount is the displacement motion amount of the eyes of the user relative to the terminal and the angular motion amount of the eyes of the user relative to the terminal, determining a first image according to the position relation between the current display image and the cache image and the relative motion amount, processing the first image to obtain a second image, and determining the image obtained after the second image is rotated by a target angle as the image to be displayed, wherein the target angle is the value of the angular motion amount of the eyes of the user relative to the terminal;
wherein a displacement movement amount of the user's eyes relative to the terminal is a displacement movement amount along a z-axis direction;
when the value of the relative motion amount indicates that the eyes of the user are far away from the terminal, the first image is an image of the central part of the currently displayed image, and the first image is processed to be enlarged; or, when the value of the relative motion amount indicates that the user's eyes are close to the terminal, the currently displayed image is an image of a central portion of the first image, and the first image is processed to be reduced.
10. A terminal according to any of claims 7-9, wherein said amount of relative angular movement comprises an amount of angular movement of the user's eyes in three dimensions relative to the terminal.
11. A terminal, wherein the terminal comprises a random access memory RAM and a display, the RAM comprising a display memory buffer for storing a buffer image, the number of pixels in the horizontal direction of the buffer image being greater than the number of pixels in the horizontal direction of the display, the number of pixels in the vertical direction of the buffer image being greater than the number of pixels in the vertical direction of the display, and a currently displayed image in the display being a portion of the buffer image, the terminal comprising: a memory and a processor;
the memory is configured to store code, and the processor performs the following actions in accordance with the code:
acquiring the relative movement amount of eyes of the terminal and a user using the terminal;
acquiring an image to be displayed in the cache image according to the position relationship between the current display image and the cache image and the relative motion amount, wherein the image to be displayed is an image to be displayed in the display after the relative motion amount is compensated, the number of pixels of the image to be displayed in the horizontal direction is the same as that of the display in the horizontal direction, and the number of pixels of the image to be displayed in the vertical direction is the same as that of the display in the vertical direction;
wherein the processor is specifically configured to:
and detecting the movement of the eyes of the user relative to the terminal by adopting an iris technology or a sclera technology, and acquiring the relative movement amount of the eyes of the user relative to the terminal.
12. A terminal according to claim 11, characterized in that the amount of relative movement comprises an amount of relative displacement movement and/or an amount of relative angular movement.
13. The terminal of claim 12, wherein the processor is specifically configured to:
when the relative movement amount is the displacement movement amount of the eyes of the user relative to the terminal, determining an image composed of N pixel points in the cache image, which correspond to N pixel points in the current display image in a one-to-one manner, as the image to be displayed, wherein a coordinate value of any pixel point in the image to be displayed in the cache image is larger than a coordinate value of a pixel point in the current display image, which corresponds to the pixel point, in the cache image by a target value, the target value is a value of the displacement movement amount of the eyes of the user relative to the terminal, and N is a positive integer; or,
when the relative motion amount is the angular motion amount of the eyes of the user relative to the terminal, determining an image obtained after the current display image is rotated by a target angle as the image to be displayed, wherein the target angle is the value of the angular motion amount of the eyes of the user relative to the terminal; or,
when the relative movement amount is the displacement movement amount of the eyes of the user relative to the terminal and the angular movement amount of the eyes of the user relative to the terminal, determining an image composed of N pixel points in the cache image, which correspond to N pixel points in the current display image in a one-to-one manner, as an intermediate image, and determining an image obtained after the intermediate image is rotated by a target angle as the image to be displayed, wherein a coordinate value of any pixel point in the intermediate image in the cache image is larger than a coordinate value of the pixel point in the current display image, which corresponds to the pixel point, in the cache image by a target value, the target value is a value of the displacement movement amount of the eyes of the user relative to the terminal, and the target angle is a value of the angular movement amount of the eyes of the user relative to the terminal, n is a positive integer;
wherein the amount of displacement motion of the user's eyes relative to the terminal is either along the x-axis direction or along the y-axis direction.
14. The terminal of claim 12, wherein the processor is specifically configured to:
when the relative movement amount is the displacement movement amount of the eyes of the user relative to the terminal, determining a first image according to the position relation between the current display image and the cache image and the relative movement amount, processing the first image to obtain a second image, and determining the second image as the image to be displayed; or,
when the relative motion amount is the displacement motion amount of the eyes of the user relative to the terminal and the angular motion amount of the eyes of the user relative to the terminal, determining a first image according to the position relation between the current display image and the cache image and the relative motion amount, processing the first image to obtain a second image, and determining the image obtained after the second image is rotated by a target angle as the image to be displayed, wherein the target angle is the value of the angular motion amount of the eyes of the user relative to the terminal;
wherein a displacement movement amount of the user's eyes relative to the terminal is a displacement movement amount along a z-axis direction;
when the value of the relative motion amount indicates that the eyes of the user are far away from the terminal, the first image is an image of the central part of the currently displayed image, and the first image is processed to be enlarged; or, when the value of the relative motion amount indicates that the user's eyes are close to the terminal, the currently displayed image is an image of a central portion of the first image, and the first image is processed to be reduced.
15. The terminal of any of claims 12-14, wherein the amount of relative angular motion comprises an amount of angular motion of the user's eyes in three dimensions relative to the terminal.
16. A computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a terminal, cause the terminal to perform the method of any of claims 1-5.
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/CN2016/078500 WO2017173583A1 (en) | 2016-04-05 | 2016-04-05 | Terminal display anti-shake method and apparatus |
Publications (2)
Publication Number | Publication Date |
---|---|
CN108027646A CN108027646A (en) | 2018-05-11 |
CN108027646B true CN108027646B (en) | 2020-07-14 |
Family
ID=60000799
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201680009578.0A Active CN108027646B (en) | 2016-04-05 | 2016-04-05 | Anti-shaking method and device for terminal display |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN108027646B (en) |
WO (1) | WO2017173583A1 (en) |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107562212A (en) * | 2017-10-20 | 2018-01-09 | 网易(杭州)网络有限公司 | Virtual reality scenario anti-fluttering method, device, storage medium and wear display device |
CN110248243B (en) * | 2019-07-25 | 2022-02-18 | 维沃移动通信有限公司 | Multimedia file display method, terminal and medium |
CN111010476A (en) * | 2019-11-13 | 2020-04-14 | 北京奇艺世纪科技有限公司 | Image display method, device, terminal and readable storage medium |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1574884A (en) * | 2003-06-14 | 2005-02-02 | Lg电子株式会社 | Apparatus and method for automatically compensating for an image gradient of a mobile communication terminal |
CN103250152A (en) * | 2010-12-10 | 2013-08-14 | 高智83基金会有限责任公司 | Image display device controlled responsive to sharing breadth |
CN104464579A (en) * | 2013-09-12 | 2015-03-25 | 中兴通讯股份有限公司 | Data display method, data display device, data display terminal, display control method and display control device |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103309582B (en) * | 2012-03-08 | 2016-12-07 | 阿里巴巴集团控股有限公司 | The stabilization display packing of a kind of terminal unit and can the terminal unit that shows of stabilization |
KR20150071344A (en) * | 2013-12-18 | 2015-06-26 | 삼성전기주식회사 | Apparatus and method for stabilizing image of display |
US9720496B2 (en) * | 2014-03-20 | 2017-08-01 | Intel Corporation | Techniques for stabilizing a display scene output |
CN104575357A (en) * | 2015-01-21 | 2015-04-29 | 昆山龙腾光电有限公司 | Method and system for stabilizing display picture of handheld equipment and handheld device |
-
2016
- 2016-04-05 CN CN201680009578.0A patent/CN108027646B/en active Active
- 2016-04-05 WO PCT/CN2016/078500 patent/WO2017173583A1/en active Application Filing
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1574884A (en) * | 2003-06-14 | 2005-02-02 | Lg电子株式会社 | Apparatus and method for automatically compensating for an image gradient of a mobile communication terminal |
CN103250152A (en) * | 2010-12-10 | 2013-08-14 | 高智83基金会有限责任公司 | Image display device controlled responsive to sharing breadth |
CN104464579A (en) * | 2013-09-12 | 2015-03-25 | 中兴通讯股份有限公司 | Data display method, data display device, data display terminal, display control method and display control device |
Also Published As
Publication number | Publication date |
---|---|
CN108027646A (en) | 2018-05-11 |
WO2017173583A1 (en) | 2017-10-12 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN106502427B (en) | Virtual reality system and scene presenting method thereof | |
CN109074681B (en) | Information processing apparatus, information processing method, and program | |
CN110322542B (en) | Reconstructing views of a real world 3D scene | |
CN109743892B (en) | Virtual reality content display method and device | |
US9424767B2 (en) | Local rendering of text in image | |
US10999412B2 (en) | Sharing mediated reality content | |
US11294535B2 (en) | Virtual reality VR interface generation method and apparatus | |
CN113574863A (en) | Method and system for rendering 3D image using depth information | |
US11720996B2 (en) | Camera-based transparent display | |
CN111833403B (en) | Method and apparatus for spatial localization | |
CN108961423B (en) | Virtual information processing method, device, equipment and storage medium | |
US10901213B2 (en) | Image display apparatus and image display method | |
US11749141B2 (en) | Information processing apparatus, information processing method, and recording medium | |
CN110706283B (en) | Calibration method and device for sight tracking, mobile terminal and storage medium | |
CN108027646B (en) | Anti-shaking method and device for terminal display | |
KR101148508B1 (en) | A method and device for display of mobile device, and mobile device using the same | |
JP2021526693A (en) | Pose correction | |
CN114026603A (en) | Rendering computer-generated reality text | |
US10891714B2 (en) | Error concealment for a head-mountable device | |
CN112308981A (en) | Image processing method, image processing device, electronic equipment and storage medium | |
US10902554B2 (en) | Method and system for providing at least a portion of content having six degrees of freedom motion | |
TWI817335B (en) | Stereoscopic image playback apparatus and method of generating stereoscopic images thereof | |
TWM630947U (en) | Stereoscopic image playback apparatus | |
US11615767B2 (en) | Information processing apparatus, information processing method, and recording medium | |
CN108881892A (en) | Anti-dazzle method, system for Table top type virtual reality system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |