WO2018176958A1

WO2018176958A1 - Adaptive mapping method and system depending on movement of key points in image

Info

Publication number: WO2018176958A1
Application number: PCT/CN2017/120135
Authority: WO
Inventors: 李亮; 陈少杰; 张文明
Original assignee: 武汉斗鱼网络科技有限公司
Priority date: 2017-03-28
Filing date: 2017-12-29
Publication date: 2018-10-04
Also published as: CN107122774B; CN107122774A

Abstract

The present invention provides an adaptive mapping method and system depending on movement of key points in an image. The method comprises: positioning the locations of key points on a key object in the image, and performing rotation matrix transformation on any one point on the image according to the location change of the moved key point to obtain the coordinates of the corresponding point after the rotation matrix transformation is performed; obtaining coordinates in a certain range in the vicinity of the location of the moved key point according to the coordinates of the moved key point and the scale coefficient of a map; and obtaining map sampling coordinates according to the coordinates in the certain range in the vicinity of the location of the moved key point, the coordinates of the key point and the scale coefficient of the map, and displaying the map on the map sampling coordinates. By means of the present invention, the map can adaptively rotate in the case that a human face is rotated, and an original display scale will not be changed, and the user experience can be improved.

Description

Adaptive mapping method and system for moving with key points in an image

cross reference

The present application is hereby incorporated by reference in its entirety in its entirety in its entirety the entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire all all all all all all all all all each

Technical field

The present invention relates to the field of image processing and, more particularly, to an adaptive mapping method and system that moves with key points in an image.

Background technique

With the development of photographic technology and computer applications, mapping on video images is becoming more and more common. The so-called texture is the effect of adding dynamic texture to specific parts of the image. For example, a human face can be referred to as an eye. , nose or mouth, the existing mapping method only places the texture at a specific position in the picture. When the specific position changes, although the position of the texture changes, the display scale changes without considering the specific position. The shape of the texture will be distorted to a certain extent, which will greatly reduce the display effect of the texture.

Summary of the invention

The present invention provides a method and system for adaptive mapping of key points moving in an image that overcomes the above problems or at least partially solves the above problems.

According to one aspect of the invention, a method of adaptive mapping that moves with key points in an image is provided, comprising:

S1. Positioning a key point on a key object in the positioning image, performing rotation matrix conversion on any point on the image according to the position change after the key point is moved, and obtaining a coordinate corresponding to the rotation matrix transformation of any point;

S2, according to the coordinate of the key point after moving and the scaling factor of the texture, obtain a certain range of coordinates near the position after the key point is moved;

S3. Obtain a map sampling coordinate according to a certain range of coordinates, a coordinate of a key point, and a scaling factor of the map near the position after the key point is moved, and display the map on the map sampling coordinate.

According to another aspect of the present invention, an adaptive mapping system that moves with key points in an image is provided, including:

Converting the coordinate device, locating the position of the key point on the key object in the image, performing a rotation matrix transformation on any point on the image according to the position change after the key point is moved, and obtaining the coordinate converted by the rotation matrix corresponding to any point;

The nearby coordinate generating device obtains a certain range of coordinates near the position after the key point is moved according to the coordinate of the key point movement and the scaling factor of the texture;

The texture sampling coordinate obtaining means obtains the texture sampling coordinates according to the coordinates of a certain range, the coordinates of the key points, and the scaling factor of the texture in the vicinity of the position after the key point is moved, and displays the texture on the texture sampling coordinates.

According to another aspect of the present invention, an adaptive mapping apparatus is provided, comprising:

At least one processor, at least one memory, and a bus; wherein

The processor and the memory complete communication with each other through the bus;

The memory stores program instructions executable by the processor, the processor invoking the program instructions to perform the following methods:

S1. Positioning the key points on the key object in the positioning image, performing rotation matrix conversion on any point on the image according to the position change after the key point is moved, and obtaining coordinates converted by the rotation matrix corresponding to any point;

According to another aspect of the present invention, a computer program product is provided, the computer program product comprising a computer program stored on a non-transitory computer readable storage medium, the computer program comprising program instructions when the program instructions are When the computer executes, it can perform the following methods:

According to another aspect of the present invention, a non-transitory computer readable storage medium is provided, the non-transitory computer readable storage medium storing computer instructions that cause the computer to perform the following method:

The present application proposes an adaptive mapping method and system for moving key points in an image, by locating the position of a key point on a key object in the image, and rotating any point on the image according to the position change after the key point is moved. Matrix transformation, obtain the coordinates of the rotation matrix corresponding to the point, ensure that the points on the image move synchronously with the position of the key point, and then move the key point according to the coordinate of the key point and the scaling factor of the texture. A certain range of coordinates near the position, and finally the coordinate of the key point and the scaling factor of the texture are obtained to obtain the texture sampling coordinates of the display texture. The present invention enables the texture to be adaptively moved in the case where the key point on the image is moved, and The user's experience is improved without changing the original display ratio.

DRAWINGS

1 is a flow chart of an adaptive mapping method for moving key points in an image according to an embodiment of the present invention;

2 is a flowchart of step S1 in the embodiment of the present invention;

3 is a schematic flowchart of step S2 in the embodiment of the present invention;

4 is a block diagram of an adaptive mapping system that moves with key points in an image according to an embodiment of the present invention;

FIG. 5 is a structural block diagram of a conversion module according to an embodiment of the present invention; FIG.

FIG. 6 is a functional block diagram of an adaptive mapping device in an embodiment of the present invention.

detailed description

The technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the drawings in the embodiments of the present invention. It is a partial embodiment of the invention, and not all of the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

In order to overcome the problem of the prior art that the texture cannot be adaptively rotated with the rotation of the human face, the present invention provides a mapping method of adaptive rotation that can be rotated with the human face.

FIG. 1 is a flowchart of an adaptive mapping method for face rotation according to an embodiment of the present invention. As shown in FIG. 1, the method includes:

The present application proposes an adaptive mapping method and system for moving key points in an image, by locating the position of a key point on a key object in the image, and rotating any point on the image according to the position change after the key point is moved. Matrix transformation, get the converted coordinates corresponding to the point, and then according to the coordinate of the key point and the scaling factor of the texture, filter the coordinates of a certain range around the position after the key point is moved, and finally combine the coordinates of the key point and the texture of the map. The scaling factor obtains the texture sampling coordinates of the display texture. The present invention enables the texture to be adaptively moved in the case of moving key points on the image without changing the original display ratio, thereby improving the user experience.

FIG. 2 is a flowchart of step S1 in the embodiment of the present invention, including:

S1.1. Acquire an aspect ratio of the image, and locate the position of the key point on the key object in the image.

It should be noted that since the shape of the regular image is rectangular, such as the aspect ratio of most videos is 16:9, 4:3, 2:1, when the coordinates on the image rotate, it will inevitably be distorted. The most significant thing is that when the mobile phone is watching the video, the width of the word on the subtitle is different in the horizontal screen mode or the vertical screen model. Therefore, in order to ensure that the shape of the texture remains unchanged during the rotation process, this embodiment considers The coordinates of any point are scaled based on the aspect ratio of the image.

S1.2. Obtain the distance moved by the key point and the rotation angle of the key object.

S1.3. Perform a rotation matrix transformation on any point on the image according to the aspect ratio of the image, the distance moved by the key point, and the rotation angle of the key object, and obtain the coordinates after the rotation matrix transformation corresponding to any point.

It should be noted that the embodiment of the present invention refers to the coordinates of the image as the world coordinate system, and the coordinate system in which the movable key object in the image is located is referred to as the object coordinate system. Although the texture is located in the coordinate system of the image, the texture is mapped. It always follows the motion of the object, which is equivalent to the coordinate system of the object. Therefore, in order to ensure the rotation of the texture to adapt to the transformation between the two coordinate systems, the aspect ratio of the image, the distance moved by the key point, and the rotation angle of the key object are required. , Perform a rotation matrix transformation on any point on the image.

For the sake of clarity and ease of description, the key objects in the following embodiments are all exemplified by a human face, but are not intended to limit the scope of the present invention.

In an embodiment, step S1.3 further includes:

S1.3.1, for any point on the image, according to the aspect ratio of the image, the coordinates of the point are scaled to obtain the scaled coordinates;

S1.3.2: The coordinates of the rotation center point are translated from the origin coordinates to the coordinates of the key points, and the scaled coordinates are translated according to the moving distance of the key points to obtain the coordinates after the first translation.

It should be noted that if a graphic D is rotated by α° around a certain point O, the obtained new graphic completely coincides with the original graphic, and O is called the rotation center point of the graphic D. In order to ensure that the texture can be rotated at a specific position, the rotation center needs to be translated to a specific position to ensure that the rotated image completely coincides with the original image. In the application scenario of the present invention, the rotation center point is a key point, so-called The key point, to put it simply, is that the texture needs to be aligned at all times, for example, for mapping on the human eye, the key point can be the center point of the region of the human eye (assuming this is the coordinates of the pupil). Obviously, the rotation center point in the embodiment refers to a key point after the face is moved in the image, and also in the above example, the coordinates of the pupil after the face is moved. Of course, the present invention is not limited to the mapping of the human eye, and the present invention is equally applicable to the mapping of other parts of the face, such as the nose, mouth or eyebrows, and will not be described herein.

S1.3.3, according to the rotation angle of the key object and the coordinates of the rotation center point, the coordinates after the first translation are rotated to obtain the rotated coordinates.

It should be noted that the rotation angle of the face can be calculated from the position of the key points on the human face. For example, the angle between the bridge of the nose and the X-axis in the horizontal direction is calculated, and the calculation formula is not given in detail here. Therefore, in order to ensure that the rotated coordinates coincide with the rotation angle of the face and the shape does not change, the embodiment rotates the coordinates after the first translation according to the rotation angle of the face and the coordinates of the rotation center point. obtain.

S1.3.4: The coordinates of the rotation center point are translated from the coordinates of the key point back to the origin coordinates, and the scaled coordinates are translated according to the moving distance of the rotation center point to obtain the coordinates after the second translation.

S1.3.5, scaling the coordinates after the second translation back to the original scale, and obtaining the converted coordinates.

It should be noted that after the second translation is completed, the coordinates are scaled to the original scale, which realizes the correct display of the texture.

In an embodiment, step S1.3 further includes:

S1.3.1, for any point on the image, the coordinates (x, y) of the point are converted into homogeneous coordinates (x, y, 1), and the homogeneous coordinates are scaled based on the aspect ratio R of the image. Get the scaled coordinates (R*x, y, 1).

It should be noted that the homogeneous coordinate is to represent a vector that is originally n-dimensional with an n+1-dimensional vector. For example, the homogeneous coordinates of the two-dimensional point (x, y) are expressed as (hx, hy, h). It can be seen that the homogeneous representation of a vector is not unique, and the different values of the h of the homogeneous coordinates represent the same point, such as homogeneous coordinates (8, 4, 2), (4, 2 , 1) represents two-dimensional points (4, 2). The purpose of introducing homogeneous coordinates is mainly to multiply and add in the merging matrix operation, expressed as the form of p'=p*M. That is, it provides an efficient way to transform a set of points in a two-dimensional, three-dimensional or even high-dimensional space from one coordinate system to another using matrix operations.

The scaled coordinates are represented by matrix M ₁ as:

S1.3.2, shifting the coordinates of the rotation center point from the origin coordinates (0, 0) to the coordinates (D _x , D _y ) of the key points, and shifting the scaled coordinates according to the moving distance of the key points to obtain The coordinates after the first translation (R*x+D _x /R, y+D _y , 1).

It should be noted that in the two-dimensional coordinates, the coordinates of the original rotation center point are the origin coordinates (0, 0), and the coordinates after the translation are assumed to be (D _x , D _y ), and the sx units are translated in the x-axis direction. The sy units are translated in the y-axis direction, [x, y] is defined as the pre-transform coordinates, and [X, Y] is the transformed coordinates. Then: X = x + sx; Y = y + sy; represented by a matrix:

Applied to the present embodiment, the first coordinates of the shifted matrix M ₂ is expressed as:

S1.3.3, according to the rotation angle a of the key object and the coordinates of the rotation center point, rotate the coordinates after the first translation to obtain the rotated coordinates: ((R*x+D _x /R)*cosa- (y+D _y )*sina,(R*x+D _x /R)*sina-(y+D _y )*cosa,1).

It should be noted that the angle between the line connecting the point and the origin is b degree, the origin is the center of the circle, and the degree is rotated counterclockwise by a degree. The length of the line connecting the origin and the point is R. [x, y] is the coordinate before transformation, and [X, Y] is the coordinate after transformation. then:

x=R*cos(b);y=R*sin(b);

X=R*cos(a+b)=R*cos(a)*cos(b)=R*sin(a)*sin(b)=x*cos(a)-y*sin(a);

Y=R*sin(a+b)=R*sin(a)*cos(b)+R*cos(a)*sin(b)=x*sin(a)+y*cos(a);

Expressed in a matrix:

Applied to the present embodiment, the rotated coordinates are represented by a matrix M ₃ as:

S1.3.4, shifting the coordinates of the rotation center point from the coordinates of the key point to the origin coordinates, and translating the rotated coordinates according to the translation distance of the rotation center point, and obtaining the coordinates after the second translation: ((R* x+D _x /R)*cosa-(y+D _y )*sina-D _x /R,(R*x+D _x /R)*sina-(y+D _y )*cosa-D _y ,1 ).

It should be noted that the coordinates after the second translation are represented by the matrix M ₄ as:

S1.3.5, scaling the coordinates after the second translation back to the original scale, and obtaining the converted coordinates: ((x+D _x /R ² )*cosa-(y+D _y )*sina-D _x /R ² , (x+D _x /R ² )*sina-(y+D _y )*cosa-D _y ).

It should be noted that the converted coordinates are represented by matrix M5 as:

FIG. 3 is a schematic flowchart of step S2 in the embodiment of the present invention. As shown in FIG. 3, step S2 includes:

S2.1, obtaining a scaling factor of the texture on the x-axis based on the longitudinal length of the key object, the width of the texture, and the width of the image, and obtaining a scaling factor of the texture on the y-axis based on the longitudinal length of the key object, the height of the texture, and the height of the image;

S2.2. For the coordinates converted by any one of the rotation matrices, the coordinates after the transformation of the rotation matrix are defined as (dst _x , dst _y ), and the coordinates of the key points are (center _x , center _y ), when the coordinates after the rotation The following conditions are satisfied: (center _x -resize _x *0.5) <dst _x ≤(center _x +resize _x *0.5) and (center _y -resize _y *0.5)<dst _y ≤(center _y +resize _y *0.5), Then, the coordinate converted by the rotation matrix is used as a coordinate of a certain range near the position after the key point is moved.

In an alternative embodiment, the expression of the scaling factor resize _x of the texture on the x-axis is: resize _x = l*w/(W*r); the expression of the scaling factor resize _y of the texture on the y-axis is: resize _y =l*h/(H*r);

Where l represents the length of the longitudinal length of the key object, such as the length of the face, w represents the width of the texture, h represents the height of the texture, r represents the display coefficient, W represents the width of the image, and H represents the height of the image.

In an optional embodiment, the step of obtaining texture sampling coordinates according to the coordinate of a certain range, the coordinates of the key points, and the scaling factor of the map located near the position after the movement of the key point further includes:

Defines a certain range of coordinates near the position after the key point is moved (near _x , near _y ), the key point coordinates are (center _x , center _y ), the scaling factor of the texture on the x-axis is resize _x , and the texture is scaled on the y-axis. The coefficient resize _y and the texture sampling coordinates are (coord _x , coord _y ), then:

Coord _x =(near _x -center _x +resize _x *0.5)/resize _x ;

Coord _y =(near _y -center _y +resize _y *0.5)/resize _y .

4 is a block diagram of an adaptive mapping system that moves with key points in an image according to an embodiment of the present invention, including:

It should be noted that, in this embodiment, by locating the position of the key point on the key object in the image, according to the position change after the movement of the key point, a rotation matrix transformation is performed on any point on the image to obtain a rotation matrix conversion corresponding to the point. The coordinates after the image ensure that the points on the image move synchronously with the position of the key point, and then according to the coordinates of the key point and the scaling factor of the texture, the coordinates of a certain range near the position after the key point is moved are filtered, and finally combined. The coordinate of the key point and the scaling factor of the texture obtain the texture sampling coordinates of the display texture. The present invention enables the texture to be adaptively moved when the key points on the image are moved, and the original display ratio is not changed, thereby improving the user. Experience.

In one embodiment, the conversion coordinate device comprises:

a positioning module for acquiring an aspect ratio of an image and locating a position of a key point on a key object in the image;

It should be noted that since the shape of the regular image is rectangular, such as the aspect ratio of most videos is 16:9, 4:3, 2:1, when the coordinates on the image rotate, it will inevitably be distorted. The most significant thing is that when the mobile phone is watching the video, the width of the word on the subtitle is different in the horizontal screen mode or the vertical screen model. Therefore, in order to ensure that the shape of the texture remains unchanged during the rotation process, this embodiment considers Scales the coordinates of any point based on the aspect ratio of the texture.

Obtain a key point parameter module, a distance for obtaining key point movement, and a rotation angle of a key object;

The conversion module is configured to perform rotation matrix conversion on any point on the image according to the aspect ratio of the image, the distance moved by the key point, and the rotation angle of the key object, to obtain the converted coordinates corresponding to any point.

It should be noted that the coordinates of the image are called the world coordinate system, and the coordinate system of the movable key object in the image is called the object coordinate system. Although the texture is located in the coordinate system of the image, the texture always follows the object. Movement, which is equivalent to the coordinate system of the object, so in order to ensure the rotation of the texture to adapt to the conversion between the two coordinate systems, the image should be based on the aspect ratio of the image, the distance moved by the key point, and the rotation angle of the key object. Rotate the matrix transformation at any point.

FIG. 5 is a structural block diagram of a conversion module in an embodiment of the present invention, including:

The first scaling unit is configured to scale the coordinates of the point according to the aspect ratio of the image to any point on the image to obtain the scaled coordinates.

The first translation unit is configured to translate the coordinates of the rotation center point from the origin coordinates to the coordinates of the key point, and translate the scaled coordinates according to the moving distance of the key points to obtain the coordinates after the first translation.

It should be noted that if a graphic D is rotated by α° around a certain point O, the obtained new graphic completely coincides with the original graphic, and D is called a rotationally symmetric figure, and O is called the rotation center point of the rotationally symmetric figure D. In order to ensure that the texture can be rotated at a specific position, the rotation center needs to be translated to a specific position to ensure that the rotated image completely coincides with the original image. In the application scenario of the present invention, the rotation center point is a key point, so-called The key point, to put it simply, is that the texture needs to be aligned at all times, for example, for mapping on the human eye, the key point can be the center point of the region of the human eye (assuming this is the coordinates of the pupil). Obviously, the rotation center point in the embodiment refers to a key point after the face is moved in the image, and also in the above example, the coordinates of the pupil after the face is moved. Of course, the present invention is not limited to the mapping of the human eye, and the present invention is equally applicable to the mapping of other parts of the face, such as the nose, mouth or eyebrows, and will not be described herein.

The rotation unit is configured to rotate the coordinates after the first translation according to the rotation angle of the key object and the coordinates of the rotation center point, and obtain the rotated coordinates.

a second translation unit, configured to translate coordinates of the rotation center point from coordinates of the key point back to the origin coordinates, and translate the scaled coordinates according to the moving distance of the rotation center point to obtain coordinates after the second translation; as well as

a second scaling unit, configured to scale the coordinates after the second translation back to the original scale to obtain the converted coordinates.

In one embodiment, the nearby coordinate generation device comprises:

A scaling factor acquisition module for obtaining a scaling factor of the texture on the x-axis based on the longitudinal length of the key object, the width of the texture, and the width of the image, and obtaining the texture on the y-axis based on the longitudinal length of the key object, the height of the texture, and the height of the image. Scaling factor

The attachment coordinate acquisition module is configured to define (dstx, dsty) the coordinate after the rotation for any one of the rotated coordinates, and the coordinates of the key point are (centerx, centery), and the coordinates after the rotation satisfy the following conditions: Centerx-resizex*0.5)<dstx≤(centerx+resizex*0.5) and (centery–resizey*0.5)<dsty≤(centery+resizey*0.5), the rotated coordinates are taken as the position after the key point is moved A certain range of coordinates nearby.

In a specific embodiment, the texture sampling coordinate obtaining device is further configured to:

The coordinates of a certain range around the position after the key point is moved are (near _x , near _y ), and the coordinates of the texture sample are (coord _x , coord _y ), then:

Coord _x =(near _x -center _x +resize _x *0.5)/resize _x ;

Coord _y =(near _y -center _y +resize _y *0.5)/resize _y .

In one embodiment, the present invention discloses an adaptive mapping device, as shown in FIG. 6, comprising:

At least one processor 601, at least one memory 602, and a bus 603; wherein

The processor 601 and the memory 602 complete communication with each other through the bus 603; the memory 602 stores program instructions executable by the processor 601, and the processor 602 invokes the program instructions to execute the above The methods provided by the method embodiments include, for example:

In one embodiment, the present invention discloses a computer program product comprising a computer program stored on a non-transitory computer readable storage medium, the computer program comprising program instructions when the program instructions are When the computer is executed, the computer can perform the methods provided by the foregoing method embodiments, including, for example:

In one embodiment, the present invention discloses a non-transitory computer readable storage medium storing computer instructions that cause the computer to perform the various method embodiments described above The methods provided include, for example:

S1. Positioning the key points on the key object in the positioning image, performing rotation matrix conversion on any point on the image according to the position change of the key point after moving, to obtain the converted coordinates corresponding to any point;

S3. Obtain a map sampling coordinate according to a certain range of coordinates, a coordinate of a key point, and a scaling factor of the map located near the position after the key point is moved, and display the map on the map sampling coordinate.

A person skilled in the art can understand that all or part of the steps of implementing the above method embodiments may be completed by using hardware related to the program instructions. The foregoing program may be stored in a computer readable storage medium, and the program is executed when executed. The foregoing steps include the steps of the foregoing method embodiments; and the foregoing storage medium includes: a medium that can store program codes, such as a ROM, a RAM, a magnetic disk, or an optical disk.

The above described embodiments of an apparatus for operating a database are merely illustrative, wherein the units described as separate components may or may not be physically separate, and the components displayed as units may or may not be Physical units can be located in one place or distributed to multiple network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the embodiment. Those of ordinary skill in the art can understand and implement without deliberate labor.

Through the description of the above embodiments, those skilled in the art can clearly understand that the various embodiments can be implemented by means of software plus a necessary general hardware platform, and of course, by hardware. Based on such understanding, the above-described technical solutions may be embodied in the form of software products in essence or in the form of software products, which may be stored in a computer readable storage medium such as ROM/RAM, magnetic Discs, optical discs, etc., include instructions for causing a computer device (which may be a personal computer, server, or network device, etc.) to perform the methods described in various embodiments or portions of the embodiments.

Finally, the method of the present application is only a preferred embodiment and is not intended to limit the scope of the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and scope of the present invention are intended to be included within the scope of the present invention.

Claims

An adaptive mapping method that moves with key points in an image, and includes:

S1. Positioning a key point on a key object in the positioning image, performing rotation matrix conversion on any point on the image according to the position change after the key point is moved, and obtaining a coordinate converted by the rotation matrix corresponding to an arbitrary point;

S2, according to the coordinate of the key point after moving and the scaling factor of the texture, obtain a certain range of coordinates near the position after the key point is moved;

S3. Obtain a map sampling coordinate according to a certain range of coordinates, a coordinate of a key point, and a scaling factor of the map near the position after the key point is moved, and display the map on the map sampling coordinate.
The adaptive mapping method according to claim 1, wherein the step S1 further comprises:

S1.1. Obtain an aspect ratio of the image, and locate a key point on a key object in the image;

S1.2. Obtaining the distance moved by the key point and the rotation angle of the key object;

S1.3. Perform a rotation matrix transformation on any point on the image according to the aspect ratio of the image, the distance moved by the key point, and the rotation angle of the key object, and obtain the coordinates after the rotation matrix transformation corresponding to any point.
The adaptive mapping method according to claim 2, wherein the step S1.3 further comprises:

S1.3.1, for any point on the image, according to the aspect ratio of the image, the coordinates of the point are scaled to obtain the scaled coordinates;

S1.3.2: shifting the coordinates of the rotation center point from the origin coordinate to the coordinate of the key point, and shifting the scaled coordinate according to the moving distance of the key point to obtain the coordinate after the first translation;

S1.3.3, according to the rotation angle of the key object and the coordinates of the rotation center point, the coordinates after the first translation are rotated to obtain the rotated coordinates;

S1.3.4, shifting the coordinates of the rotation center point from the coordinates of the key point back to the origin coordinates, and translating the scaled coordinates according to the moving distance of the rotation center point to obtain the coordinates after the second translation;

S1.3.5, scaling the coordinates after the second translation back to the original scale, and obtaining the converted coordinates.
The adaptive mapping method according to claim 2, wherein the step S1.3 further comprises:

S1.3.1, for any point on the image, the coordinates (x, y) of the point are converted into homogeneous coordinates (x, y, 1), and the homogeneous coordinates are scaled based on the aspect ratio R of the image. Get the scaled coordinates (R*x, y, 1);

S1.3.2, shifting the coordinates of the rotation center point from the origin coordinates (0, 0) to the coordinates (D x , D y ) of the key points, and shifting the scaled coordinates according to the moving distance of the key points to obtain The coordinates after the first translation (R*x+D x /R, y+D y , 1);

S1.3.3, according to the rotation angle a of the key object and the coordinates of the rotation center point, rotate the coordinates after the first translation to obtain the rotated coordinates: ((R*x+D x /R)*cosa- (y+D y )*sina,(R*x+D x /R)*sina-(y+D y )*cosa,1);

S1.3.4, shifting the coordinates of the rotation center point from the coordinates of the key point to the origin coordinates, and translating the rotated coordinates according to the translation distance of the rotation center point, and obtaining the coordinates after the second translation: ((R* x+D x /R)*cosa-(y+D y )*sina-D x /R,(R*x+D x /R)*sina-(y+D y )*cosa-D y ,1 );as well as

S1.3.5, scaling the coordinates after the second translation back to the original scale, and obtaining the converted coordinates: ((x+D x /R 2 )*cosa-(y+D y )*sina-D x /R 2 , (x+D x /R 2 )*sina-(y+D y )*cosa-D y ).
The adaptive mapping method according to claim 1, wherein the step S2 further comprises:

S2.1. Obtain a scaling factor of the texture on the x-axis based on the longitudinal length of the key object, the width of the texture, and the width of the image, and obtain a scaling factor of the texture on the y-axis based on the longitudinal length of the key object, the height of the texture, and the height of the image;

S2.2. For any coordinate converted by the rotation matrix, the coordinates after the transformation of the rotation matrix are defined as (dst x , dst y ), and the coordinates of the key point are (center x , center y ), when the rotation is The coordinates satisfy the following conditions: (center x -resize x *0.5)<dst x ≤(center x +resize x *0.5) and (center y –resize y *0.5)<dst y ≤(center y +resize y *0.5) , the coordinate converted by the rotation matrix is used as a coordinate of a certain range near the position after the key point is moved;

The expression of the scaling factor resize x of the texture on the x-axis is: resize x = l * w / (W * r); the expression of the scaling factor resize y of the texture on the y-axis is: resize y = L*h/(H*r);

Where l represents the longitudinal length of the key object, w represents the width of the texture, h represents the height of the texture, r represents the display coefficient, W represents the width of the image, and H represents the height of the image.
The adaptive mapping method according to claim 5, wherein the step of obtaining texture sampling coordinates according to a certain range of coordinates, a coordinate of a key point, and a scaling factor of the texture in the vicinity of the position after the movement of the key point , further including:

The coordinates of a certain range around the position after the key point is moved are (near x , near y ), and the coordinates of the texture sample are (coord x , coord y ), then:

Coord x =(near x -center x +resize x *0.5)/resize x ;

Coord y =(near y -center y +resize y *0.5)/resize y .
An adaptive mapping system that moves with key points in an image, and includes:

Converting the coordinate device, locating the position of the key point on the key object in the image, performing a rotation matrix transformation on any point on the image according to the position change after the key point is moved, and obtaining the coordinate converted by the rotation matrix corresponding to any point;

The nearby coordinate generating device obtains a certain range of coordinates near the position after the key point is moved according to the coordinate of the key point movement and the scaling factor of the texture;

The texture sampling coordinate obtaining means obtains the texture sampling coordinates according to the coordinates of a certain range, the coordinates of the key points, and the scaling factor of the texture in the vicinity of the position after the movement of the key point, and displays the texture on the texture sampling coordinates.
The adaptive mapping system of claim 7 wherein said converting coordinate means comprises:

a positioning module for acquiring an aspect ratio of an image and locating a position of a key point on a key object in the image;

Obtain a key point parameter module, a distance for obtaining key point movement, and a rotation angle of a key object;

The conversion module is configured to perform rotation matrix conversion on any point on the image according to the aspect ratio of the image, the distance moved by the key point, and the rotation angle of the key object, to obtain the converted coordinates corresponding to any point.
The adaptive mapping system of claim 8 wherein said nearby coordinate generation means comprises:

A scaling factor acquisition module for obtaining a scaling factor of the texture on the x-axis based on the longitudinal length of the key object, the width of the texture, and the width of the image, and obtaining the texture on the y-axis based on the longitudinal length of the key object, the height of the texture, and the height of the image. Scaling factor

The attachment coordinate acquisition module is configured to define (dstx, dsty) the coordinate after the rotation for any one of the rotated coordinates, and the coordinates of the key point are (centerx, centery), and the coordinates after the rotation satisfy the following conditions: Centerx-resizex*0.5)<dstx≤(centerx+resizex*0.5) and (centery–resizey*0.5)<dsty≤(centery+resizey*0.5), the rotated coordinates are taken as the position after the key point is moved A certain range of coordinates nearby.
The adaptive mapping system according to claim 9, wherein the texture sampling coordinate obtaining means is further configured to:

The coordinates of a certain range around the position after the key point is moved are (near x , near y ), and the coordinates of the texture sample are (coord x , coord y ), then:

Coord x =(near x -center x +resize x *0.5)/resize x ;

Coord y =(near y -center y +resize y *0.5)/resize y .
An adaptive mapping device, comprising:

At least one processor, at least one memory, and a bus; wherein

The processor and the memory complete communication with each other through the bus; the memory stores program instructions executable by the processor, the processor invoking the program instructions capable of performing any of claims 1 to 6 A method as described.
A computer program product, comprising: a computer program stored on a non-transitory computer readable storage medium, the computer program comprising program instructions, when the program instructions are executed by a computer, The computer performs the method of any of claims 1 to 6.
A non-transitory computer readable storage medium, wherein the non-transitory computer readable storage medium stores computer instructions, the computer instructions causing the computer to perform the method of any one of claims 1 to 6. .