CN103096046A - Video frame processing method, device and player - Google Patents

Abstract

The invention discloses a video frame processing method, a device and a player. The video frame processing method includes the steps of receiving methods and parameters which are used for adjusting video frames in a three-dimensional mode, and adjusting the video frames according to the methods and the parameters. According to the video frame processing method and the player, adjustment of the video frames in a three-dimensional space can be achieved, limitation of two-dimensional transferring is overcome, and better user experience can be generated.

Description

A kind of frame of video processing method, device and player

Technical field

The present invention relates to a kind of frame of video processing method, device and player.

Background technology

Existing player only has simple two-dimensional process about the rotation of video pictures, such as 90 ° of left-hand rotations, 90 ° of right-hand rotations, horizontal/vertical upset etc.Yet under the scene of some mobile phones or DV shooting, restriction due to external condition, picture may not be level (inclination of certain angle is arranged), perhaps because photographed subject is not that the cross section of looking that is parallel to camera lens causes picture distortion to occur, because present player does not have picture calibration function at any angle, so can not address these problems.

For example, the mode of in two-dimensional space, frame of video being adjusted in prior art can be as shown in Figure 1-Figure 3.Be illustrated in figure 1 as a normal two-dimensional video frame picture of the prior art, Figure 2 shows that turn right pictures after 90 ° of described two-dimensional video frame picture, Figure 3 shows that turn left pictures after 90 ° of described two-dimensional video frame picture.

As seen, existing two-dimensional picture treatment technology can only carry out at two-dimensional space the adjustment of some special angle to picture, and for other as situations such as picture perspective and torsional deformations, present two-dimensional process technology is obviously helpless.

Summary of the invention

The main technical problem to be solved in the present invention is, a kind of frame of video processing method is provided, and can adjust in three dimensions frame of video.

For solving the problems of the technologies described above, the invention provides a kind of frame of video processing method, comprising: receive frame of video is carried out three-dimensional mode and the parameter of adjusting; According to described mode and parameter adjustment frame of video.

The invention allows for a kind of frame of video processing unit, comprising:

Interactive unit is used for receiving frame of video is carried out three-dimensional mode and the parameter of adjusting;

Converter unit is used for according to described mode and parameter adjustment frame of video.

The invention has the beneficial effects as follows: by frame of video processing method and the player that the embodiment of the present invention proposes, can realize adjusting frame of video in three dimensions, overcome the limitation of two-dimensional transform, produce better user and experience.

Description of drawings

Fig. 1 is frame of video picture view of the prior art;

Fig. 2 is the schematic diagram one that the frame of video picture is carried out the two dimension adjustment of the prior art;

Fig. 3 is the schematic diagram two that the frame of video picture is carried out the two dimension adjustment of the prior art;

Fig. 4 is the module diagram of an embodiment of a kind of player of the present invention;

Fig. 5 is the schematic diagram one that the frame of video picture is carried out three-dimensional adjustment of the present invention;

Fig. 6 is the schematic diagram two that the frame of video picture is carried out three-dimensional adjustment of the present invention;

Fig. 7 is the schematic diagram three that the frame of video picture is carried out three-dimensional adjustment of the present invention;

Fig. 8 is the schematic flow sheet of an embodiment of a kind of frame of video processing method of the present invention;

Fig. 9 is the schematic flow sheet of another embodiment of a kind of frame of video processing method of the present invention.

Embodiment

By reference to the accompanying drawings the present invention is described in further detail below by embodiment.

Be illustrated in figure 4 as the module diagram of an embodiment that the present invention can realize the player of frame of video three-dimension varying, be provided with the three-dimension varying module in the Video Rendering module of this player, this player comprises: data communication interface, file read module, separation module, audio decoder module, video decode module, audio frequency rendering module, Video Rendering module, playing controller, playback interface, User Interface; Wherein, the Video Rendering module also comprises the three-dimension varying module, and described User Interface is used for receiving mode and the parameter of frame of video being carried out three-dimensional adjustment, and described three-dimension varying module is used for according to described mode and parameter adjustment frame of video.

The three-dimension varying module receives the user by playback interface and adjusts mode and angle through the frame of video of User Interface input, and accordingly the frame of video picture is carried out three-dimensional adjustment.

The principle of frame of video three-dimension varying is as follows:

In two-dimensional space, the each point pixel coordinate in the setting video image frame be (x, y), and defining the Two Dimensional Rotating conversion is exactly that any point on the plane rotate θ angle around initial point, and general provision is counterclockwise for just, and clockwise direction is to bear.Can release transformation for mula from figure below:

Wherein P1 (x1, y1) is postrotational pixel coordinate.

When being extended to three-dimensional, at first the two-dimensional video frame is expanded in three dimensions, can look each pixel coordinate is (x, y, z) { z=0}, again the 3 D video frame after expansion is carried out following conversion, obtain with pixel (x, y, z) thereby along x axle rotation θ angle a new pixel (x ', y ', z '):

$\left[x^{\′}{y}^{\′}{z}^{\′}1\right]=\left[\begin{array}{cccc}x& y& z& 1\end{array}\right]\left[\begin{array}{cccc}\cos \mathrm{\θ}& \sin \mathrm{\θ}& 0& 0\\ -\sin \mathrm{\θ}& \cos \mathrm{\θ}& 0& 0\\ 0& 0& 1& 0\\ 0& 0& 0& 1\end{array}\right]$

As shown in Figure 5, be the schematic diagram of the frame of video that obtains after x axle rotation.

In like manner, the account form along y axle rotation θ angle is as follows:

$\left[x^{\′}{y}^{\′}{z}^{\′}1\right]=\left[\begin{array}{cccc}x& y& z& 1\end{array}\right]\left[\begin{array}{cccc}1& 0& 0& 0\\ 0& \cos \mathrm{\θ}& \sin \mathrm{\θ}& 0\\ 0& -\sin \mathrm{\θ}& \cos \mathrm{\θ}& 0\\ 0& 0& 0& 1\end{array}\right]$

As shown in Figure 6, be the schematic diagram of the frame of video that obtains after y axle rotation.

Account form along z axle rotation θ angle is as follows:

$\left[x^{\′}{y}^{\′}{z}^{\′}1\right]=\left[\begin{array}{cccc}x& y& z& 1\end{array}\right]\left[\begin{array}{cccc}\cos \mathrm{\θ}& 0& -\sin \mathrm{\θ}& 0\\ 0& 1& 0& 0\\ \sin \mathrm{\θ}& & \cos \mathrm{\θ}& 0\\ 0& 0& 0& 1\end{array}\right]$

As shown in Figure 7, be the schematic diagram of the frame of video that obtains after z axle rotation.

Wherein (x ', y ', z ') be exactly behind each axle rotation θ angle new pixel coordinate (the 1st, the coefficient that keeps is used for expanded function, such as zoom function, with 1 become 2 figure can be put be twice).

The account form of brief description when not using this retention factor 1:

Account form along x axle rotation θ angle is as follows:

$\left[\begin{array}{ccc}{x}^{\′}& y^{\′}& z^{\′}\end{array}\right]=\left[\begin{array}{ccc}x& y& z\end{array}\right]*\left|\begin{array}{cccc}\cos \mathrm{\θ}& \sin \mathrm{\θ}& 0& 0\\ -\sin \mathrm{\θ}& \cos \mathrm{\θ}& 0& 0\\ 0& 0& 1& 0\end{array}\right|$

Account form along y axle rotation θ angle is as follows:

$\left[\begin{array}{ccc}{x}^{\′}& y^{\′}& z^{\′}\end{array}\right]=\left[\begin{array}{ccc}x& y& z\end{array}\right]*\left|\begin{array}{cccc}1& 0& 0& 0\\ 0& \cos \mathrm{\θ}& \sin \mathrm{\θ}& 0\\ 0& -\sin \mathrm{\θ}& \cos \mathrm{\θ}& 0\end{array}\right|$

Account form along z axle rotation θ angle is as follows:

$\left[\begin{array}{ccc}{x}^{\′}& y^{\′}& z^{\′}\end{array}\right]=\left[\begin{array}{ccc}x& y& z\end{array}\right]*\left|\begin{array}{cccc}\cos \mathrm{\θ}& 0& -\sin \mathrm{\θ}& 0\\ 0& 1& 0& 0\\ \sin \mathrm{\θ}& 0& \cos \mathrm{\θ}& 0\end{array}\right|$

Above-mentioned various adjustment mode can be separate, also can carry out together, for example to a frame of video, has both carried out the rotation around the x axle, also carries out the rotation around the y axle, exports afterwards final result again.

After being rotated in three dimensions, then the result that will obtain projects on default plane, just can obtain final transformation results.Usually, that plane when this plane can be the plane that at first the two-dimensional video frame is considered as in three dimensions, for example at first will be at each pixel (x of two-dimensional space, y) expanding to three dimensions is (x, y, z) and z=0}, this plane is { z=0} so, pixel after can being adjusted after projection is (x ', y ').Certainly, also can according to concrete demand, this plane be defined as other planes.

According to the angle adjustment parameter of user's input, the three-dimension varying module is adjusted each frame of video picture according to aforesaid way.Preferably, carry out coordinate transform for some predetermined key points (as four summits of picture) and just can realize the angle adjustment of complete video picture, the frame of video key point coordinate parameters of video card after according to the receiving conversion of three-dimension varying module, and accordingly frame of video is done frame of video picture after texture mapping is obtained angle adjustment, show for front end.

Described key point can be four summits of picture, can be also the point of other predetermined location, for example the mid point on four limits, perhaps other points; For irregular tetragonal other pictures, can be also other boundary point or the point of figure inside.

Above key point can be to use the key point that sets in advance, and for example to set in advance and adopt four summits be key point to hypothesis, so no matter to what picture, all to adopt such point as key point; In addition, can also be to provide multiple key point and select for the user, for example can allow the user select in the mid point in four summits and four sidelines a kind of as key point.

In the embodiment of the present invention, preferably, adopt non-cpu mode, utilize video card (GPU) to realize the three-dimension varying of frame of video, due to the processing speed of present video card obviously faster than CPU, because the method for the embodiment of the present invention and player can be accelerated the processing speed of frame of video, produce better user and experience.In addition, allow the user to input voluntarily the adjustment angle of each dimension in the embodiment of the present invention, can realize tilting at any angle, the correction of distortion, overcome the limitation of two-dimensional transform.

In the embodiment of the present invention, player can be the video playback control section of any device that can display video, and the device of described display video includes but not limited to various consumption electronic products with display screen, PC, industrial control computer etc.

Be illustrated in figure 8 as the schematic flow sheet of an embodiment of a kind of frame of video processing method that the present invention proposes, comprise:

801, receive mode and the parameter of frame of video being carried out three-dimensional adjustment;

803, according to described mode and parameter adjustment frame of video.

Preferably, describedly frame of video carried out the three-dimensional mode of adjusting and parameter comprise with lower at least a:

Mode: frame of video is rotated around the x axle; Parameter: around the angle of x axle rotation;

Or,

Mode: frame of video is rotated around the y axle; Parameter: around the angle of y axle rotation;

Or,

Mode: frame of video is rotated around the z axle; Parameter: around the angle of z axle rotation.

Preferably:

The angle ranging from manual input.

Preferably:

Described method is processed by video card.

Preferably:

Described step according to described mode and parameter adjustment frame of video comprises:

According to the key point of described mode and parameter adjustment frame of video, determine on frame of video other coordinate according to the coordinate of the described key point after adjusting.

In order to clearly demonstrate above-mentioned flow process, below describe in conjunction with example again.Be illustrated in figure 9 as the schematic flow sheet of another embodiment of a kind of frame of video processing method that the present invention proposes, comprise:

901, determine the target video frame;

Usually, the user can carry out the selected frame of video of certain operations, can determine the target video frame after receiving afterwards these operation informations of user;

903, receive mode and the parameter of described frame of video being carried out three-dimensional adjustment;

This mode can be the operations such as the user drags by mouse or drags on touch-screen, and system can go out according to user's operation judges the user and want roughly angle that how frame of video is rotated and rotated;

Preferably, can also be that the user directly accurately selectes mode and the parameter of adjusting;

These modes and parameter can be:

Mode: frame of video is rotated around the x axle; Parameter: around the angle of x axle rotation;

Or,

Mode: frame of video is rotated around the y axle; Parameter: around the angle of y axle rotation;

Or,

Mode: frame of video is rotated around the z axle; Parameter: around the angle of z axle rotation;

905, described frame of video is converted to three-dimensional frame of video;

Usually, the frame of video of two-dimensional space is considered as frame of video in three dimensions, each pixel (x, y) at two-dimensional space can be expanded to three dimensions for (x, y, z) z=0}, the value of z can be also other numerical value except 0;

907, the three-dimensional frame of video (x, y, z) that obtains after described conversion is adjusted according to described three-dimensional mode and the parameter of adjusting;

Illustrate respectively as follows:

Adjustment mode along x axle rotation θ angle is as follows:

$\left[\begin{array}{ccc}{x}^{\′}& y^{\′}& z^{\′}\end{array}\right]=\left[\begin{array}{ccc}x& y& z\end{array}\right]*\left|\begin{array}{cccc}\cos \mathrm{\θ}& \sin \mathrm{\θ}& 0& 0\\ -\sin \mathrm{\θ}& \cos \mathrm{\θ}& 0& 0\\ 0& 0& 1& 0\end{array}\right|$

Adjustment mode along y axle rotation θ angle is as follows:

$\left[\begin{array}{ccc}{x}^{\′}& y^{\′}& z^{\′}\end{array}\right]=\left[\begin{array}{ccc}x& y& z\end{array}\right]*\left|\begin{array}{cccc}1& 0& 0& 0\\ 0& \cos \mathrm{\θ}& \sin \mathrm{\θ}& 0\\ 0& -\sin \mathrm{\θ}& \cos \mathrm{\θ}& 0\end{array}\right|$

Adjustment mode along z axle rotation θ angle is as follows:

$\left[\begin{array}{ccc}{x}^{\′}& y^{\′}& z^{\′}\end{array}\right]=\left[\begin{array}{ccc}x& y& z\end{array}\right]*\left|\begin{array}{cccc}\cos \mathrm{\θ}& 0& -\sin \mathrm{\θ}& 0\\ 0& 1& 0& 0\\ \sin \mathrm{\θ}& 0& \cos \mathrm{\θ}& 0\end{array}\right|$

909, the 3 D video frame after adjusting projects to the two-dimensional video frame after being adjusted on default plane;

Usually, that plane when this plane can be the plane that at first the two-dimensional video frame is considered as in three dimensions, for example at first will be at each pixel (x of two-dimensional space, y) expanding to three dimensions is (x, y, z) and z=0}, this plane is { z=0} so, pixel after can being adjusted after projection is (x ', y ');

Certainly, also can according to concrete demand, this plane be defined as other planes.

Above content is in conjunction with concrete execution mode further description made for the present invention, can not assert that concrete enforcement of the present invention is confined to these explanations.For the general technical staff of the technical field of the invention, without departing from the inventive concept of the premise, can also make some simple deduction or replace, all should be considered as belonging to protection scope of the present invention.

Claims (16)

1. a frame of video processing method, is characterized in that, comprising:

Reception is carried out three-dimensional mode and the parameter of adjusting to frame of video;

According to described mode and parameter adjustment frame of video.

2. frame of video processing method as claimed in claim 1 is characterized in that:

Describedly frame of video carried out the three-dimensional mode of adjusting and parameter comprise with lower at least a:

Mode: frame of video is rotated around the x axle; Parameter: around the angle of x axle rotation;

Or,

Mode: frame of video is rotated around the y axle; Parameter: around the angle of y axle rotation;

Or,

Mode: frame of video is rotated around the z axle; Parameter: around the angle of z axle rotation.

3. frame of video processing method as claimed in claim 1 is characterized in that:

The step that described reception is carried out the three-dimensional mode of adjusting and parameter to frame of video also comprises before:

Determine the target video frame;

Described step according to described mode and parameter adjustment frame of video comprises:

Described target video frame is converted to three-dimensional frame of video;

The three-dimensional frame of video that obtains after described conversion is adjusted according to described three-dimensional mode and the parameter of adjusting;

3 D video frame after adjusting is projected to the two-dimensional video frame of presetting after being adjusted on the plane.

4. frame of video processing method as described in the claims 1 to 3 any one is characterized in that:

The angle ranging from manual input.

5. frame of video processing method as described in the claims 1 to 3 any one is characterized in that:

Described method is processed by video card.

6. as claim 1 or the described frame of video processing method of 2 any one, it is characterized in that:

Described step according to described mode and parameter adjustment frame of video comprises:

According to the key point of described mode and parameter adjustment frame of video, determine on frame of video other coordinate according to the coordinate of the described key point after adjusting.

7. a frame of video processing unit, is characterized in that, comprising:

Interactive unit is used for receiving frame of video is carried out three-dimensional mode and the parameter of adjusting;

Converter unit is used for according to described mode and parameter adjustment frame of video.

8. frame of video processing unit as claimed in claim 7 is characterized in that:

Describedly frame of video carried out the three-dimensional mode of adjusting and parameter comprise with lower at least a:

Mode: frame of video is rotated around the x axle; Parameter: around the angle of x axle rotation;

Or,

Mode: frame of video is rotated around the y axle; Parameter: around the angle of y axle rotation;

Or,

Mode: frame of video is rotated around the z axle; Parameter: around the angle of z axle rotation.

9. frame of video processing unit as claimed in claim 7 is characterized in that:

Described interactive unit also is used for receiving the signal of determining the target video frame;

Described converter unit is used for:

Described target video frame is converted to three-dimensional frame of video;

The three-dimensional frame of video that obtains after described conversion is adjusted according to described three-dimensional mode and the parameter of adjusting;

3 D video frame after adjusting is projected to the two-dimensional video frame of presetting after being adjusted on the plane.

10. frame of video processing unit as described in claim 7 to 9 any one is characterized in that:

The angle ranging from manual input.

11. frame of video processing unit as described in claim 7 to 9 any one is characterized in that:

Described converter unit is the part of video card.

12. as claim 7 or the described frame of video processing unit of 8 any one, it is characterized in that:

Described converter unit is used for:

According to the key point of described mode and parameter adjustment frame of video, determine on frame of video other coordinate according to the coordinate of the described key point after adjusting.

13. a player is characterized in that, comprising: Video Rendering module and User Interface; Wherein,

The Video Rendering module also comprises the three-dimension varying module, and described User Interface and described three-dimension varying module are processed frame of video according to the method for claim 1,2 or 3 any one.

14. player as claimed in claim 13 is characterized in that:

The angle ranging from manual input.

15. player as claimed in claim 13 is characterized in that:

Described three-dimension varying module is the part of video card.

16. player as claimed in claim 13 is characterized in that:

Described three-dimension varying module is used for:

According to the key point of described mode and parameter adjustment frame of video, determine on frame of video other coordinate according to the coordinate of the described key point after adjusting.

Images