CN111093045B - Method and device for scaling video sequence resolution - Google Patents
Method and device for scaling video sequence resolution Download PDFInfo
- Publication number
- CN111093045B CN111093045B CN201911259827.3A CN201911259827A CN111093045B CN 111093045 B CN111093045 B CN 111093045B CN 201911259827 A CN201911259827 A CN 201911259827A CN 111093045 B CN111093045 B CN 111093045B
- Authority
- CN
- China
- Prior art keywords
- source image
- image
- pixel
- interpolation
- coordinate
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 40
- 238000004422 calculation algorithm Methods 0.000 claims abstract description 32
- 230000006870 function Effects 0.000 claims description 6
- 238000006243 chemical reaction Methods 0.000 claims description 4
- 238000004590 computer program Methods 0.000 claims description 2
- 238000004364 calculation method Methods 0.000 abstract description 6
- 230000000694 effects Effects 0.000 abstract description 3
- 238000005457 optimization Methods 0.000 abstract description 3
- 230000004044 response Effects 0.000 abstract description 3
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 238000005070 sampling Methods 0.000 description 2
- 238000004891 communication Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
- H04N7/0117—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level involving conversion of the spatial resolution of the incoming video signal
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234363—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the spatial resolution, e.g. for clients with a lower screen resolution
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440263—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Graphics (AREA)
- Image Processing (AREA)
- Editing Of Facsimile Originals (AREA)
Abstract
The invention discloses a method and a device for scaling the resolution of a video sequence. The method comprises the following steps: step S1, judging whether the source image meets the preset condition frame by frame; step S2, if the current frame source image meets the preset condition, the interpolation algorithm is used to obtain the interpolation pixel coordinate table and the weighting coefficient table of all the pixel points of the target image corresponding to the source image; step S3: and if the current frame source image does not meet the preset condition, obtaining a zoomed image according to the interpolation pixel coordinate table and the weighting coefficient table of all the pixel points of the obtained target image corresponding to the source image. The method reduces the total calculation amount of image scaling, shortens the execution time of image scaling and improves the real-time response efficiency of the system. In addition, the method can generate an optimization effect on various image stretching algorithms and has certain universality.
Description
Technical Field
The invention relates to a method for scaling the resolution of a video sequence, and also relates to a corresponding device for scaling the resolution of the video sequence, belonging to the field of video image processing.
Background
At present, digital image processing is more and more widely applied to the fields of digital communication, intelligent analysis and the like. Before the steps of encoding, analyzing, enhancing, displaying and the like are carried out on the video sequence, the requirement of scaling the resolution of the video sequence exists, namely, the video sequence is scaled from the resolution of a source image to the resolution of a target image.
Scaling the video sequence resolution occupies a non-negligible amount of memory bandwidth and computation in the entire image processing process. In the process of scaling the resolution of the existing video sequence, each frame of target image generates one pixel, and at least more than ten times of multiplication is needed before modification, so that the total calculation amount of image scaling is larger, the efficiency of scaling the resolution of the video sequence is reduced, and the occupation of system resources is increased.
Therefore, the method for rapidly scaling the resolution of the video sequence can effectively improve the real-time performance and the processing efficiency of the system.
Disclosure of Invention
The first technical problem to be solved by the present invention is to provide a method for scaling the resolution of a video sequence.
Another object of the present invention is to provide an apparatus for scaling the resolution of a video sequence.
In order to achieve the purpose, the invention adopts the following technical scheme:
according to a first aspect of embodiments of the present invention, there is provided a method for scaling the resolution of a video sequence, comprising the steps of:
step S1, judging whether the source image meets the preset condition frame by frame;
step S2, if the current frame source image meets the preset condition, the interpolation algorithm is used to obtain the interpolation pixel coordinate table and the weighting coefficient table of all the pixel points of the target image corresponding to the source image;
step S3: and if the current frame source image does not meet the preset condition, obtaining a zoomed image according to the interpolation pixel coordinate table and the weighting coefficient table of all the pixel points of the obtained target image corresponding to the source image.
Preferably, the preset conditions are as follows: the current frame source image is a first frame image of a video sequence, or the resolution of the current frame source image is changed compared with the previous frame source image, or the resolution of a target image corresponding to the current frame source image is changed.
Preferably, obtaining the interpolated pixel coordinate table of all the pixel points of the destination image corresponding to the source image comprises the following sub-steps:
step S21: respectively obtaining the coordinates of each pixel point in the target image in the source image;
step S22: and confirming the interpolation pixel coordinate of each pixel point in the target image in the source image according to the interpolation algorithm and the coordinate of each pixel point in the target image in the source image so as to form an interpolation pixel coordinate table.
Preferably, the interpolation algorithm is implemented by a bilinear interpolation algorithm or a bicubic linear interpolation algorithm.
Preferably, the coordinate of any one pixel point in the destination image in the source image is represented as (s × r)0，t×r1) Wherein (s, t) represents the coordinates of the pixel point in the target image, r0Representing the ratio of the width of the source image to the destination image, r1Representing a sourceHigh ratio of image to target image.
Preferably, when the interpolation algorithm adopts a bilinear interpolation algorithm, obtaining a weighting coefficient table of all pixel points of the target image corresponding to interpolated pixels of the source image comprises the following substeps:
step S23, obtaining a first transverse interpolation pixel value and a second transverse interpolation pixel value corresponding to each pixel point in the target image in the source image according to the coordinate of each pixel point in the target image in the source image and the interpolation pixel coordinate;
and step S24, obtaining a weighting coefficient of each pixel point in the target image corresponding to the interpolation pixel of the source image according to the coordinate of each pixel point in the target image in the source image and the corresponding first transverse interpolation pixel value and second transverse interpolation pixel value, so as to form a weighting coefficient table.
Preferably, when the interpolation algorithm adopts a bicubic linear interpolation algorithm, all pixel points of the target image are obtained to correspond to interpolation pixel points of the source image, and the weighting coefficient of any interpolation pixel point is obtained according to the following formula;
cij＝W(xi-x′)×W(yj-y′)
wherein, cijWeight coefficient (x) representing any one of the interpolated pixelsi，yj) Representing interpolated pixel point nijThe coordinate (x ', y') represents the coordinate of any pixel point in the target image after conversion in the coordinate system of the source image, and a represents a weight function.
Preferably, the pixel value of each pixel point in the zoomed image is: and the sum of the products of the pixel values of the interpolation pixel points corresponding to the pixel points and the corresponding weighting coefficients.
According to a second aspect of the embodiments of the present invention, there is provided an apparatus for scaling the resolution of a video sequence, comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the following steps when executing the program:
step S1, judging whether the source image meets the preset condition frame by frame;
step S2, if the current frame source image meets the preset condition, the interpolation algorithm is used to obtain the interpolation pixel coordinate table and the weighting coefficient table of all the pixel points of the target image corresponding to the source image;
step S3: and if the current frame source image does not meet the preset condition, obtaining a zoomed image according to the interpolation pixel coordinate table and the weighting coefficient table of all the pixel points of the obtained target image corresponding to the source image.
The method and the device for scaling the resolution of the video sequence provided by the invention can obtain the interpolation pixel coordinate table and the weighting coefficient table of the source image corresponding to all the pixel points of the target image only when the source image of the current frame meets the preset condition, thereby being convenient for obtaining the scaled image according to the interpolation pixel coordinate table and the weighting coefficient table of the source image corresponding to all the pixel points of the obtained target image when the source image of the current frame does not meet the preset condition. The method and the device for scaling the resolution of the video sequence reduce the total calculation amount of image scaling, shorten the execution time of image scaling and improve the real-time response efficiency of a system. In addition, the method and the device for scaling the resolution of the video sequence can generate an optimization effect on various image stretching algorithms, and have certain universality.
Drawings
FIG. 1 is a flow chart of a method for scaling the resolution of a video sequence according to the present invention;
fig. 2 is a schematic diagram of the conversion of any pixel point in the target image to the coordinate system of the source image in the method for scaling the resolution of the video sequence provided by the present invention.
Detailed Description
The technical contents of the present invention will be further described in detail with reference to the accompanying drawings and specific embodiments.
In order to increase the speed of scaling the resolution of a video sequence and reduce the occupation of system resources, as shown in fig. 1, the present invention provides a method for scaling the resolution of a video sequence, comprising the following steps:
and step S1, judging whether the source image meets the preset condition frame by frame.
Because the video is composed of a plurality of continuous frames of images, when the resolution of the video sequence is zoomed, that is, the resolution of each frame of image input in the video sequence is zoomed frame by frame, it is necessary to judge whether the source image meets the preset condition frame by frame. Wherein the preset conditions are as follows: the current frame source image is a first frame image of a video sequence, or the contrast resolution of the current frame source image and a previous frame source image is changed, or the resolution of a target image corresponding to the current frame source image is changed.
And step S2, if the current frame source image meets the preset conditions, obtaining an interpolation pixel coordinate table and a weighting coefficient table of all pixel points of the target image corresponding to the source image by using an interpolation algorithm.
If the current frame source image meets any one of the preset conditions, the step of obtaining the interpolation pixel coordinate table of all the pixel points of the target image corresponding to the source image comprises the following substeps:
step S21: respectively obtaining the coordinates of each pixel point in the target image in the source image;
assuming that the coordinate system of a source image is A, the coordinate system of a destination image is B, m is any pixel point in the destination image, the pixel point m needs to output a pixel value, and the ratio of the source image to the destination image width is r0The ratio of the source image to the destination image is r1. The pixel value of the pixel point m to be output depends on the format of the target image. For example, the pixel values of the pixel points output by the BMP or PNG format image are tristimulus values (RGB values).
As shown in fig. 2, the process of obtaining the coordinates of each pixel point in the destination image in the source image is as follows: for any pixel point m in the target image, assuming that the coordinate value of the pixel point m in the coordinate system B of the target image is (s, t), knowing that the ratio of the width of the source image to the width of the target image is r0High ratio of r1Therefore, the coordinate of the pixel point m in the coordinate system A of the source image is (s × r)0，t×r1)。
Step S22: and confirming the interpolation pixel coordinate of each pixel point in the target image in the source image according to the interpolation algorithm and the coordinate of each pixel point in the target image in the source image so as to form an interpolation pixel coordinate table.
The following explains in detail the implementation process of determining the interpolation pixel coordinate of each pixel point in the target image in the source image in this step, by taking bilinear interpolation algorithm as an example.
When a bilinear interpolation algorithm is used, let x1＝s×r0，y1＝t×r1. As shown in fig. 2, the coordinate of any one pixel m in the destination image in the coordinate system a of the source image is (x)1，y1) The abscissa x of the pixel point m1Rounding down to obtain integer coordinate x0The abscissa x of the pixel point m1Rounding up to obtain integer coordinate x2. The ordinate y of the pixel point m1Rounding down to obtain an integer coordinate y0The ordinate y of the pixel point m1Rounding up to obtain an integer coordinate y2。
As shown in FIG. 2, with (x)0，y0)，(x2，y0)，(x0，y2) And (x)2，y2) For coordinate, finding corresponding n in coordinate system A of source image00，n01，n10And n11And four pixel points. The 4 pixel points found in the coordinate system a of the source image are pixel points of any one pixel point m in the target image, which need reference interpolation in the source image, that is, the interpolation pixel coordinate of any one pixel point m in the target image in the source image is (x)0，y0)，(x2，y0)，(x0，y2) And (x)2，y2). Calculating the interpolation pixel coordinate in the source image corresponding to each pixel point of the target image needs to carry out multiplication for 2 times, rounding up for 2 times and rounding down for 2 times.
The method for determining the interpolation pixel coordinate of each pixel point in the target image in the source image is adopted to respectively obtain the interpolation pixel coordinate of each pixel point in the target image in the source image, and the obtained interpolation pixel coordinate of each pixel point in the target image in the source image is stored to form an interpolation pixel coordinate table P of the target image corresponding to the source image.
As shown in fig. 2, obtaining a table of weighting coefficients for all pixel points of the destination image corresponding to interpolated pixels of the source image comprises the following sub-steps:
step S23, obtaining a first transverse interpolation pixel value and a second transverse interpolation pixel value corresponding to each pixel point in the target image in the source image according to the coordinate of each pixel point in the target image in the source image and the interpolation pixel coordinate;
as shown in fig. 2, for any pixel m in the destination image, according to the coordinates of the pixel m in the source image and the corresponding four interpolation pixels n00，n01，n10And n11Determining the position of the pixel point m in the source image and the corresponding four interpolation pixel points n00，n01，n10And n11Performing first interpolation on a pixel point m in the horizontal direction to obtain a first transverse interpolation pixel value corresponding to the pixel point m; and carrying out second interpolation on the pixel point m in the horizontal direction to obtain a second transverse interpolation pixel value corresponding to the pixel point m.
The process of performing the first interpolation on the pixel point m in the horizontal direction to obtain a first horizontal interpolation pixel value corresponding to the pixel point m is as follows: from pixel m to pixel n00And n01The line segment n00n01Make a perpendicular line to cross m0Point, can know m0The coordinate value of the point is (x)1，y0)。m0Point distance pixel point n00Has a length of (x)1-x0) Distance pixel n01Has a length of (x)2-x1). Thus, m0The pixel value of the point is the first horizontal interpolation pixel value corresponding to the pixel point m, and is expressed as:
a pixel point n00And n01The pixel value of (a) is substituted into the formula (1), and a first horizontal interpolation pixel value corresponding to the pixel point m can be obtained.
Similarly, from pixel m to pixel n10And n11The line segment n10n11Make a perpendicular line to cross m1Performing second interpolation on the pixel point m in the horizontal direction by adopting a method for obtaining a first horizontal interpolation pixel value corresponding to the pixel point m to obtain m1The pixel value of the point is the second horizontal interpolation pixel value corresponding to the pixel point m, and is expressed as:
a pixel point n10And n11The pixel value of (a) is substituted into the formula (2), and a second horizontal interpolation pixel value corresponding to the pixel point m can be obtained.
And step S24, obtaining the weighting coefficient of each pixel point of the target image corresponding to the interpolation pixel of the source image according to the coordinate of each pixel point in the target image in the source image and the corresponding first transverse interpolation pixel value and second transverse interpolation pixel value, so as to form a weighting coefficient table.
For any pixel point M in the target image, according to the coordinates in the source image of the pixel point M and the corresponding first horizontal interpolation pixel value and second horizontal interpolation pixel value, similar to the method for performing horizontal direction interpolation on the pixel point M, performing vertical direction interpolation on the pixel point M to obtain the pixel value of the M point as follows:
m is to be0Dot pixel value sum m1The pixel values of the dots are respectively substituted into the formula (3), and the following can be obtained:
and for each determined pixel point m, the coordinate values in the source image coordinate system A are all constant. Then order
Then c is00，c01，c10And c11Four interpolation pixel points n corresponding to the pixel point m in the source image00，n01，n10And n11The weighting coefficient of (2). Since the denominators are the same, the weighting coefficients are calculated, at least 5 multiplications, 4 divisions and 6 subtractions need to be performed, and the calculation amount is equivalent to performing 9 multiplications (multiplications for converting the divisions into reciprocal numbers).
And respectively obtaining the weighting coefficient of the interpolation pixel of each pixel point in the target image in the source image by adopting the method for determining the weighting coefficient of the interpolation pixel of each pixel point in the target image corresponding to the source image, and storing the obtained weighting coefficient of the interpolation pixel of each pixel point in the target image in the source image to form a weighting coefficient table Q.
Step S3: and if the current frame source image does not meet the preset condition, obtaining a zoomed image according to the interpolation pixel coordinate table and the weighting coefficient table of all the pixel points of the obtained target image corresponding to the source image.
And if the current frame source image is not the first frame image of the video sequence, or the contrast resolution of the current frame source image and the previous frame source image is not changed, or the resolution of the target image corresponding to the current frame source image is not changed. And determining the pixel value of the interpolation pixel point corresponding to each pixel point of the target image in the source image according to the interpolation pixel coordinate corresponding to each pixel point of the target image in the source image and the weighting coefficient, and respectively substituting the pixel value of the interpolation pixel point corresponding to each pixel point of the target image in the source image and the corresponding weighting coefficient into the following formula to obtain the zoomed target image.
m＝c00×n00+c01×n01+c10×n10+c11×n11 (9)
In an embodiment of the present invention, the method of steps S1 to S3 may also be implemented by using a bicubic linear interpolation algorithm, and more specifically, the method of using the bicubic linear interpolation algorithm to obtain an interpolated pixel coordinate table and a weighting coefficient table of all pixel points of the target image corresponding to the source image is used, so that when the current frame source image does not satisfy the preset condition, the zoomed image may be obtained according to the interpolated pixel coordinate table and the weighting coefficient table of all pixel points of the obtained target image corresponding to the source image.
The difference between the bicubic linear interpolation algorithm and the bilinear interpolation algorithm is that the number of interpolation pixel points of each pixel point in the target image in the source image is increased from 4 to 16, and the interpolation function is adjusted from linear interpolation to the interpolation function based on the sampling formula.
Assuming that the coordinate of any pixel point m in the target image after conversion in the coordinate system A of the source image is (x ', y'), respectively rounding up and rounding down the transverse coordinate of the coordinate to obtain the nearest adjacent interpolation pixel point of the pixel point m in the coordinate system A of the source imageCoordinate, then each interpolated pixel point nij(wherein i is more than or equal to 0 and less than or equal to 3, j is more than or equal to 0 and less than or equal to 3, and integers are taken) is (x)i，yj) Therefore, 2 times of multiplication is needed for converting the coordinates of any one pixel point m in the target image in the coordinate system a of the source image, the converted coordinates are rounded up and rounded down 4 times respectively to obtain the horizontal and vertical coordinates of 4 interpolation pixel points nearest to the pixel point m, and the horizontal and vertical coordinates of each pixel point in the target image in the other 12 interpolation pixel points in the source image are obtained through 2 times of addition and 2 times of subtraction. And storing the 16 interpolation pixel coordinates of each pixel point in the target image in the source image to form an interpolation pixel coordinate table P of the target image corresponding to the source image.
Any one of 16 interpolation pixel points referenced by the pixel point m, and the weighting coefficient of the interpolation pixel point is related to the transverse and longitudinal distances of the interpolation pixel point. Let cijFor interpolation pixel point nijCalculating the obtained weighting coefficient, i.e. the weighting coefficient cijIs related to its distance from the pixel point m, a weighting factor cijObtained according to the following formula.
cij＝W(xi-x′)×W(yj-y′) (10)
Wherein a of the weighting function takes a value of 0.5.
Weighting coefficient cijEach weight function is subjected to 2 times of weight calculation based on a sampling formula and multiplied.
Finally, in step S3, from the obtained interpolation pixel coordinate table and weighting coefficient table corresponding to the source image with the same resolution as the source image of the current frame, the interpolation pixel coordinate and weighting coefficient corresponding to each pixel point of the target image in the source image are used, and the pixel value of the interpolation pixel point corresponding to each pixel point of the target image in the source image is determined according to the interpolation pixel coordinate corresponding to each pixel point of the target image in the source image, and the pixel value of the interpolation pixel point corresponding to each pixel point of the target image in the source image and the corresponding weighting coefficient are respectively substituted into the following formulas in sequence to obtain the zoomed target image.
The method for scaling the resolution of the video sequence provided by the invention can obtain the interpolation pixel coordinate table and the weighting coefficient table of the source image corresponding to all the pixel points of the target image again only when the current frame source image meets the preset condition, thereby being convenient for obtaining the scaled image according to the interpolation pixel coordinate table and the weighting coefficient table of the source image corresponding to all the pixel points of the obtained target image when the current frame source image does not meet the preset condition. The method for scaling the resolution of the video sequence reduces the total calculation amount of image scaling, shortens the execution time of the image scaling and improves the real-time response efficiency of the system. In addition, the method for scaling the resolution of the video sequence can generate an optimization effect on various image stretching algorithms and has certain universality.
In addition, an apparatus for scaling a resolution of a video sequence according to an embodiment of the present invention includes: a memory storing a computer control program which, when executed by the processor, implements the steps of the method of scaling video sequence resolution provided by the present invention (steps S1-S3 as described above).
The method and apparatus for scaling the resolution of a video sequence according to the present invention are described in detail above. It will be apparent to those skilled in the art that any obvious modifications thereto can be made without departing from the true spirit of the invention, which is to be accorded the full scope of the claims herein.
Claims (9)
1. A method for scaling the resolution of a video sequence, comprising the steps of:
step S1, judging whether the source image meets the preset condition frame by frame;
step S2, if the current frame source image meets the preset condition, the interpolation algorithm is used to obtain the interpolation pixel coordinate table and the weighting coefficient table of all the pixel points of the target image corresponding to the source image;
step S3: if the current frame source image does not meet the preset condition, obtaining a zoomed image by using the interpolation pixel coordinate and the weighting coefficient corresponding to each pixel point of the target image in the source image from the interpolation pixel coordinate table and the weighting coefficient table corresponding to the source image with the same resolution as the current frame source image obtained in the step S2.
2. The method for scaling the resolution of a video sequence of claim 1, wherein:
the preset conditions are as follows: the current frame source image is a first frame image of a video sequence, or the resolution of the current frame source image is changed compared with the previous frame source image, or the resolution of a target image corresponding to the current frame source image is changed.
3. The method for scaling the resolution of a video sequence of claim 1, wherein:
the step of obtaining the interpolation pixel coordinate table of all the pixel points of the target image corresponding to the source image comprises the following substeps:
step S21: respectively obtaining the coordinates of each pixel point in the target image in the source image;
step S22: and confirming the interpolation pixel coordinate of each pixel point in the target image in the source image according to the interpolation algorithm and the coordinate of each pixel point in the target image in the source image so as to form an interpolation pixel coordinate table.
4. A method of scaling the resolution of a video sequence as recited in claim 3, wherein:
the interpolation algorithm is realized by a bilinear interpolation algorithm or a bicubic linear interpolation algorithm.
5. A method of scaling the resolution of a video sequence as recited in claim 3, wherein:
the coordinate of any pixel point in the target image in the source image is expressed as (s multiplied by r)0，t×r1) Wherein (s, t) represents the coordinates of the pixel point in the target image, r0Representing the ratio of the width of the source image to the destination image, r1Representing a high ratio of source image to destination image.
6. The method for scaling the resolution of a video sequence of claim 1, wherein:
when the interpolation algorithm adopts a bilinear interpolation algorithm, the step of obtaining a weighting coefficient table of interpolation pixels of all pixel points of the target image corresponding to the source image comprises the following substeps:
step S23, obtaining a first transverse interpolation pixel value and a second transverse interpolation pixel value corresponding to each pixel point in the target image in the source image according to the coordinate of each pixel point in the target image in the source image and the interpolation pixel coordinate;
and step S24, obtaining a weighting coefficient of each pixel point in the target image corresponding to the interpolation pixel of the source image according to the coordinate of each pixel point in the target image in the source image and the corresponding first transverse interpolation pixel value and second transverse interpolation pixel value, so as to form a weighting coefficient table.
7. The method for scaling the resolution of a video sequence of claim 1, wherein:
when the interpolation algorithm adopts a bicubic linear interpolation algorithm, obtaining all pixel points of the target image corresponding to interpolation pixel points of the source image, and obtaining the weighting coefficient of any one interpolation pixel point according to the following formula;
cij＝W(xi-x′)×W(yj-y′)
wherein, cijWeight coefficient (x) representing any one of the interpolated pixelsi，yj) Representing interpolated pixel point nijThe coordinate (x ', y') represents the coordinate of any pixel point in the target image after conversion in the coordinate system of the source image, and a represents a weight function.
8. The method for scaling the resolution of a video sequence of claim 1, wherein:
the pixel value of each pixel point in the zoomed image is as follows: and the sum of the products of the pixel values of the interpolation pixel points corresponding to the pixel points and the corresponding weighting coefficients.
9. An apparatus for scaling the resolution of a video sequence, comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein the processor executes the program to perform the steps of:
step S1, judging whether the source image meets the preset condition frame by frame;
step S2, if the current frame source image meets the preset condition, the interpolation algorithm is used to obtain the interpolation pixel coordinate table and the weighting coefficient table of all the pixel points of the target image corresponding to the source image;
step S3: if the current frame source image does not meet the preset condition, obtaining a zoomed image by using the interpolation pixel coordinate and the weighting coefficient corresponding to each pixel point of the target image in the source image from the interpolation pixel coordinate table and the weighting coefficient table corresponding to the source image with the same resolution as the current frame source image obtained in the step S2.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911259827.3A CN111093045B (en) | 2019-12-10 | 2019-12-10 | Method and device for scaling video sequence resolution |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911259827.3A CN111093045B (en) | 2019-12-10 | 2019-12-10 | Method and device for scaling video sequence resolution |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111093045A CN111093045A (en) | 2020-05-01 |
| CN111093045B true CN111093045B (en) | 2021-03-26 |
Family
ID=70396280
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911259827.3A Active CN111093045B (en) | 2019-12-10 | 2019-12-10 | Method and device for scaling video sequence resolution |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111093045B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112258396B (en) * | 2020-12-17 | 2021-04-06 | 恒银金融科技股份有限公司 | Method for scaling character image |
| CN114331832B (en) * | 2021-11-26 | 2024-09-06 | 格兰菲智能科技股份有限公司 | Image scaling method and device |
Family Cites Families (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR100608835B1 (en) * | 2004-12-09 | 2006-08-08 | 엘지전자 주식회사 | Method for transmitting images of mobile terminal |
| CN1288598C (en) * | 2004-12-27 | 2006-12-06 | 北京中星微电子有限公司 | A method for implementing image zoom |
| CN100428331C (en) * | 2005-08-12 | 2008-10-22 | 深圳华为通信技术有限公司 | Self adaptive pantographic system and its method for image in mobile terminal |
| CN101365077B (en) * | 2008-09-28 | 2012-06-20 | 华为终端有限公司 | Image scaling method and device |
| US9218792B2 (en) * | 2008-12-11 | 2015-12-22 | Nvidia Corporation | Variable scaling of image data for aspect ratio conversion |
| CN101576996B (en) * | 2009-06-05 | 2012-04-25 | 腾讯科技（深圳）有限公司 | Processing method and device for realizing image zooming |
| CN102891998B (en) * | 2011-07-22 | 2015-08-05 | 安凯(广州)微电子技术有限公司 | A kind of image scaling, coding method and system |
| CN105513011B (en) * | 2014-09-23 | 2018-10-16 | 上海机电工程研究所 | Image-scaling method |
| CN104361555A (en) * | 2014-11-24 | 2015-02-18 | 中国航空工业集团公司洛阳电光设备研究所 | Infrared image scaling method based on FPGA |
| CN104869284B (en) * | 2015-05-14 | 2018-05-04 | 北京邮电大学 | The high efficiency FPGA implementation method and device of a kind of bilinear interpolation interpolator arithmetic |
| JP6642347B2 (en) * | 2016-09-09 | 2020-02-05 | コニカミノルタ株式会社 | Image processing device |
| CN107422953A (en) * | 2017-06-19 | 2017-12-01 | 南京巨鲨显示科技有限公司 | A kind of image local for medical display protrudes Zoom method |
| CN108537729B (en) * | 2018-03-27 | 2022-03-04 | 珠海全志科技股份有限公司 | Image stepless zooming method, computer device and computer readable storage medium |
| CN108986033A (en) * | 2018-07-26 | 2018-12-11 | 西安电子科技大学 | Image-scaling method based on bilinear interpolation algorithm processing |
| CN109934773B (en) * | 2019-03-13 | 2023-08-25 | 北京旷视科技有限公司 | Image processing method, device, electronic equipment and computer readable medium |
-
2019
- 2019-12-10 CN CN201911259827.3A patent/CN111093045B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN111093045A (en) | 2020-05-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2021088473A1 (en) | Image super-resolution reconstruction method, image super-resolution reconstruction apparatus, and computer-readable storage medium | |
| US20030198399A1 (en) | Method and system for image scaling | |
| CN106780336B (en) | Image reduction method and device | |
| CN111093045B (en) | Method and device for scaling video sequence resolution | |
| CN104700360B (en) | Image-scaling method and system based on edge self-adaption | |
| CN106169173B (en) | Image interpolation method | |
| WO2017059043A1 (en) | 2d lut color transforms with reduced memory footprint | |
| WO2023160426A1 (en) | Video frame interpolation method and apparatus, training method and apparatus, and electronic device | |
| CN111724304A (en) | Image scaling method and device, terminal equipment and storage medium | |
| EP2362655B1 (en) | Motion-vector estimation | |
| CN112801879B (en) | Image super-resolution reconstruction method and device, electronic equipment and storage medium | |
| CN113935934A (en) | Image processing method, image processing device, electronic equipment and computer readable storage medium | |
| WO2001006456A1 (en) | Image processing device, image processing method, image-processing program recorded medium | |
| CN115004220A (en) | Neural network for raw low-light image enhancement | |
| US20180218477A1 (en) | Data interpolation device, method therefor, and image processing apparatus | |
| CN111275615B (en) | Video image scaling method based on bilinear interpolation improvement | |
| CN106296614B (en) | Image processing apparatus and image processing method | |
| CN111784733A (en) | Image processing method, device, terminal and computer readable storage medium | |
| CN109087257B (en) | Airspace increment image filtering method based on parameter estimation framework | |
| JP2008113292A (en) | Motion estimation method and device, program thereof and recording medium thereof | |
| CN103618904B (en) | Motion estimation method and device based on pixels | |
| US20030215156A1 (en) | Method and computing device for determining the pixel value of a pixel in an image | |
| JP2006238188A (en) | Interpolation filter and video signal processing device | |
| CN109658332A (en) | A kind of image magnification method and terminal based on stream data processing | |
| JP4662969B2 (en) | Image processing apparatus and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |