CN101163252A - Zoom method of multimedia video image - Google Patents

Zoom method of multimedia video image Download PDF

Info

Publication number
CN101163252A
CN101163252A CNA2007101781889A CN200710178188A CN101163252A CN 101163252 A CN101163252 A CN 101163252A CN A2007101781889 A CNA2007101781889 A CN A2007101781889A CN 200710178188 A CN200710178188 A CN 200710178188A CN 101163252 A CN101163252 A CN 101163252A
Authority
CN
China
Prior art keywords
steps
video image
image
interpolation method
pixel
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CNA2007101781889A
Other languages
Chinese (zh)
Other versions
CN101163252B (en
Inventor
王国晖
魏征
王贞松
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Xinjiang Meite Intelligent Security Engineering Co., Ltd.
Original Assignee
Institute of Computing Technology of CAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Institute of Computing Technology of CAS filed Critical Institute of Computing Technology of CAS
Priority to CN2007101781889A priority Critical patent/CN101163252B/en
Publication of CN101163252A publication Critical patent/CN101163252A/en
Application granted granted Critical
Publication of CN101163252B publication Critical patent/CN101163252B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The invention discloses a scale method of a multimedia audio image, which implements transformation operations on the executive color space of an audio image, which leads to that the image satisfies that in the transformed color space, the information content of image included in the three color components is different, and the image information is concentrated in one color component. The audio image is scaled in the transformed color space. As for the color component which includes most information of the audio images, complicated interpolation method is adopted when scaling, which gives the color component better effects, and relatively simple interpolation method is adopted on other color components when image scale process is implemented. The scale method of the multimedia audio image can well remain the details of audio images with excellent scale effects, and in particularly when the invention is used for audio of bad image quality under the bad condition of low bit rate and bad network , the invention can obtain more excellent audio scale effects than c other methods.

Description

A kind of Zoom method of multimedia video image
Technical field
The present invention relates to the multimedia video image processing technology field, particularly relate to a kind of Zoom method of multimedia video image.
Background technology
Along with multimedia, rapid development of network technique, video has been deep into different social sectors as a kind of information carrier.In various Video Applications, the convergent-divergent of the video image function that all is absolutely necessary, and be to use the most frequent function.In digital image processing field, the digital image interpolation algorithm of a large amount of maturations has been arranged, as neighbor interpolation, bilinear interpolation, bicubic spline interpolation, cube convolution interpolation etc., use these interpolation algorithms to can be good at finishing the convergent-divergent of digital picture.
Yet complicated slightly any algorithm just can't be grafted directly in the convergent-divergent of digital video image and go, because video playback requires real-time to be guaranteed, thereby to the very high requirement of efficient proposition of the convergent-divergent of video image.Lift a simple example, video frame rate as a full speed running was 24 frame/seconds, whole processing times of so every frame video image can not be above 33 milliseconds, in this time, except finishing image zoom, also comprise the decoding of video image, processing and other various processing of a large amount of consume system resources such as colour space transformation, directly use and comprise the bicubic spline interpolation, the cube convolution interpolation will consume a large amount of system resource, and need the very long processing time, to have a strong impact on the real-time of video playback, thereby the efficient of the convergent-divergent of video image is proposed very high requirement.So the actual bilinear interpolation of often using in video scaling realizes the convergent-divergent of video image, the bilinear interpolation algorithm complex is little, and is better than the most contiguous algorithm effect, but tangible smoothing effect is arranged.Although video image quality has no small loss, consider the complexity of algorithm, be subject to the computer hardware condition, in order to guarantee the real-time broadcast of video image, people still can exchange the real-time of video usually with some loss of video image quality for.
Development along with digital video technology, the operational capability of computer and storage capacity have had and have increased substantially, personal computer (PC) also can satisfy H.264 gradually and MPEG4 coding and decoding video forms such as (Motion Picture ExpertsGroup 4) to the requirement of hardware environment.As comparing with the code/decode format that H.263 waits in the past with The Application of Technology H.264, H.264 the coding and decoding video form has the high performance advantage of low code check, especially at some to code check and network bandwidth requirement very under the rigorous environment, H.264 coding and decoding video has shown very outstanding performance.
Along with the development of digital video technology, adopt the network teleconference, network remote monitoring etc. of technology H.264 to use ripe gradually.In these are used, be subject to the disposal ability of the network bandwidth and server, be generally CIF form (Common Intermediate Format, CLV Common Intermediate Format) in the video image size of transmission over networks.Yet the size of CIF form can not satisfy demands of applications such as video conference or network remote monitoring far away, therefore, in these are used, the demand of video scaling is become stronger.
Under low code check condition, the convergent-divergent of video image faces more difficulty.Under low code check, because being similar to significantly in quantification and the cataloged procedure, the quality of video itself descends very serious; Add under the network environment of general low code check, packet loss and wrong unavoidable, the details that has caused video is by heavy damage, and picture quality is relatively poor.Under this prerequisite, if also use bilinear interpolation to carry out the convergent-divergent of video, the details that the aliasing that brings of bilinear interpolation and blurring effect can further failure pattern pictures so, the video image quality of the convergent-divergent that obtains with this algorithm will seriously descend.
In addition, traditional video image zooming operation is generally carried out at rgb color space, needs so three color components are handled respectively, and operand is bigger, and this has had further restriction to using interpolation algorithm.
At above demand, need a kind of digital video Zoom method that efficiently has better performance fast simultaneously of design, be used for when guaranteeing the video image real-time, obtaining the zooming effect of video image preferably.
Summary of the invention
The object of the present invention is to provide a kind of Zoom method of multimedia video image, its high-quality of realizing digital video image amplifies.
For realizing the Zoom method of a kind of multimedia video image that purpose of the present invention provides, comprise the following steps:
Steps A, to having a plurality of color components, color component includes the color space of the video image of the different information of image, color component to maximum image information of comprising video image, adopting when amplifying makes color component obtain the complicated interpolation method of better effect, to other color component, adopt simple relatively interpolation method, carry out the convergent-divergent of video image and handle.
The Zoom method of described multimedia video image can also comprise the following steps:
Step B after a plurality of components of color space for the treatment of the multimedia video image of convergent-divergent dispose respectively, carries out colour space transformation to image, and it is transformed to rgb color space, finishes the convergent-divergent of multimedia video image.
In the described steps A, described complicated interpolation method is Spline Interpolation Method or cube convolution method.
In the described steps A, described simple relatively interpolation method is bilinear interpolation method or neighbor interpolation method.
Described Spline Interpolation Method is the bicubic spline interpolation method after bicubic spline interpolation method or the improvement.
Described color space or be the YUV color space perhaps is the YCrCb color space, perhaps is the HSI color space
Described steps A also comprises the following steps:
Steps A 1 is treated the multimedia video image of convergent-divergent, adopts bilinear interpolation method that U, V component are carried out processing and amplifying to video image in the YUV color space, adopts Spline Interpolation Method the Y component to be handled the video image that obtains amplifying.
Described steps A 1 comprises the following steps:
Steps A 11 to multimedia video image, adopts bilinear interpolation method or neighbor interpolation method to carry out processing and amplifying at the YUV color space to the U of video image, V component;
Steps A 12 to multimedia video image, adopts Spline Interpolation Method or cube convolution interpolation method to carry out processing and amplifying at the YUV color space to the Y component of video image.
In the described steps A 12, described Spline Interpolation Method is the bicubic spline interpolation method, comprises the following steps:
Steps A 121 is for the pixel (x in the target video image 1, y 1), by contrary geometric transformation:
x 0 ‾ = x 1 / M y 0 ‾ = y 1 / M ;
Obtain position coordinates in the original image of pixel mapping in the target video image (
Figure S2007101781889D00032
), (
Figure S2007101781889D00033
) through rounding the coordinate (x after obtaining rounding downwards 0, y 0), that is:
Figure S2007101781889D00034
Steps A 122, calculate position coordinates in the original image of pixel mapping in the target video image ( ) and round after coordinate (x 0, y 0) between difference be:
u = x ‾ 0 - x 0 v = y ‾ 0 - y 0 ;
Steps A 123, with u, the value substitution interpolation kernel function S (x) of v draws:
A → = S ( u + 1 ) S ( u ) S ( u - 1 ) S ( u - 2 )
C → = S ( v + 1 ) S ( v ) S ( v - 1 ) S ( v - 2 ) ;
Steps A 124 reads the pixel (x of original video image 0, y 0) near 4 * 4 pixel, constitute matrix:
B → ( x 0 , y 0 ) = f ( x 0 - 1 , y 0 - 1 ) f ( x 0 - 1 , y 0 ) f ( x 0 - 1 , y 0 + 1 ) f ( x 0 - 1 , y 0 + 2 ) f ( x 0 , y 0 - 1 ) f ( x 0 , y 0 ) f ( x 0 , y 0 + 1 ) f ( x 0 , y 0 + 2 ) f ( x 0 + 1 , y 0 - 1 ) f ( x 0 + 1 , y 0 ) f ( x 0 + 1 , y 0 + 1 ) f ( x 0 + 1 , y 0 + 2 ) f ( x 0 + 2 , y 0 - 1 ) f ( x 0 + 2 , y 0 ) f ( x 0 + 2 , y 0 + 1 ) f ( x 0 + 2 , y 0 + 2 ) ;
Steps A 125, according to interpolation formula: f ′ = ( x 1 , y 1 ) = f ( x ‾ 0 , y ‾ 0 ) = A → × B → × C → , Calculate the pixel value of target video image;
Steps A 126, all pixels in the whole target video image are scanned in repeating step A121~125, finish the bicubic spline interpolation of whole digital video image, the video image that obtains amplifying.
In the described steps A 12, described Spline Interpolation Method is improved bicubic spline interpolation method, comprises the following steps:
Steps A 121 ', according to multiplication factor, the interpolation kernel functional value that calculating may be used;
Steps A 122 ' with the value integer of interpolation kernel function, and becomes 2 power, saves as S_int 2(x) value;
Steps A 123 ' is got a subimage block that is of a size of M*M of target image;
Steps A 124 ', calculate each pixel correspondence in the subimage block difference (u, v) and S_int 2(x) value;
Steps A 125 ' confirms whether subimage block is arranged in the target image Far Left;
Steps A 126 ' is taken out a pixel in the target image subimage, obtains corresponding S_int 2(x) value;
Steps A 127 ', substitution bicubic spline interpolating matrix formula calculates, and the result is moved to right 20, obtains the target image pixel value;
Steps A 128 ' confirms whether handle all pixels in the current subimage block;
Steps A 129 ' confirms whether to handle all subimage blocks in the target multimedia video image.
Described steps A 125 ' comprises the following steps:
Steps A 1251 ' if subimage block is to be arranged in the target image Far Left, then reads the subimage block B of M*M from original image;
Steps A 1252 ' if subimage block is not to be arranged in the target image Far Left, then reads M pixel of row and last the right three of calculating the subimage block B ' of the M*M that uses and is listed as and constitutes new subimage block B together from former multimedia video image.
Described steps A 128 ' also further comprises the following steps:
Steps A 1281 ' if handled all pixels in the current subimage block, then continues steps A 9 ';
Steps A 1282 ' if do not handle all pixels in the current subimage block, is then returned steps A 6 '.
Described steps A 129 ' also further comprises the following steps:
Steps A 1291 ' if handled all pixels in the current subimage block, then finishes amplifieroperation;
Steps A 1292 ' if do not handle all pixels in the current subimage block, is then returned steps A 123 '.
Described steps A also comprises the following steps:
Steps A 2 is treated the multimedia video image of convergent-divergent, at three color components of YUV color space to video data, adopts bilinear interpolation method or neighbor interpolation method to dwindle processing respectively.
When described bilinear interpolation method is handled, comprise the following steps:
Steps A 21 for the pixel in the target video image, obtains the position coordinates of pixel mapping in the original image in the target video image by contrary geometric transformation, and position coordinates is through rounding the coordinate that obtains after the round numbers downwards;
Steps A 22, calculate pixel mapping in the target video image in the original image position coordinates and round after coordinate between difference;
Steps A 23 is utilized bilinear interpolation method, calculates the pixel value of target video image;
Steps A 24 judges whether to finish the scanning of the pixel of entire image, if do not finish, then gets back to steps A 11, begins to handle next pixel; If finish, then the interpolation of whole digital video image finishes, and finishes computing.
Can also comprise the following steps: before the described steps A
Video image is carried out the colour space transformation operation, make image satisfy in the color space after conversion, the information content of image that three color components comprise is inequality, and the information of image concentrates on one of them color component.
The invention has the beneficial effects as follows: the Zoom method of multimedia video image of the present invention, it can keep the video image details well, has extraordinary zooming effect; Realize simply not only can realizing, also can realize with hardware easily with software; For the common video image, can obtain good effect.Especially during the relatively poor video of the picture quality under being used for low code check, network environment situation mal-condition, can obtain the video scaling effect outstanding than additive method.
Description of drawings
Fig. 1 is the flow chart of bilinear interpolation algorithm;
Fig. 2 is the schematic diagram of the multimedia video image amplification method described of the present invention;
Fig. 3 is the flow chart of bicubic spline interpolation algorithm;
Fig. 4 is the flow chart of the bicubic spline interpolation fast algorithm after improving.
Embodiment
In order to make purpose of the present invention, technical scheme and advantage clearer,, the Zoom method of a kind of multimedia video image of the present invention is further elaborated below in conjunction with drawings and Examples.Should be appreciated that specific embodiment described herein only in order to explanation the present invention, and be not used in qualification the present invention.
The method that the purpose of this invention is to provide a kind of multimedia video image convergent-divergent, the high-quality convergent-divergent of the video image under the especially low code check condition of realization digital video.
In order to achieve the above object, the technical scheme that the present invention takes is: to having a plurality of color components, color component includes the color space of the video image of the different information of image, (wherein the Y component is a luminance signal as the YUV color space, U component and V component are represented two color difference signals respectively, image information mainly concentrates on the Y component), YCrCb color space (image information mainly concentrates on the Y component), HSI color space (image information mainly concentrates on the I component), a plurality of color components of video image are handled respectively.Wherein, color component to the more image information that comprises video image, adopting when amplifying makes color component obtain the complicated interpolation method (algorithm) of better effect, as Spline Interpolation Method (algorithm), cube convolution interpolation method (algorithm) to other color component, adopts simple relatively interpolation method (algorithm), as bilinear interpolation method (algorithm) or neighbor interpolation method (algorithm), the video image that obtains amplifying.Wherein, for dwindling of video image, adopt bilinear interpolation method (algorithm) or neighbor interpolation method (algorithm) to handle video image.Different color components is adopted different interpolation algorithms, realize the high-quality and high-efficiency convergent-divergent of video image.
YUV color space with the video image that comprises the YUV color component is an example below, describe multimedia video image Zoom method of the present invention in detail, but, should be noted that, the Zoom method to multimedia video image of the embodiment of the invention, be equally applicable to comprise YCrCb color space, HSI color space or other has a plurality of color components, color component includes the color space of the video image of the different information of image.
Comprise a kind of Zoom method of multimedia video image of color space of the video image of YUV color component in the embodiment of the invention, comprise the following steps:
Step S100, video image is carried out the colour space transformation operation, make image satisfy in the color space after conversion, the information content of image that three color components comprise is inequality, and the information of image concentrates on one of them color component, to the color component of maximum image information of comprising video image, adopting when amplifying makes color component obtain the complicated interpolation method of better effect, to other color component, adopt simple relatively interpolation method, carry out the convergent-divergent of video image and handle.
Multimedia video image Zoom method of the present invention, at first video image is carried out the colour space transformation operation, make image satisfy in the color space after conversion, the information content of image that three color components comprise is inequality, the information of image concentrates on one of them color component, be converted to the video image of YUV color space as video image with rgb color space, inequality in the information content of image that the different color component of YUV includes; And then the video image of described color space carried out convergent-divergent.
The conversion in the different color space of video image is a kind of prior art, and it is not innovation and creation of the present invention, and those skilled in the art can realize its conversion process according to content disclosed by the invention, therefore, describes in detail no longer one by one in the present invention.
Step S110 treats the multimedia video image of convergent-divergent, at three color components of YUV color space to video data, it is the Y component of luminance signal, two color difference signal U components and V component adopt bilinear interpolation method or neighbor interpolation method to dwindle processing respectively, referring to Fig. 1.
The bilinear interpolation of image is to utilize 4 adjoint points of object pixel to make linear interpolation on both direction, with the distance as weight.Be implemented as follows:
The object pixel coordinate is (x 1, y 1), by the floating-point coordinate that obtains after the inverse transformation for ( ), (
Figure S2007101781889D00072
) obtain integer to (x through rounding downwards 0, y 0), establish p = x ‾ 0 - x 0 q = y ‾ 0 - y 0 , (x then 1, y 1) gray value located can obtain with following formula:
f ( x ‾ 0 , y ‾ 0 ) = ( 1 - q ) [ ( 1 - p ) f ( x 0 , y 0 ) + pf ( x 0 + 1 , y 0 ) ] + q [ ( 1 - p ) f ( x 0 , y 0 + 1 ) + pf ( x 0 + 1 , y 0 + 1 ) ]
Calculate then f ( x 1 , y 1 ) = f ( x ‾ 0 , y ‾ 0 ) , Obtain the target video image after the interpolation.
As a kind of enforceable mode, the reduction operation process of video image of the present invention comprises the steps: in detail
As former digital video image is that (x, y), carry out interpolation operation target video image afterwards is f ' (x to f 1, y 1), minification is M.
After computing began, from (0,0) some beginning of target video image, pointwise was handled.Step is as follows, and algorithm flow is seen Fig. 2:
Step S111 is for the pixel (x in the target video image 1, y 1), by contrary geometric transformation
x 0 ‾ = x 1 / M y 0 ‾ = y 1 / M
Obtain position coordinates in the original image of pixel mapping in the target video image (
Figure S2007101781889D00084
), ( ) through rounding the coordinate (x after obtaining rounding downwards 0, y 0), that is:
Figure S2007101781889D00086
Step S112, calculate position coordinates in the original image of pixel mapping in the target video image ( ) and round after coordinate (x 0, y 0) between difference be:
p = x ‾ 0 - x 0 q = y ‾ 0 - y 0
Step S113 utilizes bilinear interpolation method (algorithm), calculates the pixel value of target video image:
The formula of described bilinear interpolation method is as follows:
f ( x ‾ 0 , y ‾ 0 ) = ( 1 - q ) [ ( 1 - p ) f ( x 0 , y 0 ) + pf ( x 0 + 1 , y 0 ) ] + q [ ( 1 - p ) f ( x 0 , y 0 + 1 ) + pf ( x 0 + 1 , y 0 + 1 ) ]
Also promptly:
f ′ = ( x 1 , y 1 ) = f ( x ‾ 0 , y ‾ 0 )
= ( 1 - q ) [ ( 1 - p ) f ( x 0 , y 0 ) + pf ( x 0 + 1 , y 0 ) ] + q [ ( 1 - p ) f ( x 0 , y 0 + 1 ) + pf ( x 0 + 1 , y 0 + 1 ) ]
Step S114 judges whether to finish the scanning of the pixel of entire image, if do not finish, then gets back to step S111, begins to handle next pixel; If finish, then the interpolation of whole digital video image finishes, and finishes computing.
As another kind of embodiment, the YUV color space is dwindled processing to three color components of video data, adopt nearest field interpolation method, step and step S111~114 are basic identical, use neighbor interpolation method (algorithm) on just method (algorithm) is selected, wherein, neighbor interpolation method (algorithm) is a kind of prior art, those skilled in the art can utilize neighbor interpolation method (algorithm) to realize the processing of dwindling of this video image according to the description of the embodiment of the invention, thereby describe in detail no longer one by one in embodiments of the present invention.
Step S120, treat the multimedia video image of convergent-divergent, in the YUV color space, adopt bilinear interpolation method (algorithm) that U, V component are carried out processing and amplifying, adopt Spline Interpolation Method (algorithm) that the Y component is handled video image, the video image that obtains amplifying is referring to Fig. 2.
Step S121 to multimedia video image, adopts bilinear interpolation method or neighbor interpolation method to carry out processing and amplifying at the YUV color space to the U of video image, V component;
Multimedia video image is amplified, to U, V component carry out the specific implementation of processing and amplifying and video image to dwindle the method (algorithm) that is adopted identical, therefore, in embodiments of the present invention, describe in detail no longer one by one.
Step S122 to multimedia video image, adopts Spline Interpolation Method (algorithm) or cube convolution interpolation method (algorithm) to carry out processing and amplifying at the YUV color space to the Y component of video image.
For the Y component data, adopt Spline Interpolation Method (algorithm).Compare neighbor interpolation algorithm and bilinear interpolation algorithm, spline interpolation has been made best balance between accuracy and computing consume.
Described batten is piecewise function (a normally multinomial), and what each section was smooth links together.
As a kind of enforceable mode, spline interpolation of the present invention is the bicubic spline interpolation.
A) describe the process utilize the bicubic spline interpolation method to be implemented in the processing that the YUV color space amplifies the Y component of video image below in detail.
As a kind of embodiment, in the bicubic spline interpolation method, utilize the B-batten to realize in the embodiment of the invention.
The B-batten is one of the most frequently used spline function, can obtain from convolution from a basic function.
The basic function form is as follows:
&beta; Basis ( x ) = 1 0 &le; | x | < 0.5 1 2 | x | = 1 2 0 elsewhere
Interpolating function can be by β Basis(x) function obtains from convolution:
β 1(x)=β Basis(x)*β Basis(x)
N rank B-spline function can be obtained by N-1 basic function convolution:
Figure S2007101781889D00102
When N=4, can obtain a cube B-spline interpolation kernel function:
&beta; 4 ( x ) = 1 2 | x | 3 - | x | 2 + 2 3 0 &le; | x | < 1 - 1 6 | x | 3 + | x | 2 - 2 | x | + 4 3 1 &le; | x | < 2 0 elsewhere
With the bicubic spline interpolation application in video image is handled the time, the bicubic spline interpolation consider the pixel mapping of the target image that generates return the floating-point coordinate of original image (
Figure S2007101781889D00104
) on every side 16 adjoint points, can use matrix
Figure S2007101781889D00105
Expression.If the pixel coordinate of target video image is (x 1, y 1), the floating-point coordinate by the correspondence that obtains after how much inverse transformations for (
Figure S2007101781889D00106
), (
Figure S2007101781889D00107
) obtain integer to (x through rounding downwards 0, y 0).
If u = x &OverBar; 0 - x 0 v = y &OverBar; 0 - y 0 , And establish:
S ( x ) = 1 2 | x | 3 - | x | 2 + 2 3 0 &le; | x | < 1 - 1 6 | x | 3 + | x | 2 - 2 | x | + 4 3 1 &le; | x | < 2 0 elsewhere
A &RightArrow; = S ( u + 1 ) S ( u ) S ( u - 1 ) S ( u - 2 )
B &RightArrow; ( x 0 , y 0 ) = f ( x 0 - 1 , y 0 - 1 ) f ( x 0 - 1 , y 0 ) f ( x 0 - 1 , y 0 + 1 ) f ( x 0 - 1 , y 0 + 2 ) f ( x 0 , y 0 - 1 ) f ( x 0 , y 0 ) f ( x 0 , y 0 + 1 ) f ( x 0 , y 0 + 2 ) f ( x 0 + 1 , y 0 - 1 ) f ( x 0 + 1 , y 0 ) f ( x 0 + 1 , y 0 + 1 ) f ( x 0 + 1 , y 0 + 2 ) f ( x 0 + 2 , y 0 - 1 ) f ( x 0 + 2 , y 0 ) f ( x 0 + 2 , y 0 + 1 ) f ( x 0 + 2 , y 0 + 2 )
C &RightArrow; = S ( v + 1 ) S ( v ) S ( v - 1 ) S ( v - 2 )
Target pixel value then
Figure S2007101781889D00113
Can obtain by following interpolation formula:
f &prime; ( x 1 , y 1 ) = f ( x &OverBar; 0 , y &OverBar; 0 ) = A &RightArrow; &times; B &RightArrow; &times; C &RightArrow;
Therefore, the Y component bicubic spline interpolation of the embodiment of the invention is carried out processing and amplifying and is comprised the following steps:
Former digital video image is that (x, y), carry out interpolation operation target video image afterwards is f ' (x to f 1, y 1), suppose that multiplication factor is M.
After computing began, from (0,0) some beginning of target video image, pointwise was handled, and algorithm flow is seen Fig. 3.Detailed process is as follows:
Step S1221 is for the pixel (x in the target video image 1, y 1), by contrary geometric transformation:
x 0 &OverBar; = x 1 / M y 0 &OverBar; = y 1 / M
Obtain position coordinates in the original image of pixel mapping in the target video image (
Figure S2007101781889D00116
), (
Figure S2007101781889D00117
) through rounding the coordinate (x after obtaining rounding downwards 0, y 0), that is:
Step S1222, calculate position coordinates in the original image of pixel mapping in the target video image ( ) and round after coordinate (x 0, y 0) between difference be:
u = x &OverBar; 0 - x 0 v = y &OverBar; 0 - y 0
Step S1223, with u, the value substitution interpolation kernel function S (x) of v draws:
A &RightArrow; = S ( u + 1 ) S ( u ) S ( u - 1 ) S ( u - 2 )
C &RightArrow; = S ( v + 1 ) S ( v ) S ( v - 1 ) S ( v - 2 )
Step S1224 reads the pixel (x of original video image 0, y 0) near 4 * 4 pixel, constitute matrix:
B &RightArrow; ( x 0 , y 0 ) = f ( x 0 - 1 , y 0 - 1 ) f ( x 0 - 1 , y 0 ) f ( x 0 - 1 , y 0 + 1 ) f ( x 0 - 1 , y 0 + 2 ) f ( x 0 , y 0 - 1 ) f ( x 0 , y 0 ) f ( x 0 , y 0 + 1 ) f ( x 0 , y 0 + 2 ) f ( x 0 + 1 , y 0 - 1 ) f ( x 0 + 1 , y 0 ) f ( x 0 + 1 , y 0 + 1 ) f ( x 0 + 1 , y 0 + 2 ) f ( x 0 + 2 , y 0 - 1 ) f ( x 0 + 2 , y 0 ) f ( x 0 + 2 , y 0 + 1 ) f ( x 0 + 2 , y 0 + 2 ) ,
Step S1225, according to interpolation formula: f &prime; = ( x 1 , y 1 ) = f ( x &OverBar; 0 , y &OverBar; 0 ) = A &RightArrow; &times; B &RightArrow; &times; C &RightArrow; , Calculate the pixel value of target video image.
Step S1226, all pixels in the whole target video image are scanned in repeating step S1221~1225, finish the bicubic spline interpolation of whole digital video image, the video image that obtains amplifying.
The process of the processing that the bicubic spline interpolation fast algorithm implementation after describe in detail to utilize improving B) is amplified the Y component of video image at the YUV color space.
Former digital video image be f (x, y), former digital video image is wide to be width_original, high be height_original, the target video image that carries out after the interpolation operation is f ' (x 1, y 1), the wide of the target video image after the difference is width_interpol, the high height_interpol of being, supposes that multiplication factor is M, so:
width _ interpol = width _ original &CenterDot; M height _ interpol = height _ original &CenterDot; M
For amplifying M situation doubly, can be being divided into some M * M rank matrix in the target video image:
F &prime; &OverBar; ( kM , lM ) = f ( kM , lM ) f ( kM , lM + 1 ) &CenterDot; &CenterDot; &CenterDot; f ( kM , lM + M - 1 ) f ( kM + 1 , lM ) f ( kM + 1 , lM + 1 ) &CenterDot; &CenterDot; &CenterDot; f ( kM + 1 , lM + M - 1 ) &CenterDot; &CenterDot; &CenterDot; &CenterDot; &CenterDot; &CenterDot; &CenterDot; &CenterDot; &CenterDot; &CenterDot; &CenterDot; &CenterDot; f ( kM + M - 1 , lM ) f ( kM + M - 1 , lM + 1 ) &CenterDot; &CenterDot; &CenterDot; f ( kM + M - 1 , lM + M - 1 )
(wherein, k, l ∈ Z, and satisfy ( kM + M - 1 ) &le; width _ interpol ( lM + M - 1 ) &le; width _ interpol
Each M * M rank matrix
Figure S2007101781889D00127
The subimage block that can regard a target video image as, matrix
Figure S2007101781889D00128
In all pixel mapping return original image, the same pixel in all corresponding original image (k, l).4 * 4 pixels that are used for the bicubic spline interpolation that this point closes on constitute matrix
Figure S2007101781889D00131
B &RightArrow; ( k , l ) = f ( k , l ) f ( k , l + 1 ) f ( k , l + 2 ) f ( k , l + 3 ) f ( k + 1 , l ) f ( k + 1 , l + 1 ) f ( k + 1 , l + 2 ) f ( k + 1 , l + 3 ) f ( k + 2 , l ) f ( k + 2 , l + 1 ) f ( k + 2 , l + 2 ) f ( k + 2 , l + 3 ) f ( k + 3 , l ) f ( k + 3 , l + 1 ) f ( k + 3 , l + 2 ) f ( k + 3 , l + 3 )
That is to say that for each M * M subimage block, the interpolation result of all pixels of this subimage block inside all is to use identical Value calculate.Therefore, can disposablely read out
Figure S2007101781889D00134
(kM, the lM) M * M in pixel can reduce the memory access number of times to the subimage F of disposable then processing target image so in a large number, improves the degree of parallelism of computing.
Therefore, in target video image, be image division some subimage blocks that are of a size of M * M size, block-by-block is handled.
In addition, in processing procedure, use difference two tuples (u, v), it is defined as follows:
For the pixel (x in the target video image 1, y 1), by contrary geometric transformation:
x 0 &OverBar; = x 1 / M y 0 &OverBar; = y 1 / M
Obtain position coordinates in the original image of pixel mapping in the target video image (
Figure S2007101781889D00136
), (
Figure S2007101781889D00137
) obtain integer to (x through rounding downwards 0, y 0),
That is:
Figure S2007101781889D00138
Calculate position coordinates in the original image of pixel mapping in the target video image ( ) and round after coordinate (x 0, y 0) between difference be:
u = x &OverBar; 0 - x 0 v = y &OverBar; 0 - y 0
Be called difference two tuples (u, v).
Bicubic spline interpolation fast algorithm after detailed description Y component employing of the present invention improves below carries out the implementation process of processing and amplifying, and algorithm flow is seen Fig. 4, and concrete steps are as follows:
Step S1221 ' carries out initialization to the function of bicubic interpolation and obtains kernel function;
In the initialization procedure after interpolation process starts, at first calculate several interpolation kernel functions that in calculating process, may occur.
For the multiplication factor M that determines, need the result of calculation of the interpolation kernel function used to determine in the calculating process.If with x represent difference two tuples (u, v) the u in or v value are under the situation of M in multiplication factor, parameter x have M kind value (x=0,
Figure S2007101781889D00141
), so need M kind interpolation kernel function S (x i) (i=0 wherein, 1 ..., M-1).
The kernel function integer that calculates is also approximate.The interpolation kernel functional value that calculates is a floating number, moves to left 10 for each interpolation kernel functional value, amplifies 1000 times and rounds then, can obtain integer interpolation kernel functional value, is designated as S_int (x).Then, the value of interpolation kernel function is replaced with the most contiguous 2 power.Obtain one group of new value, be designated as S_int 2(x), it is inferior with respect to 2 power that it has write down each interpolation kernel function.
So far, initialization is finished.
Step S 1222 ', determine current pending subimage block F (kM, lM), calculate matrix F (kM, lM) in corresponding difference two tuples of each pixel (u, value v), and be saved as matrix
Figure S2007101781889D00142
UV &RightArrow; ( kM , lM ) = uv ( kM , lM ) uv ( kM , lM + 1 ) &CenterDot; &CenterDot; &CenterDot; uv ( kM , lM + M - 1 ) uv ( kM + 1 , lM ) uv ( kM + 1 , lM + 1 ) &CenterDot; &CenterDot; &CenterDot; uv ( kM + 1 , lM + M - 1 ) &CenterDot; &CenterDot; &CenterDot; &CenterDot; &CenterDot; &CenterDot; &CenterDot; &CenterDot; &CenterDot; &CenterDot; &CenterDot; &CenterDot; uv ( kM + M - 1 , lM ) uv ( kM + M - 1 , lM + 1 ) &CenterDot; &CenterDot; &CenterDot; uv ( kM + M - 1 , lM + M - 1 )
Uv in the formula (k, l)=(u (k, l), v (k, l))
Step S1223 ', (kM lM) is leftmost image block, then reads 4 * 4 pixels in the pairing original image of current pending image block as if current pending image block F
Figure S2007101781889D00144
Be put in the internal memory.
(kM, lM) each pixel in is all corresponding identical owing to F So only need read once
Figure S2007101781889D00146
Get final product.
If (kM lM) is not leftmost image block, then reads last round of processing current pending image block F
Figure S2007101781889D00147
The right a row pixel value (4 pixels of row), then and
Figure S2007101781889D00148
The right three columns new according to constituting together
Figure S2007101781889D00149
Matrix, a columns that newly reads is according to being placed on
Figure S2007101781889D001410
The right three columns according to the right, be used for current F (kM, the calculating of pixel value lM).
Step S1224 ', image block F (kM, lM) each pixel in are handled in pointwise;
Concrete operations are as follows:
For F (kM, the capable j row of i pixel f lM) (kM+i, lM+j),
According to formula
A &RightArrow; = S ( u + 1 ) S ( u ) S ( u - 1 ) S ( u - 2 )
B &RightArrow; ( k , l ) = f ( k , l ) f ( k , l + 1 ) f ( k , l + 2 ) f ( k , l + 3 ) f ( k + 1 , l ) f ( k + 1 , l + 1 ) f ( k + 1 , l + 2 ) f ( k + 1 , l + 3 ) f ( k + 2 , l ) f ( k + 2 , l + 1 ) f ( k + 2 , l + 2 ) f ( k + 2 , l + 3 ) f ( k + 3 , l ) f ( k + 3 , l + 1 ) f ( k + 3 , l + 2 ) f ( k + 3 , l + 3 )
C &RightArrow; = S ( v + 1 ) S ( v ) S ( v - 1 ) S ( v - 2 )
f &prime; = ( x 1 , y 1 ) = f ( x &OverBar; 0 , y &OverBar; 0 ) = A &RightArrow; &times; B &RightArrow; &times; C &RightArrow;
Can obtain:
f &prime; = ( x 1 , y 1 ) = f ( x &OverBar; 0 , y &OverBar; 0 ) = A &RightArrow; &times; B &RightArrow; &times; C &RightArrow;
= [ S ( u + 1 ) S ( u ) S ( u - 1 ) S ( u - 2 ) ] f ( k , l ) f ( k , l + 1 ) f ( k , l + 2 ) f ( k , l + 3 ) f ( k + 1 , l ) f ( k + 1 , l + 1 ) f ( k + 1 , l + 2 ) f ( k + 1 , l + 3 ) f ( k + 2 , l ) f ( k + 2 , l + 1 ) f ( k + 2 , l + 2 ) f ( k + 2 , l + 3 ) f ( k + 3 , l ) f ( k + 3 , l + 1 ) f ( k + 3 , l + 2 ) f ( k + 3 , l + 3 ) S ( v + 1 ) S ( v ) S ( v - 1 ) S ( v - 2 )
Matrix operation is launched and can obtain:
f &prime; ( x 1 , y 1 ) = f ( x &OverBar; 0 , y &OverBar; 0 )
= [ S ( u + 1 ) &CenterDot; f ( k , l ) + S ( u ) &CenterDot; f ( k + 1 , l ) + S ( u - 1 ) &CenterDot; f ( k + 2 , l ) + S ( u - 2 ) &CenterDot; f ( k + 3 , l ) ] &CenterDot; S ( v + 1 )
+ [ S ( u + 1 ) &CenterDot; f ( k , l + 1 ) + S ( u ) &CenterDot; f ( k + 1 , l + 1 ) + S ( u - 1 ) &CenterDot; f ( k + 2 , l + 1 ) + S ( u - 2 ) &CenterDot; f ( k + 3 , l + 1 ) ] &CenterDot; S ( v )
+ [ S ( u + 1 ) &CenterDot; f ( k , l + 2 ) + S ( u ) &CenterDot; f ( k + 1 , l + 2 ) + S ( u - 1 ) &CenterDot; f ( k + 2 , l + 2 ) + S ( u - 2 ) &CenterDot; f ( k + 3 , l + 2 ) ] &CenterDot; S ( v - 1 )
+ ( S ( u + 1 ) &CenterDot; f ( k , l + 3 ) + S ( u ) &CenterDot; f ( k + 1 , l + 3 ) + S ( u - 1 ) &CenterDot; f ( k + 2 , l + 3 ) + S ( u - 2 ) &CenterDot; f ( k + 3 , l + 3 ) ) &CenterDot; S ( v - 2 )
Use prior good as calculated and S_int integer (x) value replacement S (x) function, further use then to be rewritten into 2 the inferior S_int of power 2(x) and shift operation replace S_int (x) value:
F (kM+i, lM+j)=[f (k, l) S_int (u+1)+f (k+l, l) S_int (u)+f (k+2, l) S_int (u-1)+f (k+3, l) S_int (u-2) S_int (v+1)+[f (k, l+1) S_int (u+1)+f (k+1, l+1) S_int (u)+f (k+2, l+1) S_int (u-1)+f (k+3, l+1) S_int (u-2) S_int (v)+[f (k, l+2) S_int (u+1)+f (k+1, l+2) S_int (u)+f (k+2, l+2) S_int (u-1)+f (k+3, l+2) S_int (u-1)+f (k+3, l+2) S_int (u-2)] S_int (v-1)+[f (k, l+3) S_int (u+1)+f (k+l, l+3) S_int (u)+f (k+2, l+3) S_int (u-1)+f (k+3, l+3) S_int (u-2)] S_int (v-2)=[f (and k, l)<<S_int 2(u+1)+f (k+1, l)<<S_int 2(u)+f (k+2, l)<<S_int 2(u-1)+f (k+3, l)<<S_int 2(u-2)<<S_int 2(v+1)+[f (k, l+1)<<S_int 2(u+1)+f (k+1, l+1)<<S_int 2(u)+f (k+2, l+1)<<S_int 2(u-1)+f (k+3, l+1)<<S_int 2(u-2)<<S_int 2(v)+[f (k, l+2)<<S_int 2(u+1)+f (k+l, l+2)<<S_int 2(u)+f (k+2, l+2)<<S_int 2(u)+f (k+2, l+2)<<S_int 2(u-1)+f (k+3, l+2)<<S_int 2(u-2)]<<S_int 2(v-1)+[f (k, l+3)<<S_int 2(u+1)+f (k+l, l+3)<<S_int 2(u)+f (k+2, l+3)<<S_int 2(u-1)+f (k+3, l+3)<<S_int 2(u-2)]<<S_int 2(v-2) wherein, in the formula<<expression left shift operation, for for simplicity, in formula, use u, v represent u (i, j), V (i, j).
Next, step S1223 ' is obtained and f (kM+i, lM+j) corresponding
Figure S2007101781889D00161
The uv that calculates with step S1222 ' (kM+i lM+j) brings top formula into, calculate f (kM+i, lM+j).
At last, with f (kM+i lM+j) moves to right 20, obtain f (kM+i, lM+j) the final pixel value result of pixel:
f final(kM+i,lM+j)=f(kM+i,lM+j)>>20。
Execution in step S1224 ' repeatedly is up to image block
Figure S2007101781889D00162
Interior all M * M pixel all disposes.
Step S1225 ' judges whether to handle all images piece in the target video image, if do not handle, then gets back to step S1223 '; If handled all images piece in the target video image, then target video image Y component interpolation finishes.
As another kind of embodiment, the YUV color space is carried out processing and amplifying to three color components of video data, adopt the cube convolution interpolation method, bicubic spline interpolation method (algorithm) or step S1221 '~1225 ' in step and step S122l~1226 are basic identical, just use cube convolution interpolation method (algorithm) in method (algorithm) selection, wherein, the cube convolution interpolation method is a kind of prior art, those skilled in the art can utilize cube convolution interpolation method (algorithm) to realize the processing of dwindling of this video image according to the description of the embodiment of the invention, thereby describe in detail no longer one by one in embodiments of the present invention.
As another kind of embodiment, to comprising YCrCb color space with the video image that comprises the YCrCb color component, processing to the Y component is identical with the Y component processing of the YUV color space of the embodiment of the invention, handles identical to the processing of Cb and Cr color component and the U of YUV with the V component.Therefore, describe in detail no longer one by one in embodiments of the present invention.
As another kind of embodiment, to comprising HSI color space with the video image that comprises the HSI color component, processing to I component is identical with the Y component processing of the YUV color space of the embodiment of the invention, handles identical to the processing of H and S color component and the U of YUV with the V component.Therefore, describe in detail no longer one by one in embodiments of the present invention.
Step S200 after a plurality of components of color space for the treatment of the multimedia video image of convergent-divergent dispose respectively, carries out colour space transformation to image, and it is transformed to rgb color space, finishes the convergent-divergent of multimedia video image.
No matter be reduction operation or amplifieroperation, after treating that three color component data dispose respectively, if need not carry out other operation bidirectional at the YUV color space, just can carry out colour space transformation to image, it is transformed to rgb color space, comes display image by display routine then or carry out further other processing.
Conversion from the YUV color space to rgb color space is a kind of prior art, and it is not innovation and creation of the present invention, those skilled in the art are according to content disclosed by the invention, can realize its conversion process, therefore, describe in detail no longer one by one in the present invention.
The Zoom method of a kind of multimedia video image of the present invention has proposed a kind of fast algorithm of bicubic spline interpolation, and quick bicubic spline interpolation algorithm is applied in the video image zooming.The embodiment of the invention has following beneficial effect: (1) has significantly reduced the computation complexity of bicubic spline interpolation, can realize the real-time convergent-divergent of video with the personal computer (PC) of common configuration; (2) can be good at keeping the video image details, have extraordinary zooming effect; (3) algorithm is realized simply not only can realizing with software, also can realize with hardware easily; (4), can obtain good effect for the common video image; During in particular for the relatively poor video of the picture quality under low code check, the network environment situation mal-condition, can obtain the video amplification effect outstanding than additive method.
In conjunction with the drawings to the description of the specific embodiment of the invention, others of the present invention and feature are conspicuous to those skilled in the art.
More than specific embodiments of the invention are described and illustrate it is exemplary that these embodiment should be considered to it, and be not used in and limit the invention, the present invention should make an explanation according to appended claim.

Claims (16)

1. the Zoom method of a multimedia video image is characterized in that, comprises the following steps:
Steps A, to having a plurality of color components, color component includes the color space of the video image of the different information of image, color component to maximum image information of comprising video image, adopting when amplifying makes color component obtain the complicated interpolation method of better effect, to other color component, adopt simple relatively interpolation method, carry out the convergent-divergent of video image and handle.
2. the Zoom method of multimedia video image according to claim 1 is characterized in that, also comprises the following steps:
Step B after a plurality of components of color space for the treatment of the multimedia video image of convergent-divergent dispose respectively, carries out colour space transformation to image, and it is transformed to rgb color space, finishes the convergent-divergent of multimedia video image.
3. the Zoom method of multimedia video image according to claim 1 and 2 is characterized in that, in the described steps A, described complicated interpolation method is Spline Interpolation Method or cube convolution method.
4. the Zoom method of multimedia video image according to claim 3 is characterized in that, in the described steps A, described simple relatively interpolation method is bilinear interpolation method or neighbor interpolation method.
5. the Zoom method of multimedia video image according to claim 3 is characterized in that, described Spline Interpolation Method is the bicubic spline interpolation method after bicubic spline interpolation method or the improvement.
6. the Zoom method of multimedia video image according to claim 5 is characterized in that, described color space or be the YUV color space perhaps is the YCrCb color space, perhaps is the HSI color space
7. the Zoom method of multimedia video image according to claim 1 is characterized in that, described steps A also comprises the following steps:
Steps A 1 is treated the multimedia video image of convergent-divergent, adopts bilinear interpolation method that U, V component are carried out processing and amplifying to video image in the YUV color space, adopts Spline Interpolation Method the Y component to be handled the video image that obtains amplifying.
8. the Zoom method of multimedia video image according to claim 7 is characterized in that, described steps A 1 comprises the following steps:
Steps A 11 to multimedia video image, adopts bilinear interpolation method or neighbor interpolation method to carry out processing and amplifying at the YUV color space to the U of video image, V component;
Steps A 12 to multimedia video image, adopts Spline Interpolation Method or cube convolution interpolation method to carry out processing and amplifying at the YUV color space to the Y component of video image.
9. the Zoom method of multimedia video image according to claim 8 is characterized in that, in the described steps A 12, described Spline Interpolation Method is the bicubic spline interpolation method, comprises the following steps:
Steps A 121 is for the pixel (x in the target video image 1, y 1), by contrary geometric transformation:
{ x 0 &OverBar; = x 1 / M y 0 &OverBar; = y 1 / M ;
Obtain position coordinates in the original image of pixel mapping in the target video image (
Figure S2007101781889C00022
), ( ) through rounding the coordinate (x after obtaining rounding downwards 0, y 0), that is:
Figure S2007101781889C00024
Steps A 122, calculate position coordinates in the original image of pixel mapping in the target video image (
Figure S2007101781889C00025
) and round after coordinate (x 0, y 0) between difference be:
{ u = x &OverBar; 0 - x 0 v = y &OverBar; 0 - y 0 ;
Steps A 123, with u, the value substitution interpolation kernel function S (x) of v draws:
A &RightArrow; = S ( u + 1 ) S ( u ) S ( u - 1 ) S ( u - 2 )
C &RightArrow; = S ( v + 1 ) S ( v ) S ( v - 1 ) S ( v - 2 ) ;
Steps A 124 reads the pixel (x of original video image 0, y 0) near 4 * 4 pixel, constitute matrix:
B &RightArrow; ( x 0 , y 0 ) = f ( x 0 - 1 , y 0 - 1 ) f ( x 0 - 1 , y 0 ) f ( x 0 - 1 , y 0 + 1 ) f ( x 0 - 1 , y 0 + 2 ) f ( x 0 , y 0 - 1 ) f ( x 0 , y 0 ) f ( x 0 , y 0 + 1 ) f ( x 0 , y 0 + 2 ) f ( x 0 + 1 , y 0 - 1 ) f ( x 0 + 1 , y 0 ) f ( x 0 + 1 , y 0 + 1 ) f ( x 0 + 1 , y 0 + 2 ) f ( x 0 + 2 , y 0 - 1 ) f ( x 0 + 2 , y 0 ) f ( x 0 + 2 , y 0 + 1 ) f ( x 0 + 2 , y 0 + 2 ) ;
Steps A 125, according to interpolation formula: f &prime; ( x 1 , y 1 ) = f ( x &OverBar; 0 , y &OverBar; 0 ) = A &RightArrow; &times; B &RightArrow; &times; C &RightArrow; , Calculate the pixel value of target video image;
Steps A 126, all pixels in the whole target video image are scanned in repeating step A121~125, finish the bicubic spline interpolation of whole digital video image, the video image that obtains amplifying.
10. the Zoom method of multimedia video image according to claim 8 is characterized in that, in the described steps A 12, described Spline Interpolation Method is improved bicubic spline interpolation method, comprises the following steps:
Steps A 121 ', according to multiplication factor, the interpolation kernel functional value that calculating may be used;
Steps A 122 ' with the value integer of interpolation kernel function, and becomes 2 power, saves as S_int 2(x) value;
Steps A 123 ' is got a subimage block that is of a size of M*M of target image;
Steps A 124 ', calculate each pixel correspondence in the subimage block difference (u, v) and S_int 2(x) value;
Steps A 125 ' confirms whether subimage block is arranged in the target image Far Left;
Steps A 126 ' is taken out a pixel in the target image subimage, obtains corresponding S_int 2(x) value;
Steps A 127 ', substitution bicubic spline interpolating matrix formula calculates, and the result is moved to right 20, obtains the target image pixel value;
Steps A 128 ' confirms whether handle all pixels in the current subimage block;
Steps A 129 ' confirms whether to handle all subimage blocks in the target multimedia video image.
11. the Zoom method of multimedia video image according to claim 10 is characterized in that, described steps A 125 ' comprises the following steps:
Steps A 1251 ' if subimage block is to be arranged in the target image Far Left, then reads the subimage block B of M*M from original image;
Steps A 1252 ' if subimage block is not to be arranged in the target image Far Left, then reads M pixel of row and last the right three of calculating the subimage block B ' of the M*M that uses and is listed as and constitutes new subimage block B together from former multimedia video image.
12. the Zoom method of multimedia video image according to claim 10 is characterized in that, described steps A 128 ' also further comprises the following steps:
Steps A 1281 ' if handled all pixels in the current subimage block, then continues steps A 9 ';
Steps A 1282 ' if do not handle all pixels in the current subimage block, is then returned steps A 6 '.
13. the Zoom method of multimedia video image according to claim 10 is characterized in that, described steps A 129 ' also further comprises the following steps:
Steps A 1291 ' if handled all pixels in the current subimage block, then finishes amplifieroperation;
Steps A 1292 ' if do not handle all pixels in the current subimage block, is then returned steps A 123 '.
14. the Zoom method of multimedia video image according to claim 7 is characterized in that, described steps A also comprises the following steps:
Steps A 2 is treated the multimedia video image of convergent-divergent, at three color components of YUV color space to video data, adopts bilinear interpolation method or neighbor interpolation method to dwindle processing respectively.
15. according to Claim 8 or the Zoom method of 14 described multimedia video images, it is characterized in that, when described bilinear interpolation method is handled, comprise the following steps:
Steps A 21 for the pixel in the target video image, obtains the position coordinates of pixel mapping in the original image in the target video image by contrary geometric transformation, and position coordinates is through rounding the coordinate that obtains after the round numbers downwards;
Steps A 22, calculate pixel mapping in the target video image in the original image position coordinates and round after coordinate between difference;
Steps A 23 is utilized bilinear interpolation method, calculates the pixel value of target video image;
Steps A 24 judges whether to finish the scanning of the pixel of entire image, if do not finish, then gets back to steps A 11, begins to handle next pixel; If finish, then the interpolation of whole digital video image finishes, and finishes computing.
16. the Zoom method of multimedia video image according to claim 1 and 2 is characterized in that, also comprises the following steps: before the described steps A
Video image is carried out the colour space transformation operation, make image satisfy in the color space after conversion, the information content of image that three color components comprise is inequality, and the information of image concentrates on one of them color component.
CN2007101781889A 2007-11-27 2007-11-27 Zoom method of multimedia video image Expired - Fee Related CN101163252B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2007101781889A CN101163252B (en) 2007-11-27 2007-11-27 Zoom method of multimedia video image

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2007101781889A CN101163252B (en) 2007-11-27 2007-11-27 Zoom method of multimedia video image

Publications (2)

Publication Number Publication Date
CN101163252A true CN101163252A (en) 2008-04-16
CN101163252B CN101163252B (en) 2011-10-26

Family

ID=39298060

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2007101781889A Expired - Fee Related CN101163252B (en) 2007-11-27 2007-11-27 Zoom method of multimedia video image

Country Status (1)

Country Link
CN (1) CN101163252B (en)

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102508851A (en) * 2011-09-27 2012-06-20 深圳市五巨科技有限公司 Image upload processing method and image upload processing system
CN102567948A (en) * 2010-12-27 2012-07-11 北大方正集团有限公司 Method and device for processing pixel color
CN103905807A (en) * 2012-12-27 2014-07-02 深圳市快播科技有限公司 Method and device for converting two-dimension video into three-dimension video
CN104574277A (en) * 2015-01-30 2015-04-29 京东方科技集团股份有限公司 Image interpolation method and image interpolation device
WO2015143671A1 (en) * 2014-03-27 2015-10-01 Microsoft Technology Licensing, Llc Adjusting quantization/scaling and inverse quantization/scaling when switching color spaces
CN106373090A (en) * 2016-08-31 2017-02-01 广州视睿电子科技有限公司 Picture processing method and picture processing device
CN107135382A (en) * 2017-03-02 2017-09-05 广东美电贝尔科技集团股份有限公司 A kind of quick Zoom method of image based on YUV signal processing
CN107197291A (en) * 2017-05-25 2017-09-22 厦门大学 The cube convolution Spline Interpolation Method that low complex degree is directly calculated
CN108184090A (en) * 2017-12-07 2018-06-19 中国航空工业集团公司西安航空计算技术研究所 A kind of CMOS cameras multiresolution VESA videos are to the automatic switching method of BT1120 protocol videos
CN108833872A (en) * 2018-05-28 2018-11-16 北京文香信息技术有限公司 A kind of method that YUY2 color space quickly scales or amplifies
US10171833B2 (en) 2014-03-04 2019-01-01 Microsoft Technology Licensing, Llc Adaptive switching of color spaces, color sampling rates and/or bit depths
CN109218737A (en) * 2018-09-19 2019-01-15 厦门理工学院 A kind of lossy compression of video data, decompression method and device
US10182241B2 (en) 2014-03-04 2019-01-15 Microsoft Technology Licensing, Llc Encoding strategies for adaptive switching of color spaces, color sampling rates and/or bit depths
US10687069B2 (en) 2014-10-08 2020-06-16 Microsoft Technology Licensing, Llc Adjustments to encoding and decoding when switching color spaces
CN111510692A (en) * 2020-04-23 2020-08-07 Oppo广东移动通信有限公司 Image processing method, terminal and computer readable storage medium

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103236035B (en) * 2013-03-28 2015-12-02 浙江大学 Based on the image magnification method without the bilateral quadratic B-spline interpolation of skew

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4053021B2 (en) * 2004-05-12 2008-02-27 三洋電機株式会社 Image enlargement apparatus and program
CN100366045C (en) * 2005-01-11 2008-01-30 北京中星微电子有限公司 Image conversion method capable of realizing zooming
CN1319375C (en) * 2005-04-08 2007-05-30 杭州国芯科技有限公司 Image zooming method based on edge detection
CN100505860C (en) * 2005-11-08 2009-06-24 逐点半导体(上海)有限公司 An adaptive interpolation method and device to maintain image resolution

Cited By (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102567948A (en) * 2010-12-27 2012-07-11 北大方正集团有限公司 Method and device for processing pixel color
CN102567948B (en) * 2010-12-27 2014-10-29 北大方正集团有限公司 Method and device for processing pixel color
CN102508851A (en) * 2011-09-27 2012-06-20 深圳市五巨科技有限公司 Image upload processing method and image upload processing system
CN103905807A (en) * 2012-12-27 2014-07-02 深圳市快播科技有限公司 Method and device for converting two-dimension video into three-dimension video
US10171833B2 (en) 2014-03-04 2019-01-01 Microsoft Technology Licensing, Llc Adaptive switching of color spaces, color sampling rates and/or bit depths
US10182241B2 (en) 2014-03-04 2019-01-15 Microsoft Technology Licensing, Llc Encoding strategies for adaptive switching of color spaces, color sampling rates and/or bit depths
WO2015143671A1 (en) * 2014-03-27 2015-10-01 Microsoft Technology Licensing, Llc Adjusting quantization/scaling and inverse quantization/scaling when switching color spaces
US10116937B2 (en) 2014-03-27 2018-10-30 Microsoft Technology Licensing, Llc Adjusting quantization/scaling and inverse quantization/scaling when switching color spaces
CN105432077A (en) * 2014-03-27 2016-03-23 微软技术许可有限责任公司 Adjusting quantization/scaling and inverse quantization/scaling when switching color spaces
US10687069B2 (en) 2014-10-08 2020-06-16 Microsoft Technology Licensing, Llc Adjustments to encoding and decoding when switching color spaces
CN104574277A (en) * 2015-01-30 2015-04-29 京东方科技集团股份有限公司 Image interpolation method and image interpolation device
CN106373090B (en) * 2016-08-31 2019-11-15 广州视睿电子科技有限公司 Image processing method and device
CN106373090A (en) * 2016-08-31 2017-02-01 广州视睿电子科技有限公司 Picture processing method and picture processing device
CN107135382A (en) * 2017-03-02 2017-09-05 广东美电贝尔科技集团股份有限公司 A kind of quick Zoom method of image based on YUV signal processing
CN107197291A (en) * 2017-05-25 2017-09-22 厦门大学 The cube convolution Spline Interpolation Method that low complex degree is directly calculated
CN107197291B (en) * 2017-05-25 2020-02-14 厦门大学 Low-complexity direct-calculation cubic convolution spline interpolation method
CN108184090A (en) * 2017-12-07 2018-06-19 中国航空工业集团公司西安航空计算技术研究所 A kind of CMOS cameras multiresolution VESA videos are to the automatic switching method of BT1120 protocol videos
CN108184090B (en) * 2017-12-07 2020-09-22 中国航空工业集团公司西安航空计算技术研究所 Automatic conversion method for multi-resolution VESA video of CMOS camera to BT1120 protocol video
CN108833872A (en) * 2018-05-28 2018-11-16 北京文香信息技术有限公司 A kind of method that YUY2 color space quickly scales or amplifies
CN109218737A (en) * 2018-09-19 2019-01-15 厦门理工学院 A kind of lossy compression of video data, decompression method and device
CN111510692A (en) * 2020-04-23 2020-08-07 Oppo广东移动通信有限公司 Image processing method, terminal and computer readable storage medium

Also Published As

Publication number Publication date
CN101163252B (en) 2011-10-26

Similar Documents

Publication Publication Date Title
CN101163252B (en) Zoom method of multimedia video image
Jin et al. A flexible deep CNN framework for image restoration
Yu et al. Multi-level video frame interpolation: Exploiting the interaction among different levels
CN106170093B (en) Intra-frame prediction performance improving coding method
JP2002506585A (en) Method for sprite generation for object-based coding systems using masks and rounded averages
CN107820085B (en) Method for improving video compression coding efficiency based on deep learning
Kumar et al. A reversible high capacity data hiding scheme using pixel value adjusting feature
CN101765011B (en) Method and device for scaling motion estimation
JP5174238B2 (en) Image / video quality improvement and super-resolution using sparse transform
CN113301347A (en) Optimization method of HEVC high-definition video coding
Kamble et al. Modified three-step search block matching motion estimation and weighted finite automata based fractal video compression
CN1214648C (en) Method and apparatus for performing motion compensation in a texture mapping engine
US7274825B1 (en) Image matching using pixel-depth reduction before image comparison
CN116542889A (en) Panoramic video enhancement method with stable view point
Miyata et al. Novel inverse colorization for image compression
Chang et al. An image zooming technique based on vector quantization approximation
JP4709074B2 (en) Moving picture encoding method, apparatus, program thereof, and recording medium recording the program
US7389005B2 (en) Interpolation of video and audio digital data
Hu et al. Deep inter prediction with error-corrected auto-regressive network for video coding
Zheng et al. A novel gray image representation using overlapping rectangular NAM and extended shading approach
CN110766117B (en) Two-dimensional code generation method and system
WO2012065447A1 (en) Sub pixel interpolation method and system
US8577185B2 (en) Apparatus and method for interpolating and rendering image on mobile devices
CN114449294A (en) Motion estimation method, motion estimation apparatus, motion estimation device, storage medium, and computer program product
Li et al. Learning local and global priors for JPEG image artifacts removal

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
C53 Correction of patent for invention or patent application
CB03 Change of inventor or designer information

Inventor after: Wang Guohui

Inventor after: Wei Zheng

Inventor after: Wang Zhensong

Inventor before: Wang Guohui

Inventor before: Wei Zheng

Inventor before: Wang Zhensong

ASS Succession or assignment of patent right

Owner name: XINJIANG MEITE INTELLIGENT SAFETY ENGINEERING CO.,

Free format text: FORMER OWNER: INSTITUTE OF COMPUTING TECHNOLOGY, CHINESE ACADEMY OF SCIENCES

Effective date: 20121212

C41 Transfer of patent application or patent right or utility model
COR Change of bibliographic data

Free format text: CORRECT: ADDRESS; FROM: 100080 HAIDIAN, BEIJING TO: 830011 URUMQI, XINJIANG UYGUR AUTONOMOUS REGION

TR01 Transfer of patent right

Effective date of registration: 20121212

Address after: 2909, room 830011, B, Pacific Plaza, 217 Gaoxin street, Urumqi hi tech Zone, the Xinjiang Uygur Autonomous Region

Patentee after: Xinjiang Meite Intelligent Security Engineering Co., Ltd.

Address before: 100080 Haidian District, Zhongguancun Academy of Sciences, South Road, No. 6, No.

Patentee before: Institute of Computing Technology, Chinese Academy of Sciences

CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20111026

Termination date: 20181127

CF01 Termination of patent right due to non-payment of annual fee