CN101163252B - Zoom method of multimedia video image - Google Patents

Zoom method of multimedia video image Download PDF

Info

Publication number
CN101163252B
CN101163252B CN2007101781889A CN200710178188A CN101163252B CN 101163252 B CN101163252 B CN 101163252B CN 2007101781889 A CN2007101781889 A CN 2007101781889A CN 200710178188 A CN200710178188 A CN 200710178188A CN 101163252 B CN101163252 B CN 101163252B
Authority
CN
China
Prior art keywords
video image
steps
multimedia video
interpolation method
pixel
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN2007101781889A
Other languages
Chinese (zh)
Other versions
CN101163252A (en
Inventor
王国晖
魏征
王贞松
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Xinjiang Meite Intelligent Security Engineering Co., Ltd.
Original Assignee
Institute of Computing Technology of CAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Institute of Computing Technology of CAS filed Critical Institute of Computing Technology of CAS
Priority to CN2007101781889A priority Critical patent/CN101163252B/en
Publication of CN101163252A publication Critical patent/CN101163252A/en
Application granted granted Critical
Publication of CN101163252B publication Critical patent/CN101163252B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Editing Of Facsimile Originals (AREA)
  • Television Systems (AREA)
  • Image Processing (AREA)

Abstract

The invention discloses a scale method of a multimedia audio image, which implements transformation operations on the executive color space of an audio image, which leads to that the image satisfies that in the transformed color space, the information content of image included in the three color components is different, and the image information is concentrated in one color component. The audio image is scaled in the transformed color space. As for the color component which includes most information of the audio images, complicated interpolation method is adopted when scaling, which gives the color component better effects, and relatively simple interpolation method is adopted on other color components when image scale process is implemented. The scale method of the multimedia audio image can well remain the details of audio images with excellent scale effects, and in particularly when the invention is used for audio of bad image quality under the bad condition of low bit rate and bad network , the invention can obtain more excellent audio scale effects than c other methods.

Description

A kind of Zoom method of multimedia video image
Technical field
The present invention relates to the multimedia video image processing technology field, particularly relate to a kind of Zoom method of multimedia video image.
Background technology
Along with multimedia, rapid development of network technique, video has been deep into different social sectors as a kind of information carrier.In various Video Applications, the convergent-divergent of the video image function that all is absolutely necessary, and be to use the most frequent function.In digital image processing field, the digital image interpolation algorithm of a large amount of maturations has been arranged, as neighbor interpolation, bilinear interpolation, bicubic spline interpolation, cube convolution interpolation etc., use these interpolation algorithms to can be good at finishing the convergent-divergent of digital picture.
Yet complicated slightly any algorithm just can't be grafted directly in the convergent-divergent of digital video image and go, because video playback requires real-time to be guaranteed, thereby to the very high requirement of efficient proposition of the convergent-divergent of video image.Lift a simple example, video frame rate as a full speed running was 24 frame/seconds, whole processing times of so every frame video image can not be above 33 milliseconds, in this time, except finishing image zoom, also comprise the decoding of video image, processing and other various processing of a large amount of consume system resources such as colour space transformation, directly use and comprise the bicubic spline interpolation, the cube convolution interpolation will consume a large amount of system resource, and need the very long processing time, to have a strong impact on the real-time of video playback, thereby the efficient of the convergent-divergent of video image is proposed very high requirement.So the actual bilinear interpolation of often using in video scaling realizes the convergent-divergent of video image, the bilinear interpolation algorithm complex is little, and is better than the most contiguous algorithm effect, but tangible smoothing effect is arranged.Although video image quality has no small loss, consider the complexity of algorithm, be subject to the computer hardware condition, in order to guarantee the real-time broadcast of video image, people still can exchange the real-time of video usually with some loss of video image quality for.
Development along with digital video technology, the operational capability of computer and storage capacity have had and have increased substantially, personal computer (PC) also can satisfy H.264 gradually and MPEG4 coding and decoding video forms such as (Motion Picture ExpertsGroup 4) to the requirement of hardware environment.As comparing with the code/decode format that H.263 waits in the past with The Application of Technology H.264, H.264 the coding and decoding video form has the high performance advantage of low code check, especially at some to code check and network bandwidth requirement very under the rigorous environment, H.264 coding and decoding video has shown very outstanding performance.
Along with the development of digital video technology, adopt the network teleconference, network remote monitoring etc. of technology H.264 to use ripe gradually.In these are used, be subject to the disposal ability of the network bandwidth and server, be generally CIF form (Common Intermediate Format, CLV Common Intermediate Format) in the video image size of transmission over networks.Yet the size of CIF form can not satisfy demands of applications such as video conference or network remote monitoring far away, therefore, in these are used, the demand of video scaling is become stronger.
Under low code check condition, the convergent-divergent of video image faces more difficulty.Under low code check, because being similar to significantly in quantification and the cataloged procedure, the quality of video itself descends very serious; Add under the network environment of general low code check, packet loss and wrong unavoidable, the details that has caused video is by heavy damage, and picture quality is relatively poor.Under this prerequisite, if also use bilinear interpolation to carry out the convergent-divergent of video, the details that the aliasing that brings of bilinear interpolation and blurring effect can further failure pattern pictures so, the video image quality of the convergent-divergent that obtains with this algorithm will seriously descend.
In addition, traditional video image zooming operation is generally carried out at rgb color space, needs so three color components are handled respectively, and operand is bigger, and this has had further restriction to using interpolation algorithm.
At above demand, need a kind of digital video Zoom method that efficiently has better performance fast simultaneously of design, be used for when guaranteeing the video image real-time, obtaining the zooming effect of video image preferably.
Summary of the invention
The object of the present invention is to provide a kind of Zoom method of multimedia video image, its high-quality of realizing digital video image amplifies.
For realizing the Zoom method of a kind of multimedia video image that purpose of the present invention provides, comprise the following steps:
A kind of Zoom method of multimedia video image is characterized in that, comprises the following steps:
Steps A, multimedia video image is carried out the colour space transformation operation, make multimedia video image satisfy in the color space after conversion, the amount of information of the multimedia video image that three color components comprise is inequality, the information of multimedia video image concentrates on one of them color component, color component to maximum image information of comprising multimedia video image, adopting when amplifying makes color component obtain the complicated interpolation method of better effect, to other color component, adopt simple relatively interpolation method, carry out the convergent-divergent of multimedia video image and handle.
Also comprise the following steps:
Step B after a plurality of color components of color space for the treatment of the multimedia video image of convergent-divergent dispose respectively, carries out colour space transformation to multimedia video image, and it is transformed to rgb color space, finishes the convergent-divergent of multimedia video image.
In the described steps A, described complicated interpolation method is Spline Interpolation Method or cube convolution method.
It is characterized in that in the described steps A, described simple relatively interpolation method is bilinear interpolation method or neighbor interpolation method.
Described Spline Interpolation Method is the bicubic spline interpolation method after bicubic spline interpolation method or the improvement.
Described color space or be the YUV color space perhaps is the YCrCb color space, perhaps is the HSI color space.
Described steps A also comprises the following steps:
Steps A 1, treat the multimedia video image of convergent-divergent, in the YUV color space, adopt bilinear interpolation method that U, V component are carried out processing and amplifying, adopt Spline Interpolation Method the Y component to be handled the multimedia video image that obtains amplifying multimedia video image.
Described steps A 1 comprises the following steps:
Steps A 11 to multimedia video image, adopts bilinear interpolation method or neighbor interpolation method to carry out processing and amplifying at the YUV color space to the U of multimedia video image, V component;
Steps A 12 to multimedia video image, adopts Spline Interpolation Method or cube convolution interpolation method to carry out processing and amplifying at the YUV color space to the Y component of multimedia video image.
In the described steps A 12, described Spline Interpolation Method is the bicubic spline interpolation method, comprises the following steps:
Steps A 121 is for the pixel (x in the target multimedia video image 1, y 1), by contrary geometric transformation:
x 0 ‾ = x 1 / M y 0 ‾ = y 1 / M ;
Obtain the position coordinates of pixel mapping in the former multimedia video image in the target multimedia video image
Figure GSB00000584740500032
Wherein, M when carrying out processing and amplifying, amplification multiple,
Figure GSB00000584740500033
Through rounding the coordinate (x after obtaining rounding downwards 0, y 0), that is:
Figure GSB00000584740500041
Steps A 122 is calculated the position coordinates of pixel mapping in the former multimedia video image in the target multimedia video image With round after coordinate (x 0, y 0) between difference be:
u = x ‾ 0 - x 0 v = y ‾ 0 - y 0 ;
Steps A 123, with u, the value substitution interpolation kernel function S (x) of v draws:
A → = S ( u + 1 ) S ( u ) S ( u - 1 ) S ( u - 2 )
C → = S ( v + 1 ) S ( v ) S ( v - 1 ) S ( v - 2 ) ;
Steps A 124 reads the pixel (x of former multimedia video image 0, y 0) all around 4 * 4 pixel, constitute matrix:
B → ( x 0 , y 0 ) = f ( x 0 - 1 , y 0 - 1 ) f ( x 0 - 1 , y 0 ) f ( x 0 - 1 , y 0 + 1 ) f ( x 0 - 1 , y 0 + 2 ) f ( x 0 , y 0 - 1 ) f ( x 0 , y 0 ) f ( x 0 , y 0 + 1 ) f ( x 0 , y 0 + 2 ) f ( x 0 + 1 , y 0 - 1 ) f ( x 0 + 1 , y 0 ) f ( x 0 + 1 , y 0 + 1 ) f ( x 0 + 1 , y 0 + 2 ) f ( x 0 + 2 , y 0 - 1 ) f ( x 0 + 2 , y 0 ) f ( x 0 + 2 , y 0 + 1 ) f ( x 0 + 2 , y 0 + 2 ) ;
Steps A 125, according to interpolation formula: Calculate the pixel value of target multimedia video image;
Steps A 126, all pixels in the whole target multimedia video image are scanned in repeating step A121~125, finish the bicubic spline interpolation of whole multimedia video image, the multimedia video image that obtains amplifying.
In the described steps A 12, described Spline Interpolation Method is improved bicubic spline interpolation method, comprises the following steps:
Steps A 121 ', according to multiplication factor, the interpolation kernel functional value that calculating may be used;
Steps A 122 ' with the value integer of interpolation kernel function, and becomes 2 power, saves as S_int 2(x) value;
Steps A 123 ' is got a subimage block that is of a size of M*M of target multimedia video image;
Steps A 124 ', calculate each pixel correspondence in the subimage block difference (u, v) and S_int 2(x) value;
Steps A 125 ' confirms whether subimage block is arranged in target multimedia video image Far Left, if, then read pixel in the pairing multimedia video image of subimage block (k, l) 4 * 4 the matrix that pixel constituted all around,
B → ( k , l ) = f ( k , l ) f ( k , l + 1 ) f ( k , l + 2 ) f ( k , l + 3 ) f ( k + 1 , l ) f ( k + 1 , l + 1 ) f ( k + 1 , l + 2 ) f ( k + 1 , l + 3 ) f ( k + 2 , l ) f ( k + 2 , l + 1 ) f ( k + 2 , l + 2 ) f ( k + 2 , l + 3 ) f ( k + 3 , l ) f ( k + 3 , l + 1 ) f ( k + 3 , l + 2 ) f ( k + 3 , l + 3 ) ;
Steps A 126 ' is taken out a pixel in the target multimedia video image subimage block, obtains corresponding S_int 2(x) value;
Steps A 127 ', for the subimage block correspondence
Figure GSB00000584740500052
And difference (u, v) substitution bicubic spline interpolating matrix formula calculates, and moves to right 20 with calculating the result who obtains, and obtains target multimedia video image pixel value;
Steps A 128 ' confirms whether handle all pixels in the current subimage block;
Steps A 129 ' confirms whether to handle all subimage blocks in the target multimedia video image.
Described steps A 125 ' comprises the following steps:
Steps A 1251 ' if subimage block is to be arranged in target multimedia video image Far Left, then reads the subimage block B of M*M from former multimedia video image;
Steps A 1252 ', if subimage block is not to be arranged in target multimedia video image Far Left, then reading M pixel of row and last the right three of calculating the subimage block B ' of the M*M that uses from former multimedia video image is listed as and constitutes new subimage block B together.
Described steps A 128 ' also further comprises the following steps:
Steps A 1281 ' if handled all pixels in the current subimage block, then continues steps A 129 ';
Steps A 1282 ' if do not handle all pixels in the current subimage block, is then returned steps A 126 '.
Described steps A 129 ' also further comprises the following steps:
Steps A 1291 ' if handled all pixels in the current subimage block, then finishes amplifieroperation;
Steps A 1292 ' if do not handle all pixels in the current subimage block, is then returned steps A 123 '.
Described steps A also comprises the following steps:
Steps A 2 is treated the multimedia video image of convergent-divergent, at three color components of YUV color space to video data, adopts bilinear interpolation method or neighbor interpolation method to dwindle processing respectively.
When described bilinear interpolation method is handled, comprise the following steps:
Steps A 21, for the pixel in the target multimedia video image, obtain the position coordinates of pixel mapping in the former multimedia video image in the target multimedia video image by contrary geometric transformation, position coordinates is through rounding the coordinate that obtains after the round numbers downwards;
Steps A 22, calculate pixel mapping in the target multimedia video image in the former multimedia video image position coordinates and round after coordinate between difference;
Steps A 23 is utilized bilinear interpolation method, calculates the pixel value of target multimedia video image;
Steps A 24 judges whether to finish the scanning of the pixel of whole multimedia video image, if do not finish, then gets back to steps A 21, begins to handle next pixel; If finish, then the interpolation of whole multimedia video image finishes, and finishes computing.
The invention has the beneficial effects as follows: the Zoom method of multimedia video image of the present invention, it can keep the video image details well, has extraordinary zooming effect; Realize simply not only can realizing, also can realize with hardware easily with software; For the common video image, can obtain good effect.Especially during the relatively poor video of the picture quality under being used for low code check, network environment situation mal-condition, can obtain the video scaling effect outstanding than additive method.
Description of drawings
Fig. 1 is the flow chart of bilinear interpolation algorithm;
Fig. 2 is the schematic diagram of the multimedia video image amplification method described of the present invention;
Fig. 3 is the flow chart of bicubic spline interpolation algorithm;
Fig. 4 is the flow chart of the bicubic spline interpolation fast algorithm after improving.
Embodiment
In order to make purpose of the present invention, technical scheme and advantage clearer,, the Zoom method of a kind of multimedia video image of the present invention is further elaborated below in conjunction with drawings and Examples.Should be appreciated that specific embodiment described herein only in order to explanation the present invention, and be not used in qualification the present invention.
The method that the purpose of this invention is to provide a kind of multimedia video image convergent-divergent, the high-quality convergent-divergent of the video image under the especially low code check condition of realization digital video.
In order to achieve the above object, the technical scheme that the present invention takes is: to having a plurality of color components, color component includes the color space of the video image of the different information of image, (wherein the Y component is a luminance signal as the YUV color space, U component and V component are represented two color difference signals respectively, image information mainly concentrates on the Y component), YCrCb color space (image information mainly concentrates on the Y component), HSI color space (image information mainly concentrates on the I component), a plurality of color components of video image are handled respectively.Wherein, color component to the more image information that comprises video image, adopting when amplifying makes color component obtain the complicated interpolation method (algorithm) of better effect, as Spline Interpolation Method (algorithm), cube convolution interpolation method (algorithm) to other color component, adopts simple relatively interpolation method (algorithm), as bilinear interpolation method (algorithm) or neighbor interpolation method (algorithm), the video image that obtains amplifying.Wherein, for dwindling of video image, adopt bilinear interpolation method (algorithm) or neighbor interpolation method (algorithm) to handle video image.Different color components is adopted different interpolation algorithms, realize the high-quality and high-efficiency convergent-divergent of video image.
YUV color space with the video image that comprises the YUV color component is an example below, describe multimedia video image Zoom method of the present invention in detail, but, should be noted that, the Zoom method to multimedia video image of the embodiment of the invention, be equally applicable to comprise YCrCb color space, HSI color space or other has a plurality of color components, color component includes the color space of the video image of the different information of image.
Comprise a kind of Zoom method of multimedia video image of color space of the video image of YUV color component in the embodiment of the invention, comprise the following steps:
Step S100, video image is carried out the colour space transformation operation, make image satisfy in the color space after conversion, the information content of image that three color components comprise is inequality, and the information of image concentrates on one of them color component, to the color component of maximum image information of comprising video image, adopting when amplifying makes color component obtain the complicated interpolation method of better effect, to other color component, adopt simple relatively interpolation method, carry out the convergent-divergent of video image and handle.
Multimedia video image Zoom method of the present invention, at first video image is carried out the colour space transformation operation, make image satisfy in the color space after conversion, the information content of image that three color components comprise is inequality, the information of image concentrates on one of them color component, be converted to the video image of YUV color space as video image with rgb color space, inequality in the information content of image that the different color component of YUV includes; And then the video image of described color space carried out convergent-divergent.
The conversion in the different color space of video image is a kind of prior art, and it is not innovation and creation of the present invention, and those skilled in the art can realize its conversion process according to content disclosed by the invention, therefore, describes in detail no longer one by one in the present invention.
Step S110 treats the multimedia video image of convergent-divergent, at three color components of YUV color space to video data, it is the Y component of luminance signal, two color difference signal U components and V component adopt bilinear interpolation method or neighbor interpolation method to dwindle processing respectively, referring to Fig. 1.
The bilinear interpolation of image is to utilize 4 adjoint points of object pixel to make linear interpolation on both direction, with the distance as weight.Be implemented as follows:
The object pixel coordinate is (x 1, y 1), by the floating-point coordinate that obtains after the inverse transformation be
Figure GSB00000584740500081
Obtain integer to (x through rounding downwards 0, y 0), establish p = x ‾ 0 - x 0 q = y ‾ 0 - y 0 , (x then 1, y 1) gray value located can obtain with following formula:
f ( x ‾ 0 , y ‾ 0 ) = ( 1 - q ) [ ( 1 - p ) f ( x 0 , y 0 ) + pf ( x 0 + 1 , y 0 ) ] + q [ ( 1 - p ) f ( x 0 , y 0 + 1 ) + pf ( x 0 + 1 , y 0 + 1 ) ]
Calculate then Obtain the target video image after the interpolation.
As a kind of enforceable mode, the reduction operation process of video image of the present invention comprises the steps: in detail
As former digital video image is that (x, y), carry out interpolation operation target video image afterwards is f ' (x to f 1, y 1), minification is M.
After computing began, from (0,0) some beginning of target video image, pointwise was handled.Step is as follows, and algorithm flow is seen Fig. 2:
Step S111 is for the pixel (x in the target video image 1, y 1), by contrary geometric transformation
x 0 ‾ = x 1 / M y 0 ‾ = y 1 / M
Obtain the position coordinates of pixel mapping in the original image in the target video image
Figure GSB00000584740500087
Figure GSB00000584740500088
Through rounding the coordinate (x after obtaining rounding downwards 0, y 0), that is:
Figure GSB00000584740500089
Step S112 calculates the position coordinates of pixel mapping in the original image in the target video image
Figure GSB000005847405000810
With round after coordinate (x 0, y 0) between difference be:
p = x ‾ 0 - x 0 q = y ‾ 0 - y 0
Step S113 utilizes bilinear interpolation method (algorithm), calculates the pixel value of target video image:
The formula of described bilinear interpolation method is as follows:
f ( x ‾ 0 , y ‾ 0 ) = ( 1 - q ) [ ( 1 - p ) f ( x 0 , y 0 ) + pf ( x 0 + 1 , y 0 ) ] + q [ ( 1 - p ) f ( x 0 , y 0 + 1 ) + pf ( x 0 + 1 , y 0 + 1 ) ]
Also promptly:
f ′ ( x 1 , y 1 ) = f ( x ‾ 0 , y ‾ 0 )
= ( 1 - q ) [ ( 1 - p ) f ( x 0 , y 0 ) + pf ( x 0 + 1 , y 0 ) ] + q [ ( 1 - p ) f ( x 0 , y 0 + 1 ) + pf ( x 0 + 1 , y 0 + 1 ) ]
Step S114 judges whether to finish the scanning of the pixel of entire image, if do not finish, then gets back to step S111, begins to handle next pixel; If finish, then the interpolation of whole digital video image finishes, and finishes computing.
As another kind of embodiment, the YUV color space is dwindled processing to three color components of video data, adopt nearest field interpolation method, step and step S111~114 are basic identical, use neighbor interpolation method (algorithm) on just method (algorithm) is selected, wherein, neighbor interpolation method (algorithm) is a kind of prior art, those skilled in the art can utilize neighbor interpolation method (algorithm) to realize the processing of dwindling of this video image according to the description of the embodiment of the invention, thereby describe in detail no longer one by one in embodiments of the present invention.
Step S120, treat the multimedia video image of convergent-divergent, in the YUV color space, adopt bilinear interpolation method (algorithm) that U, V component are carried out processing and amplifying, adopt Spline Interpolation Method (algorithm) that the Y component is handled video image, the video image that obtains amplifying is referring to Fig. 2.
Step S121 to multimedia video image, adopts bilinear interpolation method or neighbor interpolation method to carry out processing and amplifying at the YUV color space to the U of video image, V component;
Multimedia video image is amplified, to U, V component carry out the specific implementation of processing and amplifying and video image to dwindle the method (algorithm) that is adopted identical, therefore, in embodiments of the present invention, describe in detail no longer one by one.
Step S122 to multimedia video image, adopts Spline Interpolation Method (algorithm) or cube convolution interpolation method (algorithm) to carry out processing and amplifying at the YUV color space to the Y component of video image.
For the Y component data, adopt Spline Interpolation Method (algorithm).Compare neighbor interpolation algorithm and bilinear interpolation algorithm, spline interpolation has been made best balance between accuracy and computing consume.
Described batten is piecewise function (a normally multinomial), and what each section was smooth links together.
As a kind of enforceable mode, spline interpolation of the present invention is the bicubic spline interpolation.
A) describe the process utilize the bicubic spline interpolation method to be implemented in the processing that the YUV color space amplifies the Y component of video image below in detail.
As a kind of embodiment, in the bicubic spline interpolation method, utilize the B-batten to realize in the embodiment of the invention.
The B-batten is one of the most frequently used spline function, can obtain from convolution from a basic function.
The basic function form is as follows:
β Basis ( x ) = 1 0 ≤ | x | ≤ 0.5 1 2 | x | = 1 2 0 elsewhere
Interpolating function can be by β Basis(x) function obtains from convolution:
β 1(x)=β Basis(x)*β Basis(x)
N rank B-spline function can be obtained by N-1 basic function convolution:
Figure GSB00000584740500102
When N=4, can obtain a cube B-spline interpolation kernel function:
&beta; 4 ( x ) = 1 2 | x | 3 - | x | 2 + 2 3 , 0 &le; | x | < 1 - 1 6 | x | 3 + | x | 2 - 2 | x | + 4 3 , 1 &le; | x | < 2 0 , elsewhere
With the bicubic spline interpolation application in video image is handled the time, the bicubic spline interpolation considers that the pixel mapping of the target image that generates returns the floating-point coordinate of original image
Figure GSB00000584740500104
16 adjoint points on every side can be used matrix
Figure GSB00000584740500105
Expression.If the pixel coordinate of target video image is (x 1, y 1), by the floating-point coordinate of the correspondence that obtains after how much inverse transformations be
Figure GSB00000584740500106
Figure GSB00000584740500107
Obtain integer to (x through rounding downwards 0, y 0).
If u = x &OverBar; 0 - x 0 v = y &OverBar; 0 - y 0 , And establish:
S ( x ) = 1 2 | x | 3 - | x | 2 + 2 3 , 0 &le; | x | < 1 - 1 6 | x | 3 + | x | 2 - 2 | x | + 4 3 , 1 &le; | x | < 2 0 , elsewhere
A &RightArrow; = S ( u + 1 ) S ( u ) S ( u - 1 ) S ( u - 2 )
B &RightArrow; = f ( x 0 - 1 , y 0 - 1 ) f ( x 0 - 1 , y 0 ) f ( x 0 - 1 , y 0 + 1 ) f ( x 0 - 1 , y 0 + 2 ) f ( x 0 , y 0 - 1 ) f ( x 0 , y 0 ) f ( x 0 , y 0 + 1 ) f ( x 0 , y 0 + 2 ) f ( x 0 + 1 , y 0 - 1 ) f ( x 0 + 1 , y 0 ) f ( x 0 + 1 , y 0 + 1 ) f ( x 0 + 1 , y 0 + 2 ) f ( x 0 + 2 , y 0 - 1 ) f ( x 0 + 2 , y 0 ) f ( x 0 + 2 , y 0 + 1 ) f ( x 0 + 2 , y 0 + 2 )
C &RightArrow; = S ( v + 1 ) S ( v ) S ( v - 1 ) S ( v - 2 )
Target pixel value then
Figure GSB00000584740500115
Can obtain by following interpolation formula:
f &prime; ( x 1 , y 1 ) = f ( x &OverBar; 0 , y &OverBar; 0 ) = A &RightArrow; &times; B &RightArrow; &times; C &RightArrow;
Therefore, the Y component bicubic spline interpolation of the embodiment of the invention is carried out processing and amplifying and is comprised the following steps:
Former digital video image is that (x, y), carry out interpolation operation target video image afterwards is f ' (x to f 1, y 1), suppose that multiplication factor is M.
After computing began, from (0,0) some beginning of target video image, pointwise was handled, and algorithm flow is seen Fig. 3.Detailed process is as follows:
Step S1221 is for the pixel (x in the target video image 1, y 1), by contrary geometric transformation:
x 0 &OverBar; = x 1 / M y 0 &OverBar; = y 1 / M
Obtain the position coordinates of pixel mapping in the original image in the target video image
Figure GSB00000584740500118
Figure GSB00000584740500119
Through rounding the coordinate (x after obtaining rounding downwards 0, y 0), that is:
Figure GSB000005847405001110
Step S1222 calculates the position coordinates of pixel mapping in the original image in the target video image
Figure GSB00000584740500121
With round after coordinate (x 0, y 0) between difference be:
u = x &OverBar; 0 - x 0 v = y &OverBar; 0 - y 0
Step S1223, with u, the value substitution interpolation kernel function S (x) of v draws:
A &RightArrow; = S ( u + 1 ) S ( u ) S ( u - 1 ) S ( u - 2 )
C &RightArrow; = S ( v + 1 ) S ( v ) S ( v - 1 ) S ( v - 2 )
Step S1224 reads the pixel (x of original video image 0, y 0) near 4 * 4 pixel, constitute matrix:
B &RightArrow; ( x 0 , y 0 ) = f ( x 0 - 1 , y 0 - 1 ) f ( x 0 - 1 , y 0 ) f ( x 0 - 1 , y 0 + 1 ) f ( x 0 - 1 , y 0 + 2 ) f ( x 0 , y 0 - 1 ) f ( x 0 , y 0 ) f ( x 0 , y 0 + 1 ) f ( x 0 , y 0 + 2 ) f ( x 0 + 1 , y 0 - 1 ) f ( x 0 + 1 , y 0 ) f ( x 0 + 1 , y 0 + 1 ) f ( x 0 + 1 , y 0 + 2 ) f ( x 0 + 2 , y 0 - 1 ) f ( x 0 + 2 , y 0 ) f ( x 0 + 2 , y 0 + 1 ) f ( x 0 + 2 , y 0 + 2 ) ,
Step S1225, according to interpolation formula:
Figure GSB00000584740500126
Calculate the pixel value of target video image.
Step S1226, all pixels in the whole target video image are scanned in repeating step S1221~1225, finish the bicubic spline interpolation of whole digital video image, the video image that obtains amplifying.
The process of the processing that the bicubic spline interpolation fast algorithm implementation after describe in detail to utilize improving B) is amplified the Y component of video image at the YUV color space.
Former digital video image be f (x, y), former digital video image is wide to be width_original, high be height_original, the target video image that carries out after the interpolation operation is f ' (x 1, y 1), the wide of the target video image after the difference is width_interpol, the high height_interpol of being, supposes that multiplication factor is M, so:
Figure GSB00000584740500127
For amplifying M situation doubly, can be being divided into some M * M rank matrix in the target video image:
F &prime; &RightArrow; ( kM , lM ) = f ( kM , lM ) f ( kM , lM + 1 ) &CenterDot; &CenterDot; &CenterDot; f ( kM , lM + M - 1 ) f ( kM + 1 , lM ) f ( kM + 1 , lM + 1 ) &CenterDot; &CenterDot; &CenterDot; f ( kM + 1 , lM + M - 1 ) &CenterDot; &CenterDot; &CenterDot; &CenterDot; &CenterDot; &CenterDot; &CenterDot; &CenterDot; &CenterDot; &CenterDot; &CenterDot; &CenterDot; f ( kM + M - 1 , lM ) f ( kM + M - 1 , lM + 1 ) &CenterDot; &CenterDot; &CenterDot; f ( kM + M - 1 , lM + M - 1 )
(wherein, k, l ∈ Z, and satisfy ( kM + M - 1 ) &le; width _ interpol ( lM + M - 1 ) &le; width _ interpol )
Each M * M rank matrix The subimage block that can regard a target video image as, matrix
Figure GSB00000584740500134
In all pixel mapping return original image, the same pixel in all corresponding original image (k, l).4 * 4 pixels that are used for the bicubic spline interpolation that this point closes on constitute matrix
Figure GSB00000584740500135
B &RightArrow; ( k , l ) = f ( k , l ) f ( k , l + 1 ) f ( k , l + 2 ) f ( k , l + 3 ) f ( k + 1 , l ) f ( k + 1 , l + 1 ) f ( k + 1 , l + 2 ) f ( k + 1 , l + 3 ) f ( k + 2 , l ) f ( k + 2 , l + 1 ) f ( k + 2 , l + 2 ) f ( k + 2 , l + 3 ) f ( k + 3 , l ) f ( k + 3 , l + 1 ) f ( k + 3 , l + 2 ) f ( k + 3 , l + 3 )
That is to say that for each M * M subimage block, the interpolation result of all pixels of this subimage block inside all is to use identical
Figure GSB00000584740500137
Value calculate.Therefore, can disposablely read out
Figure GSB00000584740500138
(kM, the lM) M * M in pixel can reduce the memory access number of times to the subimage F of disposable then processing target image so in a large number, improves the degree of parallelism of computing.
Therefore, in target video image, be image division some subimage blocks that are of a size of M * M size, block-by-block is handled.
In addition, in processing procedure, use difference two tuples (u, v), it is defined as follows:
For the pixel (x in the target video image 1, y 1), by contrary geometric transformation:
x 0 &OverBar; = x 1 / M y 0 &OverBar; = y 1 / M
Obtain the position coordinates of pixel mapping in the original image in the target video image
Figure GSB000005847405001310
Figure GSB000005847405001311
Obtain integer to (x through rounding downwards 0, y 0),
That is:
Calculate the position coordinates of pixel mapping in the original image in the target video image
Figure GSB000005847405001313
With round after coordinate (x 0, y 0) between difference be:
u = x &OverBar; 0 - x 0 v = y &OverBar; 0 - y 0
Be called difference two tuples (u, v).
Bicubic spline interpolation fast algorithm after detailed description Y component employing of the present invention improves below carries out the implementation process of processing and amplifying, and algorithm flow is seen Fig. 4, and concrete steps are as follows:
Step S1221 ' carries out initialization to the function of bicubic interpolation and obtains kernel function;
In the initialization procedure after interpolation process starts, at first calculate several interpolation kernel functions that in calculating process, may occur.
For the multiplication factor M that determines, need the result of calculation of the interpolation kernel function used to determine in the calculating process.If with x represent difference two tuples (u, v) the u in or v value are under the situation of M in multiplication factor, parameter x have M kind value ( ), so need M kind interpolation kernel function S (x i) (i=0 wherein, 1 ..., M-1).
The kernel function integer that calculates is also approximate.The interpolation kernel functional value that calculates is a floating number, moves to left 10 for each interpolation kernel functional value, amplifies 1000 times and rounds then, can obtain integer interpolation kernel functional value, is designated as S_int (x).Then, the value of interpolation kernel function is replaced with the most contiguous 2 power.Obtain one group of new value, be designated as S_int 2(x), it is inferior with respect to 2 power that it has write down each interpolation kernel function.
So far, initialization is finished.
Step S1222 ', determine current pending subimage block F (kM, lM), calculate matrix F (kM, lM) in corresponding difference two tuples of each pixel (u, value v), and be saved as matrix
Figure GSB00000584740500142
UV &RightArrow; ( kM , lM ) = uv ( kM , lM ) uv ( kM , lM + 1 ) &CenterDot; &CenterDot; &CenterDot; uv ( kM , lM + M - 1 ) uv ( kM + 1 , lM ) uv ( kM + 1 , lM + 1 ) &CenterDot; &CenterDot; &CenterDot; uv ( kM + 1 , lM + M - 1 ) &CenterDot; &CenterDot; &CenterDot; &CenterDot; &CenterDot; &CenterDot; &CenterDot; &CenterDot; &CenterDot; &CenterDot; &CenterDot; &CenterDot; uv ( kM + M - 1 , lM ) uv ( kM + M - 1 , lM + 1 ) &CenterDot; &CenterDot; &CenterDot; uv ( kM + M - 1 , lM + M - 1 )
Uv in the formula (k, l)=(u (k, l), v (k, l))
Step S1223 ', (kM lM) is leftmost image block, then reads 4 * 4 pixels in the pairing original image of current pending image block as if current pending image block F
Figure GSB00000584740500144
Be put in the internal memory.
(kM, lM) each pixel in is all corresponding identical owing to F
Figure GSB00000584740500145
So only need read once
Figure GSB00000584740500151
Get final product.
If (kM lM) is not leftmost image block, then reads last round of processing current pending image block F
Figure GSB00000584740500152
The right a row pixel value (4 pixels of row), then and
Figure GSB00000584740500153
The right three columns new according to constituting together Matrix, a columns that newly reads is according to being placed on
Figure GSB00000584740500155
The right three columns according to the right, be used for current F (kM, the calculating of pixel value lM).
Step S1224 ', image block F (kM, lM) each pixel in are handled in pointwise;
Concrete operations are as follows:
For F (kM, the capable j row of i pixel f lM) (kM+i, lM+j),
According to formula
A &RightArrow; = S ( u + 1 ) S ( u ) S ( u - 1 ) S ( u - 2 )
B &RightArrow; ( k , l ) = f ( k , l ) f ( k , l + 1 ) f ( k , l + 2 ) f ( k , l + 3 ) f ( k + 1 , l ) f ( k + 1 , l + 1 ) f ( k + 1 , l + 2 ) f ( k + 1 , l + 3 ) f ( k + 2 , l ) f ( k + 2 , l + 1 ) f ( k + 2 , l + 2 ) f ( k + 2 , l + 3 ) f ( k + 3 , l ) f ( k + 3 , l + 1 ) f ( k + 3 , l + 2 ) f ( k + 3 , l + 3 )
C &RightArrow; = S ( v + 1 ) S ( v ) S ( v - 1 ) S ( v - 2 )
f &prime; ( x 1 , y 1 ) = f ( x &OverBar; 0 , y &OverBar; 0 ) = A &RightArrow; &times; B &RightArrow; &times; C &RightArrow;
Can obtain:
f &prime; ( x 1 , y 1 ) = f ( x &OverBar; 0 , y &OverBar; 0 ) = A &RightArrow; &times; B &RightArrow; &times; C &RightArrow;
= S ( u + 1 ) S ( u ) S ( u - 1 ) S ( u - 2 ) f ( k , l ) f ( k , l + 1 ) f ( k , l + 2 ) f ( k , l + 3 ) f ( k + 1 , l ) f ( k + 1 , l + 1 ) f ( k + 1 , l + 2 ) f ( k + 1 , l + 3 ) f ( k + 2 , l ) f ( k + 2 , l + 1 ) f ( k + 2 , l + 2 ) f ( k + 2 , l + 3 ) f ( k + 3 , l ) f ( k + 3 , l + 1 ) f ( k + 3 , l + 2 ) f ( k + 3 , l + 3 ) S ( v + 1 ) S ( v ) S ( v - 1 ) S ( v - 2 )
Matrix operation is launched and can obtain:
Figure GSB00000584740500161
Figure GSB00000584740500162
Figure GSB00000584740500163
Use prior good as calculated and S_int integer (x) value replacement S (x) function, further use then to be rewritten into 2 the inferior S_int of power 2(x) and shift operation replace S_int (x) value:
f(kM+i,lM+j)
=[f(k,l)□S_int(u+1)+f(k+1,l)□S_int(u)+f(k+2,l)□S_int(u-1)+f(k+3,l)□S_int(u-2)]□S_int(v+1)
+[f(k,l+1)□S_int(u+1)+f(k+1,l+1)□S_int(u)+f(k+2,l+1)□S_int(u-1)+f(k+3,l+1)□S_int(u-2)]□S_int(v)
+[f(k,l+2)□S_int(u+1)+f(k+1,l+2)□S_int(u)+f(k+2,l+2)□S_int(u-1)+f(k+3,l+2)□S_int(u-2)]□S_int(v-1)
+[f(k,l+3)□S_int(u+1)+f(k+1,l+3)□S_int(u)+f(k+2,l+3)□S_int(u-1)+f(k+3,l+3)□S_int(u-2)]□S_int(v-2)
=[f(k,l)□S_int 2(u+1)+f(k+1,l)□S_int 2(u)+f(k+2,l)□S_int 2(u-1)+f(k+3,l)□S_int 2(u-2)]□S_int 2(v+1)
+[f(k,l+1)□S_int 2(u+1)+f(k+1,l+1)□S_int 2(u)+f(k+2,l+1)□S_int 2(u-1)+f(k+3,l+1)□S_int 2(u-2)]□S_int 2(v)
+[f(k,l+2)□S_int 2(u+1)+f(k+1,l+2)□S_int 2(u)+f(k+2,l+2)□S_int 2(u-1)+f(k+3,l+2)□S_int 2(u-2)]□S_int 2(v-1)
+[f(k,l+3)□S_int 2(u+1)+f(k+1,l+3)□S_int 2(u)+f(k+2,l+3)□S_int 2(u-1)+f(k+3,l+3)□S_int 2(u-2)]□S_int 2(v-2)
Wherein, the in the formula represents left shift operation, for for simplicity, uses u in formula, v represent u (i, j), v (i, j).
Next, step S1223 ' is obtained and f (kM+i, lM+j) corresponding The uv that calculates with step S1222 ' (kM+i lM+j) brings top formula into, calculate f (kM+i, lM+j).
At last, with f (kM+i lM+j) moves to right 20, obtain f (kM+i, lM+j) the final pixel value result of pixel:
f final(kM+i,lM+j)=f(kM+i,lM+j)□?20。
Execution in step S1224 ' repeatedly is up to image block
Figure GSB00000584740500167
Interior all M * M pixel all disposes.
Step S1225 ' judges whether to handle all images piece in the target video image, if do not handle, then gets back to step S1223 '; If handled all images piece in the target video image, then target video image Y component interpolation finishes.
As another kind of embodiment, the YUV color space is carried out processing and amplifying to three color components of video data, adopt the cube convolution interpolation method, bicubic spline interpolation method (algorithm) or step S1221 '~1225 ' in step and step S1221~1226 are basic identical, just use cube convolution interpolation method (algorithm) in method (algorithm) selection, wherein, the cube convolution interpolation method is a kind of prior art, those skilled in the art can utilize cube convolution interpolation method (algorithm) to realize the processing of dwindling of this video image according to the description of the embodiment of the invention, thereby describe in detail no longer one by one in embodiments of the present invention.
As another kind of embodiment, to comprising YCrCb color space with the video image that comprises the YCrCb color component, processing to the Y component is identical with the Y component processing of the YUV color space of the embodiment of the invention, handles identical to the processing of Cb and Cr color component and the U of YUV with the V component.Therefore, describe in detail no longer one by one in embodiments of the present invention.
As another kind of embodiment, to comprising HSI color space with the video image that comprises the HSI color component, processing to I component is identical with the Y component processing of the YUV color space of the embodiment of the invention, handles identical to the processing of H and S color component and the U of YUV with the V component.Therefore, describe in detail no longer one by one in embodiments of the present invention.
Step S200 after a plurality of components of color space for the treatment of the multimedia video image of convergent-divergent dispose respectively, carries out colour space transformation to image, and it is transformed to rgb color space, finishes the convergent-divergent of multimedia video image.
No matter be reduction operation or amplifieroperation, after treating that three color component data dispose respectively, if need not carry out other operation bidirectional at the YUV color space, just can carry out colour space transformation to image, it is transformed to rgb color space, comes display image by display routine then or carry out further other processing.
Conversion from the YUV color space to rgb color space is a kind of prior art, and it is not innovation and creation of the present invention, those skilled in the art are according to content disclosed by the invention, can realize its conversion process, therefore, describe in detail no longer one by one in the present invention.
The Zoom method of a kind of multimedia video image of the present invention has proposed a kind of fast algorithm of bicubic spline interpolation, and quick bicubic spline interpolation algorithm is applied in the video image zooming.The embodiment of the invention has following beneficial effect: (1) has significantly reduced the computation complexity of bicubic spline interpolation, can realize the real-time convergent-divergent of video with the personal computer (PC) of common configuration; (2) can be good at keeping the video image details, have extraordinary zooming effect; (3) algorithm is realized simply not only can realizing with software, also can realize with hardware easily; (4), can obtain good effect for the common video image; During in particular for the relatively poor video of the picture quality under low code check, the network environment situation mal-condition, can obtain the video amplification effect outstanding than additive method.
In conjunction with the drawings to the description of the specific embodiment of the invention, others of the present invention and feature are conspicuous to those skilled in the art.
More than specific embodiments of the invention are described and illustrate it is exemplary that these embodiment should be considered to it, and be not used in and limit the invention, the present invention should make an explanation according to appended claim.

Claims (15)

1. the Zoom method of a multimedia video image is characterized in that, comprises the following steps:
Steps A, multimedia video image is carried out the colour space transformation operation, make multimedia video image satisfy in the color space after conversion, the amount of information of the multimedia video image that three color components comprise is inequality, the information of multimedia video image concentrates on one of them color component, color component to maximum image information of comprising multimedia video image, adopting when amplifying makes color component obtain the complicated interpolation method of better effect, to other color component, adopt simple relatively interpolation method, carry out the convergent-divergent of multimedia video image and handle.
2. the Zoom method of multimedia video image according to claim 1 is characterized in that, also comprises the following steps:
Step B after a plurality of color components of color space for the treatment of the multimedia video image of convergent-divergent dispose respectively, carries out colour space transformation to multimedia video image, and it is transformed to rgb color space, finishes the convergent-divergent of multimedia video image.
3. the Zoom method of multimedia video image according to claim 1 and 2 is characterized in that, in the described steps A, described complicated interpolation method is Spline Interpolation Method or cube convolution method.
4. the Zoom method of multimedia video image according to claim 3 is characterized in that, in the described steps A, described simple relatively interpolation method is bilinear interpolation method or neighbor interpolation method.
5. the Zoom method of multimedia video image according to claim 3 is characterized in that, described Spline Interpolation Method is the bicubic spline interpolation method after bicubic spline interpolation method or the improvement.
6. the Zoom method of multimedia video image according to claim 5 is characterized in that, described color space or be the YUV color space perhaps is the YCrCb color space, perhaps is the HSI color space.
7. the Zoom method of multimedia video image according to claim 1 is characterized in that, described steps A also comprises the following steps:
Steps A 1, treat the multimedia video image of convergent-divergent, in the YUV color space, adopt bilinear interpolation method that U, V component are carried out processing and amplifying, adopt Spline Interpolation Method the Y component to be handled the multimedia video image that obtains amplifying multimedia video image.
8. the Zoom method of multimedia video image according to claim 7 is characterized in that, described steps A 1 comprises the following steps:
Steps A 11 to multimedia video image, adopts bilinear interpolation method or neighbor interpolation method to carry out processing and amplifying at the YUV color space to the U of multimedia video image, V component;
Steps A 12 to multimedia video image, adopts Spline Interpolation Method or cube convolution interpolation method to carry out processing and amplifying at the YUV color space to the Y component of multimedia video image.
9. the Zoom method of multimedia video image according to claim 8 is characterized in that, in the described steps A 12, described Spline Interpolation Method is the bicubic spline interpolation method, comprises the following steps:
Steps A 121 is for the pixel (x in the target multimedia video image 1, y 1), by contrary geometric transformation:
x 0 &OverBar; = x 1 / M y 0 &OverBar; = y 1 / M ;
Obtain the position coordinates of pixel mapping in the former multimedia video image in the target multimedia video image
Figure FSB00000584740400022
Wherein, M when carrying out processing and amplifying, amplification multiple,
Figure FSB00000584740400023
Through rounding the coordinate (x after obtaining rounding downwards 0, y 0), that is:
Steps A 122 is calculated the position coordinates of pixel mapping in the former multimedia video image in the target multimedia video image
Figure FSB00000584740400025
With round after coordinate (x 0, y 0) between difference be:
u = x &OverBar; 0 - x 0 v = y &OverBar; 0 - y 0 ;
Steps A 123, with u, the value substitution interpolation kernel function S (x) of v draws:
A &RightArrow; = S ( u + 1 ) S ( u ) S ( u - 1 ) S ( u - 2 )
C &RightArrow; = S ( v + 1 ) S ( v ) S ( v - 1 ) S ( v - 2 ) ;
Steps A 124 reads the pixel (x of former multimedia video image 0, y 0) all around 4 * 4 pixel, constitute matrix:
B &RightArrow; ( x 0 , y 0 ) = f ( x 0 - 1 , y 0 - 1 ) f ( x 0 - 1 , y 0 ) f ( x 0 - 1 , y 0 + 1 ) f ( x 0 - 1 , y 0 + 2 ) f ( x 0 , y 0 - 1 ) f ( x 0 , y 0 ) f ( x 0 , y 0 + 1 ) f ( x 0 , y 0 + 2 ) f ( x 0 + 1 , y 0 - 1 ) f ( x 0 + 1 , y 0 ) f ( x 0 + 1 , y 0 + 1 ) f ( x 0 + 1 , y 0 + 2 ) f ( x 0 + 2 , y 0 - 1 ) f ( x 0 + 2 , y 0 ) f ( x 0 + 2 , y 0 + 1 ) f ( x 0 + 2 , y 0 + 2 ) ;
Steps A 125, according to interpolation formula:
Figure FSB00000584740400032
Calculate the pixel value of target multimedia video image;
Steps A 126, all pixels in the whole target multimedia video image are scanned in repeating step A121~125, finish the bicubic spline interpolation of whole multimedia video image, the multimedia video image that obtains amplifying.
10. the Zoom method of multimedia video image according to claim 8 is characterized in that, in the described steps A 12, described Spline Interpolation Method is improved bicubic spline interpolation method, comprises the following steps:
Steps A 121 ', according to multiplication factor, the interpolation kernel functional value that calculating may be used;
Steps A 122 ' with the value integer of interpolation kernel function, and becomes 2 power, saves as S_int 2(x) value;
Steps A 123 ' is got a subimage block that is of a size of M*M of target multimedia video image;
Steps A 124 ', calculate each pixel correspondence in the subimage block difference (u, v) and S_int 2(x) value;
Steps A 125 ' confirms whether subimage block is arranged in target multimedia video image Far Left, if, then read pixel in the pairing multimedia video image of subimage block (k, l) 4 * 4 the matrix that pixel constituted all around,
B &RightArrow; ( k , l ) = f ( k , l ) f ( k , l + 1 ) f ( k , l + 2 ) f ( k , l + 3 ) f ( k + 1 , l ) f ( k + 1 , l + 1 ) f ( k + 1 , l + 2 ) f ( k + 1 , l + 3 ) f ( k + 2 , l ) f ( k + 2 , l + 1 ) f ( k + 2 , l + 2 ) f ( k + 2 , l + 3 ) f ( k + 3 , l ) f ( k + 3 , l + 1 ) f ( k + 3 , l + 2 ) f ( k + 3 , l + 3 ) ;
Steps A 126 ' is taken out a pixel in the target multimedia video image subimage block, obtains corresponding S_int 2(x) value;
Steps A 127 ', for the subimage block correspondence
Figure FSB00000584740400034
And difference (u, v) substitution bicubic spline interpolating matrix formula calculates, and moves to right 20 with calculating the result who obtains, and obtains target multimedia video image pixel value;
Steps A 128 ' confirms whether handle all pixels in the current subimage block;
Steps A 129 ' confirms whether to handle all subimage blocks in the target multimedia video image.
11. the Zoom method of multimedia video image according to claim 10 is characterized in that, described steps A 125 ' comprises the following steps:
Steps A 1251 ' if subimage block is to be arranged in target multimedia video image Far Left, then reads the subimage block B of M*M from former multimedia video image;
Steps A 1252 ', if subimage block is not to be arranged in target multimedia video image Far Left, then reading M pixel of row and last the right three of calculating the subimage block B ' of the M*M that uses from former multimedia video image is listed as and constitutes new subimage block B together.
12. the Zoom method of multimedia video image according to claim 10 is characterized in that, described steps A 128 ' also further comprises the following steps:
Steps A 1281 ' if handled all pixels in the current subimage block, then continues steps A 129 ';
Steps A 1282 ' if do not handle all pixels in the current subimage block, is then returned steps A 126 '.
13. the Zoom method of multimedia video image according to claim 10 is characterized in that, described steps A 129 ' also further comprises the following steps:
Steps A 1291 ' if handled all pixels in the current subimage block, then finishes amplifieroperation;
Steps A 1292 ' if do not handle all pixels in the current subimage block, is then returned steps A 123 '.
14. the Zoom method of multimedia video image according to claim 7 is characterized in that, described steps A also comprises the following steps:
Steps A 2 is treated the multimedia video image of convergent-divergent, at three color components of YUV color space to video data, adopts bilinear interpolation method or neighbor interpolation method to dwindle processing respectively.
15. according to Claim 8 or the Zoom method of 14 described multimedia video images, it is characterized in that, when described bilinear interpolation method is handled, comprise the following steps:
Steps A 21, for the pixel in the target multimedia video image, obtain the position coordinates of pixel mapping in the former multimedia video image in the target multimedia video image by contrary geometric transformation, position coordinates is through rounding the coordinate that obtains after the round numbers downwards;
Steps A 22, calculate pixel mapping in the target multimedia video image in the former multimedia video image position coordinates and round after coordinate between difference;
Steps A 23 is utilized bilinear interpolation method, calculates the pixel value of target multimedia video image;
Steps A 24 judges whether to finish the scanning of the pixel of whole multimedia video image, if do not finish, then gets back to steps A 21, begins to handle next pixel; If finish, then the interpolation of whole multimedia video image finishes, and finishes computing.
CN2007101781889A 2007-11-27 2007-11-27 Zoom method of multimedia video image Expired - Fee Related CN101163252B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2007101781889A CN101163252B (en) 2007-11-27 2007-11-27 Zoom method of multimedia video image

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2007101781889A CN101163252B (en) 2007-11-27 2007-11-27 Zoom method of multimedia video image

Publications (2)

Publication Number Publication Date
CN101163252A CN101163252A (en) 2008-04-16
CN101163252B true CN101163252B (en) 2011-10-26

Family

ID=39298060

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2007101781889A Expired - Fee Related CN101163252B (en) 2007-11-27 2007-11-27 Zoom method of multimedia video image

Country Status (1)

Country Link
CN (1) CN101163252B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103236035A (en) * 2013-03-28 2013-08-07 浙江大学 Image magnification algorithm on basis of zero-offset bilateral quadratic B-spline interpolation

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102567948B (en) * 2010-12-27 2014-10-29 北大方正集团有限公司 Method and device for processing pixel color
CN102508851A (en) * 2011-09-27 2012-06-20 深圳市五巨科技有限公司 Image upload processing method and image upload processing system
CN103905807A (en) * 2012-12-27 2014-07-02 深圳市快播科技有限公司 Method and device for converting two-dimension video into three-dimension video
EP3114835B1 (en) 2014-03-04 2020-04-22 Microsoft Technology Licensing, LLC Encoding strategies for adaptive switching of color spaces
US10171833B2 (en) 2014-03-04 2019-01-01 Microsoft Technology Licensing, Llc Adaptive switching of color spaces, color sampling rates and/or bit depths
JP6367359B2 (en) * 2014-03-27 2018-08-01 マイクロソフト テクノロジー ライセンシング,エルエルシー Quantization / scaling and inverse quantization / scaling adjustments when switching color spaces
US10687069B2 (en) 2014-10-08 2020-06-16 Microsoft Technology Licensing, Llc Adjustments to encoding and decoding when switching color spaces
CN104574277A (en) * 2015-01-30 2015-04-29 京东方科技集团股份有限公司 Image interpolation method and image interpolation device
CN106373090B (en) * 2016-08-31 2019-11-15 广州视睿电子科技有限公司 Image processing method and device
CN107135382A (en) * 2017-03-02 2017-09-05 广东美电贝尔科技集团股份有限公司 A kind of quick Zoom method of image based on YUV signal processing
CN107197291B (en) * 2017-05-25 2020-02-14 厦门大学 Low-complexity direct-calculation cubic convolution spline interpolation method
CN108184090B (en) * 2017-12-07 2020-09-22 中国航空工业集团公司西安航空计算技术研究所 Automatic conversion method for multi-resolution VESA video of CMOS camera to BT1120 protocol video
CN108833872B (en) * 2018-05-28 2020-09-22 北京文香信息技术有限公司 Method for quickly zooming or amplifying YUY2 color space
CN109218737A (en) * 2018-09-19 2019-01-15 厦门理工学院 A kind of lossy compression of video data, decompression method and device
CN111510692B (en) * 2020-04-23 2022-01-18 Oppo广东移动通信有限公司 Image processing method, terminal and computer readable storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1622134A (en) * 2005-01-11 2005-06-01 北京中星微电子有限公司 Image conversion method capable of realizing zooming
CN1667650A (en) * 2005-04-08 2005-09-14 杭州国芯科技有限公司 Image zooming method based on edge detection
CN1964463A (en) * 2005-11-08 2007-05-16 逐点半导体(上海)有限公司 An adaptive interpolation method and device to maintain image resolution
CN101052990A (en) * 2004-05-12 2007-10-10 三洋电机株式会社 Image enlarging device and program

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101052990A (en) * 2004-05-12 2007-10-10 三洋电机株式会社 Image enlarging device and program
CN1622134A (en) * 2005-01-11 2005-06-01 北京中星微电子有限公司 Image conversion method capable of realizing zooming
CN1667650A (en) * 2005-04-08 2005-09-14 杭州国芯科技有限公司 Image zooming method based on edge detection
CN1964463A (en) * 2005-11-08 2007-05-16 逐点半导体(上海)有限公司 An adaptive interpolation method and device to maintain image resolution

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103236035A (en) * 2013-03-28 2013-08-07 浙江大学 Image magnification algorithm on basis of zero-offset bilateral quadratic B-spline interpolation
CN103236035B (en) * 2013-03-28 2015-12-02 浙江大学 Based on the image magnification method without the bilateral quadratic B-spline interpolation of skew

Also Published As

Publication number Publication date
CN101163252A (en) 2008-04-16

Similar Documents

Publication Publication Date Title
CN101163252B (en) Zoom method of multimedia video image
KR101137753B1 (en) Methods for fast and memory efficient implementation of transforms
TWI771679B (en) Block-based prediction
US7149355B2 (en) Image processing apparatus, image processing method, image processing program, and computer-readable record medium storing image processing program
Malik et al. Image interpolation based high capacity reversible data hiding scheme
Yu et al. Multi-level video frame interpolation: Exploiting the interaction among different levels
CN106170093B (en) Intra-frame prediction performance improving coding method
JP2008503192A (en) Image cleanup and precoding
JP5174238B2 (en) Image / video quality improvement and super-resolution using sparse transform
Guo et al. Joint denoising and demosaicking with green channel prior for real-world burst images
Kumar et al. A reversible high capacity data hiding scheme using pixel value adjusting feature
CN101765011B (en) Method and device for scaling motion estimation
CN113301347A (en) Optimization method of HEVC high-definition video coding
Kamble et al. Modified three-step search block matching motion estimation and weighted finite automata based fractal video compression
US7274825B1 (en) Image matching using pixel-depth reduction before image comparison
CN116542889A (en) Panoramic video enhancement method with stable view point
JP3426092B2 (en) Motion compensated inter-frame prediction method in video coding device
Hu et al. Deep inter prediction with error-corrected auto-regressive network for video coding
Miyata et al. Novel inverse colorization for image compression
US7389005B2 (en) Interpolation of video and audio digital data
JP4709074B2 (en) Moving picture encoding method, apparatus, program thereof, and recording medium recording the program
US7203378B2 (en) Accelerative noise filtering method for image data
Zheng et al. A novel gray image representation using overlapping rectangular NAM and extended shading approach
Xie et al. A Turtle Shell based RDH scheme with two-dimensional histogram shifting
CN110766117B (en) Two-dimensional code generation method and system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
C53 Correction of patent for invention or patent application
CB03 Change of inventor or designer information

Inventor after: Wang Guohui

Inventor after: Wei Zheng

Inventor after: Wang Zhensong

Inventor before: Wang Guohui

Inventor before: Wei Zheng

Inventor before: Wang Zhensong

ASS Succession or assignment of patent right

Owner name: XINJIANG MEITE INTELLIGENT SAFETY ENGINEERING CO.,

Free format text: FORMER OWNER: INSTITUTE OF COMPUTING TECHNOLOGY, CHINESE ACADEMY OF SCIENCES

Effective date: 20121212

C41 Transfer of patent application or patent right or utility model
COR Change of bibliographic data

Free format text: CORRECT: ADDRESS; FROM: 100080 HAIDIAN, BEIJING TO: 830011 URUMQI, XINJIANG UYGUR AUTONOMOUS REGION

TR01 Transfer of patent right

Effective date of registration: 20121212

Address after: 2909, room 830011, B, Pacific Plaza, 217 Gaoxin street, Urumqi hi tech Zone, the Xinjiang Uygur Autonomous Region

Patentee after: Xinjiang Meite Intelligent Security Engineering Co., Ltd.

Address before: 100080 Haidian District, Zhongguancun Academy of Sciences, South Road, No. 6, No.

Patentee before: Institute of Computing Technology, Chinese Academy of Sciences

CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20111026

Termination date: 20181127

CF01 Termination of patent right due to non-payment of annual fee