Detailed description of the invention
The embodiment of the present invention have employed for the current macro in present frame, determines the search window of correspondence in reference frame,
Object matching block is searched in be matched piece of search window;If during search object matching block, searching part data bit
Outside described search window to be matched piece, then the position of to be matched piece be positioned at outside search window according to part data determines the grandest
The method of the position of the search window that next macro block of block is corresponding.Search window can be made in this way according to video data owing to adopting
Slide to all directions, thus improve the sequence of video images containing bigger motion and search the general of object matching block
Rate, and improve the compression ratio of sequence of video images containing bigger motion.
In the embodiment of the present invention, object matching block refers to that in present frame, current macro is in the range of the search window of reference frame, searches
To be matched piece of the matched error minimum that rope arrives, the object matching block that namely current macro of present frame is corresponding.
Below in conjunction with Figure of description, the embodiment of the present invention is described in further detail.
As shown in Figure 4, in the embodiment of the present invention, the sliding method of a kind of search window comprises the following steps:
Step 401: for the current macro in present frame, determine the search window of correspondence in reference frame, at search window
To be matched piece is searched for object matching block;
Step 402: if during search object matching block, search that part data are positioned at outside described search window treats
Join block, then the position of to be matched piece be positioned at outside search window according to part data determines corresponding the searching of next macro block of current macro
The position of rope window;
Step 403: after the object matching block search of current macro completes, according to the position of search window corresponding to next macro block
Put, the search window of current macro is carried out slip process, obtains the search window that next macro block is corresponding.
It is preferred that step 401 specifically includes: the initial match block searched in the range of determining search window, if search window scope
To be matched piece of interior not coupling, then using to be matched piece of search window central authorities as initial match block, then according to certain searches
Rope strategy searches for the object matching block of current macro in the range of the search window that current macro is corresponding;
If in the range of search window may the number of to be matched piece no less than one, then will mate mistake with current macro
Difference minimum to be matched piece is as initial match block, then according to certain search strategy is at search window model corresponding to current macro
Enclose the object matching block of interior search current macro.
It is preferred that search strategy can use different searching algorithms, searching algorithm can include but not limited to: rhombus is searched
Rope algorithm, hexagon search algorithm, three-step approach, new triple step search, the searching algorithm such as four step rule.
As a example by diamond search algorithm, as it is shown in figure 5, determine the object matching block of current macro for the embodiment of the present invention
Method.
In figure, solid line region is the scope of the search window of current macro, if to be matched piece 1 is initial match block, with to be matched
The hunting zone that to be matched piece is searching algorithm of 4 labellings of surrounding centered by block 1, by be matched piece 1 and 4 labellings of surrounding
To be matched piece compare with current macro respectively, find out and current macro matching error is minimum to be matched piece;If treating
Joining block 1 is minimum to be matched piece of matching error, then it is assumed that to be matched piece 1 is the object matching block of current macro.
If to be matched piece that one of them to be matched piece of to be matched piece of 4 labellings of surrounding is error minimum, then should
To be matched piece, as center, and is repeated the search procedure of to be matched piece 1;Be labeled as to be matched piece of 2 above to be matched piece 1
As a example by be matched piece of the matching error minimum in this hunting zone, using to be matched piece 2 center as next hunting zone,
To be matched piece of to be matched piece 2 and 4 labellings about is compared with current macro respectively, finds out and current macro
To be matched piece of matching error minimum, if as to be matched piece that to be matched piece 2 is matching error minimum of search center, then recognizing
For the object matching block that to be matched piece 2 is current macro, and terminate search;If 4 labellings around to be matched piece 2 is to be matched
To be matched piece of one of them of block is to be matched piece that error is minimum, then using minimum for this matching error to be matched piece as search
Center continues search for be matched piece that matching error is minimum, until to be matched piece as search center is that current macro coupling is missed
When differing from minimum to be matched piece, terminate search, and using to be matched piece of this search center object matching block as current macro.
It is preferred that step 402 specifically includes: judge in the search procedure of the object matching block of current macro, if search
The match block that rope is positioned at outside search window to part data;If it did not, search window level corresponding to next macro block slides to the right one
Individual macro block;If it has, the position of the match block being positioned at outside search window according to the part data searched determines that next macro block is corresponding
The position of search window;
If next macro block is first row macro block, it is judged that whether this is positioned at around the macro block of first row has inter prediction grand
According to the predicted motion vector of inter prediction macro block, block, if it has, then determine that this is positioned at the search window that the macro block of first row is corresponding
Position;Otherwise, it is judged that this is positioned at the inter prediction in some or all of region of a upper macro-block line of macro block of first row
Whether the quantity of macro block is more than the threshold value of the quantity of the inter prediction macro block set, if being more than, is then positioned at first row according to this
The average motion vector of all or part of inter prediction macro block of a upper macro-block line of macro block determines that this is positioned at first row
The position of the search window that macro block is corresponding;If being not more than, then it is assumed that this is positioned at the part of a upper macro-block line of macro block of first row
Or the average motion vector of whole inter prediction macro blocks is 0, the center of the macro block that this is positioned at first row is positioned at as this
The center of the search window that the macro block of string is corresponding.
Wherein, inter prediction refers to it is not the decoding image according to current, but obtain from decoded reference picture
Predictive value.Inter prediction macro block refers to the macro block obtained by inter-frame prediction method.
The center of macro block refers to the pixel of the center pixel row of this macro block and the lap of the center pixel row of this macro block.
It is preferred that according to n-th search part data be positioned to be matched piece outside described search window horizontal direction and/
Or search part data for the M time and be positioned at the position of outside described search window vertical direction to be matched piece and determine next macro block pair
The position of the search window answered;Or the position of to be matched piece be positioned at outside search window according to the part data searched for the L time determines
The position of the search window that next macro block is corresponding;Wherein, M, N, L are positive integer.
The position of the part data searched with above-mentioned diamond search algorithm below to be matched piece of X+1 outside search window is
Example, illustrates the method that the embodiment of the present invention determines the position of the search window of next macro block, as shown in Figure 6, for searching for according to n-th
Outside being positioned at search window vertical direction to part data to be matched piece determines the position of the search window that next macro block is corresponding, it is assumed that
N is 1, and in figure, bold portion is the search window of current macro, dotted portion be next macro block according to part data outside search window
The corresponding search window that determines of the position of to be matched piece of X+1:
During the object matching block search of current macro, read what next macro block correspondence search window level was slided to the right
The reference data of one macro block row;The object matching block of current macro has been searched for complete, and to be matched piece of X+1 is the mesh of current macro
Mark to be matched piece outside search window vertical direction of the part data searched for the first time in the search procedure of match block, read
The pixel that the position vertical sliding motion of be positioned at outside search window vertical direction to be matched piece of the part data searched for the first time sets
The data of row, the search window of next macro block first level of fixing moves right macro block row, then moves s_dy to vertical direction
Individual pixel column.
Wherein, s_dy is integer.S_dy is the vertical direction step-length that search window slides, and can set numerical value as required, relatively
Good can select 8 pixels, 12 pixels or 16 pixels.S_dy is that positive integer represents vertical downward sliding movement, and 0 for vertically not slide
Dynamic, negative integer represents slides vertically upward.
As it is shown in fig. 7, for true according to searching to be matched piece that part data are positioned at outside search window horizontal direction for the M time
Fixing the position of search window corresponding to a macro block, it is assumed that M is 2, in figure, bold portion is the search window of current macro, dotted portion
The corresponding search window determined according to the position of the part data to be matched piece of Y+1 outside search window for next macro block:
During the object matching block search of current macro, read what next macro block correspondence search window level was slided to the right
The reference data of one macro block row;The object matching block of current macro has been searched for complete, and to be matched piece of Y+1 is the mesh of current macro
Mark to be matched piece outside search window horizontal direction of the part data searched for the second time in the search procedure of match block, read
The position level of be positioned at outside search window horizontal direction to be matched piece of the part data that search of second time is slided the pixel set
The data of row, the search window of next macro block first level of fixing moves right after macro block row, then moves s_dx to horizontal direction
Individual pixel column.
Wherein, s_dx is integer.S_dx is the horizontal direction step-length that search window slides, and can set numerical value as required, relatively
Good can select 8 pixels, 12 pixels or 16 pixels.S_dx is that positive integer expression level is slided to the right, and 0 does not slides for level
Dynamic, negative integer represents that level is slided to the left
As shown in Figure 8, it is positioned to be matched piece outside search window vertical direction really for searching part data according to n-th
Fix the position of search window corresponding to a macro block and search part data for the M time and be positioned at treating outside search window horizontal direction
Joining the position of the search window that block determines that next macro block is corresponding, it is assumed that N is 2, M is 1;In figure, bold portion is the search of current macro
Window, dotted portion is next macro block to exist according to the part data to be matched piece of Z+2 outside search window horizontal direction and part data
The corresponding search window that the position of to be matched piece of T+1 outside search window vertical direction determines:
During the object matching block search of current macro, read what next macro block correspondence search window level was slided to the right
The reference data of one macro block row;The object matching block of current macro has been searched for complete, and to be matched piece of Z+2 is the mesh of current macro
Outside search window horizontal direction to be matched piece of the part data searched for the first time in the search procedure of mark match block, treats
Join the part data searched for the second time in the search procedure of the object matching block that block T+1 is current macro at search window Vertical Square
Outside to be matched piece, reads the position of to be matched piece that the part data searched for the first time are positioned at outside search window horizontal direction
Put the data of the pixel column that level slip sets, and the part data that reading second time searches are positioned at search window vertical direction
The data of the pixel column that the position vertical sliding motion of outer to be matched piece sets, the search window of next macro block first level of fixing moves right
After dynamic macro block row, move s_dx pixel column to horizontal direction, then move s_dy pixel column to vertical direction, then read
Take off the reference data of the search window of a macro block and the misaligned part of search window of current macro.Wherein, the search of next macro block
Window can also first the level of fixing move right after macro block row, moves s_dy pixel column to vertical direction, then to level side
To mobile s_dx pixel column.
Wherein, s_dx, s_dy are integers.S_dx is the horizontal direction step-length that search window slides, and can set number as required
Value, preferably can select 8 pixels, 12 pixels or 16 pixels, and s_dy is the vertical direction step-length that search window slides, can basis
Need to set numerical value, preferably can select 8 pixels, 12 pixels or 16 pixels.S_dx is that positive integer expression level is slided to the right
Dynamic, 0 does not slides for level, and negative integer represents that level is slided to the left;S_dy is that positive integer represents vertical downward sliding movement, and 0 is vertical
Not sliding, negative integer represents slides vertically upward.
Wherein, it is also possible to the position of to be matched piece be positioned at outside search window according to the part data searched for the L time determines
The position of the search window that next macro block is corresponding, during the object matching block search of current macro, reads next macro block corresponding
The reference data of the macro block row that search window level is slided to the right;The object matching block of current macro has been searched for complete, treats
Join the part data searched for the L time in the search procedure of the object matching block that block S+1 is current macro outside search window
To be matched piece, reading to be matched piece of S+1 place pixel column or the data of pixel column, the search window of next macro block fixes level to the right
After mobile macro block row, then move s_dn pixel column or pixel column to be matched piece of S+1 place pixel column or pixel column.
Wherein, s_dn is integer.S_dn is that search window is according to be matched piece of horizontal direction outside search window or Vertical Square
To step-length, numerical value can be set as required, preferably can select 8 pixels, 12 pixels or 16 pixels.S_dn is positive integer table
Showing that level is slided to the right or vertically upward, 0 does not slides for level, and negative integer represents that level is to the left or vertical downward sliding movement.
In force, in step 402, if search object matching block during, search part data be positioned at described in search
Rope outside window to be matched piece, also includes:
During judging search object matching block, whether the number of times that search window slides is more than the threshold value set;If it is little
In the threshold value set, then next of the current macro that the position of to be matched piece be positioned at outside search window according to part data determines is grand
The position of the search window that block is corresponding;
If the number of times that search window slides is more than the threshold value set, determine the search window that next macro block of current macro is corresponding
Position is that search window level corresponding to current macro is slided to the right the position of a macro block.
It is preferred that in step 402, if next macro block of current macro is in the first row of macro-block line, then under basis
Row method determines the search window of next macro block of current macro:
The position of judge that search window is positioned at outside search window according to part data to be matched piece determines that next macro block is corresponding
The threshold value whether the slip number of times of the position of search window is more than;If greater than the threshold value set, then this is positioned at the grand of first row
The center of block is positioned at the center of search window corresponding to the macro block of first row as this;If being not more than the threshold value set, then basis
Inter prediction macro block whether is had to determine the position of search window around the macro block of first row.
If during first macro block of first macro-block line that next macro block is present frame of current macro, under current macro
Do not have inter prediction macro block around one macro block, can directly set the search window centre of current macro and the center of current macro
Overlapping.
If next macro block of current macro is first row macro block, and there is inter prediction macro block about, then pre-according to interframe
The predicted motion vector surveying macro block determines that this is positioned at the position of search window corresponding to the macro block of first row:
s_ox=((mvp_x+(s_dx*2)*(mvp_x>=0?1:-1))/(s_dx*4))*s_dx;
s_oy=((mvp_y+(s_dy*2)*(mvp_y>=0?1:-1))/(s_dy*4))*s_dy;
Wherein, s_ox is the deviant of search window centre and the x direction at current macro center;S_oy be search window centre with
The deviant in the y direction at current macro center, the digit of s_ox Yu s_oy is whole pixel;
Mvp_x is the horizontal motion vector that prediction obtains;Mvp_y is the vertical motion vector that obtains of prediction, mvp_x and
The digit of mvp_y is 1/4 pixel;
If the surrounding of this first row macro block does not has inter prediction macro block, then judge the some or all of district of a upper macro-block line
Whether the quantity of the inter prediction macro block in territory is more than the threshold value of the quantity of the inter prediction macro block set, if more than, according to this position
In the average motion vector of all or part of inter prediction macro block of a upper macro-block line of the macro block of first row, determine this position
Position in search window corresponding to the macro block of first row;If being not more than, then this is positioned at the center of macro block of first row as this
It is positioned at the center of search window corresponding to the macro block of first row.Inter prediction macro block partly or completely according to a upper macro-block line
The method of average motion vector mv position that search window is set as follows:
s_ox=((mvAveragely_x+(s_dx*2)*(mvAveragely_x>=0?1:-1))/(s_dx*4))*s_dx;
s_oy=((mvAveragely_y+(s_dy*2)*(mvAveragely_y>=0?1:-1))/(s_dy*4))*s_dy;
Wherein, s_ox is the deviant of search window centre and the x direction at current macro center;S_oy be search window centre with
The deviant in the y direction at current macro center, the digit of s_ox Yu s_oy is whole pixel;
mvAveragely_ x is the horizontal average motion vector of a upper macro-block line some or all of inter prediction macro block, mvAveragely_ y is
The vertical average motion vector of a upper macro-block line some or all of inter prediction macro block, their digit is 1/4 pixel,
If there is no inter prediction macro block or a upper some or all of region of macro-block line in a upper some or all of region of macro-block line
In the quantity of inter prediction macro block less than the threshold value of quantity of the inter prediction macro block set, then it is assumed that mvAveragely_ x, mvAveragely_y
It is 0.
It is also preferred that the left after search that part data are positioned at outside search window to be matched piece, suspend the target of this macro block
Join the search procedure of block, the pixel column of the part data in be matched piece determining that part data are positioned at outside search window and/or picture
Element row, read the pixel column described in determining and/or pixel column in the search window that next macro block is corresponding, then proceed to this macro block
The search procedure of object matching block;
Or determine, in the position of to be matched piece be positioned at outside search window according to part data, the search that next macro block is corresponding
After the position of window, the pixel column of the part data in be matched piece determining that described part data are positioned at outside search window and/or
Pixel column;The pixel column described in determining and/or pixel column is read in the search window that next macro block is corresponding.
As it is shown in figure 9, be the concrete search of the object matching block of current macro:
Step 901: judge in the range of search window may the number of to be matched piece whether more than 0, if greater than 0,
Perform step 902, otherwise perform step 903;
Step 902: from may to be matched piece find and current macro matching error is minimum to be matched piece, will
This to be matched piece initial match block as search, performs step 904;
Step 903: using to be matched piece of the search window centre initial match block as search, performs step 904;
Step 904: search for the object matching block of current macro according to certain search strategy in search window, records
One second part data exceed the information of to be matched piece of search window scope.
It is preferred that in step 904, in search procedure, object matching block does not include that part data are beyond search window scope
To be matched piece, if repeatedly searching part data beyond to be matched piece of search window scope, record can be set as required
Any one second part data exceed the position of to be matched piece of search window scope.Set record the most once portion the most as required
Divided data includes but not limited to following manner beyond the position of to be matched piece of search window scope: record any one second part data
It is positioned at the position of outside search window horizontal direction to be matched piece, or records any one second part data and be positioned at search window Vertical Square
The position of to be matched piece outside to, or record to be matched piece outside any one second part data are positioned at search window horizontal direction
Position and any one second part data be positioned at the position of outside search window vertical direction to be matched piece.
Wherein, step 904 can also include: searches for current macro in the range of search window according to certain search strategy
Object matching block, object matching block does not include that part data exceed to be matched piece of search window scope.If in search procedure,
Repeatedly search part data and exceed to be matched piece of search window scope, record part data for the first time and exceed search window model
The information of to be matched piece enclosed, and reading part divided data is beyond the relevant information of to be matched piece of search window scope.
Shown in Figure 10, when being first row macro block for next macro block of current macro, determine the position of the search window of next macro block
The concrete steps put:
Step 1001: judge that the position of to be matched piece be positioned at outside search window according to part data determines that next macro block is corresponding
The slip number of times of position of search window whether more than the threshold value set, if it is greater, then perform step 1002, otherwise perform step
Rapid 1003;
Step 1002: this is positioned at the macro block of first row, the center of to be matched piece of same position in reference frame, as
The center of search window of next macro block, and process ends;
Step 1003: judge whether to have around next macro block inter prediction macro block, if it has, perform step 1004;Otherwise
Perform step 1005;
Step 1004: determine that this is positioned at corresponding the searching of the macro block of first row according to the predicted motion vector of inter prediction macro block
The position of rope window, and process ends;
Step 1005: judge that this is positioned at the interframe in the some or all of region of a upper macro-block line of the macro block of first row
Whether the quantity of predicted macroblock is more than the threshold value of the quantity of the inter prediction macro block set, if it is greater, then perform step 1006,
Otherwise, step 1002 is performed;
Step 1006: the some or all of inter prediction of a upper macro-block line according to this macro block being positioned at first row is grand
The average motion vector of block determines that this is positioned at the position of search window corresponding to the macro block of first row, and process ends.
As shown in figure 11, the embodiment of the present invention judges that search window sliding method specifically includes the following step:
Step 1101: judge current macro in the range of search window may the number of to be matched piece whether be more than
0;If greater than 0, perform step 1102;Otherwise perform step 1103;
Step 1102: may to be matched piece in find the match block most like with current macro as initial
Join block, then perform step 1104;
Step 1103: using to be matched piece of search window central authorities as initial match block, then perform step 1104;
Step 1104: search for current macro in the range of the search window that current macro is corresponding according to certain search strategy
Object matching block, then performs step 1105;
Step 1105: judge that whether current macro is last macro block of current macro row, if it is not, perform step
1106, otherwise perform step 1107;
Step 1106: judge in the search procedure of object matching block of current macro, if having part data at search window
Outer to be matched piece, if there being execution step 1108, otherwise performs step 1109;
Step 1107: according to the position of the match block that the part data searched are positioned at outside search window, judgement determines that next is grand
The threshold value whether number of times of the position of the search window that block is corresponding is more than;If it does, perform step 1111, otherwise perform step
1112;
Step 1108: judge that the position of to be matched piece be positioned at outside search window according to part data determines that next macro block is corresponding
The threshold value that whether is more than of the slip number of times of position of search window;If it does, perform step 1109, otherwise perform step
1110;
Step 1109: the search window level of fixing of current macro moves right macro block row, obtains next macro block corresponding
Search window, and process ends;
Step 1110: the position of the match block being positioned at outside search window according to the part data searched determines next macro block pair
The position of the search window answered, and process ends;
Step 1111: using to be matched piece identical with next macro block position of current macro in reference frame as next
The center of the search window of macro block, and process ends;
Step 1112: judge whether to have around next macro block inter prediction macro block, if it has, perform step 1113, otherwise
Perform step 1114;
Step 1113: determine the position of search window that next macro block is corresponding according to the predicted motion vector of inter prediction macro block
Put, and process ends;
Step 1114: judge that this is positioned at the interframe in the some or all of region of a upper macro-block line of the macro block of first row
Whether the quantity of predicted macroblock is more than the threshold value of the quantity of the inter prediction macro block set, if it does, perform step 1115, no
Then, step 1111 is performed;
Step 1115: under determining according to the average motion vector of the some or all of inter prediction macro block of current macro row
The position of the search window that one macro block is corresponding, and process ends.
It is preferred that during such as first macro block of first macro-block line that current macro is present frame, around current macro not
There will be inter prediction macro block, the position of the search window of current macro can be according to not having inter prediction macro block around current macro
Method determines, it is possible to directly set center and the current macro of search window of current macro the treating of same position in reference frame
The center joining block is overlapping.
It is preferred that in step 1107 and step 1109, the setting of threshold value, can be according to the content of sequence of video images and regard
Frequently encoder performance is set, if the sequence of video images containing frequently motion, threshold value can set relatively big, if quiet
Only or the less sequence of video images that moves, threshold value can set smaller;If video encoder performance is stronger, then threshold value
Can set relatively big, otherwise can set smaller.
As shown in figure 12, for the sliding method of embodiment of the present invention another kind search window, the method includes:
Step 1201: for the current macro in present frame, determine the search window of correspondence in reference frame, at search window
To be matched piece is searched for object matching block;
Step 1202: if during search object matching block, searching part data and be positioned at treating outside described search window
Match block, then the search window of described current macro is slided by the position of to be matched piece be positioned at outside search window according to part data
Dynamic process, and continue search for object matching block based on the search window obtained after sliding;
Step 1203: after the object matching block search of current macro completes, the search window obtained after sliding carries out solid
Fixed slip, obtains the search window of next macro block of current macro.
It is preferred that step 1201 specifically includes: the initial match block searched in the range of determining search window, if search window scope
To be matched piece of interior not coupling, then using to be matched piece of search window central authorities as initial match block, then according to certain searches
Rope strategy searches for the object matching block of current macro in the range of the search window that current macro is corresponding;
If in the range of search window may the number of to be matched piece no less than one, then will mate mistake with current macro
Difference minimum to be matched piece is as initial match block, then according to certain search strategy is at search window model corresponding to current macro
Enclose the object matching block of interior search current macro.
It is preferred that search strategy can use different searching algorithms, searching algorithm can include but not limited to: rhombus is searched
Rope algorithm, hexagon search algorithm, three-step approach, new triple step search, the searching algorithm such as four step rule.Concrete searching algorithm as it is shown in figure 5,
Do not repeat them here.
It is preferred that step 1202 specifically includes: judge in the search procedure of the object matching block of current macro, if search
The match block that rope is positioned at outside search window to part data;Without searching the match block that part data are positioned at outside search window,
After searching the object matching block of current macro, search window level is slided to the right the macro block search window as next macro block
Position;
If searching the match block that part data are positioned at outside search window, then it is positioned at search according to the part data searched
The position of to be matched piece outside window makes the search window of current macro slide, and based on the window search current macro after sliding
Object matching block, the position of search window when then searching object matching block according to current macro, level slides to the right one
Macro block arranges the position of the search window as next macro block.
If next macro block of current macro is first row macro block, the method for determining position of the search window of next macro block
For: judge this is positioned at around the macro block of first row whether have inter prediction macro block, if it has, then pre-according to inter prediction macro block
Survey motion vector and determine that this is positioned at the position of search window corresponding to the macro block of first row;Otherwise, it is judged that this is positioned at the grand of first row
Whether the quantity of the inter prediction macro block in the some or all of region of a upper macro-block line of block is more than the inter prediction set
The threshold value of the quantity of macro block, if being more than, is then positioned at a upper macro-block line all or part of of macro block of first row according to this
The average motion vector of inter prediction macro block determines that this is positioned at the position of search window corresponding to the macro block of first row;If being not more than,
Then think that this is positioned at the mean motion of all or part of inter prediction macro block of a upper macro-block line of the macro block of first row and vows
Amount is 0, and the center of the macro block that this is positioned at first row is positioned at the center of search window corresponding to the macro block of first row as this.
Wherein, inter prediction refers to it is not the decoding image according to current, but obtain from decoded reference picture
Predictive value.Inter prediction macro block refers to the macro block obtained by inter-frame prediction method.
It is preferred that current macro is during search Optimum Matching, it is positioned at outside search window if searching part data
Match block, then the position of judge that the search window of current macro is positioned at outside search window according to part data to be matched piece is slided
Whether dynamic number of times is more than the threshold value set, if more than the threshold value set, then the search window of current macro does not slides, and continues
The object matching block of search current macro in the search window slided the last time;If being not more than the threshold value set, according to search
To the position of match block that is positioned at outside search window of part data make the search window of current macro slide, and after slip
The object matching block of current macro is continued search in search window.Current macro according to part data be positioned at outside search window to be matched
The position of block carries out the method slided, similar with the sliding method of search window in Fig. 6, Fig. 7 and Fig. 8, does not repeats them here.
It is preferred that in step 1202, if next macro block of current macro is in the first row of macro-block line, then according to being somebody's turn to do
Inter prediction macro block whether is had to determine the position of search window around the macro block of first row.
If during next macro block is the first macro-block line the first of current macro macro block, do not had around next macro block
Inter prediction macro block, can directly set the search window centre of next macro block and next macro block the treating of same position in reference frame
The center joining block is overlapping.
When having inter prediction macro block around the macro block of this first row, the position of the search window of correspondence is determined according to the following equation
Put:
s_ox=((mvp_x+(s_dx*2)*(mvp_x>=0?1:-1))/(s_dx*4))*s_dx;
s_oy=((mvp_y+(s_dy*2)*(mvp_y>=0?1:-1))/(s_dy*4))*s_dy;
Wherein, s_ox is the deviant of search window centre and the horizontal direction at current macro center;S_oy is in search window
The deviant of the vertical direction at the heart and current macro center, the digit of s_ox Yu s_oy is whole pixel;
Mvp_x is the horizontal motion vector that prediction obtains;Mvp_y is the vertical motion vector that obtains of prediction, mvp_x and
The digit of mvp_y is 1/4 pixel;
When there is no inter prediction macro block around the macro block of this first row, then judge the some or all of of a upper macro-block line
Whether the quantity of the inter prediction macro block in region is more than the threshold value of the quantity of the inter prediction macro block set, if more than, according to being somebody's turn to do
It is positioned at the average motion vector of all or part of inter prediction macro block of a upper macro-block line of the macro block of first row, determines this
It is positioned at the position of search window corresponding to the macro block of first row;If be not more than, then this is positioned at first row macro block center as
This is positioned at the center of search window corresponding to the macro block of first row.Inter prediction partly or completely according to a upper macro-block line is grand
Block the method for average motion vector mv position that search window is set as follows:
s_ox=((mvAveragely_x+(s_dx*2)*(mvAveragely_x>=0?1:-1))/(s_dx*4))*s_dx;
s_oy=((mvAveragely_y+(s_dy*2)*(mvAveragely_y>=0?1:-1))/(s_dy*4))*s_dy;
Wherein, s_ox is the deviant of search window centre and the x direction at current macro center;S_oy be search window centre with
The deviant in the y direction at current macro center, the digit of s_ox Yu s_oy is whole pixel;
mvAveragely_ x is the horizontal average motion vector of a upper macro-block line some or all of inter prediction macro block, mvAveragelyY is
The vertical average motion vector of a upper macro-block line some or all of inter prediction macro block, their digit is 1/4 pixel,
If there is no inter prediction macro block or a upper some or all of region of macro-block line in a upper some or all of region of macro-block line
In the quantity of inter prediction macro block less than the threshold value of quantity of the inter prediction macro block set, then it is assumed that mvAveragely_ x, mvAveragely_y
It is 0.
It is also preferred that the left during current macro search object matching block, search that part data are positioned at outside search window treats
After match block, suspending the search procedure of object matching block of current macro, determine that part data are positioned at outside search window treats
Join pixel column and/or the pixel column of part data in block, search window reads the pixel column described in determining and/or pixel
Row, and the search window of current macro is slided, then proceed to the search procedure of the object matching block of current macro.
As shown in figure 13, the concrete grammar of the slip of embodiment of the present invention another kind search window:
Step 1301: judge that whether the number of to be matched piece relatively mated in the range of search window of current macro is more than 0;
If it does, perform step 1302;Otherwise perform step 1303;
Step 1302: find the match block minimum with current macro matching error as rising in be matched piece relatively mated
Beginning match block, then performs step 1304;
Step 1303: using to be matched piece of search window central authorities as initial match block, then perform step 1304;
Step 1304: search for current macro in the range of the search window that current macro is corresponding according to certain search strategy
Object matching block, then performs step 1305;
Step 1305: judge whether current macro searches to be matched piece that part data are positioned at outside search window, if search
To be matched piece be positioned at outside search window to part data, performs step 1306;If not searching part data to be positioned at search window
Outer to be matched piece, performs step 1308;
Step 1306: judge the to be matched piece of number of times carrying out sliding that current macro is positioned at outside search window according to part data
Whether more than threshold value, if more than threshold value, then perform step 1307;If no more than threshold value, then perform step 1308;
Step 1307: search for the object matching block of current macro in the range of current search window, perform step after having searched for
Rapid 1309;
Step 1308: current macro is searched by the position according to searching to be matched piece that part data are positioned at outside search window
Rope window carries out slip process, proceeds the search of the object matching block of current macro, search in the range of the search window after slip
After rope completes, perform step 1309;
Step 1309: whether next macro block judging current macro is first row macro block, if not first row macro block, then holds
Row step 1310;If first row macro block, then perform step 1311;
Step 1310: in the position of the search window of current macro, level moves right macro block row, obtains the grandest
The search window of next macro block of block, and process ends;
Step 1311: judge whether to have around next macro block inter prediction macro block, if it has, perform step 1312, otherwise
Perform step 1313;
Step 1312: determine the position of search window that next macro block is corresponding according to the predicted motion vector of inter prediction macro block
Put, and process ends;
Step 1313: judge that this is positioned at the interframe in the some or all of region of a upper macro-block line of the macro block of first row
Whether the quantity of predicted macroblock is more than the threshold value of the quantity of the inter prediction macro block set, if it does, perform step 1314, no
Then, step 1315 is performed;
Step 1314: vow according to the mean motion of the some or all of inter prediction macro block of current macro place macro-block line
Amount determines the position of the search window that next macro block is corresponding, and process ends;
Step 1315: using to be matched piece identical with next macro block position of current macro in reference frame as next
The center of the search window of macro block, and process ends.
It is preferred that during such as next macro block is first macro-block line first macro block of current macro, around current macro
Not havinging inter prediction macro block, the position of the search window of next macro block of current macro can be according to not having frame around current macro
Between the method for predicted macroblock determine, it is possible to directly set center and next macro block pair of the search window of next macro block of current macro
In the reference frame answered, the center of to be matched piece of same position is overlapping.
It is preferred that in step 1306, the setting of threshold value, can be according to the content of sequence of video images and video encoder
Can be set, if the sequence of video images containing frequently motion, threshold value can set relatively big, if static or motion
Less sequence of video images, threshold value can set smaller;If video encoder performance is stronger, then threshold value can
Set relatively big, otherwise can set smaller.
Based on same inventive concept, the embodiment of the present invention additionally provides the carriage of a kind of search window, due to this dress
The principle putting solution problem is similar to the sliding method of embodiment of the present invention search window, therefore the enforcement side of may refer to of this device
The enforcement of method, repeats no more in place of repetition.
As shown in figure 14, the carriage of a kind of search window of the embodiment of the present invention includes: motion estimation unit 1401, search
Window determines unit 1402 and search window sliding unit 1403.
Estimation computing unit 1401, for for the current macro in present frame, determining correspondence in reference frame
Search window, searches for object matching block in be matched piece of search window;
Search window determines unit 1402, if during search object matching block, searching part data and be positioned at institute
State to be matched piece outside search window, then the position of to be matched piece be positioned at outside search window according to part data determines current macro
The position of the search window that next macro block is corresponding;
Search window sliding unit 1403: after the object matching block search of current macro completes, corresponding according to next macro block
The position of search window, carries out slip process to the search window of current macro, obtains the search window that next macro block is corresponding.
It is preferred that estimation computing unit 1401 specifically for: determine the initial match block of search in the range of search window,
If do not have in the range of search window may to be matched piece, then using search window central authorities to be matched piece as initial match block,
Then according to certain search strategy searches for the object matching block of current macro in the range of the search window that current macro is corresponding;Its
In, object matching block refers to that in present frame, current macro is in the range of the search window of reference frame, the matched error searched
Minimum to be matched piece, the blocks and optimal matching blocks that namely current macro of present frame is corresponding.
If in the range of search window may the number of to be matched piece no less than one, then will be most like with current macro
To be matched piece as initial match block, then according to certain search strategy is searched in the range of the search window that current macro is corresponding
The object matching block of rope current macro.
It is preferred that search strategy can use different searching algorithms, searching algorithm can include but not limited to: rhombus is searched
Rope algorithm, hexagon search algorithm, three-step approach, new triple step search, the searching algorithm such as four step rule.
It is preferred that search window determine unit 1402 specifically for: if next macro block is its in addition to first row macro block
During his macro block, it is judged that in the search procedure of the blocks and optimal matching blocks of current macro, if search part data and be positioned at search window
Outer match block;Slide to the right macro block row if it did not, search window corresponding to next macro block fixes level;If it has, root
According to preset n-th is determined correspondence region of search in have to be matched piece of part to be positioned at described search window outside, according to
The position of to be matched piece that what n-th searched be positioned at outside search window determines the position of the search window that next macro block is corresponding;Wherein,
N is positive integer.
If next macro block is first row macro block, it is judged that whether this is positioned at around the macro block of first row has inter prediction grand
According to the predicted motion vector of inter prediction macro block, block, if it has, then determine that this is positioned at the search window that the macro block of first row is corresponding
Position;Otherwise, it is judged that this is positioned at the inter prediction in some or all of region of a upper macro-block line of macro block of first row
Macro block quantity whether more than the threshold value of quantity of the inter prediction macro block set, if being more than, be then positioned at first row according to this
The all or part of inter prediction macro block average motion vector of a upper macro-block line of macro block determine that this is positioned at first row
The position of the search window that macro block is corresponding;If being not more than, then it is assumed that this is positioned at the part of a upper macro-block line of macro block of first row
Or the average motion vector of whole inter prediction macro blocks is 0, the center of the macro block that this is positioned at first row is positioned at as this
The center of the search window that the macro block of string is corresponding.
Wherein, inter prediction refers to it is not the decoding image according to current, but obtain from decoded reference picture
Predictive value.
Inter prediction macro block refers to the macro block obtained by inter-frame prediction method.
It is preferred that according to n-th search part data be positioned to be matched piece outside described search window horizontal direction and/
Or search part data for the M time and be positioned at the position of outside described search window vertical direction to be matched piece and determine next macro block pair
The position of the search window answered;Or the position of to be matched piece be positioned at outside search window according to the part data searched for the L time determines
The position of the search window that next macro block is corresponding;Wherein, M, N, L are positive integer.
It is preferred that search window determines that unit 1402 can be also used for: if next macro block is in addition to first row macro block
Other macro blocks, and in the search procedure of the blocks and optimal matching blocks of current macro, search the coupling that part data are positioned at outside search window
Block, it is judged that the position of the match block being positioned at outside search window according to the part data searched determines the search window that next macro block is corresponding
The threshold value whether the slip number of times in addition to acquiescence to the right one macro block of slip is more than, if greater than the threshold value set, then next is grand
The search window level of fixing that block is corresponding moves right macro block row;If being not more than the threshold value set, then basis searches
The position of the match block that part data are positioned at outside search window determines the position of the search window that next macro block is corresponding.
It is preferred that search window determines that unit 1402 can be also used for: if next macro block is first row macro block, it is judged that according to
The position of the match block that the part data searched are positioned at outside search window determines that the search window that next macro block is corresponding removes acquiescence to the right
The threshold value whether the slip number of times outside a macro block that slides is more than;If greater than the threshold value set, then this is positioned at first row
The center of macro block is positioned at the center of search window corresponding to the macro block of first row as this;If being not more than the threshold value set, then root
The position of search window is determined according to whether there being inter prediction macro block around the macro block of first row.
If it is preferred that during first macro block of next macro block of current macro the first macro-block line of being, next macro block
The center of search window is overlapping with next macro block center of to be matched piece of same position in reference frame.
It is preferred that search window determines in unit 1402, if there are inter prediction macro block, then basis in the surrounding of this first row macro block
The predicted motion vector of inter prediction macro block determines that this is positioned at the position of search window corresponding to the macro block of first row:
s_ox=((mvp_x+(s_dx*2)*(mvp_x>=0?1:-1))/(s_dx*4))*s_dx;
s_oy=((mvp_y+(s_dy*2)*(mvp_y>=0?1:-1))/(s_dy*4))*s_dy;
Wherein, s_ox is the deviant of search window centre and the x direction at current macro center;S_oy be search window centre with
The deviant in the y direction at current macro center, the digit of s_ox Yu s_oy is whole pixel;
Mvp_x is the horizontal motion vector that prediction obtains;Mvp_y is the vertical motion vector that obtains of prediction, mvp_x and
The digit of mvp_y is 1/4 pixel;
S_dx is the horizontal direction step-length that search window slides, and can set numerical value as required, preferably can select 8 pictures
Element, 12 pixels or 16 pixels;S_dy is the vertical direction step-length that search window slides, and can be set as arbitrary integer as required
Value, preferably can select 8 pixels, 12 pixels or 16 pixels.
It is preferred that search window determines in unit 1402, if the surrounding of this first row macro block does not has inter prediction macro block, then sentence
Whether the quantity of the inter prediction macro block in the some or all of region of a disconnected upper macro-block line is more than the inter prediction macro block set
The threshold value of quantity, if more than; all or part of interframe of a upper macro-block line according to this macro block being positioned at first row would be pre-
Survey the average motion vector of macro block, determine that this is positioned at the position of search window corresponding to the macro block of first row;If being not more than, then should
The center of the macro block being positioned at first row is positioned at the center of search window corresponding to the macro block of first row as this.According to a upper macro-block line
The method of the average motion vector mv of the macro block of inter prediction partly or completely position that search window is set as follows:
s_ox=((mvAveragely_x+(s_dx*2)*(mvAveragely_x>=0?1:-1))/(s_dx*4))*s_dx;
s_oy=((mvAveragely_y+(s_dy*2)*(mvAveragely_y>=0?1:-1))/(s_dy*4))*s_dy;
Wherein, s_ox is the deviant of search window centre and the x direction at current macro center;S_oy be search window centre with
The deviant in the y direction at current macro center, the digit of s_ox Yu s_oy is whole pixel;
mvAveragely_ x is the horizontal average motion vector of a upper macro-block line some or all of inter prediction macro block, mvAveragely_ y is
The vertical average motion vector of a upper macro-block line some or all of inter prediction macro block, their digit is 1/4 pixel,
If there is no inter prediction macro block or a upper some or all of region of macro-block line in a upper some or all of region of macro-block line
In the quantity of inter prediction macro block less than the threshold value of quantity of the inter prediction macro block set, then it is assumed that mvAveragely_ x, mvAveragely_y
It is 0;
S_dx is the horizontal direction step-length that search window slides, and can set numerical value as required, preferably can select 8 pictures
Element, 12 pixels or 16 pixels;S_dy is the vertical direction step-length that search window slides, and can be set as arbitrary integer as required
Value, preferably can select 8 pixels, 12 pixels or 16 pixels.
It is also preferred that the left as shown in figure 15, the carriage of search window also includes search window data-reading unit 1504.
Search window data-reading unit 1504 specifically for: read the search window corresponding to next macro block of current macro according to
Sliding type set in advance is fixed macro-block line and/or the data of macro block row of slip, and reads the part number searched
The pixel column that the pixel column set according to the position level slip of to be matched piece be positioned at outside search window and/or vertical sliding motion set
Data.
When next macro block is not first row macro block, in the search procedure of the blocks and optimal matching blocks of current macro, read search
The reference data of a window level macro block to the right;After the search procedure of the blocks and optimal matching blocks of current macro terminates, if before
Level is slided to the right on the basis of a macro block arranges has other to slide, and reads next macro block correspondence search window data the most again.
When next macro block is first row macro block, then determine next macro block correspondence search window position according to method set in advance
After, more promptly read the reference data of search window corresponding to next macro block.
As shown in figure 16, the carriage of embodiment of the present invention another kind search window includes: motion estimation unit 1601, search
Rope window moving cell 1602, search window sliding unit 1603.
Motion estimation unit 1601, for for the current macro in present frame, determining the search of correspondence in reference frame
Window, searches for object matching block in be matched piece of search window;
Search window moving cell 1602, if during search object matching block, searching part data and be positioned at institute
State to be matched piece outside search window, then the position of to be matched piece be positioned at outside search window according to part data is to described current macro
Search window carry out slip process, and continue search for object matching block based on the search window obtained after sliding;
Search window sliding unit 1603, for after the object matching block search of current macro completes, obtains after slip
Search window be fixed slip, obtain the search window of next macro block of current macro.
It is preferred that motion estimation unit 1601 specifically for: determine the initial match block of search in the range of search window, if searching
Do not have in the range of rope window may to be matched piece, then using search window central authorities to be matched piece as initial match block, then
In the range of the search window that current macro is corresponding, the object matching block of current macro is searched for according to certain search strategy;
If in the range of search window may the number of to be matched piece no less than one, then will be most like with current macro
To be matched piece as initial match block, then according to certain search strategy is searched in the range of the search window that current macro is corresponding
The object matching block of rope current macro.
It is preferred that search strategy can use different searching algorithms, searching algorithm can include but not limited to: rhombus is searched
Rope algorithm, hexagon search algorithm, three-step approach, new triple step search, the searching algorithm such as four step rule.
It is preferred that search window moving cell 1602 specifically for: judge the search of blocks and optimal matching blocks in current macro
Cheng Zhong, if search the match block that part data are positioned at outside search window;It is positioned at search window without searching part data
Outer match block, after searching the blocks and optimal matching blocks of current macro, and when next macro block is not first row macro block, search window water
The flat macro block position as the search window of next macro block of sliding to the right;
If searching the match block that part data are positioned at outside search window, then it is positioned at search according to the part data searched
The search window that the position of match block outside window makes current macro corresponding slides, and continues search for the object matching of current macro
Block, the position of search window when then searching object matching block according to current macro, search window level is slided to the right a macro block
As the position of the search window of next macro block, wherein next macro block is not first row macro block.
If next macro block is first row macro block, the method for determining position of the search window of next macro block is: judging should
It is positioned at around the macro block of first row and whether has inter prediction macro block, if it has, then vow according to the predicted motion of inter prediction macro block
Amount determines that this is positioned at the position of search window corresponding to the macro block of first row;Otherwise, it is judged that this be positioned at first row macro block upper one
Whether the quantity of the inter prediction macro block in the some or all of region of individual macro-block line is more than the number of the inter prediction macro block set
The threshold value of amount, if being more than, is then positioned at all or part of inter prediction of a upper macro-block line of macro block of first row according to this
The average motion vector of macro block determines that this is positioned at the position of search window corresponding to the macro block of first row;If being not more than, then it is assumed that should
The average motion vector of all or part of inter prediction macro block being positioned at a upper macro-block line of the macro block of first row is 0, will
The center of this macro block being positioned at first row is positioned at the center of search window corresponding to the macro block of first row as this.
Wherein, inter prediction refers to it is not the decoding image according to current, but obtain from decoded reference picture
Predictive value.Inter prediction macro block refers to the macro block obtained by inter-frame prediction method.
Inter prediction macro block refers to the macro block obtained by inter-frame prediction method.
Wherein, if searching the match block that part data are positioned at outside search window, then judge the search window of current macro according to
Whether the number of times that the position of be positioned at outside search window to be matched piece of part data carries out sliding is more than the threshold value set, if more than setting
Fixed threshold value, then the search window of current macro does not slides, and in continuing the search window slided the last time, search is the grandest
The object matching block of block;If being not more than the threshold value set, the match block being positioned at outside search window according to the part data searched
Position makes the search window of current macro slide, and continues search for the object matching of current macro in the search window after slip
Block.The method that the position of be positioned at outside search window according to part data to be matched piece of current macro carries out sliding, with Fig. 6, Fig. 7 and
In Fig. 8, the sliding method of search window is similar to, and does not repeats them here.
It is preferred that search window motion calculate unit 1602 can be also used for: if next macro block of current macro be first
During first macro block of macro-block line, the center of the search window of next macro block and next macro block the treating of same position in reference frame
The center joining block is overlapping.
If next macro block is first row macro block, it is judged that whether have inter prediction macro block to determine around the macro block of first row and search
The position of rope window.
If having inter prediction macro block around next macro block, the most according to the following formula according to the predicted motion of inter prediction macro block
Vector determines that this is positioned at the position of search window corresponding to the macro block of first row:
s_ox=((mvp_x+(s_dx*2)*(mvp_x>=0?1:-1))/(s_dx*4))*s_dx;
s_oy=((mvp_y+(s_dy*2)*(mvp_y>=0?1:-1))/(s_dy*4))*s_dy;
Wherein, s_ox is the deviant of search window centre and the horizontal direction at current macro center;S_oy is in search window
The deviant of the vertical direction at the heart and current macro center, the digit of s_ox Yu s_oy is whole pixel;
Mvp_x is the horizontal motion vector that prediction obtains;Mvp_y is the vertical motion vector that obtains of prediction, mvp_x and
The digit of mvp_y is 1/4 pixel;
S_dx is the horizontal direction step-length that search window slides, and can set numerical value as required, preferably can select 8 pictures
Element, 12 pixels or 16 pixels;S_dy is the vertical direction step-length that search window slides, and can be set as arbitrary integer as required
Value, preferably can select 8 pixels, 12 pixels or 16 pixels.
If the surrounding of this first row macro block does not has inter prediction macro block, then judge the some or all of district of a upper macro-block line
Whether the quantity of the inter prediction macro block in territory is more than the threshold value of the quantity of the inter prediction macro block set, if more than, according to this position
In the average motion vector of all or part of inter prediction macro block of a upper macro-block line of the macro block of first row, determine this position
Position in search window corresponding to the macro block of first row;If being not more than, then this is positioned at the center of macro block of first row as this
It is positioned at the center of search window corresponding to the macro block of first row.Inter prediction macro block partly or completely according to a upper macro-block line
The method of average motion vector mv position that search window is set as follows:
s_ox=((mvAveragely_x+(s_dx*2)*(mvAveragely_x>=0?1:-1))/(s_dx*4))*s_dx;
s_oy=((mvAveragely_y+(s_dy*2)*(mvAveragely_y>=0?1:-1))/(s_dy*4))*s_dy;
Wherein, s_ox is the deviant of search window centre and the x direction at current macro center;S_oy be search window centre with
The deviant in the y direction at current macro center, the digit of s_ox Yu s_oy is whole pixel;
mvAveragely_ x is the horizontal average motion vector of a upper macro-block line some or all of inter prediction macro block, mvAveragely_ y is
The vertical average motion vector of a upper macro-block line some or all of inter prediction macro block, their digit is 1/4 pixel,
If there is no inter prediction macro block in a upper some or all of region of macro-block line, then it is assumed that mvAveragely_ x, mvAveragely_ y is 0;
S_dx is the horizontal direction step-length that search window slides, and can set numerical value as required, preferably can select 8 pictures
Element, 12 pixels or 16 pixels;S_dy is the vertical direction step-length that search window slides, and can be set as arbitrary integer as required
Value, preferably can select 8 pixels, 12 pixels or 16 pixels.
It is also preferred that the left as shown in figure 17, the carriage of search window also includes that reference data reads unit 1704.
Reference data reads unit 1704 specifically for search that part data are positioned at outside described search window to be matched piece
After, read the position level of to be matched piece that the part data that search are positioned at outside search window slide the pixel column set and/or
The data of the pixel column that vertical sliding motion sets.
It is preferred that can include that in a search window carriage search window determines that unit and search window motion are single simultaneously
Unit, search window data-reading unit and reference data read unit;It is positioned at according to part data when search window carriage uses
When the position of to be matched piece outside search window determines the position of the search window that next macro block of current macro is corresponding, search window slides
Device uses search window to determine unit and search window data-reading unit;When search window carriage uses according to part data bit
When the position of to be matched piece outside search window carries out slip process to the search window of described current macro, search window carriage
Search window moving cell and reference data is used to read unit.
Those skilled in the art are it should be appreciated that embodiments of the invention can be provided as method, system or computer program
Product.Therefore, the reality in terms of the present invention can use complete hardware embodiment, complete software implementation or combine software and hardware
Execute the form of example.And, the present invention can use at one or more computers wherein including computer usable program code
The upper computer program product implemented of usable storage medium (including but not limited to disk memory, CD-ROM, optical memory etc.)
The form of product.
The present invention is with reference to method, equipment (system) and the flow process of computer program according to embodiments of the present invention
Figure and/or block diagram describe.It should be understood that can the most first-class by computer program instructions flowchart and/or block diagram
Flow process in journey and/or square frame and flow chart and/or block diagram and/or the combination of square frame.These computer programs can be provided
Instruction arrives the processor of general purpose computer, special-purpose computer, Embedded Processor or other programmable data processing device to produce
A raw machine so that the instruction performed by the processor of computer or other programmable data processing device is produced for real
The device of the function specified in one flow process of flow chart or multiple flow process and/or one square frame of block diagram or multiple square frame now.
These computer program instructions may be alternatively stored in and computer or other programmable data processing device can be guided with spy
Determine in the computer-readable memory that mode works so that the instruction being stored in this computer-readable memory produces and includes referring to
Make the manufacture of device, this command device realize at one flow process of flow chart or multiple flow process and/or one square frame of block diagram or
The function specified in multiple square frames.
These computer program instructions also can be loaded in computer or other programmable data processing device so that at meter
Perform sequence of operations step on calculation machine or other programmable devices to produce computer implemented process, thus at computer or
The instruction performed on other programmable devices provides for realizing at one flow process of flow chart or multiple flow process and/or block diagram one
The step of the function specified in individual square frame or multiple square frame.
Although preferred embodiments of the present invention have been described, but those skilled in the art once know basic creation
Property concept, then can make other change and amendment to these embodiments.So, claims are intended to be construed to include excellent
Select embodiment and fall into all changes and the amendment of the scope of the invention.
Obviously, those skilled in the art can carry out various change and the modification essence without deviating from the present invention to the present invention
God and scope.So, if these amendments of the present invention and modification belong to the scope of the claims in the present invention and equivalent technologies thereof
Within, then the present invention is also intended to comprise these change and modification.