CN101853286B - Intelligent selection method of video thumbnails - Google Patents

Intelligent selection method of video thumbnails Download PDF

Info

Publication number
CN101853286B
CN101853286B CN201010180153.0A CN201010180153A CN101853286B CN 101853286 B CN101853286 B CN 101853286B CN 201010180153 A CN201010180153 A CN 201010180153A CN 101853286 B CN101853286 B CN 101853286B
Authority
CN
China
Prior art keywords
score
value
thumbnail
rgb
size
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201010180153.0A
Other languages
Chinese (zh)
Other versions
CN101853286A (en
Inventor
连惠城
刘子枫
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alibaba China Co Ltd
Original Assignee
SHANGHAI TUDOU NETWORK TECHNOLOGY Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by SHANGHAI TUDOU NETWORK TECHNOLOGY Co Ltd filed Critical SHANGHAI TUDOU NETWORK TECHNOLOGY Co Ltd
Priority to CN201010180153.0A priority Critical patent/CN101853286B/en
Publication of CN101853286A publication Critical patent/CN101853286A/en
Application granted granted Critical
Publication of CN101853286B publication Critical patent/CN101853286B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Abstract

Present invention is disclosed a kind of intelligent selection method of video thumbnails, comprise the following steps: 1) obtain the N hypertonic sketch map of one section of video, wherein, 2≤N≤100, and N is constant;2) every hypertonic sketch map is calculated its front face position and size, face position and size, whole body position of human body and size, upper body position and size and lower part of the body position and size, grey level histogram Distribution Value, grey level histogram variance Distribution Value, colored RGB histogram variances Distribution Value, color RGB image become the discrete distance value between gray level image difference value, the variance yields of gray level image pixel, the variance yields of color RGB image pixel, colored RGB block etc. feature;3) every hypertonic sketch map is tried to achieve by ambiguity function respectively the score value of above-mentioned each feature;4) the feature score value of every hypertonic sketch map is obtained a final mark by weighted evaluation;5) according to the size of mark, N hypertonic sketch map is ranked up;6) thumbnail that selection mark is the highest is as the thumbnail representing this video.

Description

Intelligent selection method of video thumbnails
Technical field
The present invention relates to picture choosing method, particularly to a kind of video thumbnails carried out by Computer Image Processing Intelligent selecting method.
Background technology
In the daily use of video website, there is an important technology to extract a two field picture exactly from video file and make For the representative picture of this video file, our this picture is called the thumbnail of video file.Our way is from video at present File extracts eight hypertonic sketch maps, and the 4th thumbnail by default is set.This employing fixed position method is given tacit consent to And the thumbnail obtained is frequently not the most representational thumbnail in eight hypertonic sketch maps.It is permissible that we have employed certain methods Solve this problem, such as (1) user and can determine any pictures thumbnail by default by self-defining method, (2) right that website staff selects which pictures thumbnail by default is given.Although said method can solve this Problem, but reality still cannot meet requirement, this is because (1) is by data analysis, it is understood that user generally will not or Little self-defined thumbnail (2) is the most numerous due to the video file quantity uploading to video website every day, is worked by website The workload that personnel define thumbnail is the heaviest.Based on above-mentioned two reason, we invent one can pass through computer The method of image procossing selects the method for representative thumbnail thumbnail by default automatically.
P.Viola and M.Jones et al. is in the computer vision and pattern recognition international conference of calendar year 2001 What (Proceedings ofComputer Vision and Pattern Recognition, 2001) proposed " uses simple special The Stacked type lifting method levied carries out quick object detection " (Rapid Object Detection Using a Boosted Cascade of SimpleFeatures.) method carries out detecting.
In view of this, those skilled in the art are for the problems referred to above, it is provided that one can pass through Computer Image Processing Method selects the intelligent selection method of video thumbnails of representative thumbnail thumbnail by default automatically.
Summary of the invention
The invention provides a kind of intelligent selection method of video thumbnails, overcome the difficulty of prior art, to reach logical Cross Computer Image Processing method and select the purpose of representative thumbnail thumbnail by default automatically.
The present invention adopts the following technical scheme that
The invention provides a kind of intelligent selection method of video thumbnails, should for selecting a representative from one section of video The thumbnail of video, comprises the following steps:
(1) obtain the N hypertonic sketch map of one section of video, wherein, 2≤N≤100, and N is constant;
(2) every hypertonic sketch map is calculated position and size, the position of side face and size, the whole body people of its front face The position of body and size, the position of upper body and size and the position of the lower part of the body and size, grey level histogram Distribution Value, grey level histogram Variance Distribution Value, colored RGB histogram variances Distribution Value, color RGB image become the difference value of gray level image, gray level image picture Discrete distance value between the variance yields of vegetarian refreshments, the variance yields of color RGB image pixel, colored RGB block etc. feature;
(3) every hypertonic sketch map is tried to achieve by ambiguity function respectively the score value of above-mentioned each feature;
(4) the feature score value of every hypertonic sketch map is obtained a final mark by weighted evaluation;
(5) according to the size of mark, N hypertonic sketch map is ranked up;
(6) thumbnail that selection mark is the highest is as the thumbnail representing this video.
Preferably, in described step (1), use extracted at equal intervals method, according to the video duration being previously obtained, it is put down Being divided into N equal portions, the most each equal portions extract a frame as thumbnail, and N=8.
Preferably, described step (2) comprises the following steps:
(21) input thumbnail, detects face characteristic, including the position of front face and size, the position of side face and Size, and calculate fractional value;
(22) input thumbnail, detects characteristics of human body, including position and size, the position of upper body and the size of whole body human body With position and the size of the lower part of the body, and calculate fractional value;
(23) input thumbnail, calculates grey level histogram Distribution Value;
(24) input thumbnail, calculates grey level histogram variance Distribution Value;
(25) input thumbnail, calculates colored RGB histogram variances Distribution Value;
(26) input thumbnail, calculates color RGB image and becomes the difference value of gray level image;
(27) input thumbnail, calculates the variance yields of gray level image pixel;
(28) input thumbnail, calculates the variance yields of color RGB image pixel;
(29) input thumbnail, calculates the discrete distance value between colored RGB block.
Preferably, in described step (21):
The then score value of front face
Wherein wiFor the width of front face, n is face number, if W is the width of thumbnail;
The score value of side face
Wherein wiFor the width of side face, n is face number, if W is the width of thumbnail.
Preferably, described step (22) sets (xi, yi, wi, hi), i=1 ..., n, wherein xi, yiRepresent face location, wiFor the width of face, n is face number, if W is the width of thumbnail,
The then score value of whole body
Wherein wiFor the width of whole body human body, n is number, if W is the width of thumbnail;
The score value of upper body
Wherein wiFor the width of whole body human upper limb, n is number, if W is the width of thumbnail;
The score value of the lower part of the body
Wherein wiFor the width of whole body human body lower limbs, n is number, if W is the width of thumbnail.
Preferably, input thumbnail in described step (23), if its grey level histogram is gray_hist=(gh_1, gh_ 2 .., gh_n), n is histogrammic number, and t1, t2 are integer thresholds, T1 and T2 is the threshold value of rectangular histogram sum, base_score On the basis of mark, then the computing formula of grey level histogram Distribution Value score_hist_distrib is:
Wherein, n=10, t1=2, t2=8, T1=0.7, T1=0.8, base_score=1.0.
Preferably, input thumbnail in described step (24), if its grey level histogram is gray_hist=(gh_1, gh_ 2 .., gh_n), n is histogrammic number,Max_num=max (gh_1, gh_2 .., gh_n), base_ Mark on the basis of score, then the score_gray_hist_std computing formula calculating grey level histogram variance Distribution Value is:
Wherein, n=64, base_score=1.0.
Preferably, histogram variances Distribution Value in R plane, G plane, B plane respectively in described step (25), then ask All it is worth to colored RGB histogram variances Distribution Value score_RGB_hist_std;
score _ RGB _ hist _ distrib = score _ R _ hist _ distrib + score _ G _ hist _ distrib + score _ B _ hist _ distrib 3
;Wherein, n=64, base_score=1.0.
Preferably, input thumbnail in described step (26), if the pixel value of gray level image is xij, i=1 ..., W, j= 1 ..., H, the pixel value (r of color RGB imageij, gij, bij), i=1 ..., W, j=1 ..., H, wherein W, H is respectively contracting The width of sketch map and height, mark on the basis of base_score1 and base_score2, t1 is threshold value, if then calculating color RGB image The computing formula of difference value score_rgb2gray_diff becoming gray level image is:
Wherein,Base_score1=1.0, base_ Score2=2.0, t1=-0.9.
Preferably, input thumbnail in described step (27), if the pixel value of gray level image is xij, i=1 ..., W, j= 1 ..., H, wherein W, H is respectively width and the height of thumbnail, then calculates the score_gray_ of the variance yields of gray level image pixel Std computing formula is:
score _ gray _ std = - base _ score + Σ i = 1 W Σ j = 1 H ( x ij - x ‾ ) 2 / 255 , Wherein x ‾ = Σ i = 1 W Σ j = 1 H x ij .
Preferably, respectively at R plane, G plane, the variance yields of B plane epigraph pixel in described step (28), then Average and obtain the variance yields score_RGB_std of color RGB image pixel;
score _ R _ std = - base _ score + Σ i = 1 W Σ j = 1 H ( x ij - x ‾ ) 2 / 255 , Wherein x ‾ = Σ i = 1 W Σ j = 1 H x ij ;
score _ G _ std = - base _ score + Σ i = 1 W Σ j = 1 H ( x ij - x ‾ ) 2 / 255 , Wherein x ‾ = Σ i = 1 W Σ j = 1 H x ij ;
score _ B _ std = - base _ score + Σ i = 1 W Σ j = 1 H ( x ij - x ‾ ) 2 / 255 , Wherein x ‾ = Σ i = 1 W Σ j = 1 H x ij ;
score _ RGB _ std = score _ R _ std + score _ G _ std + score _ B _ std 3 .
Preferably, input thumbnail in described step (29), if the pixel value (r of color RGB imagei, gi, bi), i= 1 ..., W × H, wherein W, H is respectively width and the height of thumbnail, mark on the basis of base_score, then calculate colored RGB block it Between the computing formula of discrete distance value score_rgb_dist be:
Wherein, base_score=0.0.
Preferably, in described step (4), final score value final_score is calculated by following equation:
Final_score=w1×score_face_frontal+w2×score_face_profile+w3×score_ full_body+w4×score_upper_body+w5×score_lower_body+w6×score_hist_distrib+w7 ×score_gray_hist_std+w8×score_RGB_hist_std+w9×score_rgb2gray_diff+w10× score_gray_std+w11×score_RGB_std;
Wherein, w1=1.0, w2=0.5, w3=0.5, w4=0.5, w5=0.5, w6=0.5, w7=0.5, w8=1.2, W9 =1.2, w10=0.5, w11=1.2.
Owing to have employed above-mentioned technology, compared with prior art, present invention have the advantage that the present invention can be by meter Calculation machine image processing method selects representative thumbnail thumbnail by default automatically.
The present invention is further illustrated below in conjunction with drawings and Examples.
Accompanying drawing explanation
Fig. 1 is the flow chart of the intelligent selection method of video thumbnails of the present invention.
Detailed description of the invention
A kind of specific embodiment of the present invention is introduced below by Fig. 1.
As it is shown in figure 1, a kind of intelligent selection method of video thumbnails, comprise the following steps:
(1) obtaining the N hypertonic sketch map of a video, the acquisition methods of N hypertonic sketch map is to use extracted at equal intervals method, i.e. According to the video duration being previously obtained, it being divided into N equal portions, the most each equal portions extract a frame as thumbnail.Here Taking N=8, but be not limited to N=8, N can be between 2 to 100.
(2) every hypertonic sketch map is calculated position and size, the position of side face and size, the whole body people of its front face The position of body and size, the position of upper body and size and the position of the lower part of the body and size, grey level histogram Distribution Value, histogram variances Distribution Value, colored RGB histogram variances Distribution Value, color RGB image become the difference value of gray level image, gray level image pixel Variance yields, the variance yields of color RGB image pixel, discrete distance value between colored RGB block etc. feature.
(3) score value of features described above is tried to achieve respectively by ambiguity function.
(4) a final mark is obtained by weighted evaluation.
(5) according to the size of mark, N hypertonic sketch map is ranked up.
(6) thumbnail that score value is the highest thumbnail by default.
Above-mentioned steps (2), is carried out as follows:
(21) input thumbnail, detects face characteristic, includes position and size, the position of side face of front face And size;Calculate fractional value;
(22) input thumbnail, detects characteristics of human body, includes the position of whole body human body and size, the position of upper body and big The position of the little and lower part of the body and size;Calculate fractional value;
(23) input thumbnail, calculates grey level histogram Distribution Value;
(24) input thumbnail, calculates grey level histogram variance Distribution Value;
(25) input thumbnail, calculates colored RGB histogram variances Distribution Value;
(26) input thumbnail, calculates color RGB image and becomes the difference value of gray level image;
(27) input thumbnail, calculates the variance yields of gray level image pixel;
(28) input thumbnail, calculates the variance yields of color RGB image pixel;
(29) input thumbnail, calculates the discrete distance value between colored RGB block.
Embodiments of the present invention are as follows:
With continued reference to Fig. 1, a kind of intelligent selection method of video thumbnails of the present invention, for selecting one from one section of video Zhang represents the thumbnail of this video, comprises the following steps:
Step (1) obtains the N hypertonic sketch map of one section of video, wherein, 2≤N≤100, and N is constant, uses and takes out at equal intervals Access method, according to the video duration being previously obtained, is divided into N equal portions by it, and the most each equal portions extract a frame as breviary Figure, and N=8.
Step (2) calculates the position of its front face and size, the position of side face and size, complete to every hypertonic sketch map The position of body human body and size, the position of upper body and size and the position of the lower part of the body and size, grey level histogram Distribution Value, gray scale are straight Side's figure variance Distribution Value, colored RGB histogram variances Distribution Value, color RGB image become the difference value of gray level image, gray-scale map As the discrete distance value between the variance yields of pixel, the variance yields of color RGB image pixel, colored RGB block etc. feature;
Described step comprises the following steps in (2):
Step (21) input thumbnail, detects face characteristic, including position and size, the position of side face of front face Put and size, and calculate fractional value;
Step (22) input thumbnail, detects characteristics of human body, including the position of whole body human body and size, the position of upper body and Size and the position of the lower part of the body and size, and calculate fractional value;
Step (23) input thumbnail, calculates grey level histogram Distribution Value;
Step (24) input thumbnail, calculates grey level histogram variance Distribution Value;
Step (25) input thumbnail, calculates colored RGB histogram variances Distribution Value;
Step (26) input thumbnail, calculates color RGB image and becomes the difference value of gray level image;
Step (27) input thumbnail, calculates the variance yields of gray level image pixel;
Step (28) input thumbnail, calculates the variance yields of color RGB image pixel;
Step (29) input thumbnail, calculates the discrete distance value between colored RGB block.
In described step (21): the then score value of front face Wherein wiFor the width of front face, n is face number, if W is the width of thumbnail;The score value of side face
Wherein wiFor the width of side face, n is face number, if W is the width of thumbnail.
Described step sets (x in (22)i, yi, wi, hi), i=1 ..., n, wherein xi, yiRepresent face location, wiFor face Width, n is face number, if W is the width of thumbnail,
The then score value of whole body
Wherein wiFor the width of whole body human body, n is number, if W is the width of thumbnail;
The score value of upper body
Wherein wiFor the width of whole body human upper limb, n is number, if W is the width of thumbnail;
The score value of the lower part of the body
Wherein wiFor the width of whole body human body lower limbs, n is number, if W is the width of thumbnail.
Input thumbnail in described step (23), if its grey level histogram is gray_hist=(gh_1, gh_2 .., gh_ N), n is histogrammic number, and t1, t2 are integer thresholds, T1 and T2 is the threshold value of rectangular histogram sum, divides on the basis of base_score Number, then the computing formula of grey level histogram Distribution Value score_hist_distrib is:
Wherein, n=10, t1=2, t2=8, T1=0.7, T1=0.8, base_score=1.0.
Input thumbnail in described step (24), if its grey level histogram is gray_hist=(gh_1, gh_2 .., gh_ N), n is histogrammic number,Max_num=max (gh_1, gh_2 .., gh_n), base_score are base Quasi-mark, then the score_gray_hist_std computing formula calculating grey level histogram variance Distribution Value is:
Wherein, n=64, base_score=1.0.
Histogram variances Distribution Value in R plane, G plane, B plane respectively in described step (25), then averages To colored RGB histogram variances Distribution Value score_RGB_hist_std;
score _ RGB _ hist _ distrib = score _ R _ hist _ distrib + score _ G _ hist _ distrib + score _ B _ hist _ distrib 3
;Wherein, n=64, base_score=1.0.
Input thumbnail in described step (26), if the pixel value of gray level image is xij, i=1 ..., W, j=1 ..., H, the pixel value (r of color RGB imageij, gij, bij), i=1 ..., W, j=1 ..., H, wherein W, H is respectively thumbnail Wide and high, mark on the basis of base_score1 and base_score2, t1 is threshold value, if then calculating color RGB image to become ash The computing formula of difference value score_rgb2gray_diff of degree image is:
Wherein,Base_score1=1.0, base_ Score2=2.0, t1=-0.9.
Input thumbnail in described step (27), if the pixel value of gray level image is xij, i=1 ..., W, j=1 ..., H, wherein W, H is respectively width and the height of thumbnail, then calculate the score_gray_std meter of the variance yields of gray level image pixel Calculation formula is:
score _ gray _ std = - base _ score + Σ i = 1 W Σ j = 1 H ( x ij - x ‾ ) 2 / 255 , Wherein x ‾ = Σ i = 1 W Σ j = 1 H x ij .
Respectively at R plane, G plane, the variance yields of B plane epigraph pixel in described step (28), then average Obtain the variance yields score_RGB_std of color RGB image pixel;
score _ R _ std = - base _ score + Σ i = 1 W Σ j = 1 H ( x ij - x ‾ ) 2 / 255 , Wherein x ‾ = Σ i = 1 W Σ j = 1 H x ij ;
score _ G _ std = - base _ score + Σ i = 1 W Σ j = 1 H ( x ij - x ‾ ) 2 / 255 , Wherein x ‾ = Σ i = 1 W Σ j = 1 H x ij ;
score _ B _ std = - base _ score + Σ i = 1 W Σ j = 1 H ( x ij - x ‾ ) 2 / 255 , Wherein x ‾ = Σ i = 1 W Σ j = 1 H x ij ;
score _ RGB _ std = score _ R _ std + score _ G _ std + score _ B _ std 3 .
Input thumbnail in described step (29), if the pixel value (r of color RGB imagei, gi, bi), i=1 ..., W × H, wherein W, H is respectively width and the height of thumbnail, mark on the basis of base_score, then calculate between colored RGB block is discrete The computing formula of distance value score_rgb_dist is:
score _ rgb _ dist = - base _ score + Σ i = 1 W × H Σ j = 1 , j ≠ i W × H ( | r i - r j | + | g i - g j | + | b i - b j | ) / ( 3 × W × H × 255 ) , Wherein, base_score=0.0.
The score value of above-mentioned each feature tried to achieve by every hypertonic sketch map by step (3) respectively by ambiguity function;
Step (4) obtains a final mark to the feature score value of every hypertonic sketch map by weighted evaluation, and final divides Value final_score is calculated by following equation:
Final_score=w1×score_face_frontal+w2×score_face_profile+w3×score_ full_body+w4×score_upper_body+w5×score_lower_body+w6×score_hist_distrib+w7 ×score_gray_hist_std+w8×score_RGB_hist_std+w9×score_rgb2gray_diff+w10× score_gray_std+w11×score_RGB_std;
Wherein, w1=1.0, w2=0.5, w3=0.5, w4=0.5, w5=0.5, w6=0.5, w7=0.5, w8=1.2, W9 =1.2, w10=0.5, w11=1.2.
N hypertonic sketch map is ranked up by step (5) according to the size of mark;
Step (6) selects the highest thumbnail of mark as the thumbnail representing this video.
In summary, owing to have employed above-mentioned technology, present invention have the advantage that the present invention can pass through computer graphic Representative thumbnail thumbnail by default is selected automatically as processing method.
Embodiment described above is merely to illustrate technological thought and the feature of the present invention, in its object is to make this area Technical staff will appreciate that present disclosure and implement according to this, it is impossible to only limit the patent model of the present invention with the present embodiment Enclose, the most all equal changes made according to disclosed spirit or modification, still fall in the scope of the claims of the present invention.

Claims (12)

1. an intelligent selection method of video thumbnails, for selecting a thumbnail representing this video from one section of video, It is characterized in that: comprise the following steps:
(1) obtain the N hypertonic sketch map of one section of video, wherein, 2≤N≤100, and N is constant;
(2) every hypertonic sketch map is calculated the position of its front face and size, the position of side face and size, whole body human body Position and size, the position of upper body and size and the position of the lower part of the body and size, grey level histogram Distribution Value, grey level histogram variance Distribution Value, colored RGB histogram variances Distribution Value, color RGB image become the difference value of gray level image, gray level image pixel Variance yields, the variance yields of color RGB image pixel, discrete distance value tag between colored RGB block;
(3) every hypertonic sketch map is tried to achieve by ambiguity function respectively the score value of above-mentioned each feature;
(4) the feature score value of every hypertonic sketch map is obtained a final mark by weighted evaluation;
(5) according to the size of mark, N hypertonic sketch map is ranked up;
(6) thumbnail that selection mark is the highest is as the thumbnail representing this video;
Wherein, described step (2) comprises the following steps:
(21) input thumbnail, detects face characteristic, including the position of front face and size, the position of side face and big Little, and calculate fractional value;
(22) input thumbnail, detects characteristics of human body, including the position of whole body human body and size, the position of upper body and size and under The position of body and size, and calculate fractional value;
(23) input thumbnail, calculates grey level histogram Distribution Value;
(24) input thumbnail, calculates grey level histogram variance Distribution Value;
(25) input thumbnail, calculates colored RGB histogram variances Distribution Value;
(26) input thumbnail, calculates color RGB image and becomes the difference value of gray level image;
(27) input thumbnail, calculates the variance yields of gray level image pixel;
(28) input thumbnail, calculates the variance yields of color RGB image pixel;
(29) input thumbnail, calculates the discrete distance value between colored RGB block.
2. intelligent selection method of video thumbnails as claimed in claim 1, it is characterised in that: in described step (1), employing etc. Interval abstracting method, according to the video duration being previously obtained, is divided into N equal portions by it, and the most each equal portions extract a frame and make For thumbnail, and N=8.
3. intelligent selection method of video thumbnails as claimed in claim 1, it is characterised in that: in described step (21):
The score value of front face
Wherein wiFor the width of front face, n is face number, if W is the width of thumbnail;
The score value of side face
Wherein wiFor the width of side face, n is face number, if W is the width of thumbnail.
4. intelligent selection method of video thumbnails as claimed in claim 1, it is characterised in that: described step sets (x in (22)i, yi, wi, hi), i=1 ..., n, wherein xi, yiRepresent face location, wiFor the width of face, n is face number, if W is breviary The width of figure,
The then score value of whole body
Wherein wiFor the width of whole body human body, n is number, if W is the width of thumbnail;
The score value of upper body
Wherein wiFor the width of whole body human upper limb, n is number, if W is the width of thumbnail;
The score value of the lower part of the body
Wherein wiFor the width of whole body human body lower limbs, n is number, if W is the width of thumbnail.
5. intelligent selection method of video thumbnails as claimed in claim 1, it is characterised in that: input contracting in described step (23) Sketch map, if its grey level histogram is gray_hist=(gh1, gh2.., ghn), ghiFor i-th grey level histogram, n is Nogata The number of figure, t1, t2 are integer thresholds, T1And T2For the threshold value of rectangular histogram sum, mark on the basis of base_score, then gray scale is straight The computing formula of side figure Distribution Value score_hist_distrib is:
Wherein, n=10, t1=2, t2=8, T1=0.7, T1=0.8, base_score=1.0.
6. intelligent selection method of video thumbnails as claimed in claim 1, it is characterised in that: input contracting in described step (24) Sketch map, if its grey level histogram is gray_hist=(gh1, gh2.., ghn), n is histogrammic number, Max_num=max (gh1, gh2.., ghn), mark on the basis of base_score, then calculate grey level histogram variance Distribution Value Score_gray_hist_std computing formula is:
When max_num ≠ 0
Wherein, n=64, base_score=1.0.
7. intelligent selection method of video thumbnails as claimed in claim 1, it is characterised in that: described step exists in (25) respectively Histogram variances Distribution Value in R plane, G plane, B plane, then averages and obtains colored RGB histogram variances Distribution Value score_RGB_hist_std;
Wherein, max_num=max (gh1, gh2.., ghn),ForghiFor i-th grey level histogram, n= 64, base_score=1.0.
8. intelligent selection method of video thumbnails as claimed in claim 1, it is characterised in that: input contracting in described step (26) Sketch map, if the pixel value of gray level image is xij, i=1 ..., W, j=1 ..., H, the pixel value (r of color RGB imageij, gij, bij), i=1 ..., W, j=1 ..., H, wherein W, H is respectively width and the height of thumbnail, base_score1 and base_ Mark on the basis of score2, t1For threshold value, if then calculating color RGB image to become difference value score_ of gray level image The computing formula of rgb2gray_diff is:
Wherein,Base_score1=1.0, base_score2= 2.0, t1=-0.9.
9. intelligent selection method of video thumbnails AA as claimed in claim 1, it is characterised in that: input in described step (27) Thumbnail, if the pixel value of gray level image is xij, i=1 ..., W, j=1 ..., H, wherein W, H be respectively thumbnail width and Height, mark on the basis of base_score, then calculate the score_gray_std computing formula of the variance yields of gray level image pixel For:
Wherein
10. intelligent selection method of video thumbnails as claimed in claim 1, it is characterised in that: in described step (28) respectively At R plane, G plane, the variance yields of B plane epigraph pixel, then average and obtain the variance of color RGB image pixel Value score_RGB_std;Wherein mark on the basis of base_score, xijPixel value for gray level image
Wherein
Wherein
Wherein
11. intelligent selection method of video thumbnails as claimed in claim 1, it is characterised in that: input in described step (29) Thumbnail, if the pixel value (r of color RGB imagei, gi, bi), i=1 ..., W × H, wherein W, H be respectively thumbnail width and Height, mark on the basis of base_score, then the calculating of discrete distance value score_rgb_dist between the colored RGB block of calculating is public Formula is:
Wherein, base_score=0.0.
12. intelligent selection method of video thumbnails as claimed in claim 1, it is characterised in that: final in described step (4) Score value final_score is calculated by following equation:
Final_score=w1×score_face_frontal+w2×score_face_profile+w3×score_full_ body+w4×score_upper_body+w5×score_lower_body+w6×score_hist_distrib+w7× score_gray_hist_std+w8×score_RGB_hist_std+w9×score_rgb2gray_diff+w10×score_ gray_std+w11×score_RGB_std;
Wherein, w1=1.0, w2=0.5, w3=0.5, w4=0.5, w5=0.5, w6=0.5, w7=0.5, w8=1.2, W9= 1.2, w10=0.5, w11=1.2, score_face_frontal are the score value of front face, and score_face_profile is The score value of side face, score_full_body is whole body score value, and score_upper_body is the score value of upper body, score_ Lower_body is the score value of the lower part of the body, and score_hist_distrib is grey level histogram Distribution Value, score_gray_hist_ Std is grey level histogram variance Distribution Value, and score_RGB_hist_std is colored RGB histogram variances Distribution Value, score_ Rgb2gray_diff is the difference value that color RGB image becomes gray level image, and score_gray_std is gray level image pixel Variance yields, score_RGB_std is the variance yields of color RGB image pixel.
CN201010180153.0A 2010-05-20 2010-05-20 Intelligent selection method of video thumbnails Expired - Fee Related CN101853286B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201010180153.0A CN101853286B (en) 2010-05-20 2010-05-20 Intelligent selection method of video thumbnails

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201010180153.0A CN101853286B (en) 2010-05-20 2010-05-20 Intelligent selection method of video thumbnails

Publications (2)

Publication Number Publication Date
CN101853286A CN101853286A (en) 2010-10-06
CN101853286B true CN101853286B (en) 2016-08-10

Family

ID=42804778

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201010180153.0A Expired - Fee Related CN101853286B (en) 2010-05-20 2010-05-20 Intelligent selection method of video thumbnails

Country Status (1)

Country Link
CN (1) CN101853286B (en)

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104063844B (en) * 2013-03-21 2019-01-15 腾讯科技(深圳)有限公司 A kind of reduced graph generating method and system
US10664687B2 (en) * 2014-06-12 2020-05-26 Microsoft Technology Licensing, Llc Rule-based video importance analysis
CN104506968B (en) * 2014-12-31 2018-08-07 北京奇艺世纪科技有限公司 A kind of video frequency abstract figure determines method and device
CN104581379A (en) * 2014-12-31 2015-04-29 乐视网信息技术(北京)股份有限公司 Video preview image selecting method and device
CN104598921A (en) * 2014-12-31 2015-05-06 乐视网信息技术(北京)股份有限公司 Video preview selecting method and device
CN105704559A (en) * 2016-01-12 2016-06-22 深圳市茁壮网络股份有限公司 Poster generation method and apparatus thereof
CN106101868A (en) * 2016-07-18 2016-11-09 乐视控股(北京)有限公司 Reduced graph generating method and generating means
CN108733676A (en) * 2017-04-14 2018-11-02 合信息技术(北京)有限公司 The extracting method and device of video thumbnails
CN108650524B (en) * 2018-05-23 2022-08-16 腾讯科技(深圳)有限公司 Video cover generation method and device, computer equipment and storage medium
CN110147780B (en) * 2019-05-28 2021-01-01 山东大学 Real-time field robot terrain identification method and system based on hierarchical terrain
CN110572723A (en) * 2019-08-30 2019-12-13 华为终端有限公司 Thumbnail generation method and related device
CN112954450B (en) * 2021-02-02 2022-06-17 北京字跳网络技术有限公司 Video processing method and device, electronic equipment and storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003333523A (en) * 2002-05-17 2003-11-21 Newsoft Technology Corp Character thumbnail sequence generating system and method thereof
CN1561513A (en) * 2001-10-01 2005-01-05 汤姆森特许公司 System and method for identifying data on a storage medium
WO2009044351A1 (en) * 2007-10-04 2009-04-09 Koninklijke Philips Electronics N.V. Generation of image data summarizing a sequence of video frames
JP4612826B2 (en) * 2004-10-01 2011-01-12 キヤノン株式会社 Storage device, storage method, computer-readable storage medium, and program

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7281220B1 (en) * 2000-05-31 2007-10-09 Intel Corporation Streaming video programming guide system selecting video files from multiple web sites and automatically generating selectable thumbnail frames and selectable keyword icons
US20080046406A1 (en) * 2006-08-15 2008-02-21 Microsoft Corporation Audio and video thumbnails
US20100107126A1 (en) * 2008-10-28 2010-04-29 Hulu Llc Method and apparatus for thumbnail selection and editing

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1561513A (en) * 2001-10-01 2005-01-05 汤姆森特许公司 System and method for identifying data on a storage medium
JP2003333523A (en) * 2002-05-17 2003-11-21 Newsoft Technology Corp Character thumbnail sequence generating system and method thereof
JP4612826B2 (en) * 2004-10-01 2011-01-12 キヤノン株式会社 Storage device, storage method, computer-readable storage medium, and program
WO2009044351A1 (en) * 2007-10-04 2009-04-09 Koninklijke Philips Electronics N.V. Generation of image data summarizing a sequence of video frames

Also Published As

Publication number Publication date
CN101853286A (en) 2010-10-06

Similar Documents

Publication Publication Date Title
CN101853286B (en) Intelligent selection method of video thumbnails
CN105023008B (en) The pedestrian of view-based access control model conspicuousness and multiple features recognition methods again
US9495754B2 (en) Person clothing feature extraction device, person search device, and processing method thereof
CN102567731B (en) Extraction method for region of interest
EP2523165B1 (en) Image processing method and image processing device
CN110097034A (en) A kind of identification and appraisal procedure of Intelligent human-face health degree
CN110210360B (en) Rope skipping counting method based on video image target recognition
EP2013850B1 (en) Salience estimation for object-based visual attention model
CN103996195A (en) Image saliency detection method
CN103971126A (en) Method and device for identifying traffic signs
CN101604382A (en) A kind of learning fatigue recognition interference method based on human facial expression recognition
CN102496023A (en) Region of interest extraction method of pixel level
CN107066972B (en) Natural scene Method for text detection based on multichannel extremal region
CN105844242A (en) Method for detecting skin color in image
CN107886507B (en) A kind of salient region detecting method based on image background and spatial position
CN107038416A (en) A kind of pedestrian detection method based on bianry image modified HOG features
CN106228157A (en) Coloured image word paragraph segmentation based on image recognition technology and recognition methods
CN110032932A (en) A kind of human posture recognition method based on video processing and decision tree given threshold
CN106778704A (en) A kind of recognition of face matching process and semi-automatic face matching system
CN104598914A (en) Skin color detecting method and device
CN106056078A (en) Crowd density estimation method based on multi-feature regression ensemble learning
CN105354570A (en) Method and system for precisely locating left and right boundaries of license plate
CN106355596B (en) A kind of edge detection method merging uniform color information and compound receptive field model
TWM592541U (en) Image recognition system
CN104573743B (en) A kind of facial image detection filter method

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20200518

Address after: 310052 room 508, floor 5, building 4, No. 699, Wangshang Road, Changhe street, Binjiang District, Hangzhou City, Zhejiang Province

Patentee after: Alibaba (China) Co.,Ltd.

Address before: 200003 Shanghai Xuhui District Xietu Road No. 1238 Building No. 6, X2 Creative Park

Patentee before: SHANGHAI TUDOU NETWORK TECHNOLOGY Co.,Ltd.

CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20160810

Termination date: 20200520