CN104270553A - Video scene switching detection method and device - Google Patents
Video scene switching detection method and device Download PDFInfo
- Publication number
- CN104270553A CN104270553A CN201410507997.XA CN201410507997A CN104270553A CN 104270553 A CN104270553 A CN 104270553A CN 201410507997 A CN201410507997 A CN 201410507997A CN 104270553 A CN104270553 A CN 104270553A
- Authority
- CN
- China
- Prior art keywords
- video
- frame
- divided block
- distance
- sequence
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The embodiment of the invention discloses a video scene switching detection method and device, and relates to the technical field of video processing. The method includes the steps that a partitioning sequence measurement feature vector Vp of a first video frame p in a target video sequence is acquired; a partitioning sequence measurement feature vector Vq of a second video frame q in the target video sequence is acquired; the distance D (Vp and Vq) between Vp and Vq is calculated; whether the distance obtained after calculation meets a preset distance requirement or not is judged; if yes, it is judged that video scene switching is generated between the first video frame p and the second video frame q. By the application of the scheme, after light in video content changes, the false drop rate of video scene switching can be decreased.
Description
Technical field
The present invention relates to technical field of video processing, particularly a kind of switching detection method of video scene and device.
Background technology
Video scene switches, and refers to the DISPLAY ORDER according to frame of video, the phenomenon of the larger change of picture material generation that adjacent two frame frame of video are corresponding.Common video scene switches and comprises: the picture material of the relatively last frame of video of the picture material of adjacent two frames picture material that is completely not identical, current video frame is fusion of the picture material of last frame of video and the picture material of other frame of video etc. along the picture material of a direction significantly translation and current video frame.Video scene switch generally occur in the sudden change of video camera shooting angle, reference object acutely moves or in the situation such as video film source editing splicing.In practical application, detect video scene accurately and switch and can provide effective help for Video coding, video clipping segmentation and video frequency searching etc.
In prior art, a kind of method that detection video scene specifically switches is, obtain the grey level histogram of two frame frame of video in video sequence, judge whether the numerical value of similitude between the grey level histogram for representing this two frames frame of video is less than default threshold value, if be less than, then judge that there occurs video scene between this two frames frame of video switches, wherein, larger for representing the numerical value of similitude between two frame frame of video grey level histograms, represent that two frame of video are more similar.In practical application, during due to picture material consecutive variations that each frame of video in video sequence is corresponding, between the grey level histogram of two frame frame of video, there is higher similitude, and when video scene occurring and switching, similitude between the grey level histogram of two frame frame of video is lower, therefore, apply said method and can detect that whether there occurs scene between two frame frame of video switches.But said method is more responsive to light change, even if only there occurs light change between two frame of video, the grey level histogram change of frame of video also can comparatively greatly, and therefore, it is higher that application said method detects false drop rate when video scene switches.
Summary of the invention
The embodiment of the invention discloses a kind of switching detection method of video scene and device, with when light changes in picture material, reduce the false drop rate that video scene switches.
For achieving the above object, the embodiment of the invention discloses a kind of switching detection method of video scene, described method comprises:
Obtain the piecemeal order Measure Characteristics vector V of the first frame of video p in target vides sequence
p, wherein, V
p={ V
p[0], V
p[1] ..., V
p[N] }, N > 0,0,1 ..., N is: the numbering of (N+1) individual divided block that the frame of video determined according to the image information of frame of video is corresponding, V
p[n]=aV '
p[n]+b, V '
p[n], for each divided block corresponding to described first frame of video p is according to after the size sequence of the average gray of pixel in block, is numbered the sequence sequence number value that the divided block of n is corresponding, 0≤n≤N, 1≤V '
p[n]≤N+1, a, b represent default adjustment parameter, and a ≠ 0;
Obtain the piecemeal order Measure Characteristics vector V of the second frame of video q in described target vides sequence
q, wherein, V
q={ V
q[0], V
q[1] ..., V
q[N] }, wherein, V
q[n]=aV '
q[n]+b, V '
q[n], for each divided block corresponding to described second frame of video q is according to after the size sequence of the average gray of pixel in block, is numbered the sequence sequence number value that the divided block of n is corresponding, 0≤n≤N, 1≤V '
p[n]≤N+1;
Calculate V
pwith V
qbetween distance D (V
p, V
q);
Judge whether the distance calculated meets the required distance preset;
If yes, then judge that there occurs video scene between described first frame of video p and described second frame of video q switches.
Optionally, described calculating V
pwith V
qbetween distance D (V
p, V
q), comprising:
According to relational expression
calculate V
pwith V
qbetween distance D (V
p, V
q).
Optionally, whether the distance that described judgement calculates meets the required distance preset, and comprising:
Whether the distance that direct judgement calculates is greater than default first threshold, if yes, judges that the distance calculated meets default required distance;
Or
According to relational expression d (V
p, V
q)=D (V
p, V
q)/max{D (V
p, V
q), the distance calculated is normalized, wherein, d (V
p, V
q) represent the distance value after normalized, max{D (V
p, V
q) represent the D (V that can obtain
p, V
q) maximum;
Judge d (V
p, V
q) whether be greater than default Second Threshold, if yes, judge that the distance calculated meets default required distance.
Optionally, the piecemeal Measure Characteristics vector of target video frame is obtained by following steps:
According to the image information of target video frame, determine (N+1) individual divided block that described target video frame is corresponding;
Calculate the average gray of pixel in (N+1) individual divided block respectively;
Sort according to the size of the average gray of (N+1) the individual divided block calculated;
According to ranking results, obtain the sequence sequence number value that each divided block is corresponding;
The piecemeal Measure Characteristics vector of described target video frame is generated according to the sequence sequence number value of each divided block.
Optionally, the described image information according to target video frame, determine to comprise (N+1) individual divided block that described target video frame is corresponding:
Obtain the luminance picture of target video frame;
Described luminance picture is divided into (N+1) individual divided block;
Determine that above-mentioned (N+1) individual divided block is (N+1) individual divided block that described target video frame is corresponding.
For achieving the above object, the embodiment of the invention discloses a kind of video scene change detection device, described device comprises: characteristic vector obtains module, distance calculation module, Distance Judgment module and scene and is switched and determined module;
Described characteristic vector obtains module, for obtaining the piecemeal order Measure Characteristics vector V of the first frame of video p in target vides sequence
p, wherein, V
p={ V
p[0], V
p[1] ..., V
p[N] }, N > 0,0,1 ..., N is: the numbering of (N+1) individual divided block that the frame of video determined according to the image information of frame of video is corresponding, V
p[n]=aV '
p[n]+b, V '
p[n], for each divided block corresponding to described first frame of video p is according to after the size sequence of the average gray of pixel in block, is numbered the sequence sequence number value that the divided block of n is corresponding, 0≤n≤N, 1≤V '
p[n]≤N+1, a, b represent default adjustment parameter, and a ≠ 0;
Described characteristic vector obtains module, also for obtaining the piecemeal order Measure Characteristics vector V of the second frame of video q in described target vides sequence
q, wherein, V
q={ V
q[0], V
q[1] ..., V
q[N] }, wherein, V
q[n]=aV '
q[n]+b, V '
q[n], for each divided block corresponding to described second frame of video q is according to after the size sequence of the average gray of pixel in block, is numbered the sequence sequence number value that the divided block of n is corresponding, 0≤n≤N, 1≤V '
p[n]≤N+1;
Described distance calculation module, for calculating V
pwith V
qbetween distance D (V
p, V
q);
Described Distance Judgment module, for judging whether the distance calculated meets the required distance preset, if yes, triggering described scene switching determination module and judging that there occurs video scene between frame of video switches;
Described scene is switched and determined module, for judging that there occurs video scene between described first frame of video p and described second frame of video q switches.
Optionally, described distance calculation module, specifically for according to relational expression
calculate V
pwith V
qbetween distance D (V
p, V
q).
Optionally, described Distance Judgment module, specifically for directly judging whether the distance calculated is greater than default first threshold, if yes, judges that the distance calculated meets default required distance;
Or
Described Distance Judgment module, comprising:
Normalization submodule, for according to relational expression d (V
p, V
q)=D (V
p, V
q)/max{D (V
p, V
q), the distance calculated is normalized, wherein, d (V
p, V
q) represent the distance value after normalized, max{D (V
p, V
q) represent the D (V that can obtain
p, V
q) maximum;
Distance Judgment submodule, for judging d (V
p, V
q) whether be greater than default Second Threshold, if yes, judge that the distance calculated meets default required distance.
Optionally, described characteristic vector obtains module, comprising:
Divided block determination submodule, for the image information according to target video frame, determines (N+1) individual divided block that described target video frame is corresponding;
Average gray calculating sub module, for calculating the average gray of pixel in (N+1) individual divided block respectively;
Sorting sub-module, the size for the average gray according to (N+1) the individual divided block calculated sorts;
Sequence sequence number value obtains submodule, for according to ranking results, obtains the sequence sequence number value that each divided block is corresponding;
Characteristic vector generates submodule, for generating the piecemeal Measure Characteristics vector of described target video frame according to the sequence sequence number value of each divided block.
Optionally, described divided block determination submodule, comprising:
Luminance picture obtains unit, for obtaining the luminance picture of target video frame;
Luminance picture division unit, for being divided into (N+1) individual divided block by described luminance picture;
Divided block determining unit, for determining that above-mentioned (N+1) individual divided block is (N+1) individual divided block that described target video frame is corresponding.
As seen from the above, in the scheme that the embodiment of the present invention provides, obtain the piecemeal order Measure Characteristics vector of the first frame of video and the second frame of video in target vides sequence respectively, calculate the distance of piecemeal sequentially between Measure Characteristics vector obtained, if this distance meets the required distance preset, then judge that there occurs video scene between this two frame of video switches, wherein, element in piecemeal Measure Characteristics vector is after each divided block of frame of video sorts according to the size of the average gray of pixel in each divided block, the sequence sequence number value that each divided block is corresponding.Before in picture material, light changes, after, in two frame of video, in each divided block, the variation tendency of the average gray of pixel is similar, therefore, the piecemeal order Measure Characteristics vector of two frame of video is similar, accordingly, the distance of the piecemeal order Measure Characteristics vector of this two frame of video is general less, now can judge that video scene does not occur between two frame of video to be switched, and in prior art, before light change, after, generally differ greatly between the grey level histogram of two frame of video, easily be judged as and there occurs video scene switching, comprehensive above visible, the scheme that the application embodiment of the present invention provides, after in picture material, light changes, the false drop rate that video scene switches can be reduced.
Accompanying drawing explanation
In order to be illustrated more clearly in the embodiment of the present invention or technical scheme of the prior art, be briefly described to the accompanying drawing used required in embodiment or description of the prior art below, apparently, accompanying drawing in the following describes is only some embodiments of the present invention, for those of ordinary skill in the art, under the prerequisite not paying creative work, other accompanying drawing can also be obtained according to these accompanying drawings.
The schematic flow sheet of a kind of switching detection method of video scene that Fig. 1 provides for the embodiment of the present invention;
A kind of schematic flow sheet obtaining the method for characteristic vector that Fig. 2 provides for the embodiment of the present invention;
The structural representation of a kind of video scene change detection device that Fig. 3 provides for the embodiment of the present invention;
A kind of structural representation obtaining the device of characteristic vector that Fig. 4 provides for the embodiment of the present invention.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, be clearly and completely described the technical scheme in the embodiment of the present invention, obviously, described embodiment is only the present invention's part embodiment, instead of whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art, not making the every other embodiment obtained under creative work prerequisite, belong to the scope of protection of the invention.
The schematic flow sheet of a kind of switching detection method of video scene that Fig. 1 provides for the embodiment of the present invention, the method comprises:
S101: the piecemeal order Measure Characteristics vector V obtaining the first frame of video p in target vides sequence
p.
Wherein, V
p={ V
p[0], V
p[1] ..., V
p[N] }, N > 0,0,1 ..., N is: the numbering of (N+1) individual divided block that the frame of video determined according to the image information of frame of video is corresponding, V
p[n]=aV '
p[n]+b, V '
p[n] be each divided block that the first frame of video p is corresponding according to after the size sequence of the average gray of pixel in block, be numbered the sequence sequence number value that the divided block of n is corresponding, 0≤n≤N, 1≤V '
p[n]≤N+1, a, b represent default adjustment parameter, and a ≠ 0.
The first above-mentioned frame of video p can be the arbitrary frame of video in target vides sequence, when a, b get different numerical value, and V
pcorresponding different characteristic vectors.
Such as, when a=1, b=0, V
p=V '
p[0], V '
p[1] ..., V '
p[N] };
When a=1, b=-1, V
p=V '
p[0]-1, V '
p[1]-1 ..., V '
p[N]-1}.
Concrete, suppose that the first frame of video p is divided into 4 divided block, in these 4 divided block, the average gray of pixel is respectively: 50,120,70 and 115, a=1, b=-1, then N=3, the numbering of these 4 divided block, average gray, sequence sequence number value and V
pthe corresponding relation of [n] is as shown in table 1.
Table 1
| Divided block is numbered | Average gray | Sequence sequence number value | V p[n] |
| 0 | 50 | 1 | 1x1-1＝0 |
| 1 | 120 | 4 | 4x1-1＝3 |
| 2 | 70 | 2 | 2x1-1＝1 |
| 3 | 115 | 3 | 3x1-1＝2 |
The sequence number value that sorts in table 1 is the sequence sequence number value obtained after average gray arranges according to ascending order, and certainly, average gray also can carry out arrangement according to descending and obtain the sequence number value that sorts.
The image information of above-mentioned frame of video can be the luminance image information, chrominance image information etc. of frame of video, and the application does not limit this.
S102: the piecemeal order Measure Characteristics vector V obtaining the second frame of video q in target vides sequence
q.
Wherein, V
q={ V
q[0], V
q[1] ..., V
q[N] }, V
q[n]=aV '
q[n]+b, V '
q[n] be each divided block that the second frame of video q is corresponding according to after the size sequence of the average gray of pixel in block, be numbered the sequence sequence number value that the divided block of n is corresponding, 0≤n≤N, 1≤V '
p[n]≤N+1.
The second above-mentioned frame of video q is the arbitrary frame of video being different from the first frame of video p in target vides sequence, concrete, supposes that the frame number of the first frame of video p is frm
num1, the frame number of the second frame of video q is frm
num2, then meet relational expression in target vides sequence | frm
num2-frm
num1| any two frame of video of>=1.
In practical application, according to the DISPLAY ORDER of frame of video, the second frame of video q can be the next frame of the first frame of video p, and namely frame number meets frm
num2-frm
num1the frame of video of=1; Second frame of video q can also be that frame number meets frm
num2-frm
num1the frame of video of>=m, wherein, m>=1, such as, in Video coding, the first frame of video p can be the forward reference frame of the second frame of video q, and the value of m is relevant with the selection of reference frame in actual coding, can be 1,2 etc.
Certainly, the application is just described for above-mentioned, and in practical application, the system of selection of the first frame of video and the second frame of video is not limited only to above-mentioned several.
S103: calculate V
pwith V
qbetween distance D (V
p, V
q).
Those skilled in the art are understandable that, can according to the range formula between two vectors:
Calculate V
pwith V
qbetween distance D (V
p, V
q).
In addition, consider according to above-mentioned formulae discovery V
pwith V
qbetween distance D (V
p, V
q) amount of calculation comparatively large, in a preferred embodiment of the invention, according to following relational expression:
Calculate V
pwith V
qbetween distance D (V
p, V
q).
S104: judge whether the distance calculated meets the required distance preset, and if yes, performs S105, otherwise, perform S106.
In a kind of specific implementation, can by directly judging whether the distance calculated is greater than the mode of default first threshold, judge whether the distance calculated meets the required distance preset, when judge the distance that calculates be greater than default first threshold time, then judge that the distance calculated meets default required distance.
In another kind of specific implementation, can also judge whether the distance calculated meets the required distance preset in the following manner:
First, according to relational expression d (V
p, V
q)=D (V
p, V
q)/max{D (V
p, V
q), the distance calculated is normalized, then judges d (V
p, V
q) whether be greater than default Second Threshold, if d is (V
p, V
q) be greater than default Second Threshold, then judge that the distance calculated meets default required distance.
Wherein, above-mentioned d (V
p, V
q) represent the distance value after normalized, max{D (V
p, V
q) represent the D (V that can obtain
p, V
q) maximum.
Suppose, frame of video is divided into 16 divided block, and a=1, b=-1, i.e. N=15, then exist
V
p＝{0，1，2，3，4，5，6，7，8，9，10，11，12，13，14，15}，
V
q=during 15,14,13,12,11,10,9,8,7,6,5,4,3,2,1,0}, the D (V that can obtain
p, V
q) maximum:
Because frame of video in practical application can be divided into the divided block of varying number, therefore, max{D (V
p, V
q) concrete value can with reference to above-mentioned example, the quantity according to the divided block of frame of video obtains.
S105: judge that there occurs video scene between the first frame of video p and the second frame of video q switches.
S106: process ends.
A kind of schematic flow sheet obtaining the method for characteristic vector that Fig. 2 provides for the embodiment of the present invention, the method comprises:
S201: according to the image information of target video frame, determines (N+1) individual divided block that target video frame is corresponding.
In practical application, the picture format that target video frame is corresponding can be YUV420, the picture formats such as YUV422 or RGB32, in a kind of specific implementation, according to the image information of target video frame, determine that (N+1) individual divided block that target video frame is corresponding can be: the luminance picture first obtaining target video frame, such as, obtaining picture format is luminance picture corresponding to the Y-component of the target video frame of YUV420, again this luminance picture is divided into (N+1) individual divided block, and determine that above-mentioned (N+1) individual divided block obtained according to luminance picture is (N+1) individual divided block that target video frame is corresponding.
S202: the average gray calculating pixel in (N+1) individual divided block respectively.
Suppose, the size of a divided block is 16x16, then in this divided block, the average gray of pixel is:
wherein, G
ijrepresent the gray value of the i-th row in this divided block, jth row pixel.
S203: sort according to the size of the average gray of (N+1) the individual divided block calculated.
When the size of the average gray according to (N+1) the individual divided block calculated sorts, can sort according to ascending order, also can sort according to descending, the application does not limit this.
S204: according to ranking results, obtains the sequence sequence number value that each divided block is corresponding.
S205: the piecemeal Measure Characteristics vector generating target video frame according to the sequence sequence number value of each divided block.
The method of above-mentioned acquisition characteristic vector is described below by instantiation.
S201: the luminance picture obtaining target video frame, is divided into 4 divided block by this luminance picture.
S202: the average gray calculating pixel in 4 divided block, as shown in table 2 below.
Table 2
| Divided block is numbered | 0 | 1 | 2 | 3 |
| Average gray | 50 | 120 | 70 | 115 |
S203: according to the size of the average gray of 4 divided block calculated, carry out ascending sort, ranking results is as shown in table 3 below.
Table 3
| Average gray | 50 | 70 | 115 | 120 |
| Divided block is numbered | 0 | 2 | 3 | 1 |
| Sequence sequence number value | 1 | 2 | 3 | 4 |
S204: according to ranking results, the sequence sequence number value that each divided block of acquisition is corresponding is as shown in table 4 below.
Table 4
| Divided block is numbered | 0 | 1 | 2 | 3 |
| Sequence sequence number value | 1 | 4 | 2 | 3 |
S205: suppose, a=1, b=-1, then the piecemeal Measure Characteristics vector generating target video frame is: V={1x1-1,4x1-1,2x1-1,3x1-1}={0,3,1,2}.
As seen from the above, in the scheme that the present embodiment provides, obtain the piecemeal order Measure Characteristics vector of the first frame of video and the second frame of video in target vides sequence respectively, calculate the distance of piecemeal sequentially between Measure Characteristics vector obtained, if this distance meets the required distance preset, then judge that there occurs video scene between this two frame of video switches, wherein, element in piecemeal Measure Characteristics vector is after each divided block of frame of video sorts according to the size of the average gray of pixel in each divided block, the sequence sequence number value that each divided block is corresponding.Before in picture material, light changes, after, in two frame of video, in each divided block, the variation tendency of the average gray of pixel is similar, therefore, the piecemeal order Measure Characteristics vector of two frame of video is similar, accordingly, the distance of the piecemeal order Measure Characteristics vector of this two frame of video is general less, now can judge that video scene does not occur between two frame of video to be switched, and in prior art, before light change, after, generally differ greatly between the grey level histogram of two frame of video, easily be judged as and there occurs video scene switching, comprehensive above visible, the scheme that application the present embodiment provides, after in picture material, light changes, the false drop rate that video scene switches can be reduced.
Corresponding with above-mentioned switching detection method of video scene, the embodiment of the present invention additionally provides a kind of video scene change detection device.
The structural representation of a kind of video scene change detection device that Fig. 3 provides for the embodiment of the present invention, this device comprises: characteristic vector obtains module 301, distance calculation module 302, Distance Judgment module 303 and scene and is switched and determined module 304.
Wherein, described characteristic vector obtains module 301, for obtaining the piecemeal order Measure Characteristics vector V of the first frame of video p in target vides sequence
p, wherein, V
p={ V
p[0], V
p[1] ..., V
p[N] }, N > 0,0,1 ..., N is: the numbering of (N+1) individual divided block that the frame of video determined according to the image information of frame of video is corresponding, V
p[n]=aV '
p[n]+b, V '
p[n], for each divided block corresponding to described first frame of video p is according to after the size sequence of the average gray of pixel in block, is numbered the sequence sequence number value that the divided block of n is corresponding, 0≤n≤N, 1≤V '
p[n]≤N+1, a, b represent default adjustment parameter, and a ≠ 0;
Described characteristic vector obtains module 301, also for obtaining the piecemeal order Measure Characteristics vector V of the second frame of video q in described target vides sequence
q, wherein, V
q[n]=aV '
q[n]+b, V '
q[n], for each divided block corresponding to described second frame of video q is according to after the size sequence of the average gray of pixel in block, is numbered the sequence sequence number value that the divided block of n is corresponding, 0≤n≤N, 1≤V '
p[n]≤N+1;
Described distance calculation module 302, for calculating V
pwith V
qbetween distance D (V
p, V
q);
Described Distance Judgment module 303, for judging whether the distance calculated meets the required distance preset, if yes, triggering described scene switching determination module 304 and judging that there occurs video scene between frame of video switches;
Described scene is switched and determined module 304, for judging that there occurs video scene between described first frame of video p and described second frame of video q switches.
Concrete, described distance calculation module 302, specifically for according to relational expression
calculate V
pwith V
qbetween distance D (V
p, V
q).
Concrete, described Distance Judgment module 303, specifically for directly judging whether the distance calculated is greater than default first threshold, if yes, judges that the distance calculated meets default required distance;
Or
Described Distance Judgment module 303, comprising: normalization submodule and Distance Judgment submodule (not shown).
Wherein, normalization submodule, for according to relational expression d (V
p, V
q)=D (V
p, V
q)/max{D (V
p, V
q), the distance calculated is normalized, wherein, d (V
p, V
q) represent the distance value after normalized, max{D (V
p, V
q) represent the D (V that can obtain
p, V
q) maximum;
Distance Judgment submodule, for judging d (V
p, V
q) whether be greater than default Second Threshold, if yes, judge that the distance calculated meets default required distance.
A kind of structural representation obtaining the device of characteristic vector that Fig. 4 provides for the embodiment of the present invention, in this device, above-mentioned characteristic vector obtains module 301, comprising: divided block determination submodule 3011, average gray calculating sub module 3012, sorting sub-module 3013, sequence sequence number value obtain submodule 3014 and characteristic vector generation submodule 3015.
Wherein, divided block determination submodule 3011, for the image information according to target video frame, determines (N+1) individual divided block that described target video frame is corresponding;
Average gray calculating sub module 3012, for calculating the average gray of pixel in (N+1) individual divided block respectively;
Sorting sub-module 3013, the size for the average gray according to (N+1) the individual divided block calculated sorts;
Sequence sequence number value obtains submodule 3014, for according to ranking results, obtains the sequence sequence number value that each divided block is corresponding;
Characteristic vector generates submodule 3015, for generating the piecemeal Measure Characteristics vector of described target video frame according to the sequence sequence number value of each divided block.
Concrete, divided block determination submodule 3011, comprising: luminance picture obtains unit, luminance picture division unit and divided block determining unit (not shown).
Wherein, luminance picture obtains unit, for obtaining the luminance picture of target video frame;
Luminance picture division unit, for being divided into (N+1) individual divided block by described luminance picture;
Divided block determining unit, for determining that above-mentioned (N+1) individual divided block is (N+1) individual divided block that described target video frame is corresponding.
As seen from the above, in the scheme that the present embodiment provides, obtain the piecemeal order Measure Characteristics vector of the first frame of video and the second frame of video in target vides sequence respectively, calculate the distance of piecemeal sequentially between Measure Characteristics vector obtained, if this distance meets the required distance preset, then judge that there occurs video scene between this two frame of video switches, wherein, element in piecemeal Measure Characteristics vector is after each divided block of frame of video sorts according to the size of the average gray of pixel in each divided block, the sequence sequence number value that each divided block is corresponding.Before in picture material, light changes, after, in two frame of video, in each divided block, the variation tendency of the average gray of pixel is similar, therefore, the piecemeal order Measure Characteristics vector of two frame of video is similar, accordingly, the distance of the piecemeal order Measure Characteristics vector of this two frame of video is general less, now can judge that video scene does not occur between two frame of video to be switched, and in prior art, before light change, after, generally differ greatly between the grey level histogram of two frame of video, easily be judged as and there occurs video scene switching, comprehensive above visible, the scheme that application the present embodiment provides, after in picture material, light changes, the false drop rate that video scene switches can be reduced.
For device embodiment, because it is substantially similar to embodiment of the method, so description is fairly simple, relevant part illustrates see the part of embodiment of the method.
It should be noted that, in this article, the such as relational terms of first and second grades and so on is only used for an entity or operation to separate with another entity or operating space, and not necessarily requires or imply the relation that there is any this reality between these entities or operation or sequentially.And, term " comprises ", " comprising " or its any other variant are intended to contain comprising of nonexcludability, thus make to comprise the process of a series of key element, method, article or equipment and not only comprise those key elements, but also comprise other key elements clearly do not listed, or also comprise by the intrinsic key element of this process, method, article or equipment.When not more restrictions, the key element limited by statement " comprising ... ", and be not precluded within process, method, article or the equipment comprising described key element and also there is other identical element.
One of ordinary skill in the art will appreciate that all or part of step realized in said method execution mode is that the hardware that can carry out instruction relevant by program has come, described program can be stored in computer read/write memory medium, here the alleged storage medium obtained, as: ROM/RAM, magnetic disc, CD etc.
The foregoing is only preferred embodiment of the present invention, be not intended to limit protection scope of the present invention.All any amendments done within the spirit and principles in the present invention, equivalent replacement, improvement etc., be all included in protection scope of the present invention.
Claims (10)
1. a switching detection method of video scene, is characterized in that, described method comprises:
Obtain the piecemeal order Measure Characteristics vector V of the first frame of video p in target vides sequence
p, wherein, V
p={ V
p[0], V
p[1] ..., V
p[N] }, N > 0,0,1 ..., N is: the numbering of (N+1) individual divided block that the frame of video determined according to the image information of frame of video is corresponding, V
p[n]=aV'
p[n]+b, V'
p[n], for each divided block corresponding to described first frame of video p is according to after the size sequence of the average gray of pixel in block, is numbered the sequence sequence number value that the divided block of n is corresponding, 0≤n≤N, 1≤V'
p[n]≤N+1, a, b represent default adjustment parameter, and a ≠ 0;
Obtain the piecemeal order Measure Characteristics vector V of the second frame of video q in described target vides sequence
q, wherein, V
q={ V
q[0], V
q[1] ..., V
q[N] }, wherein, V
q[n]=aV'
q[n]+b, V'
q[n], for each divided block corresponding to described second frame of video q is according to after the size sequence of the average gray of pixel in block, is numbered the sequence sequence number value that the divided block of n is corresponding, 0≤n≤N, 1≤V'
p[n]≤N+1;
Calculate V
pwith V
qbetween distance D (V
p, V
q);
Judge whether the distance calculated meets the required distance preset;
If yes, then judge that there occurs video scene between described first frame of video p and described second frame of video q switches.
2. method according to claim 1, is characterized in that, described calculating V
pwith V
qbetween distance D (V
p, V
q), comprising:
According to relational expression
calculate V
pwith V
qbetween distance D (V
p, V
q).
3. method according to claim 1 and 2, is characterized in that, whether the distance that described judgement calculates meets the required distance preset, and comprising:
Whether the distance that direct judgement calculates is greater than default first threshold, if yes, judges that the distance calculated meets default required distance;
Or
According to relational expression d (V
p, V
q)=D (V
p, V
q)/max{D (V
p, V
q), the distance calculated is normalized, wherein, d (V
p, V
q) represent the distance value after normalized, max{D (V
p, V
q) represent the D (V that can obtain
p, V
q) maximum;
Judge d (V
p, V
q) whether be greater than default Second Threshold, if yes, judge that the distance calculated meets default required distance.
4. method according to claim 1, is characterized in that, is obtained the piecemeal Measure Characteristics vector of target video frame by following steps:
According to the image information of target video frame, determine (N+1) individual divided block that described target video frame is corresponding;
Calculate the average gray of pixel in (N+1) individual divided block respectively;
Sort according to the size of the average gray of (N+1) the individual divided block calculated;
According to ranking results, obtain the sequence sequence number value that each divided block is corresponding;
The piecemeal Measure Characteristics vector of described target video frame is generated according to the sequence sequence number value of each divided block.
5. method according to claim 4, is characterized in that, the described image information according to target video frame, determines to comprise (N+1) individual divided block that described target video frame is corresponding:
Obtain the luminance picture of target video frame;
Described luminance picture is divided into (N+1) individual divided block;
Determine that above-mentioned (N+1) individual divided block is (N+1) individual divided block that described target video frame is corresponding.
6. a video scene change detection device, is characterized in that, described device comprises: characteristic vector obtains module, distance calculation module, Distance Judgment module and scene and is switched and determined module;
Described characteristic vector obtains module, for obtaining the piecemeal order Measure Characteristics vector V of the first frame of video p in target vides sequence
p, wherein, V
p={ V
p[0], V
p[1] ..., V
p[N] }, N > 0,0,1 ..., N is: the numbering of (N+1) individual divided block that the frame of video determined according to the image information of frame of video is corresponding, V
p[n]=aV'
p[n]+b, V'
p[n], for each divided block corresponding to described first frame of video p is according to after the size sequence of the average gray of pixel in block, is numbered the sequence sequence number value that the divided block of n is corresponding, 0≤n≤N, 1≤V'
p[n]≤N+1, a, b represent default adjustment parameter, and a ≠ 0;
Described characteristic vector obtains module, also for obtaining the piecemeal order Measure Characteristics vector V of the second frame of video q in described target vides sequence
q, wherein, V
q={ V
q[0], V
q[1] ..., V
q[N] }, wherein, V
q[n]=aV'
q[n]+b, V'
q[n], for each divided block corresponding to described second frame of video q is according to after the size sequence of the average gray of pixel in block, is numbered the sequence sequence number value that the divided block of n is corresponding, 0≤n≤N, 1≤V'
p[n]≤N+1;
Described distance calculation module, for calculating V
pwith V
qbetween distance D (V
p, V
q);
Described Distance Judgment module, for judging whether the distance calculated meets the required distance preset, if yes, triggering described scene switching determination module and judging that there occurs video scene between frame of video switches;
Described scene is switched and determined module, for judging that there occurs video scene between described first frame of video p and described second frame of video q switches.
7. device according to claim 6, is characterized in that, described distance calculation module, specifically for according to relational expression
calculate V
pwith V
qbetween distance D (V
p, V
q).
8. the device according to claim 6 or 7, is characterized in that,
Described Distance Judgment module, specifically for directly judging whether the distance calculated is greater than default first threshold, if yes, judges that the distance calculated meets default required distance;
Or
Described Distance Judgment module, comprising:
Normalization submodule, for according to relational expression d (V
p, V
q)=D (V
p, V
q)/max{D (V
p, V
q), the distance calculated is normalized, wherein, d (V
p, V
q) represent the distance value after normalized, max{D (V
p, V
q) represent the D (V that can obtain
p, V
q) maximum;
Distance Judgment submodule, for judging d (V
p, V
q) whether be greater than default Second Threshold, if yes, judge that the distance calculated meets default required distance.
9. device according to claim 6, is characterized in that, described characteristic vector obtains module, comprising:
Divided block determination submodule, for the image information according to target video frame, determines (N+1) individual divided block that described target video frame is corresponding;
Average gray calculating sub module, for calculating the average gray of pixel in (N+1) individual divided block respectively;
Sorting sub-module, the size for the average gray according to (N+1) the individual divided block calculated sorts;
Sequence sequence number value obtains submodule, for according to ranking results, obtains the sequence sequence number value that each divided block is corresponding;
Characteristic vector generates submodule, for generating the piecemeal Measure Characteristics vector of described target video frame according to the sequence sequence number value of each divided block.
10. device according to claim 9, is characterized in that, described divided block determination submodule, comprising:
Luminance picture obtains unit, for obtaining the luminance picture of target video frame;
Luminance picture division unit, for being divided into (N+1) individual divided block by described luminance picture;
Divided block determining unit, for determining that above-mentioned (N+1) individual divided block is (N+1) individual divided block that described target video frame is corresponding.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410507997.XA CN104270553B (en) | 2014-09-28 | 2014-09-28 | A kind of switching detection method of video scene and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410507997.XA CN104270553B (en) | 2014-09-28 | 2014-09-28 | A kind of switching detection method of video scene and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104270553A true CN104270553A (en) | 2015-01-07 |
| CN104270553B CN104270553B (en) | 2017-12-08 |
Family
ID=52162039
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410507997.XA Active CN104270553B (en) | 2014-09-28 | 2014-09-28 | A kind of switching detection method of video scene and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104270553B (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106603886A (en) * | 2016-12-13 | 2017-04-26 | Tcl集团股份有限公司 | Video scene distinguishing method and system |
| CN109168001A (en) * | 2018-09-27 | 2019-01-08 | 苏州科达科技股份有限公司 | Detection method, device and the video capture device of video scene variation |
| CN109977738A (en) * | 2017-12-28 | 2019-07-05 | 深圳Tcl新技术有限公司 | A kind of video scene segmentation judgment method, intelligent terminal and storage medium |
| CN111166233A (en) * | 2018-11-13 | 2020-05-19 | 余姚市雷阵雨电器有限公司 | Gear control system based on gray value analysis |
| CN112165621A (en) * | 2020-09-24 | 2021-01-01 | 北京金山云网络技术有限公司 | Scene switching frame detection method and device, storage medium and electronic equipment |
| CN117456204A (en) * | 2023-09-25 | 2024-01-26 | 珠海视熙科技有限公司 | Target tracking method, device, video processing system, storage medium and terminal |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101021904A (en) * | 2006-10-11 | 2007-08-22 | 鲍东山 | Video content analysis system |
| CN103778237A (en) * | 2014-01-27 | 2014-05-07 | 北京邮电大学 | Video abstraction generation method based on space-time recombination of active events |
| CN104780388A (en) * | 2015-03-31 | 2015-07-15 | 北京奇艺世纪科技有限公司 | Video data partitioning method and device |
-
2014
- 2014-09-28 CN CN201410507997.XA patent/CN104270553B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101021904A (en) * | 2006-10-11 | 2007-08-22 | 鲍东山 | Video content analysis system |
| CN103778237A (en) * | 2014-01-27 | 2014-05-07 | 北京邮电大学 | Video abstraction generation method based on space-time recombination of active events |
| CN104780388A (en) * | 2015-03-31 | 2015-07-15 | 北京奇艺世纪科技有限公司 | Video data partitioning method and device |
Non-Patent Citations (1)
| Title |
|---|
| 刘政凯，汤晓鸥: ""视频检索中镜头分割方法综述"", 《计算机工程与应用》 * |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106603886A (en) * | 2016-12-13 | 2017-04-26 | Tcl集团股份有限公司 | Video scene distinguishing method and system |
| CN109977738A (en) * | 2017-12-28 | 2019-07-05 | 深圳Tcl新技术有限公司 | A kind of video scene segmentation judgment method, intelligent terminal and storage medium |
| CN109168001A (en) * | 2018-09-27 | 2019-01-08 | 苏州科达科技股份有限公司 | Detection method, device and the video capture device of video scene variation |
| WO2020063688A1 (en) * | 2018-09-27 | 2020-04-02 | 苏州科达科技股份有限公司 | Method and device for detecting video scene change, and video acquisition device |
| CN109168001B (en) * | 2018-09-27 | 2021-02-12 | 苏州科达科技股份有限公司 | Method and device for detecting video scene change and video acquisition equipment |
| CN111166233A (en) * | 2018-11-13 | 2020-05-19 | 余姚市雷阵雨电器有限公司 | Gear control system based on gray value analysis |
| CN112165621A (en) * | 2020-09-24 | 2021-01-01 | 北京金山云网络技术有限公司 | Scene switching frame detection method and device, storage medium and electronic equipment |
| CN112165621B (en) * | 2020-09-24 | 2024-01-19 | 北京金山云网络技术有限公司 | Scene switching frame detection method and device, storage medium and electronic equipment |
| CN117456204A (en) * | 2023-09-25 | 2024-01-26 | 珠海视熙科技有限公司 | Target tracking method, device, video processing system, storage medium and terminal |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104270553B (en) | 2017-12-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104270553A (en) | Video scene switching detection method and device | |
| US9426449B2 (en) | Depth map generation from a monoscopic image based on combined depth cues | |
| CN110544258B (en) | Image segmentation method and device, electronic equipment and storage medium | |
| JP5045371B2 (en) | Foreground / background classification apparatus, method, and program for each pixel of moving image | |
| CN107301402B (en) | Method, device, medium and equipment for determining key frame of real scene | |
| CN106937114B (en) | Method and device for detecting video scene switching | |
| CN104408429A (en) | Method and device for extracting representative frame of video | |
| US8355079B2 (en) | Temporally consistent caption detection on videos using a 3D spatiotemporal method | |
| CN108780507A (en) | System and method for providing Image Classifier | |
| US20110075025A1 (en) | System and method producing high definition video from low definition video | |
| CN113301408B (en) | Video data processing method and device, electronic equipment and readable storage medium | |
| CN109447023B (en) | Method for determining image similarity, and method and device for identifying video scene switching | |
| CN104823437A (en) | Picture processing method and device | |
| KR102102164B1 (en) | Method, apparatus and computer program for pre-processing video | |
| CN104602096B (en) | A kind of detection method and device in video caption area | |
| US10096116B2 (en) | Method and apparatus for segmentation of 3D image data | |
| CN107784269A (en) | A kind of method and system of 3D frame of video feature point extraction | |
| JP2018206292A (en) | Video summary creation device and program | |
| CN115908344A (en) | Micro LED chip defect detection method based on MLCT-YOLO | |
| CN108711164B (en) | Motion detection method based on L BP and Color characteristics | |
| EP2932466B1 (en) | Method and apparatus for segmentation of 3d image data | |
| Correa-Tome et al. | Integral split-and-merge methodology for real-time image segmentation | |
| KR101611267B1 (en) | Method for object recognition and apparatus thereof | |
| CN107886102B (en) | Adaboost classifier training method and system | |
| CN112995666B (en) | Video horizontal and vertical screen conversion method and device combined with scene switching detection |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20180717 Address after: 201103 701 rooms, No. 33, Leshan Road, Xuhui District, Shanghai Patentee after: Shanghai Zhongyuan Network Co., Ltd. Address before: 100080, 10 and 11 floors of Hongcheng development building, 2 North one street, Haidian District, Beijing. Patentee before: Beijing Qiyi Century Technology Co., Ltd. |