CN103974142A - Video playing method and system - Google Patents

Abstract

The invention discloses a video playing method and system. The video playing method includes: receiving an interested object that a user selects from a current video frame and a progress control command in the specific direction, namely forward or backward direction, and establishing an index target according to the selected interested object; starting from the current video frame, subjecting each subsequent video frame of the current video frame in the specific direction to search matching according to the index target, and recording relative positions of the matching video frames in the whole video frame during matching; using the video frame, where the index target locates, as a start frame, and establishing play links according to the recorded relative positions; playing corresponding video frames according to the established play links. The video playing method and system according to the technical scheme has the advantages that only the video frames of the interested object selected by the user can be played, playing progress can be controlled using user-selected video content as an index, interaction level is greatly increased for users watching videos, and user experience is improved.

Description

A kind of video broadcasting method and system

Technical field

The present invention relates to field of video processing, relate in particular to a kind of video broadcasting method and system taking video content as index.

Background technology

Present most of player plays video, is all taking time shaft as order, plays, and fast forwarding and fast rewinding is also to carry out according to time shaft, and general F.F. or rewind down 5 seconds, or a frame after F.F., retreat to former frame soon; When beholder to video in object in one of them frame of video time interested, want, taking this object as the F.F. of index rewind down, under current fast forwarding and fast rewinding pattern, cannot complete.

Summary of the invention

The technical problem to be solved in the present invention is, for the above-mentioned defect of prior art, provides a kind of video broadcasting method and system, can carry out taking video content as index F.F. or rewind down.

The technical solution adopted for the present invention to solve the technical problems is: construct a kind of video broadcasting method, comprising:

A. receive user in the interest object of current video frame selection and the progress monitoring instruction of specific direction, and set up index target according to selected interest object, described specific direction is for advancing or retreating;

B. taking current video frame as starting point, respectively according to described index target to described current video frame the subsequent video frame on described specific direction search for coupling, and in the time of coupling, the relative position of the frame of video that record mates in whole frame of video;

C. taking the frame of video at described index target place as start frame, set up and play chain according to recorded relative position;

D. play corresponding frame of video according to set up broadcasting chain.

In video broadcasting method of the present invention, in described steps A, user selects attention object by rectangle frame.

In video broadcasting method of the present invention, in described steps A, by being carried out to peripheral edge, selected interest object detects to set up index target.

In video broadcasting method of the present invention, described steps A also comprises: determine the position of index target in current video frame, and using determined position as current video frame the initial position of the search window of the rear frame of video on specific direction;

Described step B comprises:

B1. judge that whether current video frame is last on described specific direction, if so, performs step C; If not, perform step B2;

B2. after described, in a frame of video, select the initial position of search window, and near initial position determine multiple candidate regions, and calculate the similarity of each candidate region and index target area, wherein, the minimum boundary rectangle frame region that the result detecting using described peripheral edge expands is as index target area;

Whether multiple similarities that B3. determining step B2 calculates respectively are all less than similarity threshold, and if so, a described rear frame of video is not mated with described index target, and performs step B4; If not, described rear frame of video and described index object matching, and perform step B5;

B4. using a frame of video after described as current video frame, and, using the initial position of the initial position of the search window of current video frame search window of the rear frame of video on specific direction as current video frame, then perform step B1;

B5. the relative position of the frame of video that record mates in whole frame of video;

B6. multiple similarities of step B2 being calculated compare, and definite maximum;

B7. using a frame of video after described as current video frame, and using the initial position of the position of the corresponding search window of described maximum search window of the rear frame of video on specific direction as current video frame, then perform step B1.

In video broadcasting method of the present invention, in described step B2, according to the similarity of formula calculated candidate region and index target area below:

$D(C1,C2)=1-\sqrt{1-\frac{\underset{i=0}{\overset{255}{\mathrm{\Σ}}}{C1}_i*{C2}_i}{\underset{i=0}{\overset{255}{\mathrm{\Σ}}}{C1}_i*\underset{i=0}{\overset{255}{\mathrm{\Σ}}}{C2}_i}}$

Wherein, D(C1, C2) be the similarity of candidate region and index target area; C1 _ifor the pixel quantity that is i of tonal gradation in candidate region accounts for the ratio of total pixel number amount; C2 _ifor the pixel quantity that in index target area, tonal gradation is i accounts for the ratio of total pixel number amount, the integer that i is 0～255.

The present invention also constructs a kind of audio/video player system, comprising:

Receiver module, for receiving user in the interest object of current video frame selection and the progress monitoring instruction of specific direction, described specific direction is for advancing or retreating;

Index target is set up module, sets up index target according to selected interest object;

Search matching module, be used for taking current video frame as starting point, respectively according to described index target to described current video frame the subsequent video frame on described specific direction search for coupling, and in when coupling, the relative position of the frame of video that record mates in whole frame of video;

Play chain and set up module,, set up and play chain according to recorded relative position as start frame for the frame of video taking described index target place;

Video playback module, for playing corresponding frame of video according to set up broadcasting chain.

In audio/video player system of the present invention, described receiver module receives user by the selected interest object of rectangle frame.

In audio/video player system of the present invention, described index target is set up module and is detected to set up index target by selected interest object is carried out to peripheral edge.

In audio/video player system of the present invention, described audio/video player system also comprises:

Position determination module, for determining that index target is in the position of current video frame, and using determined position as current video frame the initial position of the search window of the rear frame of video on specific direction;

Described search matching module comprises:

The first judging unit, for judging that whether current video frame is last on described specific direction, in the time being last, turns to described broadcasting chain to set up module;

Similarity calculated, for in the time judging that current video frame is not last on described specific direction, after described, in a frame of video, select the initial position of search window, and near initial position determine multiple candidate regions, and calculate the similarity of each candidate region and index target area, wherein, the minimum boundary rectangle frame region that the result detecting using described peripheral edge expands is as index target area;

Whether matching judgment unit, be all less than similarity threshold for multiple similarities that judgement is calculated respectively, and if so, a described rear frame of video is not mated with described index target; If not, a frame of video and described index object matching after described;

The first initial position determining unit, for in the time not mating, after described, a frame of video is as current video frame, and, using the initial position of the initial position of the search window of current video frame search window of the rear frame of video on specific direction as current video frame, then turn to described the first judging unit;

Record cell, in the time mating, the relative position of the frame of video that record mates in whole frame of video;

Maximum determining unit, in the time mating, compares calculated multiple similarities, and definite maximum;

The second initial position determining unit, be used for using a described rear frame of video as current video frame, and using the initial position of the position of the corresponding search window of described maximum search window of the rear frame of video on specific direction as current video frame, then turn to described the first judging unit.

In audio/video player system of the present invention, described similarity calculated is according to the similarity of formula calculated candidate region and index target area below:

$D(C1,C2)=1-\sqrt{1-\frac{\underset{i=0}{\overset{255}{\mathrm{\Σ}}}{C1}_i*{C2}_i}{\underset{i=0}{\overset{255}{\mathrm{\Σ}}}{C1}_i*\underset{i=0}{\overset{255}{\mathrm{\Σ}}}{C2}_i}}$

Wherein, D(C1, C2) be the similarity of candidate region and index target area; C1 _ifor the pixel quantity that is i of tonal gradation in candidate region accounts for the ratio of total pixel number amount; C2 _ifor the pixel quantity that in index target area, tonal gradation is i accounts for the ratio of total pixel number amount, the integer that i is 0～255.

Implement technical scheme of the present invention, first receive the interest object of user's selection and the progress monitoring instruction of advancing or retreating of input, set up index target according to selected interest object, and in subsequent video frame, search for coupling according to index target, for the frame of video matching with index target, record its relative position in whole frame of video, then set up and play chain according to recorded relative position, finally play corresponding frame of video according to playing chain, like this, just can only play the frame of video that includes user-selected interest object, so, can carry out taking user-selected video content as index playing progress rate control, greatly improve user and watched the interactive of video, improve user's experience.

Brief description of the drawings

Below in conjunction with drawings and Examples, the invention will be further described, in accompanying drawing:

Fig. 1 is the flow chart of video broadcasting method embodiment mono-of the present invention;

Fig. 2 is the flow chart of step B preferred embodiment in Fig. 1;

Fig. 3 is the logic diagram of audio/video player system embodiment mono-of the present invention;

Fig. 4 is the logic diagram of audio/video player system embodiment bis-of the present invention.

Embodiment

Fig. 1 is the flow chart of video broadcasting method embodiment mono-of the present invention, and this video broadcasting method comprises:

A. receive user in the interest object of current video frame selection and the progress monitoring instruction of specific direction, and set up index target according to selected interest object, described specific direction is for advancing or retreating, in this step, preferably, can receive user by the selected interest object of rectangle frame, then set up index target by selected interest object is carried out to rim detection, accurately to select the peripheral edge of interest object;

B. taking current video frame as starting point, respectively according to described index target to described current video frame the subsequent video frame on described specific direction search for coupling, and in the time of coupling, the relative position of the frame of video that record mates in whole frame of video;

C. taking the frame of video at described index target place as start frame, set up and play chain according to recorded relative position;

D. play corresponding frame of video according to set up broadcasting chain.

In the time implementing this technical scheme, first receive the interest object of user's selection and the progress monitoring instruction of advancing or retreating of input, set up index target according to selected interest object, and in subsequent video frame, search for coupling according to index target, for the frame of video matching with index target, record its relative position in whole frame of video, then set up and play chain according to recorded relative position, finally play corresponding frame of video according to playing chain, like this, just can only play the frame of video that includes user-selected interest object, so, the video broadcasting method of the present embodiment can carry out taking user-selected video content as index playing progress rate control, greatly improve user and watched the interactive of video, improve user's experience.

In a preferred embodiment of video broadcasting method of the present invention, compare the embodiment mono-shown in Fig. 1, the steps A in the video broadcasting method of this embodiment also comprises:

Setting up after index target, also determining the position of index target in current video frame, and using determined position as current video frame the initial position of the search window of the rear frame of video on specific direction;

As shown in Figure 2, this step B comprises step B in the video broadcasting method of this embodiment:

B1. judge whether current video frame is last on described specific direction, if, illustrate that frame of video taking index target place is as original position, on specific direction, (forward or backward) detects each frame of video one by one, last frame of video detected, also, detected completely, performed step C; If not, perform step B2;

B2. after described, in a frame of video, select the initial position of search window, and near initial position determine multiple candidate regions, and calculate the similarity of each candidate region and index target area, the minimum boundary rectangle frame region that the result can peripheral edge detecting expands is as index target area.In this step, it should be noted that, about determine multiple candidate regions near initial position, can be by the starting point taking initial position as search window, respectively by search window up and down, left and right several directions move predeterminable range and determine, certainly, also starting point that can be taking initial position as search window, along other direction, the mobile predeterminable range such as for example, upper left 45 is spent, upper right 45 is spent, lower-left 45 is spent, lower-left 45 is spent.In addition, can for example, according to actual conditions (, the resolution of frame of video) mobile pixel number be set and determine mobile predeterminable range;

Whether multiple similarities that B3. determining step B2 calculates respectively are all less than similarity threshold, and if so, a described rear frame of video is not mated with described index target, and performs step B4; If not, described rear frame of video and described index object matching, and perform step B5.About this step, it should be noted that, this step is mainly to judge whether occurrence scene converts former and later two frame of video, because when without generation scene change, the picture of former and later two frame of video is more or less the same, have at least the similarity of a candidate region and index target area to be greater than similarity threshold, a frame of video and index object matching after also just can judging; In the time that occurrence scene converts, last frame of video is mutually far short of what is expected with the picture of a rear frame of video, and the similarity of all candidate regions and index target area is all less than similarity threshold, and after also just can judging, a frame of video is not mated with described index target;

B4. using a frame of video after described as current video frame, and, using the initial position of the initial position of the search window of current video frame search window of the rear frame of video on specific direction as current video frame, then perform step B1;

B5. the relative position of the frame of video that record mates in whole frame of video;

B6. multiple similarities of step B2 being calculated compare, and definite maximum;

B7. using a frame of video after described as current video frame, and using the initial position of the position of the corresponding search window of described maximum search window of the rear frame of video on specific direction as current video frame, then perform step B1.

In addition, preferably, in above-mentioned steps B2, can be according to the similarity of formula calculated candidate region and index target area below:

$D(C1,C2)=1-\sqrt{1-\frac{\underset{i=0}{\overset{255}{\mathrm{\Σ}}}{C1}_i*{C2}_i}{\underset{i=0}{\overset{255}{\mathrm{\Σ}}}{C1}_i*\underset{i=0}{\overset{255}{\mathrm{\Σ}}}{C2}_i}}$

Wherein, D(C1, C2) be the similarity of candidate region and index target area; C1 _ifor the pixel quantity that is i of tonal gradation in candidate region accounts for the ratio of total pixel number amount; C2 _ifor the pixel quantity that in index target area, tonal gradation is i accounts for the ratio of total pixel number amount, the integer that i is 0～255.

Fig. 3 is the logic diagram of audio/video player system embodiment mono-of the present invention, and the audio/video player system of this embodiment comprises that successively the receiver module 11, the index target that connect set up module 12, search matching module 13, play chain and set up module 14 and video playback module 15.Wherein, receiver module 11 is for receiving user in the interest object of current video frame selection and the progress monitoring instruction of specific direction, and this specific direction is for advancing or retreating.Preferably, receiver module receives user by the selected interest object of rectangle frame.Index target is set up module 12 and is set up index target according to selected interest object, preferably, sets up index target, accurately to select the peripheral edge of interest object by selected interest object is carried out to rim detection.Search matching module 13 is for taking current video frame as starting point, respectively according to index target to current video frame the subsequent video frame on described specific direction search for coupling, and in the time of coupling, the relative position of the frame of video that record mates in whole frame of video.Play chain set up module 14 for the frame of video taking described index target place as start frame, set up and play chain according to recorded relative position.Video playback module 15 is for playing corresponding frame of video according to set up broadcasting chain.

Fig. 4 is the logic diagram of audio/video player system embodiment bis-of the present invention, the audio/video player system of this embodiment comprises the receiver module 11 connecting successively, index target is set up module 12, position determination module 16, search matching module 13, play chain and set up module 14 and video playback module 15, wherein, the receiver module 11 of this embodiment, index target is set up module 12, play chain and set up the receiver module 11 in the embodiment shown in module 14 and video playback module 15 and Fig. 3, index target is set up module 12, the logical construction that broadcasting chain is set up module 14 and video playback module 15 is corresponding identical respectively, do not repeat at this, position determination module 16 and search matching module 13 are below only described.

About position determination module 16, it is set up after index target in index object module 12, be mainly used in determining the position of index target in current video frame, and using determined position as current video frame the initial position of the search window of the rear frame of video on specific direction.

About search matching module 13, it comprises the first judging unit 131, similarity calculated 132, matching judgment unit 133, the first initial position determining unit 134, record cell 135, maximum determining unit 136, the second initial position determining unit 137.And the first judging unit 131, for judging whether current video frame is last on specific direction, in the time being last, turns to broadcasting chain to set up module 14.Similarity calculated 132 is in the time judging that current video frame is not last on specific direction, in a rear frame of video, select the initial position of search window, and near initial position determine multiple candidate regions, and calculate the similarity of each candidate region and index target area, the minimum boundary rectangle frame region that the result can peripheral edge detecting expands is as index target area.Whether matching judgment unit 133 is all less than similarity threshold for multiple similarities that judgement is calculated respectively, and if so, a rear frame of video is not mated with index target; If not, after a frame of video and index object matching.The first initial position determining unit 134 is not in the time mating, using a rear frame of video as current video frame, and, using the initial position of the initial position of the search window of current video frame search window of the rear frame of video on specific direction as current video frame, then turn to the first judging unit 131.Record cell 135, in the time mating, records the relative position of the frame of video of mating in whole frame of video.Maximum determining unit 136, in the time mating, compares calculated multiple similarities, and definite maximum.The second initial position determining unit 137 is for using a rear frame of video as current video frame, and the initial position of the search window of the rear frame of video using the position of the corresponding search window of maximum as current video frame on specific direction, then turns to the first judging unit 131.

Preferably, above-mentioned similarity calculated 132 can be according to the similarity of formula calculated candidate region and index target area below:

$D(C1,C2)=1-\sqrt{1-\frac{\underset{i=0}{\overset{255}{\mathrm{\Σ}}}{C1}_i*{C2}_i}{\underset{i=0}{\overset{255}{\mathrm{\Σ}}}{C1}_i*\underset{i=0}{\overset{255}{\mathrm{\Σ}}}{C2}_i}}$

Wherein, D(C1, C2) be the similarity of candidate region and index target area; C1 _ifor the pixel quantity that is i of tonal gradation in candidate region accounts for the ratio of total pixel number amount; C2 _ifor the pixel quantity that in index target area, tonal gradation is i accounts for the ratio of total pixel number amount, the integer that i is 0～255.

The foregoing is only the preferred embodiments of the present invention, be not limited to the present invention, for a person skilled in the art, the present invention can have various modifications and variations.Within the spirit and principles in the present invention all, any amendment of doing, be equal to replacement, improvement etc., within all should being included in claim scope of the present invention.

Claims (10)

1. a video broadcasting method, is characterized in that, comprising:

A. receive user in the interest object of current video frame selection and the progress monitoring instruction of specific direction, and set up index target according to selected interest object, described specific direction is for advancing or retreating;

B. taking current video frame as starting point, respectively according to described index target to described current video frame the subsequent video frame on described specific direction search for coupling, and in the time of coupling, the relative position of the frame of video that record mates in whole frame of video;

C. taking the frame of video at described index target place as start frame, set up and play chain according to recorded relative position;

D. play corresponding frame of video according to set up broadcasting chain.

2. video broadcasting method according to claim 1, is characterized in that, in described steps A, user selects attention object by rectangle frame.

3. video broadcasting method according to claim 2, is characterized in that, in described steps A, detects to set up index target by selected interest object is carried out to peripheral edge.

4. video broadcasting method according to claim 3, it is characterized in that, described steps A also comprises: determine the position of index target in current video frame, and using determined position as current video frame the initial position of the search window of the rear frame of video on specific direction;

Described step B comprises:

B1. judge that whether current video frame is last on described specific direction, if so, performs step C; If not, perform step B2;

B2. after described, in a frame of video, select the initial position of search window, and near initial position determine multiple candidate regions, and calculate the similarity of each candidate region and index target area, wherein, the minimum boundary rectangle frame region that the result detecting using described peripheral edge expands is as index target area;

Whether multiple similarities that B3. determining step B2 calculates respectively are all less than similarity threshold, and if so, a described rear frame of video is not mated with described index target, and performs step B4; If not, described rear frame of video and described index object matching, and perform step B5;

B4. using a frame of video after described as current video frame, and, using the initial position of the initial position of the search window of current video frame search window of the rear frame of video on specific direction as current video frame, then perform step B1;

B5. the relative position of the frame of video that record mates in whole frame of video;

B6. multiple similarities of step B2 being calculated compare, and definite maximum;

B7. using a frame of video after described as current video frame, and using the initial position of the position of the corresponding search window of described maximum search window of the rear frame of video on specific direction as current video frame, then perform step B1.

5. video broadcasting method according to claim 4, is characterized in that, in described step B2, according to the similarity of formula calculated candidate region and index target area below:

$D(C1,C2)=1-\sqrt{1-\frac{\underset{i=0}{\overset{255}{\mathrm{\Σ}}}{C1}_i*C{2}_i}{\underset{i=0}{\overset{255}{\mathrm{\Σ}}}{C1}_i*\underset{i=0}{\overset{255}{\mathrm{\Σ}}}{C2}_i}}$

Wherein, D(C1, C2) be the similarity of candidate region and index target area; C1 _ifor the pixel quantity that is i of tonal gradation in candidate region accounts for the ratio of total pixel number amount; C2 _ifor the pixel quantity that in index target area, tonal gradation is i accounts for the ratio of total pixel number amount, the integer that i is 0～255.

6. an audio/video player system, is characterized in that, comprising:

Receiver module, for receiving user in the interest object of current video frame selection and the progress monitoring instruction of specific direction, described specific direction is for advancing or retreating;

Index target is set up module, sets up index target according to selected interest object;

Search matching module, be used for taking current video frame as starting point, respectively according to described index target to described current video frame the subsequent video frame on described specific direction search for coupling, and in when coupling, the relative position of the frame of video that record mates in whole frame of video;

Play chain and set up module,, set up and play chain according to recorded relative position as start frame for the frame of video taking described index target place;

Video playback module, for playing corresponding frame of video according to set up broadcasting chain.

7. audio/video player system according to claim 6, is characterized in that, described receiver module receives user by the selected interest object of rectangle frame.

8. audio/video player system according to claim 7, is characterized in that, described index target is set up module and detected to set up index target by selected interest object is carried out to peripheral edge.

9. audio/video player system according to claim 8, is characterized in that, described audio/video player system also comprises:

Position determination module, for determining that index target is in the position of current video frame, and using determined position as current video frame the initial position of the search window of the rear frame of video on specific direction;

Described search matching module comprises:

The first judging unit, for judging that whether current video frame is last on described specific direction, in the time being last, turns to described broadcasting chain to set up module;

Similarity calculated, for in the time judging that current video frame is not last on described specific direction, after described, in a frame of video, select the initial position of search window, and near initial position determine multiple candidate regions, and calculate the similarity of each candidate region and index target area, wherein, the minimum boundary rectangle frame region that the result detecting using described peripheral edge expands is as index target area;

Whether matching judgment unit, be all less than similarity threshold for multiple similarities that judgement is calculated respectively, and if so, a described rear frame of video is not mated with described index target; If not, a frame of video and described index object matching after described;

The first initial position determining unit, for in the time not mating, after described, a frame of video is as current video frame, and, using the initial position of the initial position of the search window of current video frame search window of the rear frame of video on specific direction as current video frame, then turn to described the first judging unit;

Record cell, in the time mating, the relative position of the frame of video that record mates in whole frame of video;

Maximum determining unit, in the time mating, compares calculated multiple similarities, and definite maximum;

The second initial position determining unit, be used for using a described rear frame of video as current video frame, and using the initial position of the position of the corresponding search window of described maximum search window of the rear frame of video on specific direction as current video frame, then turn to described the first judging unit.

10. audio/video player system according to claim 9, is characterized in that, described similarity calculated is according to the similarity of formula calculated candidate region and index target area below:

$D(C1,C2)=1-\sqrt{1-\frac{\underset{i=0}{\overset{255}{\mathrm{\Σ}}}{C1}_i*C{2}_i}{\underset{i=0}{\overset{255}{\mathrm{\Σ}}}{C1}_i*\underset{i=0}{\overset{255}{\mathrm{\Σ}}}{C2}_i}}$

Wherein, D(C1, C2) be the similarity of candidate region and index target area; C1 _ifor the pixel quantity that is i of tonal gradation in candidate region accounts for the ratio of total pixel number amount; C2 _ifor the pixel quantity that in index target area, tonal gradation is i accounts for the ratio of total pixel number amount, the integer that i is 0～255.