CN101303701B - Method and apparatus for searching video - Google Patents
Method and apparatus for searching video Download PDFInfo
- Publication number
- CN101303701B CN101303701B CN2008101158110A CN200810115811A CN101303701B CN 101303701 B CN101303701 B CN 101303701B CN 2008101158110 A CN2008101158110 A CN 2008101158110A CN 200810115811 A CN200810115811 A CN 200810115811A CN 101303701 B CN101303701 B CN 101303701B
- Authority
- CN
- China
- Prior art keywords
- piece
- value
- movement locus
- motion segment
- motion
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 37
- 238000001514 detection method Methods 0.000 claims abstract description 18
- 230000008878 coupling Effects 0.000 claims description 33
- 238000010168 coupling process Methods 0.000 claims description 33
- 238000005859 coupling reaction Methods 0.000 claims description 33
- 230000005484 gravity Effects 0.000 claims description 20
- 238000004321 preservation Methods 0.000 claims description 12
- 230000013011 mating Effects 0.000 claims description 3
- 239000012634 fragment Substances 0.000 abstract description 7
- 238000005516 engineering process Methods 0.000 abstract description 3
- 238000004364 calculation method Methods 0.000 abstract description 2
- 238000010586 diagram Methods 0.000 description 16
- 239000000203 mixture Substances 0.000 description 8
- 230000008569 process Effects 0.000 description 5
- 238000007792 addition Methods 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 2
- 230000001788 irregular Effects 0.000 description 2
- 239000004744 fabric Substances 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000035800 maturation Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Image Analysis (AREA)
Abstract
The invention discloses a video searching method and a device. The method includes: collecting and memorizing a video sequence, carrying out motion detection on the video sequence as well as calculating and memorizing the motion description values of motion fragments when each motion fragment is detected; when one motion fragment is needed to be searched in the video sequence, calculating the motion description value of the motion fragment which needs to be searched and matching the motion description value obtained by calculation to be matched with the memorized motion description value of each motion fragment one by one; if the two values are matched, then outputting the motion fragment in the database. The invention quantizes the motion detection result of the video sequence and can affect the search of the video data only by using the existing relation database with mature technology without applying complex multimedia database, thus the search of the video data is realized easily and the search speed is improved.
Description
Technical field
The present invention relates to the retrieval technique field, be specifically related to video retrieval method and device.
Background technology
In video monitoring, need retrieve monitor data usually, how can from monitor database, retrieve the key that the information that needs is retrieval validity apace, and how fabric analysis result is effectively concerning can retrieve fast effectively.
At present, when the retrieval monitor database, need to use independent matching algorithm that the video sequence in reference picture and the monitor database is mated.Fig. 1 has provided the movement locus image of the video clips that will retrieve, during retrieval, need carry out the movement locus analysis frame by frame to the video sequence in the database,, then this section video sequence be exported as result for retrieval if analyze the movement locus and the coupling of the movement locus among Fig. 1 of certain section video that obtains.Obviously, existing search method speed is very slow.
Summary of the invention
The invention provides video retrieval method and device, to improve retrieval rate.
Technical scheme of the present invention is achieved in that
A kind of video retrieval method, this method comprises:
Gather and preserve video sequence;
Video sequence is carried out motion detection, whenever detect a motion segment, calculate and preserve the motion description value of this motion segment;
In the time will in video sequence, retrieving the motion segment, calculate the motion description value of this motion segment that will retrieve, the motion description value of each motion segment of this motion description value that calculates and described preservation is mated one by one, if on the coupling, output this motion segment of preserving then.
Described motion description value is motor area thresholding or movement locus value.
When described motion description value is the motor area thresholding,
The motion description value of described calculating campaign segment comprises: image is described in the moving region of determining this motion segment, and it is n piece that image division is described in this moving region, and wherein, n is a positive integer,
For each piece,, be " 1 " then with this piece value if this piece is arranged in the moving region; Otherwise, be " 0 " with this piece value, the value of n piece is arranged according to pre-defined rule, obtain the motor area thresholding of this motion segment; Perhaps,
For each piece,, be " 0 " then with this piece value if this piece is arranged in the moving region; Otherwise, be " 1 " with this piece value, the value of n piece is arranged according to pre-defined rule, obtain the motor area thresholding of this motion segment.
It is described that image division is described in the moving region is that n piece further comprises: this n piece is numbered from 1 to n,
Described value with n piece is arranged as according to pre-defined rule: with the value of n piece according to its numbering from small to large, arrange from the low level to a high position successively; Perhaps,
With the value of n piece from small to large, from a high position to the low level, arrange successively according to its numbering.
Described to n piece from 1 to n be numbered for: the probability that prospect occurs according to each piece is numbered from 1 to n n piece from high to low successively; Perhaps, the probability that prospect occurs according to each piece is numbered from 1 to n n piece from low to high successively.
Described image division is described in the moving region is that n piece is: it is n the piece that size is identical that image division is described in the moving region, perhaps,
According to the area of each piece on the high zone of the prospect probability of occurrence principle less than the area of each piece on the low zone of prospect probability of occurrence, it is n piece that image division is described in the moving region.
When described motion description value is the movement locus value,
The movement locus value of described calculating campaign segment comprises: image is described in the moving region of determining this motion segment, it is n piece that image division is described in this moving region, calculate the center of gravity that each prospect in the image is described in the moving region, the center of gravity of every adjacent two prospects is linked to each other, obtain movement locus, wherein, n is a positive integer;
For each piece,, be " 1 " then with this piece value if this piece is positioned on the movement locus; Otherwise, be " 0 " with this piece value, the value of n piece is arranged according to pre-defined rule, obtain the movement locus value of this motion segment; Perhaps,
For each piece,, be " 0 " then with this piece value if this piece is positioned on the movement locus; Otherwise, be " 1 " with this piece value, the value of n piece is arranged according to pre-defined rule, obtain the movement locus value of this motion segment.
Described motion description value is with binary representation,
The motion description value of each motion segment of described motion description value that will calculate and preservation is mated one by one and comprised: the motion description value step-by-step of the motion description value that will calculate and each motion segment of preservation is carried out and computing, if the result who obtains greater than preset value, then determines on the coupling.
A kind of video frequency searching device, this device comprises:
Acquisition module is gathered video sequence, and video sequence is saved in the buffer memory;
Motion description value computing module, the video sequence that collects is carried out motion detection, whenever detect a motion segment, calculate the motion description value of this motion segment, the motion description value of motion segment and the corresponding relation of motion segment index are saved in the database; Image is described in the motion that receives the motion segment that will retrieve of user's input, calculates the motion description value that the image correspondence is described in this motion, and this motion description value is sent to retrieval module;
Retrieval module receives motion description value, and the motion description value of each motion segment that this motion description value and database are preserved is mated one by one, if on the coupling, reads the motion segment and offers the user from buffer memory according to the motion segment index on mating.
Described motion description value computing module comprises:
The moving region determination module carries out motion detection to the video sequence that collects, and whenever detects a motion segment, determines that image is described in the moving region of this video sequence, image is described in the moving region send to piece division module;
Piece is divided module, and it is n piece that image division is described in the moving region that receives, and the moving region after piece is divided is described image and sent to motor area thresholding computing module, and wherein, n is a positive integer;
Motor area thresholding computing module is described each piece in the image for the moving region that receives, if this piece is arranged in the moving region, is " 1 " with this piece value then; Otherwise, be " 0 " with this piece value; Perhaps, for each piece,, be " 0 " then with this piece value if this piece is arranged in the moving region; Otherwise, with this piece value is " 1 ", and the value of n piece is arranged according to pre-defined rule, obtains the motor area thresholding of motion segment, the corresponding relation of this motor area thresholding and motion segment index is saved in the database, perhaps the motor area thresholding is sent to retrieval module.
Described motion description value computing module comprises:
The moving region determination module carries out motion detection to the video sequence that collects, and whenever detects a motion segment, determines that image is described in the moving region of this motion segment, image is described in the moving region send to piece division module;
Piece is divided module, and it is n piece that image division is described in the moving region that receives, and the moving region after piece is divided is described image and sent to the movement locus determination module; It is n piece that the movement locus that receives is described image division, and the movement locus after piece is divided is described image and sent to movement locus value computing module;
The movement locus determination module calculates the center of gravity that each prospect in the image is described in the moving region that receives, and the center of gravity of every adjacent two prospects is continuous, obtains the movement locus mask image, and the movement locus mask image is sent to movement locus value computing module;
Movement locus value computing module is described each piece in the image for the movement locus mask image that receives or movement locus, if this piece is positioned on the movement locus, is " 1 " with this piece value then; Otherwise, be " 0 " with this piece value; Perhaps, for each piece,, be " 0 " then with this piece value if this piece is positioned on the movement locus; Otherwise, be " 1 " with this piece value, the value of n piece is arranged according to pre-defined rule, obtain the movement locus value, the corresponding relation of movement locus value and motion segment index is saved in the database, perhaps the movement locus value is sent to retrieval module.
Described retrieval module comprises:
The match retrieval module, the motion description value that receives that motion description value computing module sends with the motion segment that will retrieve of binary representation, with this motion description value respectively with database in the motion description value step-by-step with each motion segment of binary representation of preserving carry out and computing, to output to judge module with operation result, if receive the coupling indication of judge module output, then read the motion segment and offer the user from buffer memory according to the motion segment index on the coupling;
Judge module receives that the match retrieval module is sent and operation result, if this result greater than preset value, then returns the coupling indication to the match retrieval module.
Compared with prior art, the present invention whenever detects a motion segment by the video sequence that collects is carried out motion detection, calculates and preserve the motion description value of this motion segment; In the time will from video sequence, retrieving the motion segment, calculate the motion description value of this motion segment that will retrieve, the motion description value of each motion segment of this motion description value that calculates and described preservation is mated one by one, if on the coupling, this motion segment in the output database then.The present invention quantizes the motion detection result of video sequence, needn't use complicated multimedia database and only need use the relevant database of existing technology maturation can realize the retrieval of video data, realizes simply, has improved retrieval rate.
Description of drawings
Fig. 1 is the reference picture of existing video frequency searching;
The process flow diagram of the video frequency searching that Fig. 2 provides for the embodiment of the invention one;
Fig. 3-1 describes the synoptic diagram that image carries out the homogeneous blocks division for what the embodiment of the invention provided to the moving region;
Fig. 3-2 describes the synoptic diagram that image carries out inhomogeneous division for what the embodiment of the invention provided to the moving region;
Fig. 3-3 for the embodiment of the invention provide the moving region is described image block and is divided the time, overlapping synoptic diagram between the piece;
Fig. 4-1 for the embodiment of the invention provide to a video sequence carry out a motion segment that motion detection obtains the moving region exemplary plot of image is described;
The exemplary plot of the moving region mask image of the motion segment that Fig. 4-2 provides for the embodiment of the invention;
The exemplary plot of the movement locus mask image of the motion segment that Fig. 4-3 provides for the embodiment of the invention;
The process flow diagram of the video frequency searching that Fig. 5 provides for the embodiment of the invention two;
The movement locus to the motion segment that will retrieve that Fig. 6-1 provides for the embodiment of the invention is described image and is carried out the exemplary plot that piece is divided;
The exemplary plot of the movement locus mask image of the motion segment that will retrieve that Fig. 6-2 provides for the embodiment of the invention;
The composition diagram of the video frequency searching device that Fig. 7 provides for the embodiment of the invention;
The composition diagram of the motion description value computing module that Fig. 8 provides for the embodiment of the invention one;
The composition diagram of the motion description value computing module that Fig. 9 provides for the embodiment of the invention two;
The composition diagram of the retrieval module that Figure 10 provides for the embodiment of the invention.
Embodiment
The present invention is further described in more detail below in conjunction with drawings and the specific embodiments.
The process flow diagram of the video frequency searching that Fig. 2 provides for the embodiment of the invention one, as shown in Figure 2, its concrete steps are as follows:
Step 201: gather and preserve a video sequence under the scene; Simultaneously, this video sequence is carried out motion detection, whenever detect a motion segment, determine that image is described in the moving region of this motion segment.
The starting point of a motion segment is the frame that detects the motion beginning, the frame that terminating point finishes for this motion.May there be a plurality of motion segments in the video sequence, for example: if video sequence totally 1000 frames, wherein, do not detect motion in 1～500 frame, detect motion in 501～700 frames, do not detect motion in 701～800 frames, detect motion in 801～1000 frames, then have two motion segments in this video sequence: 501～700 frames, 801～1000 frames, image is described in the corresponding moving region of each motion segment, is used for the moving region of description prospect in this motion segment.
Usually, the every two field picture in the moving region size of describing image and the video sequence is big or small identical.
If do not have prospect in this video sequence, perhaps prospect does not move, and does not then just exist the moving region to describe image.
Step 202: according to predefined division methods, it is n piece that image division is described in each moving region, with n piece be numbered 1,2 respectively ..., n.
For different scenes, the piece division methods possibility that image is described in motion is different.
N is a positive integer, and the value of n can rule of thumb determine, usually n＜＜image resolution ratio.When n is big, desirable n=2
m, wherein, m is a positive integer.The size of n piece can be identical, shown in Fig. 3-1; Also can be different, shown in Fig. 3-2, for prospect probability of occurrence lower, the area of piece can be bigger, and for prospect probability of occurrence higher position, the area of piece can be less, in Fig. 3-2, piece 1～16 is a prospect probability of occurrence higher position.Adjacent block can be overlapping, and shown in Fig. 3-3, piece 2,4,5 is overlapping.
To block number the time, can position on the image be described in the moving region according to piece, number consecutively from top to bottom from left to right, also can be numbered according to the importance of piece, for example: can adjacently number for the piece on the higher zone of prospect probability of occurrence, shown in Fig. 3-2, piece 1～16 adjacent numbering that the prospect probability of occurrence is higher.
For the moving region n piece on the image described, according to its numbering from low to high, execution in step 203～206 respectively:
Step 203: judge whether this piece is the moving region, if, execution in step 204; Otherwise, execution in step 205.
Step 204: the value of this piece is changed to " 1 ", goes to step 206.
Step 205: the value of this piece is changed to " 0 ".
In actual applications, when piece is the moving region, also the value of piece can be changed to " 0 ", simultaneously, when piece is not the moving region, the value of piece be changed to " 1 ".
Step 206: whether the numbering of judging current block is n, if, execution in step 208; Otherwise, execution in step 207.
Step 207: the numbering of piece is added 1, return step 203.
Step 208: from low to high according to the numbering of n piece, the value of n piece is arranged from a high position to the low level successively, obtain the binary number of a n position, the binary number of this n position as the motor area thresholding, is saved in the index of motion segment and the corresponding relation of motor area thresholding in the monitor database.
The index of motion segment can be the motion segment initial moment+termination constantly, also can be initial moment+continue duration.
In actual applications, also can according to the numbering of n piece from low to high the value of n piece be arranged from the low level to a high position successively.
Step 209: in the time will in the video sequence under certain scene, retrieving the motion segment that satisfies the moving region of setting, according to the scene identity of record and the corresponding relation of piece division methods, determine the piece division methods under this scene, image is described in the moving region of this setting carry out the piece division, obtain the motor area thresholding of this motion segment.
Step 210: if the motor area thresholding coupling of each motion segment that motor area thresholding and the monitor database determined in the step 209 are preserved on the coupling, then according to the index of this motion segment, finds this motion segment in the video sequence of preservation.
Here, with the motor area thresholding determined in the step 209 respectively with monitor database in the motor area thresholding step-by-step work and the computing of each motion segment of preserving, as long as one of them is arranged with operation result be 1, then think on the coupling; Perhaps, with the motor area thresholding determined in the step 209 respectively with monitor database in the motor area thresholding step-by-step work and the computing of each motion segment of preserving, with all result bits additions that obtain, if the value that obtains greater than preset value, is then thought on the coupling.
In actual applications, longer for fear of the motion segment, can preestablish a motion segment maximum length Lmax, if detected motion fragment length L＞Lmax, then be at interval, L is divided into a plurality of intervals, the motion segment on each interval is calculated the motor area thresholding with Lmax.
Fig. 4-1 has provided the moving region that a video sequence is carried out the motion segment that motion detection obtains and has described image, shown in Fig. 4-1, comprises 6 human bodies among the figure, represents respectively that from left to right a people is in difference position constantly.Fig. 4-2 has provided image division is described in the moving region is n piece, and moving region mask image to obtaining after each piece value, shown in Fig. 4-2, dash area among the figure is the moving region, if n piece is numbered 1,2 from top to bottom from left to right respectively ..., n, then the motor area thresholding is 0x0063e6fe3c380000, and wherein, 0x represents 16 systems.
Fig. 2 has provided by each the motion segment in the video sequence is identified with a motor area thresholding, thereby scheme according to the motor area thresholding retrieve video sequence of motion segment, in actual applications, also each the motion segment in the video sequence can be identified with a movement locus value, thereby according to movement locus value retrieve video sequence.
The process flow diagram of the video frequency searching that Fig. 5 provides for the embodiment of the invention two, as shown in Figure 5, its concrete steps are as follows:
Step 501～502 are identical with step 201～202.
Step 503: each prospect that each moving region is described in the image is carried out center of gravity calculation, obtain the center of gravity of each prospect.
Shown in Fig. 4-1, each human body, i.e. corresponding irregular figure of prospect, the center of gravity of this irregular figure is the center of gravity of this human body, can obtain 6 gravity center of human body altogether.
Step 504: the center of gravity straight line of adjacent prospect is linked to each other, obtain the movement locus mask image.
For example: for 6 gravity center of human body that obtain according to Fig. 4-1, every adjacent two gravity center of human body's straight lines are linked to each other, just can obtain this people's movement locus, Fig. 4-3 is the movement locus mask image.
For the piece of the n on the movement locus mask image, according to its numbering from low to high, difference execution in step 505～508:
Step 505: judge whether this piece is the movement locus zone, if, execution in step 506; Otherwise, execution in step 507.
Step 506: the value of this piece is changed to " 1 ", goes to step 508.
Step 507: the value of this piece is changed to " 0 ".
In actual applications,, also the value of piece can be changed to " 0 ", simultaneously, when piece be movement locus when regional, the value of piece be changed to " 1 " when piece is movement locus when zone.
Step 508: whether the numbering of judging current block is n, if, execution in step 510; Otherwise, execution in step 509.
Step 509: the numbering of piece is added 1, return step 505.
Step 510: from low to high according to the numbering of n piece, the value of n piece is arranged from a high position to the low level successively, obtain the binary number of a n position, the binary number of this n position as the movement locus value, is saved in the index of motion segment and the corresponding relation of motor area thresholding in the monitor database.
The index of motion segment can be the motion segment initial moment+termination constantly, also can be initial moment+continue duration.
Movement locus value as Fig. 4-3 expression is 0xc3663c000000, and wherein, 0x represents 16 systems.
In actual applications, also can according to the numbering of n piece from low to high the value of n piece be arranged from the low level to a high position successively.
Step 511: in the time will in the video sequence under certain scene, retrieving the motion segment that satisfies the movement locus of setting, according to the scene identity of record and the corresponding relation of piece division methods, determine the piece division methods under this scene, the movement locus of this setting is described image carry out the piece division, obtain the movement locus value of this motion segment.
Fig. 6-1 is that a movement locus to the motion segment that will retrieve is described image and carried out the synoptic diagram that piece is divided, and Fig. 6-2 be the movement locus mask image of constructing according to Fig. 6-1, can obtain the movement locus value of this motion segment according to Fig. 6-2.
Step 512: if the movement locus value coupling of each motion segment that movement locus value and the monitor database determined in the step 511 are preserved on the coupling, then according to the index of this motion segment, finds this motion segment in the video sequence of preservation.
Here, with the movement locus value determined in the step 511 respectively with monitor database in the movement locus value step-by-step work and the computing of each motion segment of preserving, as long as one of them is arranged with operation result be 1, then think on the coupling; Perhaps, with the movement locus value determined in the step 511 respectively with monitor database in the movement locus value step-by-step work and the computing of each motion segment of preserving, with all result bits additions that obtain, if the value that obtains greater than preset value, is then thought on the coupling.
The composition diagram of the video frequency searching device that Fig. 7 provides for the embodiment of the invention, as shown in Figure 7, it mainly comprises: video acquisition module 71, motion description value computing module 72 and retrieval module 73, wherein:
Video acquisition module 71: gather the video sequence under the scene, video sequence is saved in the buffer memory.
Motion description value computing module 72: from buffer memory, take out video sequence successively, this video sequence is carried out motion detection, whenever detect a motion segment, calculate the motion description value of this motion segment, the motion description value of motion segment and the corresponding relation of motion segment index are saved in the monitor database; Image is described in the motion that receives the motion segment that will retrieve of user's input, calculates the motion description value that image is described in this motion, and this motion description value is sent to retrieval module 73.
Retrieval module 73: the motion description value of the motion segment that will retrieve that reception motion description value computing module 72 is sent, the motion description value of each motion segment of preserving in this motion description value and the monitor database is mated one by one, if on the coupling, then from buffer memory, read the motion segment and offer the user according to the motion segment index on the coupling.
The composition diagram of the motion description value computing module 72 that Fig. 8 provides for the embodiment of the invention one, as shown in Figure 8, motion description value computing module 72 can comprise: moving region determination module 721, piece are divided module 722 and motor area thresholding computing module 723, wherein:
Moving region determination module 721: from buffer memory, take out video sequence, this video sequence is carried out motion detection, whenever detect a motion segment, determine that image is described in the moving region of this motion segment, image and motion segment index are described in this moving region output to piece and divide module 722.
Piece is divided module 722: image and motion segment index are described in the moving region that reception moving region determination module 721 is sent, it is n piece that image division is described in the moving region, image is described in the moving region after dividing and the motion segment index outputs to motor area thresholding computing module 723; Image and scene identity are described in the motion that receives the motion segment that will retrieve of user's input, according to the scene identity of preserving and the corresponding relation of piece division methods, determine the piece division methods of the scene identity correspondence of input, according to this piece division methods, it is n piece that image division is described in the moving region of input, image is described in moving region after dividing and the retrieval sign sends to motor area thresholding computing module 723, wherein, n is a positive integer.
Motor area thresholding computing module 723: receiving piece and divide the moving region that module 722 sends and describe image, describe each piece in the image for the moving region, if this piece is arranged in the moving region, is " 1 " with this piece value then; Otherwise, be " 0 " with this piece value; Perhaps, for each piece,, be " 0 " then with this piece value if this piece is arranged in the moving region; Otherwise, with this piece value is " 1 ", the value of n piece is arranged according to pre-defined rule, obtain the motor area thresholding, divide the motion segment index that module 722 is sent if receive piece, then the corresponding relation with motor area thresholding and motion segment index is saved in the monitor database, divides the retrieval sign that module 722 is sent if receive piece, then the motor area thresholding is sent to retrieval module 73.
The composition diagram of the motion description value computing module 72 that Fig. 9 provides for the embodiment of the invention two, as shown in Figure 9, motion description value computing module 72 can comprise: moving region determination module 821, piece are divided module 822, movement locus determination module 823 and movement locus value computing module 824, wherein:
Moving region determination module 821: from buffer memory, take out video sequence, this video sequence is carried out motion detection, whenever detect a motion segment, determine that image is described in the moving region of this motion segment, image and motion segment index are described in the moving region output to piece and divide module 822.
Piece is divided module 822: image and motion segment index are described in the moving region that reception moving region determination module 821 is sent, it is n piece that image division is described in the moving region, image is described in moving region after dividing and the motion segment index sends to movement locus determination module 823; Image and scene identity are described in the motion that receives the motion segment that will retrieve of user's input, according to the scene identity of preserving and the corresponding relation of piece division methods, determine the piece division methods of the scene identity correspondence of input, according to this piece division methods, it is n piece that the movement locus of input is described image division, movement locus after the piece division is described image send to movement locus value computing module 824, perhaps, movement locus after further dividing according to piece is described image configuration movement locus mask image, movement locus mask image after the piece division is sent to movement locus value computing module 824, wherein, n is a positive integer.
Movement locus determination module 823: image and motion segment index are described in the moving region that reception piece division module 822 is sent, calculate the center of gravity that each prospect in the image is described in the moving region, the center of gravity straight line of every adjacent two prospects is linked to each other, obtain the movement locus mask image, movement locus mask image and motion segment index are sent to movement locus value computing module 824; Image and retrieval sign are described in the moving region that reception piece division module 822 is sent, calculate the center of gravity that each prospect in the image is described in the moving region, the center of gravity straight line of every adjacent two prospects is linked to each other, obtain the movement locus mask image, movement locus mask image and motion segment index are sent to movement locus value computing module 824.
Movement locus value computing module 824: receiving movement locus determination module 823 or piece and divide the movement locus mask image that module 822 is sent, for each piece in the movement locus mask image, if this piece is positioned on the movement locus, is " 1 " with this piece value then; Otherwise, be " 0 " with this piece value; Perhaps, for each piece,, be " 0 " then with this piece value if this piece is positioned on the movement locus; Otherwise, with this piece value is " 1 ", the value of n piece is arranged according to pre-defined rule, obtain the movement locus value, if the movement locus mask image is from movement locus determination module 823, then movement locus value and the corresponding relation that reaches the motion segment index are saved in the monitor database,, then the movement locus value are sent to retrieval module 73 if the movement locus mask image is divided module 822 from piece.
The composition diagram of the retrieval module 73 that Figure 10 provides for the embodiment of the invention, as shown in figure 10, retrieval module 73 can comprise: match retrieval module 731 and judge module 732, wherein:
Match retrieval module 731: the motion description value that receives that motion description value computing module 72 sends with the motion segment that will retrieve of binary representation, this motion description value is carried out and computing with the motion description value step-by-step with each motion segment of binary representation that motion description value computing module 72 is preserved respectively, to output to judge module 732 with operation result, if receive the coupling indication of judge module 732 outputs, then from buffer memory, read the motion segment and offer the user according to the motion segment index on the coupling.
Judge module 732: receive match retrieval module 731 send and operation results, if this result greater than preset value, then returns the coupling indication to match retrieval module 731.
The above only is process of the present invention and method embodiment, in order to restriction the present invention, all any modifications of being made within the spirit and principles in the present invention, is not equal to replacement, improvement etc., all should be included within protection scope of the present invention.
Claims (11)
1. a video retrieval method is characterized in that, this method comprises:
Gather and preserve video sequence;
Video sequence is carried out motion detection, whenever detect a motion segment, determine that image is described in the moving region of this motion segment, it is n piece that image division is described in this moving region, and wherein, n is a positive integer,
For each piece,, be " 1 " then with this piece value if this piece is arranged in the moving region; Otherwise, be " 0 " with this piece value, the value of n piece is arranged according to pre-defined rule, obtain the motor area thresholding of this motion segment; Perhaps,
For each piece,, be " 0 " then with this piece value if this piece is arranged in the moving region; Otherwise, be " 1 " with this piece value, the value of n piece is arranged according to pre-defined rule, obtain the motor area thresholding of this motion segment;
In the time will in video sequence, retrieving the motion segment, calculate the motor area thresholding of this motion segment that will retrieve, the motor area thresholding of each motion segment of this motor area thresholding that calculates and described preservation is mated one by one, if on the coupling, output this motion segment of preserving then.
2. the method for claim 1 is characterized in that, described image division is described in the moving region is that n piece further comprises: this n piece is numbered from 1 to n,
Described value with n piece is arranged as according to pre-defined rule: with the value of n piece according to its numbering from small to large, arrange from the low level to a high position successively; Perhaps,
With the value of n piece from small to large, from a high position to the low level, arrange successively according to its numbering.
3. method as claimed in claim 2 is characterized in that, described to n piece from 1 to n be numbered for: the probability that prospect occurs according to each piece is numbered from 1 to n n piece from high to low successively; Perhaps, the probability that prospect occurs according to each piece is numbered from 1 to n n piece from low to high successively.
4. as the arbitrary described method of claim 1 to 3, it is characterized in that described image division is described in the moving region is that n piece is: it is n the piece that size is identical that image division is described in the moving region, perhaps,
According to the area of each piece on the high zone of the prospect probability of occurrence principle less than the area of each piece on the low zone of prospect probability of occurrence, it is n piece that image division is described in the moving region.
5. as the arbitrary described method of claim 1 to 3, it is characterized in that described motor area thresholding is with binary representation,
The motor area thresholding of described each motion segment with the motor area thresholding that calculates and preservation is mated one by one and is comprised: the motor area thresholding step-by-step of each motion segment of the motor area thresholding that calculates and preservation is carried out and computing, if the result who obtains greater than preset value, then determines on the coupling.
6. a video retrieval method is characterized in that, this method comprises:
Gather and preserve video sequence;
Video sequence is carried out motion detection, whenever detect a motion segment, determine that the moving region of this motion segment describes image, it is n piece that image division is described in this moving region, calculate the center of gravity that each prospect in the image is described in the moving region, the center of gravity of every adjacent two prospects is continuous, obtain movement locus, wherein, n is a positive integer;
For each piece,, be " 1 " then with this piece value if this piece is positioned on the movement locus; Otherwise, be " 0 " with this piece value, the value of n piece is arranged according to pre-defined rule, obtain the movement locus value of this motion segment; Perhaps,
For each piece,, be " 0 " then with this piece value if this piece is positioned on the movement locus; Otherwise, be " 1 " with this piece value, the value of n piece is arranged according to pre-defined rule, obtain the movement locus value of this motion segment;
In the time will in video sequence, retrieving the motion segment, calculate the movement locus value of this motion segment that will retrieve, the movement locus value of each motion segment of this movement locus value that calculates and described preservation is mated one by one, if on the coupling, output this motion segment of preserving then.
7. method as claimed in claim 6 is characterized in that, described movement locus value is with binary representation,
The movement locus value of described each motion segment with the movement locus value that calculates and preservation is mated one by one and is comprised: the movement locus value step-by-step of each motion segment of the movement locus value that calculates and preservation is carried out and computing, if the result who obtains greater than preset value, then determines on the coupling.
8. a video frequency searching device is characterized in that, this device comprises:
Acquisition module is gathered video sequence, and video sequence is saved in the buffer memory;
The moving region determination module carries out motion detection to the video sequence that collects, and whenever detects a motion segment, determines that image is described in the moving region of this video sequence, image is described in the moving region send to piece division module;
Piece is divided module, and it is n piece that image division is described in the moving region that receives, and the moving region after piece is divided is described image and sent to motor area thresholding computing module, and wherein, n is a positive integer;
Motor area thresholding computing module is described each piece in the image for the moving region that receives, if this piece is arranged in the moving region, is " 1 " with this piece value then; Otherwise, be " 0 " with this piece value; Perhaps, for each piece,, be " 0 " then with this piece value if this piece is arranged in the moving region; Otherwise, with this piece value is " 1 ", and the value of n piece is arranged according to pre-defined rule, obtains the motor area thresholding of motion segment, the corresponding relation of this motor area thresholding and motion segment index is saved in the database, perhaps the motor area thresholding is sent to retrieval module;
Retrieval module receives the motor area thresholding, and the motor area thresholding of each motion segment that this motor area thresholding and database are preserved is mated one by one, if on the coupling, reads the motion segment and offers the user from buffer memory according to the motion segment index on mating.
9. device as claimed in claim 8 is characterized in that, described retrieval module comprises:
The match retrieval module, the motor area thresholding that receives that motor area thresholding computing module sends with the motion segment that will retrieve of binary representation, with this motor area thresholding respectively with database in the motor area thresholding step-by-step with each motion segment of binary representation of preserving carry out and computing, to output to judge module with operation result, if receive the coupling indication of judge module output, then read the motion segment and offer the user from buffer memory according to the motion segment index on the coupling;
Judge module receives that the match retrieval module is sent and operation result, if this result greater than preset value, then returns the coupling indication to the match retrieval module.
10. a video frequency searching device is characterized in that, this device comprises:
Acquisition module is gathered video sequence, and video sequence is saved in the buffer memory;
The moving region determination module carries out motion detection to the video sequence that collects, and whenever detects a motion segment, determines that image is described in the moving region of this motion segment, image is described in the moving region send to piece division module;
Piece is divided module, and it is n piece that image division is described in the moving region that receives, and the moving region after piece is divided is described image and sent to the movement locus determination module; It is n piece that the movement locus that receives is described image division, and the movement locus after piece is divided is described image and sent to movement locus value computing module;
The movement locus determination module calculates the center of gravity that each prospect in the image is described in the moving region that receives, and the center of gravity of every adjacent two prospects is continuous, obtains the movement locus mask image, and the movement locus mask image is sent to movement locus value computing module;
Movement locus value computing module is described each piece in the image for the movement locus mask image that receives or movement locus, if this piece is positioned on the movement locus, is " 1 " with this piece value then; Otherwise, be " 0 " with this piece value; Perhaps, for each piece,, be " 0 " then with this piece value if this piece is positioned on the movement locus; Otherwise, be " 1 " with this piece value, the value of n piece is arranged according to pre-defined rule, obtain the movement locus value, the corresponding relation of movement locus value and motion segment index is saved in the database, perhaps the movement locus value is sent to retrieval module;
Retrieval module receives the movement locus value, and the movement locus value of each motion segment that this movement locus value and database are preserved is mated one by one, if on the coupling, reads the motion segment and offers the user from buffer memory according to the motion segment index on mating.
11. device as claimed in claim 10 is characterized in that, described retrieval module comprises:
The match retrieval module, the movement locus value that receives that movement locus value computing module sends with the motion segment that will retrieve of binary representation, with this movement locus value respectively with database in the movement locus value step-by-step with each motion segment of binary representation of preserving carry out and computing, to output to judge module with operation result, if receive the coupling indication of judge module output, then read the motion segment and offer the user from buffer memory according to the motion segment index on the coupling;
Judge module receives that the match retrieval module is sent and operation result, if this result greater than preset value, then returns the coupling indication to the match retrieval module.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2008101158110A CN101303701B (en) | 2008-06-27 | 2008-06-27 | Method and apparatus for searching video |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2008101158110A CN101303701B (en) | 2008-06-27 | 2008-06-27 | Method and apparatus for searching video |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101303701A CN101303701A (en) | 2008-11-12 |
| CN101303701B true CN101303701B (en) | 2010-07-07 |
Family
ID=40113604
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2008101158110A Active CN101303701B (en) | 2008-06-27 | 2008-06-27 | Method and apparatus for searching video |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101303701B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102081671A (en) * | 2011-01-25 | 2011-06-01 | 北京中星微电子有限公司 | Method and device for generating scalable video file |
| CN105100579B (en) | 2014-05-09 | 2018-12-07 | 华为技术有限公司 | A kind of acquiring and processing method and relevant apparatus of image data |
| CN104683760A (en) * | 2015-01-28 | 2015-06-03 | 安科智慧城市技术（中国）有限公司 | Video processing method and system |
| CN105761504B (en) * | 2016-05-17 | 2018-02-09 | 重庆大学 | Speed method for real-time measurement based on the collection of non-homogeneous video frame image |
-
2008
- 2008-06-27 CN CN2008101158110A patent/CN101303701B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN101303701A (en) | 2008-11-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110751224B (en) | Training method of video classification model, video classification method, device and equipment | |
| CN102902819B (en) | A kind of Intelligent video analysis method and device | |
| US20130148898A1 (en) | Clustering objects detected in video | |
| CN101631237B (en) | Video monitoring data storing and managing system | |
| CN101084831B (en) | Method and apparatus for PET time of flight generation of compressed sinogram and image reconstruction | |
| CN101303701B (en) | Method and apparatus for searching video | |
| CN101582063A (en) | Video service system, video service device and extraction method for key frame thereof | |
| CN104469508A (en) | Method, server and system for performing video positioning based on bullet screen information content | |
| CN106446157B (en) | Travel destination recommendation method and device | |
| CN103618911B (en) | Video streaming providing method and device based on video attribute information | |
| CN103577478A (en) | Web page pushing method and system | |
| CN110991525B (en) | Accompanying pattern matching method based on operator track data | |
| CN101304479B (en) | Method and apparatus for detecting motion in video sequence | |
| CN105611321A (en) | Video code rate pushing method and device | |
| CN105578258A (en) | Method and device of video preprocessing and video playback | |
| CN103187083B (en) | A kind of storage means based on time domain video fusion and system thereof | |
| CN105245817A (en) | Video playback method and video playback device | |
| CN110006445A (en) | Running distance calculating method and device | |
| CN114241371A (en) | Video action recognition system and training method for student experiment operation evaluation | |
| CN110008362A (en) | A kind of case classifying method and device | |
| CN107358621A (en) | Method for tracing object and device | |
| CN109670153A (en) | A kind of determination method, apparatus, storage medium and the terminal of similar model | |
| CN105930839A (en) | Electric railway overhead line system pole number intelligent identification method | |
| CN106997600B (en) | Motion detection device and repetitive motion detection method | |
| CN103744993A (en) | Video file storage-retrieval method and video file storage-retrieval device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| ASS | Succession or assignment of patent right |
Owner name: SHANXI ZHONGTIANXIN TECHNOLOGY CO., LTD. Free format text: FORMER OWNER: BEIJING VIMICRO ELECTRONICS CO., LTD. Effective date: 20121211 |
|
| C41 | Transfer of patent application or patent right or utility model | ||
| COR | Change of bibliographic data |
Free format text: CORRECT: ADDRESS; FROM: 100083 HAIDIAN, BEIJING TO: 030032 TAIYUAN, SHAANXI PROVINCE |
|
| TR01 | Transfer of patent right |
Effective date of registration: 20121211 Address after: 105, room 3, building 6, Kaiyuan street, Taiyuan economic and Technological Development Zone, Shanxi 030032, China Patentee after: SHANXI VIMICRO TECHNOLOGY CO., LTD. Address before: 100083, Haidian District, Xueyuan Road, Beijing No. 35, Nanjing Ning building, 15 Floor Patentee before: Beijing Vimicro Corporation |