CN102244770A - Object monitoring system and method - Google Patents

Object monitoring system and method Download PDF

Info

Publication number
CN102244770A
CN102244770A CN201010172766XA CN201010172766A CN102244770A CN 102244770 A CN102244770 A CN 102244770A CN 201010172766X A CN201010172766X A CN 201010172766XA CN 201010172766 A CN201010172766 A CN 201010172766A CN 102244770 A CN102244770 A CN 102244770A
Authority
CN
China
Prior art keywords
pixel
background model
image
temporary
thing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201010172766XA
Other languages
Chinese (zh)
Other versions
CN102244770B (en
Inventor
陈建霖
杨智程
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai To Create Information Technology Ltd By Share Ltd
Original Assignee
Hongfujin Precision Industry Shenzhen Co Ltd
Hon Hai Precision Industry Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hongfujin Precision Industry Shenzhen Co Ltd, Hon Hai Precision Industry Co Ltd filed Critical Hongfujin Precision Industry Shenzhen Co Ltd
Priority to CN201010172766.XA priority Critical patent/CN102244770B/en
Publication of CN102244770A publication Critical patent/CN102244770A/en
Application granted granted Critical
Publication of CN102244770B publication Critical patent/CN102244770B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The invention discloses an object monitoring system and method. The method comprises the following steps of: detecting a foreground object in an image; if the foreground object is still a foreground after a time interval is more than or equal to a set time interval, marking the foreground object as an interesting pixel in the event of transferring corresponding pixels in a temporary background model; searching regions near the interesting pixel in the temporary background model; finding out pixels same to pixel values thereof as interesting pixels so as to obtain a set b; when the area of the set b is more than a set range, capturing pixels corresponding to the set b from a current background model so as to obtain a set a; finding out characteristic points and description vectors thereof in the set a and the set b; respectively taking the characteristic points in the two sets as seeds to cut the image so as to obtain blocks A and B; when the area of the block B is more than that of the block A, judging that a removed object exists; and, when the area of the block B is less than that of the block A, judging that an access object exists. By means of the method disclosed by the invention, the removed object and the access object can be judged effectively; and the access object can be identified.

Description

Object supervisory control system and method
Technical field
The present invention relates to a kind of object supervisory control system and method.
Background technology
The image of catching for watch-dog, intelligent monitoring system can be analyzed presentation content according to user's demand, by detecting, follow the trail of and the identification image in object and whether the object judging the user automatically and be concerned about meets with threat, and with this effective minimizing incident or injury that threat was brought.Given this, in open, the busy and mixed and disorderly environment such as airport, station hall, need the cover can be automatically and the system of the suspect article that occurs in the effective monitoring environment.Yet, existing supervisory control system also can't be judged the object in the guarded region when facing following problems exactly: guarded region is busy, crowded, the mixed and disorderly environment of background, because of the watch-dog shooting angle lens zoom causes the profile of captured object to change or guarded region in light variation etc.
Summary of the invention
In view of above content, be necessary to provide a kind of object supervisory control system, can be under busy, crowded, mixed and disorderly background, because of shooting angle, convergent-divergent cause under change of object profile or the light situation of change, simultaneously and effectively monitoring with judge the object that is removed in the guarded region or enter thing that and this enters thing to utilize characteristic point to describe vector identification.
Also be necessary to provide a kind of object method for supervising, can be under busy, crowded, mixed and disorderly background, because of shooting angle, convergent-divergent cause under change of object profile or the light situation of change, simultaneously and effectively monitoring with judge the object that is removed in the guarded region or enter thing that and this enters thing to utilize characteristic point to describe vector identification.
A kind of object supervisory control system, run in the image server, this system comprises: prospect object detecting unit, be used for utilizing the prospect object of the image that double-deck background model detecting watch-dog catches, and this bilayer background model comprises existing background model and temporary background model; Object and regional determination unit, be used for when the prospect object of this detecting still is judged as the prospect object after more than or equal to a setting-up time interval, being moved into the temporary described pixel of background model tense marker in the pixel of this prospect object is interested pixel, from temporary background model, search pixel identical in the zone that is close to described interested pixel as interested pixel with the pixel value of described interested pixel, obtain a pixel set b thus, when the area of set b during greater than a setting range, acquisition and the corresponding pixel of set b from existing background model, and obtain pixel set a thus; Described object and regional determination unit, also be used to utilize characteristic point algorithm pair set a and b enforcement computing respectively, find out the characteristic point in each pixel set and describe vector, to gather characteristic point among a then and implement the image cutting as seed and obtain block A, and will gather among the b with block A opposite position on characteristic point implement image cutting as seed and obtain block B; And the article identification unit, be used for judging in this guarded region to remove thing when the area of block B during greater than the area of block A, reach when the area of block B during less than the area of block A, judge in this guarded region to enter thing.
A kind of object method for supervising comprises the steps: to utilize the prospect object in the double-deck background model detecting watch-dog institute capturing video, and this bilayer background model comprises existing background model and temporary background model; If the prospect object of this detecting still is judged as the prospect object after more than or equal to a setting-up time interval, then being moved into temporary this respective pixel of background model tense marker in this prospect object respective pixel is interested pixel; From temporary background model, search the zone contiguous, find out the pixel identical, obtain a pixel set b thus as interested pixel with the pixel value of described interested pixel with described interested pixel; When the area of set b during, acquisition and the corresponding pixel of described set b from existing background model, and obtain pixel thus and gather a greater than a setting range; Utilize characteristic point algorithm pair set a and b enforcement computing respectively, find out the characteristic point in each pixel set and describe vector; The characteristic point of set among a implemented the image cutting as seed obtains block A, and will gather among the b with block A opposite position on characteristic point implement image cutting as seed and obtain block B; When the area of block B during, judge in this guarded region to remove thing greater than the area of block A; And, judge in this guarded region to enter thing when the area of block B during less than the area of block A.
Compared to prior art, described object supervisory control system and method, utilize colour element to set up background model, before judging with this, the background object, generally only adopt the supervisory control system and the method for GTG pixel, has better judgment, it can not only be busy, crowded, discern the object that is removed in the guarded region under the mixed and disorderly background or enter thing, also can be in shooting angle, when convergent-divergent causes change of object profile or light to change, simultaneously and effectively monitoring with judge the object that is removed in this guarded region and enter thing that this enters thing to utilize characteristic point to describe vector identification.
Description of drawings
Fig. 1 is the running environment figure of object supervisory control system of the present invention preferred embodiment.
Fig. 2 is the function unit figure of object supervisory control system of the present invention preferred embodiment.
Fig. 3 is the functional block diagram of prospect object detecting unit among Fig. 2.
Fig. 4 is the operation process chart of object method for supervising of the present invention preferred embodiment.
Fig. 5 is the particular flow sheet of the prospect object detecting among Fig. 4 step S400.
Fig. 6 and Fig. 7 are that the prospect object and the background model that detect among Fig. 5 change schematic diagram.
Fig. 8 is that the present invention has characteristic point detecting and the image cutting schematic diagram when entering thing.
The main element symbol description
The image server 1
Watch-dog 2
The characteristic point data storehouse 3
The object supervisory control system 10
Memory device 20
Processor 30
Display device 40
Prospect object detecting unit 100
Object and regional determination unit 102
The article identification unit 104
Model building module 1000
The pixel separation module 1002
Memory module 1004
Temporary background model monitoring module 1006
The background model update module 1008
Embodiment
As shown in Figure 1, be the running environment figure of object supervisory control system of the present invention preferred embodiment.This object supervisory control system 10 is installed and is run in the image server 1.This image server 1 links to each other with a characteristic point data storehouse 3 with at least one watch-dog 2 by network.In the present embodiment, described watch-dog 2 can have the electronic equipment of monitoring function for web camera or other types.The characteristic point that has the multiple object (comprising the people) that training in advance crosses in the described characteristic point data storehouse 3 is described vector model.
As shown in Figure 2, be the function unit figure of object supervisory control system 10 preferred embodiments of the present invention.In this figure, except operation has object supervisory control system 10, also comprise memory device 20, processor 30 and display device 40 in the image server 1.
Wherein, memory device 20 is used to store the computerization program code of described object supervisory control system 10, and storage is by the captured chromatic image of watch-dog 2.In other embodiments, this memory device 20 can be the external memory of image server 1.
Processor 30 is carried out the computerization program code of described object supervisory control system 10, promptly the image that watch-dog 2 is caught carries out the detecting of prospect object, object interested and zone in the described image is judged, and judge remove thing or enter thing in the guarded region after identification this which kind of object enters thing be, and send alarm.
Display device 40 is used to show the chromatic image that described watch-dog 2 is captured, and processor 30 pairing each picture when carrying out object supervisory control systems 10, cuts picture, schematic diagram as shown in Figure 8 as the image of background area and prospect object.
Described object supervisory control system 10 comprises: prospect object detecting unit 100, object and regional determination unit 102 and article identification unit 104, the function of this object supervisory control system 10 can specifically describe by Fig. 3 to Fig. 8.
Described prospect object detecting unit 100 comprises model building module shown in Figure 3 1000, pixel separation module 1002, memory module 1004, temporary background model monitoring module 1006 and background model update module 1008.This prospect object detecting unit 100 is used for utilizing the prospect object of the image that double-deck background model detecting watch-dog 2 caught, and concrete grammar will be described in detail in Fig. 5.Wherein, described double-deck background model comprises existing background model and temporary background model, and this existing background model is meant the background model that a width of cloth image is generated before the current image of detecting.
Described object and regional determination unit 102, be used for when described prospect object when still being judged as the prospect object after at interval more than or equal to setting-up time, if form the pixel of this prospect object be moved into temporary background model then automatically the described pixel of mark be interested pixel.Object and regional determination unit 102 search in the zone that is close to described interested pixel whether have the pixel identical with these interested pixels from temporary background model, and this pixel that searches is considered as interested pixel equally, obtain a pixel set b thus.In the present embodiment, described identical pixel is meant the pixel that pixel value is identical with the pixel value of described interested pixel.
When the area of set b during greater than a setting range, during greater than 50 pixels * 50 pixels, described object and regional determination unit 102 also are used for from existing background model acquisition and the corresponding pixel of set b as set b, and obtain pixel thus and gather a.Wherein, described setting range can be determined voluntarily by the user, for example, when the user only wants the bigger object of volume detected, this setting range can be arranged to a bigger value, so that the follow-up object of comparatively being concerned about that filters out is monitored from image.
Described object and regional determination unit 102 also are used to utilize characteristic point algorithm pair set a and b enforcement computing respectively, find out the characteristic point in each pixel set and describe vector.In the present embodiment, (scale-invariant feature transform, SIFT) algorithm, SURF algorithm or other can be used for detecting and describing the algorithm of image locality feature to described characteristic point algorithm for yardstick invariant features conversion.Wherein, the characteristic point of utilizing the SIFT algorithm to be extracted is based on the point of interest of some local appearance on the object, with the size and the irrelevant to rotation of image.As the black dot among Fig. 8 (b2) is the characteristic point of finding out in set b, and the black dot among Fig. 8 (a2) is the characteristic point of finding out in set a.
Subsequently, object and regional determination unit 102 utilize seed region to increase algorithm will gather characteristic point among a and implement image cutting as seed and obtain block A, shown in Fig. 8 (a3), and will gather among the b with block A opposite position on characteristic point implement the image cutting as seed and obtain block B, shown in Fig. 8 (b3).
Article identification unit 104 be used to judge the area of block B be greater than or less than the area of block A, when the area of block B during less than the area of block A, enter thing in article identification unit 104 these guarded regions of judgement, and, remove thing in article identification unit 104 these guarded regions of judgement when the area of block B during greater than the area of block A.
This article identification unit 104 also is used for the thing of being judged that enters is carried out size, color and entry time filtration, and utilize general machine learning algorithm such as neural network (Neural Networks), SVMs (Support Vector Machine) etc., the characteristic point of each object of storage in the characteristic point that enters thing after filtering and description vector and the characteristic point data storehouse 3 is described vector model to be compared, enter thing to discern this, and judge whether the described thing that removes at the appointed time is removed in the section.
Wherein, described filtration is meant that specifically a plurality of objects that interested pixel is formed filter, make the requirement that size, the color of object of final decision and time of entering guarded region all meet the user, the time that the automobile size need be arranged, ignore the color of city taxi and enter guarded region as the object after filtering needed in the uncovered time period.
As described in Figure 4, be the operation process chart of object method for supervising of the present invention preferred embodiment.
Step S400, prospect object detecting unit 100 utilize the prospect object in the image that double-deck background model detecting watch-dog 2 caught, and specifically describe as described in Figure 5.This bilayer background model comprises existing background model and temporary background model.
If the above-mentioned prospect object that detects still is judged as the prospect object after more than or equal to a setting-up time interval, in step S402, object and regional determination unit 102 can be labeled as interested pixel with described pixel when the pixel of this prospect object is moved into temporary background model, the zone contiguous with described interested pixel searched in object and regional determination unit 102 from temporary background model, find out the pixel identical with the pixel value of described interested pixel, and it is judged to be interested pixel, obtain a pixel set b (as the pixel set of composition diagram 8 (b1)) thus, when the area of described pixel set b during greater than a setting range, object and regional determination unit 102 be acquisition and the corresponding pixel of described pixel set b from existing background model, and obtains pixel set a (as the pixel set of five-pointed star in the composition diagram 8 (a1)) thus.
Step S404, object and regional determination unit 102 utilize the characteristic point algorithm respectively pixel set a and b to be implemented computing, find out the characteristic point (as the black dot among Fig. 8 (a2), (b2)) in each pixel set and describe vector, utilize seed region to increase algorithm then and will gather characteristic point among a and implement the image cutting as seed and obtain block A (as the black part among Fig. 8 (a3)), and will gather among the b with block A opposite position on characteristic point cut as seed enforcement image and obtain block B (as the black part among Fig. 8 (b3)).
Step S406, article identification unit 104 judges that the area of this block B is greater than the area of block A or less than the area of block A.If the area of block B is the area greater than block A, then flow process enters step S408, if the area of block B is the area less than block A, then flow process enters step S414.In the present embodiment,, show that both not entered thing in the guarded region does not remove thing yet if the area of block B is the area that equals block A.
Step S408, article identification unit 104 judges in this guarded region have object to be removed, and promptly removes thing in this guarded region.
Step S410, article identification unit 104 judges that this removes thing and whether at the appointed time is removed in the section, if judged result is at the appointed time to be removed in the section for this removes thing, then flow process enters step S412.If judged result is not at the appointed time to be removed in the section for this removes thing, then process ends.
Step S412, article identification unit 104 sends this guarded region of alarm Security Officer threat, and flow process finishes then.
Step S414, article identification unit 104 judges in this guarded region have object to enter, and promptly enters thing in this guarded region.
Step S416,104 pairs of these size, color and the entry times that enter thing in article identification unit are filtered the thing that enters after this filtration of back identification, and flow process enters step S412 then.Particularly, described size, color and the entry time that enters thing (a plurality of) analyzed whether in the claimed range that the user is provided with in article identification unit 104, and the satisfactory thing that enters discerned, as the characteristic point that enters thing after machine learning algorithm such as neural network (neural networks) or SVMs (support vector machine) will filter utilizing and describe in vector and the characteristic point data storehouse 3 characteristic point of each object of storage and describe vector model and compare, which kind of object enters thing be to discern this.
As shown in Figure 5, be the particular flow sheet of prospect object detecting among Fig. 4 step S400.This flow process is that example describes with the prospect object detecting of certain two width of cloth image in the N width of cloth chromatic image only, and the prospect object detecting in other images is all carried out according to this method for detecting.
Step S500 sets an empty background model by model building module 1000, receives first width of cloth image in the N width of cloth chromatic image, that is to say that this sky background model is used to store first width of cloth image.In the present embodiment, the detecting of the prospect of the image after the 2nd width of cloth~N width of cloth and the N width of cloth need not to re-establish the sky background model again.
Step S502, successively with the width of cloth image in this N width of cloth image as current image, be to have background model now to detect the background model that a width of cloth image is generated before this image.
Step S504, pixel separation module 1002 in will this current image each pixel and the pixel in the existing background model compare, to determine the difference and the luminance difference of the pixel value between respective pixel.In the present embodiment, second width of cloth image is to be existing background model to deposit first width of cloth image in the sky background model in; After this second width of cloth image processing is intact, take out the 3rd width of cloth image again and handle, the 3rd width of cloth image is be to have background model now with the background model that is generated by detecting first width of cloth, second width of cloth image, by that analogy, up to all image processing are finished.For example, as shown in Figure 6, N width of cloth image is to have background model now to detect the obtained background model A0 of the 1st~the N-1 width of cloth image, and N+1 width of cloth image is existing background model with background model A.
Step S506, pixel separation module 1002 judges whether the difference and the luminance difference of above-mentioned definite pixel value all are less than or equal to predefined threshold value.
When if the difference of the pixel value between the respective pixel in described pixel and the existing background model and luminance difference all are less than or equal to predefined threshold value, in step S508, pixel separation module 1002 judges that this pixel is a background pixel, memory module 1004 adds this pixel in the existing background model, thereby generated new background model, enter step S518 then, wherein, the object present embodiment of being made up of all background pixels is referred to as the background object.For example, suppose that guarded region does not have external object (as people or car) and involves in, only light has slight variation, and can not cause the existing background model of pixel in the current image to have changing too greatly by the light of this variation the time, pixel separation module 1002 still can continue the pixel in the current image is judged to be background pixel, and memory module 1004 adds the new background model of generation in the existing background model with this pixel.
Otherwise, if the difference of the pixel value between the respective pixel in described pixel and the existing background model and luminance difference are all greater than described predefined threshold value, in step S510, pixel separation module 1002 judges that this pixel is a foreground pixel, and the object present embodiment of being made up of all foreground pixels is referred to as the prospect object.As shown in Figure 6 and Figure 7, if the background model of being made up of above-mentioned the 1st~the N-1 width of cloth chromatic image is A0, this background model A0 is made up of the tree that stops in the guarded region, road, in N width of cloth image, if there is vehicle to enter guarded region, then the pixel of the detecting process decidable composition vehicle of process step S506 is the prospect object.
Step S512, memory module 1004 is kept in the pixel and the existing background model of the prospect object among the step S510, obtains described temporary background model B.
Step S514, whether pixel value and brightness value that temporary background model monitoring module 1006 is monitored the pixel among the described temporary background model B in real time change within a preset time interval.If the pixel value and the brightness value of the pixel in this Preset Time interval among the described temporary background model B change, temporary background model after supposing to change is B`, then temporary background model monitoring module 1006 repeated execution of steps S514 judge whether this temporary background model B` changes in the default time interval.Otherwise if the pixel value and the brightness value of the pixel among the described temporary background model B (or temporary background model B`) do not change in this Preset Time interval, then flow process enters step S516.
Step S516, background model update module 1008 is upgraded described existing background model with described temporary background model B or B`, thereby generated new background model, for example, as shown in Figure 7, background model update module 1008 is upgraded described existing background model with temporary background model B and is obtained new background model (as background model A).At the image after the described N width of cloth, as the N+1 width of cloth image among Fig. 6, pixel separation module 1002 detect prospect object and this prospect object by temporary behind temporary background model B`, if monitoring described temporary background model B`, temporary background model monitoring module 1006 in described Preset Time interval, do not change, then background model update module 1008 can be upgraded described background model A with this temporary background model B` and obtains background model A`, by that analogy, background model can constantly obtain upgrading, the method of this background real-time update can avoid image to rock, light changes, the interference of Periodic Object, detect the prospect object in the image more accurately, to reach to purposes such as guarded region effective monitorings.In addition, utilize this method also the object that stays for some time can be considered as background automatically in guarded region.
Step S518, the chromatic image that pixel separation module 1002 receives by checking judges whether that image is not detected in addition, that is to say that pixel separation module 1002 judges whether that the prospect object of chromatic image separates with the pixel of background object correspondence in addition.If judged result is for denying then direct process ends.If it is current image with the image of not detecting that judged result, is then returned step S504 for being, be to have background model now with the background model of detecting before this image that image was generated, execution in step S504 is to step S516 successively.
It should be noted that at last, above embodiment is only unrestricted in order to technical scheme of the present invention to be described, although the present invention is had been described in detail with reference to preferred embodiment, those of ordinary skill in the art is to be understood that, can make amendment or be equal to replacement technical scheme of the present invention, and not break away from the spirit and scope of technical solution of the present invention.

Claims (10)

1. an object method for supervising is characterized in that, this method comprises the steps:
Utilize the prospect object in the double-deck background model detecting watch-dog institute capturing video, this bilayer background model comprises existing background model and temporary background model;
If the prospect object of this detecting still is judged as the prospect object after more than or equal to a setting-up time interval, then being moved into temporary this respective pixel of background model tense marker in this prospect object respective pixel is interested pixel;
From temporary background model, search the zone contiguous, find out the pixel identical, obtain a pixel set b thus as interested pixel with the pixel value of described interested pixel with described interested pixel;
When the area of set b during, acquisition and the corresponding pixel of described set b from existing background model, and obtain pixel thus and gather a greater than a setting range;
Utilize characteristic point algorithm pair set a and b enforcement computing respectively, find out the characteristic point in each pixel set and describe vector;
The characteristic point of set among a implemented the image cutting as seed obtains block A, and will gather among the b with block A opposite position on characteristic point implement image cutting as seed and obtain block B;
When the area of block B during, judge in this guarded region to remove thing greater than the area of block A; And
When the area of block B during, judge in this guarded region to enter thing less than the area of block A.
2. object method for supervising as claimed in claim 1 is characterized in that, the step of the prospect object in the double-deck background model detecting of the described utilization watch-dog institute capturing video comprises:
(a) set an empty background model, receive first width of cloth image in the N width of cloth chromatic image;
(b) background model that this has been deposited in first width of cloth image is current image as existing background model with second width of cloth image;
(c) each pixel in will this current image and the pixel in the existing background model compare, to determine the difference and the luminance difference of the pixel value between respective pixel;
(d) when the difference of described definite pixel value and luminance difference all are less than or equal to predefined threshold value, judge that this pixel is a background pixel, this pixel added in the existing background model generate new background model, and be the background object by the object that all background pixels are formed; Or
(e) when the difference of above-mentioned definite pixel value and luminance difference during all greater than described predefined threshold value, judge that this pixel is a foreground pixel, the object of being made up of all foreground pixels is the prospect object; And
(f) successively with the width of cloth image of the 3rd in the described N width of cloth image to the N width of cloth image as current image, and will detect background model that all images before this current image obtain as existing background model, execution in step (c) to step (e) to detect prospect object and the background object in every width of cloth image.
3. object method for supervising as claimed in claim 2 is characterized in that, between step (d) and step (e), this method also comprises step:
(d1) temporary described foreground pixel and described existing background model obtain a temporary background model B;
(d2) whether pixel value and the brightness value of monitoring each pixel among this temporary background model B changes within a preset time interval;
(d3), then upgrade the new background model of generation after the described existing background model with this temporary background model B if the pixel value of each pixel in should temporary background model B and brightness value do not change at interval at described Preset Time; Or
(d4) changed in described Preset Time interval if should keep in the pixel value and the brightness value of the pixel among the background model B, temporary background model after the variation is B`, and whether then return step (d2) monitoring should change by temporary background model B` within a preset time interval.
4. object method for supervising as claimed in claim 1 is characterized in that, in this guarded region of described judgement, the step that enters thing is arranged after, this method also comprises step:
The thing of being judged that enters is carried out size, color and entry time filtration;
The characteristic point that enters thing after filtering and the characteristic point of describing each object of storing in vector and the characteristic point data storehouse thereof are described vector model compare, which kind of object enters thing be to discern this; And
Send alarm.
5. object method for supervising as claimed in claim 1 is characterized in that, in this guarded region of described judgement, the step that removes thing is arranged after, this method also comprises step:
Judge that this removes thing and whether at the appointed time is removed in the section;
If judged result is not at the appointed time to be removed in the section for this removes thing, then process ends; And
If judged result is at the appointed time to be removed in the section for this removes thing, then send alarm.
6. an object supervisory control system runs in the image server, it is characterized in that, this system comprises:
Prospect object detecting unit is used for utilizing the prospect object of the image that double-deck background model detecting watch-dog catches, and this bilayer background model comprises existing background model and temporary background model;
Object and regional determination unit, be used for when the prospect object of this detecting still is judged as the prospect object after more than or equal to a setting-up time interval, being moved into the temporary described pixel of background model tense marker in the pixel of this prospect object is interested pixel, from temporary background model, search pixel identical in the zone that is close to described interested pixel as interested pixel with the pixel value of described interested pixel, obtain a pixel set b thus, when the area of set b during greater than a setting range, acquisition and the corresponding pixel of set b from existing background model, and obtain pixel set a thus;
Described object and regional determination unit, also be used to utilize characteristic point algorithm pair set a and b enforcement computing respectively, find out the characteristic point in each pixel set and describe vector, the characteristic point that to gather a is then implemented the image cutting as seed and is obtained block A, and will gather among the b with block A opposite position on characteristic point implement image cutting as seed and obtain block B; And
The article identification unit is used for judging in this guarded region to remove thing when the area of block B during greater than the area of block A, and when the area of block B during less than the area of block A, judges in this guarded region to enter thing.
7. object supervisory control system as claimed in claim 6, it is characterized in that, described article identification unit also is used for the thing of being judged that enters is carried out size, color and entry time filtration, and the characteristic point that enters thing after will filtering and the characteristic point of describing each object of storing in vector and the characteristic point data storehouse thereof are described vector model and are compared, enter thing to discern this, and judge whether the described thing that removes at the appointed time is removed in the section.
8. object supervisory control system as claimed in claim 7 is characterized in that, described article identification unit also be used to identify enter behind the thing or when the described thing that removes be not when at the appointed time being removed in the section, send alarm.
9. object supervisory control system as claimed in claim 6 is characterized in that, described prospect object detecting unit comprises:
Model building module is used to set an empty background model, receives first width of cloth image in the N width of cloth chromatic image;
The pixel separation module, be used for this background model that has deposited first width of cloth image in as existing background model, with second width of cloth image is current image, each pixel in this current image and the pixel in the existing background model are compared, to determine the difference and the luminance difference of the pixel value between respective pixel, when the difference of determined pixel value and luminance difference all are less than or equal to predefined threshold value, judge that this pixel is a background pixel, the object of being made up of all background pixels is the background object, or when the difference of determined pixel value and luminance difference during all greater than described predefined threshold value, judge that this pixel is a foreground pixel, the object of being made up of all foreground pixels is the prospect object; And
Memory module is used for that described background pixel is added existing background model and generates new background model, and temporary described foreground pixel and existing background model obtain described temporary background model B; And
Described pixel separation module also is used for successively the 3rd a width of cloth image to the N width of cloth image with described N width of cloth image as current image, and will detect the existing background model of background model conduct that all images before this current image obtain, continue respective pixel in above-mentioned current image and the existing background model to be compared prospect object in detecting every width of cloth image and background object.
10. object supervisory control system as claimed in claim 9 is characterized in that, described prospect object detecting unit also comprises;
Temporary background model monitoring module, whether the pixel value and the brightness value that are used for monitoring in real time the pixel of described temporary background model B change within a preset time interval; And
The background model update module, be used for when the result of above-mentioned monitoring for the pixel value of each pixel of this temporary background model B and brightness value when described Preset Time does not change at interval, generate new background model after upgrading described existing background model with this temporary background model B; And
Described temporary background model monitoring unit, also be used for changing at interval at described Preset Time for the pixel value of the pixel of this temporary background model B and brightness value as the result of above-mentioned monitoring, and when the temporary background model after changing was B`, whether monitoring should change in described Preset Time interval by temporary background model B`.
CN201010172766.XA 2010-05-14 2010-05-14 Object monitoring system and method Active CN102244770B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201010172766.XA CN102244770B (en) 2010-05-14 2010-05-14 Object monitoring system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201010172766.XA CN102244770B (en) 2010-05-14 2010-05-14 Object monitoring system and method

Publications (2)

Publication Number Publication Date
CN102244770A true CN102244770A (en) 2011-11-16
CN102244770B CN102244770B (en) 2014-12-17

Family

ID=44962567

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201010172766.XA Active CN102244770B (en) 2010-05-14 2010-05-14 Object monitoring system and method

Country Status (1)

Country Link
CN (1) CN102244770B (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104983511A (en) * 2015-05-18 2015-10-21 上海交通大学 Voice-helping intelligent glasses system aiming at totally-blind visual handicapped
CN107122765A (en) * 2017-05-22 2017-09-01 成都通甲优博科技有限责任公司 A kind of Expressway Service overall view monitoring method and system
CN109308710A (en) * 2017-07-27 2019-02-05 南宁富桂精密工业有限公司 Monitoring method, computing device and computer readable storage medium
CN109993976A (en) * 2017-12-29 2019-07-09 技嘉科技股份有限公司 Traffic accident monitors system and method

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101188743A (en) * 2007-09-17 2008-05-28 深圳先进技术研究院 An intelligent digital system based on video and its processing method
US20080181507A1 (en) * 2007-01-29 2008-07-31 Intellivision Technologies Corp. Image manipulation for videos and still images
CN101325690A (en) * 2007-06-12 2008-12-17 上海正电科技发展有限公司 Method and system for detecting human flow analysis and crowd accumulation process of monitoring video flow
WO2009005141A1 (en) * 2007-07-05 2009-01-08 Nec Corporation Object area detecting device, object area detecting system, and object area detecting method and program

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080181507A1 (en) * 2007-01-29 2008-07-31 Intellivision Technologies Corp. Image manipulation for videos and still images
CN101325690A (en) * 2007-06-12 2008-12-17 上海正电科技发展有限公司 Method and system for detecting human flow analysis and crowd accumulation process of monitoring video flow
WO2009005141A1 (en) * 2007-07-05 2009-01-08 Nec Corporation Object area detecting device, object area detecting system, and object area detecting method and program
CN101188743A (en) * 2007-09-17 2008-05-28 深圳先进技术研究院 An intelligent digital system based on video and its processing method

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
SIJUN LU,JIAN ZHANG,DAVID DAGAN FENG: "Detecting unattended packages through human activity recognition and object association", 《PATTERN RECOGNITION》 *

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104983511A (en) * 2015-05-18 2015-10-21 上海交通大学 Voice-helping intelligent glasses system aiming at totally-blind visual handicapped
CN107122765A (en) * 2017-05-22 2017-09-01 成都通甲优博科技有限责任公司 A kind of Expressway Service overall view monitoring method and system
CN109308710A (en) * 2017-07-27 2019-02-05 南宁富桂精密工业有限公司 Monitoring method, computing device and computer readable storage medium
CN109308710B (en) * 2017-07-27 2021-03-05 南宁富桂精密工业有限公司 Monitoring method, computing device and computer readable storage medium
CN109993976A (en) * 2017-12-29 2019-07-09 技嘉科技股份有限公司 Traffic accident monitors system and method

Also Published As

Publication number Publication date
CN102244770B (en) 2014-12-17

Similar Documents

Publication Publication Date Title
CN101587622B (en) Forest rocket detecting and identifying method and apparatus based on video image intelligent analysis
CN102509075B (en) Remnant object detection method and device
CN104303193B (en) Target classification based on cluster
CN102867386B (en) Intelligent video analysis-based forest smoke and fire detection method and special system thereof
CN104200466B (en) A kind of method for early warning and video camera
CN110650316A (en) Intelligent patrol and early warning processing method and device, electronic equipment and storage medium
CN102348128A (en) Surveillance camera system having camera malfunction detection function
CN102156707A (en) Video abstract forming and searching method and system
US9111353B2 (en) Adaptive illuminance filter in a video analysis system
Lin et al. A vision-based parking lot management system
CN102892007B (en) Promote the synchronous method and system with obtaining tracking of color balance between multiple video camera
WO2014004901A1 (en) Unsupervised learning of feature anomalies for a video surveillance system
CN102244769B (en) Object and key person monitoring system and method thereof
CN102201121A (en) System and method for detecting article in video scene
US10445885B1 (en) Methods and systems for tracking objects in videos and images using a cost matrix
US20100131442A1 (en) Intelligent monitoring system
CN105426820A (en) Multi-person abnormal behavior detection method based on security monitoring video data
CN101727570A (en) Tracking method, track detection processing unit and monitor system
CN108694399A (en) Licence plate recognition method, apparatus and system
TW201140470A (en) System and method for monitoring objects and key persons of the objects
CN102244770B (en) Object monitoring system and method
CN102254396B (en) Intrusion detection method and device based on video
CN109146923B (en) Processing method and system for target tracking broken frame
CN112270253A (en) High-altitude parabolic detection method and device
CN112800846A (en) High-altitude parabolic monitoring method and device, electronic equipment and storage medium

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
ASS Succession or assignment of patent right

Owner name: FUXIN POWER SUPPLY COMPANY, STATE GRID LIAONING EL

Free format text: FORMER OWNER: HONGFUJIN PRECISE INDUSTRY CO., LTD.

Effective date: 20141117

Owner name: SHENZHEN QICHUANGMEI TECHNOLOGY CO., LTD.

Free format text: FORMER OWNER: HONGFUJIN PRECISE INDUSTRY (SHENZHEN) CO., LTD.

Effective date: 20141117

C41 Transfer of patent application or patent right or utility model
COR Change of bibliographic data

Free format text: CORRECT: ADDRESS; FROM: 518109 SHENZHEN, GUANGDONG PROVINCE TO: 518000 SHENZHEN, GUANGDONG PROVINCE

TA01 Transfer of patent application right

Effective date of registration: 20141117

Address after: Futian District King Road Shenzhen city Guangdong province 518000 No. 108 Tze Wei court 1218

Applicant after: Shenzhen Qichuangmei Technology Co., Ltd.

Applicant after: FUXIN POWER SUPPLY COMPANY OF STATE GRID LIAONING ELECTRIC POWER SUPPLY CO., LTD.

Address before: 518109 Guangdong city of Shenzhen province Baoan District Longhua Town Industrial Zone tabulaeformis tenth East Ring Road No. 2 two

Applicant before: Hongfujin Precise Industry (Shenzhen) Co., Ltd.

Applicant before: Hon Hai Precision Industry Co., Ltd.

C14 Grant of patent or utility model
GR01 Patent grant
ASS Succession or assignment of patent right

Free format text: FORMER OWNER: FUXIN POWER SUPPLY COMPANY, STATE GRID LIAONING ELECTRIC POWER CO., LTD.

Effective date: 20150515

Owner name: FENG LIN

Free format text: FORMER OWNER: SHENZHEN QICHUANGMEI TECHNOLOGY CO., LTD.

Effective date: 20150515

C41 Transfer of patent application or patent right or utility model
COR Change of bibliographic data

Free format text: CORRECT: ADDRESS; FROM: 518000 SHENZHEN, GUANGDONG PROVINCE TO: 518057 SHENZHEN, GUANGDONG PROVINCE

TR01 Transfer of patent right

Effective date of registration: 20150515

Address after: 518057 Guangdong, Futian District Binhe Road, Binjiang village, East District, building 8,, 502

Patentee after: Feng Lin

Address before: Futian District King Road Shenzhen city Guangdong province 518000 No. 108 Tze Wei court 1218

Patentee before: Shenzhen Qichuangmei Technology Co., Ltd.

Patentee before: FUXIN POWER SUPPLY COMPANY OF STATE GRID LIAONING ELECTRIC POWER SUPPLY CO., LTD.

C41 Transfer of patent application or patent right or utility model
TR01 Transfer of patent right

Effective date of registration: 20151204

Address after: 226299, No. 666, North Road, Chengdong Industrial Zone, Huilong Town, Nantong City, Jiangsu, Qidong

Patentee after: Jiang Hongjuan

Address before: 518057 Guangdong, Futian District Binhe Road, Binjiang village, East District, building 8,, 502

Patentee before: Feng Lin

C41 Transfer of patent application or patent right or utility model
CB03 Change of inventor or designer information

Inventor after: Zhou Caihua

Inventor before: Chen Jianlin

Inventor before: Yang Zhicheng

COR Change of bibliographic data
TR01 Transfer of patent right

Effective date of registration: 20151229

Address after: 201500 Shanghai city Jinshan District Langxia Town Landscape Road No. 228 room 7 C457

Patentee after: Shanghai to create information technology Limited by Share Ltd

Address before: 226299, No. 666, North Road, Chengdong Industrial Zone, Huilong Town, Nantong City, Jiangsu, Qidong

Patentee before: Jiang Hongjuan