CN101692281A - Safety monitoring method, safety monitoring device and automatic teller machine (ATM) system - Google Patents
Safety monitoring method, safety monitoring device and automatic teller machine (ATM) system Download PDFInfo
- Publication number
- CN101692281A CN101692281A CN200910085869A CN200910085869A CN101692281A CN 101692281 A CN101692281 A CN 101692281A CN 200910085869 A CN200910085869 A CN 200910085869A CN 200910085869 A CN200910085869 A CN 200910085869A CN 101692281 A CN101692281 A CN 101692281A
- Authority
- CN
- China
- Prior art keywords
- remittee
- eyes
- eye
- judged result
- described image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 41
- 238000012806 monitoring device Methods 0.000 title claims abstract description 36
- 238000012544 monitoring process Methods 0.000 title claims abstract description 23
- 230000004438 eyesight Effects 0.000 claims description 23
- 210000003128 head Anatomy 0.000 claims description 14
- 230000000007 visual effect Effects 0.000 claims description 12
- 238000012549 training Methods 0.000 claims description 11
- 238000010200 validation analysis Methods 0.000 claims description 6
- 238000001514 detection method Methods 0.000 claims description 5
- 239000000203 mixture Substances 0.000 description 10
- 230000008569 process Effects 0.000 description 9
- 238000010586 diagram Methods 0.000 description 6
- 239000012467 final product Substances 0.000 description 6
- 230000000694 effects Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 4
- 230000008676 import Effects 0.000 description 4
- 238000005286 illumination Methods 0.000 description 3
- 239000004615 ingredient Substances 0.000 description 3
- 238000007430 reference method Methods 0.000 description 3
- 238000012546 transfer Methods 0.000 description 3
- 230000001815 facial effect Effects 0.000 description 2
- ORQBXQOJMQIAOY-UHFFFAOYSA-N nobelium Chemical compound [No] ORQBXQOJMQIAOY-UHFFFAOYSA-N 0.000 description 2
- 238000010276 construction Methods 0.000 description 1
- 230000002950 deficient Effects 0.000 description 1
- 238000000151 deposition Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000001771 impaired effect Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 230000002265 prevention Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 238000012797 qualification Methods 0.000 description 1
- 238000012163 sequencing technique Methods 0.000 description 1
Images
Landscapes
- Image Processing (AREA)
- Image Analysis (AREA)
- Alarm Systems (AREA)
Abstract
The invention discloses a safety monitoring method, a safety monitoring device and an automatic teller machine (ATM) system. The safety monitoring method comprises the following steps: acquiring an image containing a payee and the direction behind the payee; analyzing the image, positioning the positions of the eyes of people in the image, and determining the positions of the eyes of the payee and/or the positions of the eyes of a non-payee; judging whether the eyes of the non-payee exist in the image or not, and generating a first judging result; and when the first judging result indicates that the eyes of the non-payee exist in the image, generating prompting or warning information. The invention can find out the eyes of the non-payee existing in the image in time by positioning the eyes, thereby informing users in time and effectively protecting the rights and interests of users in time.
Description
Technical field
The present invention relates generally to image processing field, relates in particular to a kind of method for safety monitoring, safety monitoring device and adopts the automatic teller machine (ATM) system of this safety monitoring device.
Background technology
In recent years, various finance activitiess such as along with the continuous development of science and technology and the raising of people's living standard, people deposit and withdraw in places such as banks, transfer transactions become frequent day by day, and meanwhile, the financial crime that occurs in ground such as bank is also more and more.With ATM (Automatic Teller Machine) (Automatic Teller Machine; ATM) be example; the life that appears as people of ATM has brought huge facility; but the crime at ATM (Automatic Teller Machine) also emerges in an endless stream simultaneously; the user worries that through regular meeting the someone steals a glance at the password of oneself importing after one's death when utilizing ATM (Automatic Teller Machine) to carry out various transaction.If password is peeped by the offender, then the offender can utilize the operation of illegally withdrawing the money of imitated bank card, thereby makes user's rights and interests be in breakneck condition, and user's legitimate rights and interests can't be effectively protected.
Technology is all monitored at places such as bank, ATM (automatic teller machine) installation camera usually now, after crime fact takes place, transfers monitoring video by specialist organization again and searches suspicious criminal, clears up a cace as clue.
The inventor finds in realizing process of the present invention; there is following defective at least in prior art: because the first-class watch-dog of shooting can not in time remind the user people to be arranged at that time at snooping password or carry out other criminal activity; thereby make can not in time the take measures generation of the delinquency prevention fact of user; having only when crime fact takes place, user ' s right is impaired could utilize monitoring video to solve a case for clue later; therefore, can not protect user's various interests timely.
Summary of the invention
The present invention proposes a kind of method for safety monitoring, safety monitoring device and adopts the automatic teller machine (ATM) system of this safety monitoring device; can in time find out the non-remittee's eyes that exist in the image by eye location; thereby in time notify the user, protect user's rights and interests effectively and timely.
The technical scheme of the embodiment of the invention is achieved in that
A kind of method for safety monitoring comprises:
Gather remittee and the remittee image of direction after one's death;
Analyze described image, locate the eye position of the people in the described image, determine remittee's eye position and/or non-remittee's eye position;
Judge whether there are non-remittee's eyes in the described image, produce first judged result;
When showing, described first judged result produces prompting or warning message when having non-remittee's eyes in the described image.
Preferably, described definite remittee's eye position and/or non-remittee's eye position comprise:
Determine that the left eye that exists in the described image and right eye are remittee's eye position apart from the eye position of maximum, the eye position of determining other existence is non-remittee's eye position.
Preferably, when showing, described first judged result also comprises when having non-remittee's eyes in the described image:
Whether the distance of judging described non-remittee's eyes and image acquisition units produces second judged result less than first predetermined threshold value;
Describedly, described first judged result produces prompting when having non-remittee's eyes in the described image or warning message is specially when showing:
When showing the distance that exists non-remittee's eyes and described second judged result to show described non-remittee's eyes and image acquisition units in the described image, described first judged result produces prompting or warning message during less than first predetermined threshold value.
Preferably, whether the described distance of judging described non-remittee's eyes and image acquisition units is less than also comprising before first predetermined threshold value:
Determine the distance of described non-remittee's eyes and image acquisition units according to the pixel distance of left eye and right eye in the described image.
Preferably, when showing, described first judged result also comprises when having non-remittee's eyes in the described image:
Judge that described non-remittee's eye sight line direction whether towards described image acquisition units, produces the 3rd judged result;
Describedly, described first judged result produces prompting when having non-remittee's eyes in the described image or warning message is specially when showing:
When showing, described first judged result produces prompting or warning message when existing non-remittee's eyes and described the 3rd judged result to show described non-remittee's eye sight line direction in the described image towards described image acquisition units.
Preferably, describedly judge whether described non-remittee's eye sight line direction comprises towards described image acquisition units:
Determine the attitude of the described relatively image acquisition units of described non-remittee's head;
Determine the direction of visual lines of the relative head of eyes, determine that according to the direction of visual lines of its head pose and relative head whether non-remittee's eye sight line direction is towards described image acquisition units.
Preferably, when showing, described first judged result also comprises when having non-remittee's eyes in the described image:
Judge that whether the pixel distance between non-remittee's right and left eyes produces four judged result greater than second predetermined threshold value in the described image;
Describedly, described first judged result produces prompting when having non-remittee's eyes in the described image or warning message is specially when showing:
When showing the pixel distance that exists non-remittee's eyes and described the 4th judged result to show non-remittee's right and left eyes described in the image in the described image, described first judged result produces prompting or warning message during greater than second predetermined threshold value.
Preferably, the described image of described analysis, the eye position of locating the people in the described image comprises:
The eyes area detector that adopts training in advance to obtain detects the eyes zone that obtains in the described image;
Determine the left eye region of search and the right eye region of search in described eyes zone, and, adopt left eye local feature detecting device that described left eye region of search is detected, obtain left-eye candidate positions; Adopt right eye local feature detecting device that described right eye region of search is detected, obtain the right eye position candidate;
Select at least one left-eye candidate positions and right eye position candidate to match, and left eye position and right eye position are determined in the row checking when adopting eyes area validation device to described at least one left-eye candidate positions and right eye position candidate.
A kind of safety monitoring device comprises:
Image acquisition units is used to gather remittee and the remittee image of direction after one's death;
Eye location unit is used for described image is analyzed, and locatees the eye position of the people in the described image, determines remittee's eye position and/or non-remittee's eye position;
First judging unit is used for judging whether described image exists non-remittee's eyes, produces first judged result;
Tip element is used for producing prompting or warning message when described first judged result shows that there are non-remittee's eyes in described image.
Preferably, described eye location unit determines that the left eye that exists in the described image and right eye are remittee's eye position apart from the eye position of maximum, and the eye position of determining other existence is non-remittee's eye position.
Preferably, also comprise:
Second judging unit, whether the distance that is used for further judging described non-remittee's eyes and described image acquisition units when described first judged result shows that there are non-remittee's eyes in described image produces second judged result less than first predetermined threshold value;
Described Tip element specifically is used for producing prompting or warning message when existing distance that non-remittee's eyes and described second judged result show described non-remittee's eyes and described image acquisition units less than first predetermined threshold value when described first judged result shows described image.
Preferably, also comprise:
Computing unit is used for determining according to the pixel distance of described image left eye and right eye the distance of described non-remittee's eyes and image acquisition units.
Preferably, also comprise:
The 3rd judging unit is used for further judging that described non-remittee's eye sight line direction whether towards described image acquisition units, produces the 3rd judged result when described first judged result shows that there are non-remittee's eyes in described image;
Described Tip element specifically is used for producing prompting or warning message when described first judged result shows that described image exists non-remittee's eyes and described the 3rd judged result to show described non-remittee's eye sight line direction towards described image acquisition units.
Preferably, also comprise:
The 4th judging unit is used for judging that pixel distance between the non-remittee's right and left eyes of described image whether greater than second predetermined threshold value, produces the 4th judged result;
Described Tip element specifically is used for producing prompting or warning message when existing pixel distance that non-remittee's eyes and described the 4th judged result show non-remittee's right and left eyes described in the image greater than second predetermined threshold value when described first judged result shows described image.
Preferably, described eye location unit comprises:
Eyes zones detection module is used to the eyes area detector that adopts training in advance to obtain, detects the eyes zone that obtains in the described image;
The position candidate determination module is used for determining the left eye region of search and the right eye region of search in described eyes zone, and, adopt left eye local feature detecting device that described left eye region of search is detected, obtain left-eye candidate positions; Adopt right eye local feature detecting device that described right eye region of search is detected, obtain the right eye position candidate;
The eyes position determination module, be used to select at least one left-eye candidate positions and right eye position candidate to match, and left eye position and right eye position are determined in the row checking when adopting eyes area validation device to described at least one left-eye candidate positions and right eye position candidate.
A kind of automatic teller machine (ATM) system comprises ATM (Automatic Teller Machine), and described automatic teller machine (ATM) system also comprises aforesaid safety monitoring device.
Preferably, described automatic teller machine (ATM) system also comprises:
Trigger element is used for when the user operates described ATM (Automatic Teller Machine), produces trigger message, triggers described image acquisition units collection remittee and the remittee image of direction after one's death.
Technical scheme of the present invention is by gathering remittee and the remittee image of direction after one's death; locate the eyes that exist in the described image by eye location; when having non-remittee's eyes in the image; in time notify user or warning; thereby the user can take measures timely and effectively; the generation that avoids damage can better be protected user's various interests.
Description of drawings
In order to be illustrated more clearly in the embodiment of the invention or technical scheme of the prior art, to do to introduce simply to the accompanying drawing of required use in embodiment or the description of the Prior Art below, apparently, accompanying drawing in describing below only is some embodiments of the present invention, for those of ordinary skills, under the prerequisite of not paying creative work, can also obtain other accompanying drawing according to these accompanying drawings.
Fig. 1 is the process flow diagram of a kind of method for safety monitoring first embodiment of the present invention;
Fig. 2 is the particular flow sheet of step S120 among Fig. 1;
Fig. 3 is the particular flow sheet of step S210 among Fig. 2;
Fig. 4 is the process flow diagram of a kind of method for safety monitoring second embodiment of the present invention;
Fig. 5 is the process flow diagram of a kind of method for safety monitoring the 3rd embodiment of the present invention;
Fig. 6 is the composition structural drawing of a kind of safety monitoring device first embodiment of the present invention;
Fig. 7 is the concrete composition structural drawing of eye location unit 620 among Fig. 6;
Fig. 8 is the composition structural drawing of a kind of safety monitoring device second embodiment of the present invention;
Fig. 9 is the composition structural drawing of a kind of safety monitoring device the 3rd embodiment of the present invention;
Figure 10 is the composition structural drawing of a kind of automatic teller machine (ATM) system preferred embodiment of the present invention;
Figure 11 is the composition structural drawing of a kind of another preferred embodiment of automatic teller machine (ATM) system of the present invention.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the invention, the technical scheme in the embodiment of the invention is clearly and completely described, obviously, described embodiment only is the present invention's part embodiment, rather than whole embodiment.Based on the embodiment among the present invention, those of ordinary skills belong to the scope of protection of the invention not making the every other embodiment that is obtained under the creative work prerequisite.
With reference to Fig. 1, show the process flow diagram of a kind of method for safety monitoring first embodiment of the present invention.Described method comprises step:
Step S110, collection remittee and remittee be the image of direction after one's death.
Image acquisition units is installed near cipher input equipment,, gathers remittee and the remittee image of direction after one's death as image capture devices such as camera, video cameras by image acquisition units.The general device password input of withdrawing the money all adopts the keyboard that is installed on the automatic drawing device to finish, therefore, a kind of embodiment of image acquisition units is for being installed in image acquisition units near the cipher inputting keyboard, when the remittee imports password on keyboard or carry out other operation, gather remittee and the remittee image of direction after one's death.
Step S120, analyze described image, locate the eye position of the people in the described image.
Analyze described image, locate the eye position of the people in the described image, determine remittee's eye position and/or non-remittee's eye position.
Step S130, judge whether there are non-remittee's eyes in the described image, produce first judged result.
Because remittee's range image collecting unit is nearest, therefore, can if also there are the eyes of other yardstick in the described image, the eyes that have non-remittee in the described image be described then with the pair of eyes of image mesoscale maximum as remittee's eye position.
In another kind of implementation, can also determine that the left eye that exists in the described image and right eye are remittee's eye position apart from the eye position of maximum, the eye position of determining other existence is non-remittee's eye position.Because remittee's range image collecting unit is nearest, therefore, the eyes of remittee's eyes distance is maximum also.
Step S140,, described first judged result produces prompting or warning message when having non-remittee's eyes in the described image when showing.
In judging described image except remittee's eyes, when also having non-remittee's eyes, be the eyes that remove sub-out to out in the described image, when also having the eyes of other yardstick, produce warning message or information, have the password input process that other non-remittee pays close attention to the remittee near prompting user or the related work personnel.User or related work personnel can take corresponding measure, the generation that avoids damage.
The described image of the analysis of described step S120, the implementation of locating the eye position of the people in the described image has multiple, introduces a kind of preferred implementation below, with reference to Fig. 2, shows the particular flow sheet of step S120, and described step S120 can comprise:
Step S210, the eyes area detector that adopts training in advance to obtain detect the eyes zone that obtains in the described image.
Step S220, the left eye region of search of determining described eyes zone and right eye region of search.
Step S230, employing left eye local feature detecting device detect described left eye region of search, obtain left-eye candidate positions; Adopt right eye local feature detecting device that described right eye region of search is detected, obtain the right eye position candidate.
Step S240, select at least one left-eye candidate positions and right eye position candidate to match, and left eye position and right eye position are determined in the row checking when adopting eyes area validation device to described at least one left-eye candidate positions and right eye position candidate.
Wherein, the eyes zone in the described image, the central point that is defined as with left eye right eye line is the center, is width with the certain multiple of eyes distance, the certain multiple of eyes distance is the zone of height.The eyes zone comprises eyes and the near zone thereof in the image, and needn't comprise other face feature zones such as nose and face, thereby has enlarged range of application.
With reference to Fig. 3, the training in advance among the described step S210 can navigate to the eyes area detector rapidly and accurately in image step comprises:
Step S211, images acquired comprising the facial image under attitudes in many and the illumination condition, and comprise the image of other characteristic areas of people's face, do not comprise the image of people's face.
Better for the detection effect that makes the eyes area detector that obtains, can gather the facial image under the multiple attitude.This need gather the image under the various illumination brightness conditions, and the image under various sidelight and the polarisation condition.Adopt the robustness of the detection effect of the eyes area detector that the training of such training image obtains can be very strong, can detect the eyes zone under various attitudes and the illumination condition.
Step S212, according to the eyes area size of definition, extract the eyes area sample, and be normalized to unified size, described eyes area sample comprises positive sample and anti-sample.
Described positive sample is the sample that comprises the eyes zone, and described anti-sample is to comprise the sample of other characteristic areas of people's face or other do not comprise the sample of people's face.
Step S213 adopts microstructure features as weak feature, and training obtains the eyes area detector as the sorter construction algorithm to adopt self-adaptation to strengthen (adaboost) algorithm.
More than the preferred implementation of the step S120 of present embodiment has been carried out simple an introduction, the detailed technology scheme please refer to the description of related art.
The described technical scheme of the embodiment of the invention is by gathering remittee and the remittee image of direction after one's death; locate the eyes that exist in the described image by eye location; when having non-remittee's eyes in the image; in time notify user or warning; thereby the user can take measures timely and effectively; the generation that avoids damage can better be protected user's various interests.
With reference to Fig. 4, show the process flow diagram of a kind of method for safety monitoring second embodiment of the present invention.Described method comprises step:
Step S410, collection remittee and remittee be the image of direction after one's death.
Step S420, analyze described image, locate the eye position of the people in the described image.
Analyze described image, locate the eye position of the people in the described image, determine remittee's eye position and/or non-remittee's eye position.Being embodied among first embodiment of step S420 described in detail, do not repeat them here, and gets final product with reference to the description of relevant portion.
Step S430, judge whether there are non-remittee's eyes in the described image, produce first judged result.
Because remittee's range image collecting unit is nearest, therefore, can if also there are the eyes of other yardstick in the described image, the eyes that have non-remittee in the described image be described then with the pair of eyes of image mesoscale maximum as remittee's eye position.
In another kind of implementation, can also determine that the left eye that exists in the described image and right eye are remittee's eye position apart from the eye position of maximum, the eye position of determining other existence is non-remittee's eye position.Because remittee's range image collecting unit is nearest, therefore, the eyes of remittee's eyes distance is maximum also.
Step S440, judge described non-remittee's eyes and described image acquisition units distance whether less than first predetermined threshold value, produce second judged result.
When described first judged result shows that the distance of further judging described non-remittee's eyes and image acquisition units when having non-remittee's eyes in the described image whether less than first predetermined threshold value, produces second judged result.
Whether the distance of judging described non-remittee's eyes among the described step S440 has much less than the implementation of first predetermined threshold value, as Chinese patent application number " 200710117964.4 ", denomination of invention has promptly proposed a kind of concrete implementation for the patent of invention of " a kind of method of automatically measuring distance and device ".
Described first predetermined threshold value can be provided with different numerical value according to actual conditions, and as 1m, 5m, 10m or other distance value, the embodiment of the invention does not limit this.
Step S450,, described first judged result produces prompting or warning message during less than first predetermined threshold value when showing the distance that exists non-remittee's eyes and described second judged result to show described non-remittee's eyes in the described image.
The difference of the present embodiment and first embodiment is, when also having other non-remittee's eyes in the described image, whether the distance that needs further to judge described non-remittee's eyes and image acquisition units (or import password keyboard) is during less than first predetermined threshold value, have only described non-remittee's eyes in the predetermined threshold value distance range, just produce prompting or warning message.
In another embodiment of the invention, because the distance of people's range image collecting unit and people comprise the eyes zone and are inversely proportional in interior face area size or people's binocular interval, therefore, can judge that whether the pixel distance between non-remittee's right and left eyes is greater than second predetermined threshold value in the described image, if produce prompting or warning message during greater than second predetermined threshold value when described first judged result shows the pixel distance that exists non-remittee's eyes and described the 4th judged result to show non-remittee's right and left eyes described in the image in the described image, described second predetermined threshold value can be set according to actual conditions, and the present invention does not limit this.In addition, can also adopt the size in eyes zone and threshold value to compare, it all is identical that the principle of described comparison is described with front embodiment, does not repeat them here.
With reference to Fig. 5, show the process flow diagram of a kind of method for safety monitoring the 3rd embodiment of the present invention.Described method comprises step:
Step S510, collection remittee and remittee be the image of direction after one's death.
Step S520, analyze described image, locate the eye position of the people in the described image.
Analyze described image, locate the eye position of the people in the described image, determine remittee's eye position and/or non-remittee's eye position.Being embodied in the first embodiment of the invention of step S520 described in detail, do not repeat them here, and gets final product with reference to the description of relevant portion.
Step S530, judge whether there are non-remittee's eyes in the described image, produce first judged result.
Because remittee's range image collecting unit is nearest, therefore, can if also there are the eyes of other yardstick in the described image, the eyes that have non-remittee in the described image be described then with the pair of eyes of image mesoscale maximum as remittee's eye position.
In another kind of implementation, can also determine that the left eye that exists in the described image and right eye are remittee's eye position apart from the eye position of maximum, the eye position of determining other existence is non-remittee's eye position.Because remittee's range image collecting unit is nearest, therefore, the eyes of remittee's eyes distance is maximum also.
Step S540, judge that described non-remittee's eye sight line direction whether towards described image acquisition units, produces the 3rd judged result.
When showing, described first judged result also further judges that described non-remittee's eye sight line direction whether towards described image acquisition units (or import password keyboard), produces the 3rd judged result when having non-remittee's eyes in the described image.
The eye areas that obtains is adopted in described judgement to non-remittee's eye sight line direction, can be further combined with also can described non-remittee's head being carried out attitude judge that it is prior art that attitude is judged, does not repeat them here not in conjunction with out of Memory.Then according to the feature of the eye areas image under the current head pose, analyze the direction of visual lines of eyes.And, judge that whether described non-remittee's eyes are at the keyboard of paying close attention to image acquisition units or input password with number of people attitude and direction of visual lines combination.
A kind of more excellent method of described judgement direction of visual lines is to be respectively left eye and right eye training direction of visual lines model, and with the direction of visual lines of both direction of visual lines judged results combinations as eyes.
Step S550,, described first judged result produces prompting or warning message when existing non-remittee's eyes and described the 3rd judged result to show described non-remittee's eye sight line direction in the described image towards described image acquisition units when showing.
At first, determine the attitude of the described relatively image acquisition units of described non-remittee's head.
Secondly, determine the direction of visual lines of the relative head of eyes, determine that according to the direction of visual lines of its head pose and relative head whether non-remittee's eye sight line direction is towards described image acquisition units.
The difference of the present embodiment and first embodiment is, when also having other non-remittee's eyes in the described image, need further to judge that whether described non-remittee's eye sight line direction is towards described image acquisition units (or keyboard of input password), have only described non-remittee's eye sight line direction towards described image acquisition units (or keyboard of input password), just produce prompting or warning message.
In the fourth embodiment of the present invention, except each composition step that comprises the 3rd embodiment, after step S530, can also comprise the step S440 among second embodiment before the step S540, whether the distance of promptly judging described non-remittee's eyes is less than first predetermined threshold value.Certainly, described step S440 also can be after described step S540, before the step S550.These two steps are combined, thereby can determine more accurately whether non-remittee may pay close attention to the password input process.
Further, for whether there being non-remittee's eyes in above-mentioned definite image, judge whether non-remittee's range image collecting unit is too near, whether sight line further can also comprise the time that record satisfies above-mentioned condition to non-remittee after the step of image acquisition units, when duration during greater than second predetermined threshold value, report to the police or point out, if the duration less than threshold value, does not then report to the police or points out.
With reference to Fig. 6, show the composition structural drawing of a kind of safety monitoring device first embodiment of the present invention.Described safety monitoring device 600 comprises image acquisition units 610, eye location unit 620, first judging unit 630 and Tip element 640.
Described image acquisition units 610 is used to gather remittee and the remittee image of direction after one's death.
Described eye location unit 620 is used for described image is analyzed, and locatees the eye position of the people in the described image, determines remittee's eye position and/or non-remittee's eye position.
Because remittee's range image collecting unit is nearest, therefore, can if also there are the eyes of other yardstick in the described image, the eyes that have non-remittee in the described image be described then with the pair of eyes of image mesoscale maximum as remittee's eye position.
Described eye location unit 620 can also determine that the left eye that exists in the described image and right eye are remittee's eye position apart from the eye position of maximum, and the eye position of determining other existence is non-remittee's eye position.
Described first judging unit 630 is used for judging whether described image exists non-remittee's eyes, produces first judged result.
Described Tip element 640 is used for producing prompting or warning message when described first judged result shows that there are non-remittee's eyes in described image.
With reference to Fig. 7, described eye location unit 620 comprises:
Eyes zones detection module 621, be used to the eyes area detector that adopts training in advance to obtain, detect the eyes zone that obtains in the described image.
Position candidate determination module 622, be used for determining the left eye region of search and the right eye region of search in described eyes zone, and, adopt left eye local feature detecting device that described left eye region of search is detected, obtain left-eye candidate positions; Adopt right eye local feature detecting device that described right eye region of search is detected, obtain the right eye position candidate.
Eyes position determination module 623, be used to select at least one left-eye candidate positions and right eye position candidate to match, and, left eye position and right eye position are determined in the row checking when adopting eyes area validation device to described at least one left-eye candidate positions and right eye position candidate.
This implement the course of work of described safety monitoring device 600 each ingredient and principle of work in front method embodiment part describe in detail, consider that for length do not repeat them here, the corresponding description of reference method embodiment part gets final product.
The described technical scheme of the embodiment of the invention is by gathering remittee and the remittee image of direction after one's death; locate the eyes that exist in the described image by eye location; when having non-remittee's eyes in the image; in time notify user or warning; thereby the user can take measures timely and effectively; the generation that avoids damage can better be protected user's various interests.
With reference to Fig. 8, show the composition structural drawing of a kind of safety monitoring device second embodiment of the present invention.Described safety monitoring device 600 comprises image acquisition units 610, eye location unit 620, first judging unit 630, second judging unit 650 and Tip element 640.
Described image acquisition units 610 is used to gather remittee and the remittee image of direction after one's death.
Described eye location unit 620 is used for described image is analyzed, and locatees the eye position of the people in the described image, determines remittee's eye position and/or non-remittee's eye position.
Described first judging unit 630 is used for judging whether described image exists non-remittee's eyes, produces first judged result.
Described second judging unit 650, whether the distance that is used for further judging described non-remittee's eyes when described first judged result shows that there are non-remittee's eyes in described image produces second judged result less than first predetermined threshold value.
Described Tip element 640 specifically is used for producing prompting or warning message when existing distance that non-remittee's eyes and described second judged result show described non-remittee's eyes less than first predetermined threshold value when described first judged result shows described image.
Further, also comprise computing unit, be used for determining the distance of described non-remittee's eyes and image acquisition units according to the pixel distance of described image left eye and right eye.
This implement the course of work of described safety monitoring device 600 each ingredient and principle of work in front method embodiment part describe in detail, consider that for length do not repeat them here, the corresponding description of reference method embodiment part gets final product.
The difference of the present embodiment and first embodiment is, when also having other non-remittee's eyes in the described image, whether the distance that needs further to judge described non-remittee's eyes and image acquisition units (or import password keyboard) is during less than first predetermined threshold value, have only described non-remittee's eyes in the predetermined threshold value distance range, just produce prompting or warning message.
With reference to Fig. 9, show the composition structural drawing of a kind of safety monitoring device the 3rd embodiment of the present invention.Described safety monitoring device 600 comprises image acquisition units 610, eye location unit 620, first judging unit 630, the 3rd judging unit 660 and Tip element 640.
Described image acquisition units 610 is used to gather remittee and the remittee image of direction after one's death.
Described eye location unit 620 is used for described image is analyzed, and locatees the eye position of the people in the described image, determines remittee's eye position and/or non-remittee's eye position.
Described first judging unit 630 is used for judging whether described image exists non-remittee's eyes, produces first judged result.
Described the 3rd judging unit 660 is used for further judging that described non-remittee's eye sight line direction whether towards described image acquisition units, produces the 3rd judged result when described first judged result shows that there are non-remittee's eyes in described image.
Described Tip element 640 specifically is used for producing prompting or warning message when described first judged result shows that described image exists non-remittee's eyes and described the 3rd judged result to show described non-remittee's eye sight line direction towards described image acquisition units.
This implement the course of work of described safety monitoring device 600 each ingredient and principle of work in front method embodiment part describe in detail, consider that for length do not repeat them here, the corresponding description of reference method embodiment part gets final product.
The difference of the present embodiment and first embodiment is, when also having other non-remittee's eyes in the described image, need further to judge that whether described non-remittee's eye sight line direction is towards described image acquisition units (or keyboard of input password), have only described non-remittee's eye sight line direction towards described image acquisition units (or keyboard of input password), just produce prompting or warning message.
In a kind of safety monitoring device the 4th embodiment of the present invention, described safety monitoring device 600 can also comprise image acquisition units 610, eye location unit 620, first judging unit 630, second judging unit 650, the 3rd judging unit 660 and Tip element 640.
In another embodiment of a kind of safety monitoring device of the present invention, described safety monitoring device can also comprise image acquisition units, eye location unit, first judging unit, the 4th judging unit and Tip element.
Described the 4th judging unit is used for judging that pixel distance between the non-remittee's right and left eyes of described image whether greater than second predetermined threshold value, produces the 4th judged result.
Described Tip element specifically is used for producing prompting or warning message when existing pixel distance that non-remittee's eyes and described the 4th judged result show non-remittee's right and left eyes described in the image greater than second predetermined threshold value when described first judged result shows described image.
The invention also discloses a kind of automatic teller machine (ATM) system, with reference to Figure 10, described automatic teller machine (ATM) system 100 comprises ATM (Automatic Teller Machine) 101 and safety monitoring device 600.
Described safety monitoring device 600 is described in detail at Fig. 6, Fig. 8, in embodiment illustrated in fig. 9, does not repeat them here, and gets final product with reference to the description of front relevant portion.
Described ATM (Automatic Teller Machine) 101, it will be understood by those skilled in the art that be used for depositing and withdrawing automatically, the self-aided terminal of transfer transactions, it generally includes parts such as display screen, numeric keypad, inward and outward card channel.
With reference to Figure 11, in another preferred embodiment of a kind of automatic teller machine (ATM) system of the present invention, described automatic teller machine (ATM) system 100 comprises ATM (Automatic Teller Machine) 101, trigger element 102 and safety monitoring device 600.
Described trigger element 102 is used for when the user operates described ATM (Automatic Teller Machine), produces trigger message, triggers described image acquisition units collection remittee and the remittee image of direction after one's death.
Technical scheme by present embodiment, when the user at the enterprising line operate of ATM (Automatic Teller Machine), as when inserting card, input password etc., described trigger element produces trigger message, trigger described image acquisition units collection remittee and the remittee image of direction after one's death, thereby described image acquisition units does not need the work that do not stop, has saved cost.When user's inoperation, as when moving back card, then stop the image acquisition work of described image acquisition units.
It will be understood by those skilled in the art that the predetermined threshold value in the various embodiments of the present invention can set according to actual needs, can not think therefore that described predetermined threshold value is unclear or protection domain had any qualification.
One of ordinary skill in the art will appreciate that, realize that all or part of step in the foregoing description method is to instruct relevant hardware to finish by program, described program can be stored in the computer read/write memory medium, this program is when carrying out, comprise step as above-mentioned method embodiment, described storage medium, as: magnetic disc, CD, read-only storage memory body (Read-Only Memory, ROM) or at random store memory body (Random Access Memory, RAM) etc.In each method embodiment of the present invention; the sequence number of described each step can not be used to limit the sequencing of each step; for those of ordinary skills, under the prerequisite of not paying creative work, the priority of each step is changed also within protection scope of the present invention.
The above only is preferred embodiment of the present invention, and is in order to restriction the present invention, within the spirit and principles in the present invention not all, any modification of being done, is equal to replacement, improvement etc., all should be included within protection scope of the present invention.
Claims (17)
1. a method for safety monitoring is characterized in that, comprising:
Gather remittee and the remittee image of direction after one's death;
Analyze described image, locate the eye position of the people in the described image, determine remittee's eye position and/or non-remittee's eye position;
Judge whether there are non-remittee's eyes in the described image, produce first judged result;
When showing, described first judged result produces prompting or warning message when having non-remittee's eyes in the described image.
2. method for safety monitoring according to claim 1 is characterized in that, described definite remittee's eye position and/or non-remittee's eye position comprise:
Determine that the left eye that exists in the described image and right eye are remittee's eye position apart from the eye position of maximum, the eye position of determining other existence is non-remittee's eye position.
3. method for safety monitoring according to claim 2 is characterized in that, also comprises when having non-remittee's eyes in the described image when described first judged result shows:
Whether the distance of judging described non-remittee's eyes and image acquisition units produces second judged result less than first predetermined threshold value;
Describedly, described first judged result produces prompting when having non-remittee's eyes in the described image or warning message is specially when showing:
When showing the distance that exists non-remittee's eyes and described second judged result to show described non-remittee's eyes and image acquisition units in the described image, described first judged result produces prompting or warning message during less than first predetermined threshold value.
4. method for safety monitoring according to claim 3 is characterized in that, whether the described distance of judging described non-remittee's eyes and image acquisition units is less than also comprising before first predetermined threshold value:
Determine the distance of described non-remittee's eyes and image acquisition units according to the pixel distance of left eye and right eye in the described image.
5. method for safety monitoring according to claim 2 is characterized in that, also comprises when having non-remittee's eyes in the described image when described first judged result shows:
Judge that described non-remittee's eye sight line direction whether towards described image acquisition units, produces the 3rd judged result;
Describedly, described first judged result produces prompting when having non-remittee's eyes in the described image or warning message is specially when showing:
When showing, described first judged result produces prompting or warning message when existing non-remittee's eyes and described the 3rd judged result to show described non-remittee's eye sight line direction in the described image towards described image acquisition units.
6. method for safety monitoring according to claim 5 is characterized in that, describedly judges whether described non-remittee's eye sight line direction comprises towards described image acquisition units:
Determine the attitude of the described relatively image acquisition units of described non-remittee's head;
Determine the direction of visual lines of the relative head of eyes, determine that according to the direction of visual lines of its head pose and relative head whether non-remittee's eye sight line direction is towards described image acquisition units.
7. method for safety monitoring according to claim 2 is characterized in that, also comprises when having non-remittee's eyes in the described image when described first judged result shows:
Judge that whether the pixel distance between non-remittee's right and left eyes produces four judged result greater than second predetermined threshold value in the described image;
Describedly, described first judged result produces prompting when having non-remittee's eyes in the described image or warning message is specially when showing:
When showing the pixel distance that exists non-remittee's eyes and described the 4th judged result to show non-remittee's right and left eyes described in the image in the described image, described first judged result produces prompting or warning message during greater than second predetermined threshold value.
8. according to the described method for safety monitoring of the arbitrary claim of claim 1 to 7, it is characterized in that, the described image of described analysis, the eye position of locating the people in the described image comprises:
The eyes area detector that adopts training in advance to obtain detects the eyes zone that obtains in the described image;
Determine the left eye region of search and the right eye region of search in described eyes zone, and, adopt left eye local feature detecting device that described left eye region of search is detected, obtain left-eye candidate positions; Adopt right eye local feature detecting device that described right eye region of search is detected, obtain the right eye position candidate;
Select at least one left-eye candidate positions and right eye position candidate to match, and left eye position and right eye position are determined in the row checking when adopting eyes area validation device to described at least one left-eye candidate positions and right eye position candidate.
9. a safety monitoring device is characterized in that, comprising:
Image acquisition units is used to gather remittee and the remittee image of direction after one's death;
Eye location unit is used for described image is analyzed, and locatees the eye position of the people in the described image, determines remittee's eye position and/or non-remittee's eye position;
First judging unit is used for judging whether described image exists non-remittee's eyes, produces first judged result;
Tip element is used for producing prompting or warning message when described first judged result shows that there are non-remittee's eyes in described image.
10. safety monitoring device according to claim 9 is characterized in that:
Described eye location unit determines that the left eye that exists in the described image and right eye are remittee's eye position apart from the eye position of maximum, and the eye position of determining other existence is non-remittee's eye position.
11. safety monitoring device according to claim 10 is characterized in that, also comprises:
Second judging unit, whether the distance that is used for further judging described non-remittee's eyes and described image acquisition units when described first judged result shows that there are non-remittee's eyes in described image produces second judged result less than first predetermined threshold value;
Described Tip element specifically is used for producing prompting or warning message when existing distance that non-remittee's eyes and described second judged result show described non-remittee's eyes and described image acquisition units less than first predetermined threshold value when described first judged result shows described image.
12. safety monitoring device according to claim 11 is characterized in that, also comprises:
Computing unit is used for determining according to the pixel distance of described image left eye and right eye the distance of described non-remittee's eyes and image acquisition units.
13. safety monitoring device according to claim 10 is characterized in that, also comprises:
The 3rd judging unit is used for further judging that described non-remittee's eye sight line direction whether towards described image acquisition units, produces the 3rd judged result when described first judged result shows that there are non-remittee's eyes in described image;
Described Tip element specifically is used for producing prompting or warning message when described first judged result shows that described image exists non-remittee's eyes and described the 3rd judged result to show described non-remittee's eye sight line direction towards described image acquisition units.
14. safety monitoring device according to claim 10 is characterized in that, also comprises:
The 4th judging unit is used for judging that pixel distance between the non-remittee's right and left eyes of described image whether greater than predetermined threshold value, produces the 4th judged result;
Described Tip element specifically is used for producing prompting or warning message when existing pixel distance that non-remittee's eyes and described the 4th judged result show non-remittee's right and left eyes described in the image greater than predetermined threshold value when described first judged result shows described image.
15., it is characterized in that described eye location unit comprises according to each described safety monitoring device of claim 9 to 14:
Eyes zones detection module is used to the eyes area detector that adopts training in advance to obtain, detects the eyes zone that obtains in the described image;
The position candidate determination module is used for determining the left eye region of search and the right eye region of search in described eyes zone, and, adopt left eye local feature detecting device that described left eye region of search is detected, obtain left-eye candidate positions; Adopt right eye local feature detecting device that described right eye region of search is detected, obtain the right eye position candidate;
The eyes position determination module, be used to select at least one left-eye candidate positions and right eye position candidate to match, and left eye position and right eye position are determined in the row checking when adopting eyes area validation device to described at least one left-eye candidate positions and right eye position candidate.
16. an automatic teller machine (ATM) system comprises ATM (Automatic Teller Machine), it is characterized in that, described automatic teller machine (ATM) system also comprises as each described safety monitoring device of claim 9 to 14.
17. automatic teller machine (ATM) system according to claim 16 is characterized in that, described automatic teller machine (ATM) system also comprises:
Trigger element is used for when the user operates described ATM (Automatic Teller Machine), produces trigger message, triggers described image acquisition units collection remittee and the remittee image of direction after one's death.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200910085869A CN101692281A (en) | 2009-06-03 | 2009-06-03 | Safety monitoring method, safety monitoring device and automatic teller machine (ATM) system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200910085869A CN101692281A (en) | 2009-06-03 | 2009-06-03 | Safety monitoring method, safety monitoring device and automatic teller machine (ATM) system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101692281A true CN101692281A (en) | 2010-04-07 |
Family
ID=42080964
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN200910085869A Pending CN101692281A (en) | 2009-06-03 | 2009-06-03 | Safety monitoring method, safety monitoring device and automatic teller machine (ATM) system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101692281A (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103108085A (en) * | 2013-01-31 | 2013-05-15 | 广东欧珀移动通信有限公司 | Glance prevention method of mobile terminal |
| CN104376243A (en) * | 2013-08-15 | 2015-02-25 | 富士施乐株式会社 | Information processing apparatus and information processing method |
| CN104902071A (en) * | 2015-04-13 | 2015-09-09 | 广东欧珀移动通信有限公司 | Method and device for protecting safety of payment with mobile phone |
| CN108376252A (en) * | 2018-02-27 | 2018-08-07 | 广东欧珀移动通信有限公司 | Control method, control device, terminal, computer equipment and storage medium |
| CN111680546A (en) * | 2020-04-26 | 2020-09-18 | 北京三快在线科技有限公司 | Attention detection method, attention detection device, electronic equipment and storage medium |
| CN112528966A (en) * | 2021-02-05 | 2021-03-19 | 华东交通大学 | Intelligent monitoring and identifying method, device and medium for peripheral environment of payee |
| US11335028B2 (en) | 2018-02-27 | 2022-05-17 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Control method based on facial image, related control device, terminal and computer device |
| CN115063939A (en) * | 2022-06-20 | 2022-09-16 | 北京金石视觉数字科技有限公司 | Anti-theft alarm equipment and anti-theft alarm method based on weighing |
-
2009
- 2009-06-03 CN CN200910085869A patent/CN101692281A/en active Pending
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103108085A (en) * | 2013-01-31 | 2013-05-15 | 广东欧珀移动通信有限公司 | Glance prevention method of mobile terminal |
| CN103108085B (en) * | 2013-01-31 | 2015-07-08 | 广东欧珀移动通信有限公司 | Glance prevention method of mobile terminal |
| CN104376243A (en) * | 2013-08-15 | 2015-02-25 | 富士施乐株式会社 | Information processing apparatus and information processing method |
| CN104376243B (en) * | 2013-08-15 | 2018-09-07 | 富士施乐株式会社 | Information processing unit and information processing method |
| CN104902071A (en) * | 2015-04-13 | 2015-09-09 | 广东欧珀移动通信有限公司 | Method and device for protecting safety of payment with mobile phone |
| CN104902071B (en) * | 2015-04-13 | 2018-05-15 | 广东欧珀移动通信有限公司 | A kind of method and device for protecting mobile-phone payment safety |
| CN108376252A (en) * | 2018-02-27 | 2018-08-07 | 广东欧珀移动通信有限公司 | Control method, control device, terminal, computer equipment and storage medium |
| US11335028B2 (en) | 2018-02-27 | 2022-05-17 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Control method based on facial image, related control device, terminal and computer device |
| CN111680546A (en) * | 2020-04-26 | 2020-09-18 | 北京三快在线科技有限公司 | Attention detection method, attention detection device, electronic equipment and storage medium |
| CN112528966A (en) * | 2021-02-05 | 2021-03-19 | 华东交通大学 | Intelligent monitoring and identifying method, device and medium for peripheral environment of payee |
| CN115063939A (en) * | 2022-06-20 | 2022-09-16 | 北京金石视觉数字科技有限公司 | Anti-theft alarm equipment and anti-theft alarm method based on weighing |
| CN115063939B (en) * | 2022-06-20 | 2023-03-21 | 北京金石视觉数字科技有限公司 | Anti-theft alarm equipment and anti-theft alarm method based on weighing |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101692281A (en) | Safety monitoring method, safety monitoring device and automatic teller machine (ATM) system | |
| CN103733633B (en) | Video analytic system | |
| TWI776796B (en) | Financial terminal security system and financial terminal security method | |
| US7995791B2 (en) | ATM security system | |
| CN101266704B (en) | ATM secure authentication and pre-alarming method based on face recognition | |
| CN101894428B (en) | ATM (Automated Teller Machine) intelligent monitoring system | |
| CN103714631B (en) | ATM cash dispenser intelligent monitor system based on recognition of face | |
| CN109376639B (en) | Accompanying personnel early warning system and method based on portrait recognition | |
| CN111064925B (en) | Subway passenger ticket evasion behavior detection method and system | |
| CN100570651C (en) | Doubtful object detection system | |
| CN101794481A (en) | ATM (Automatic teller machine) self-service bank monitoring system and method | |
| CN102004904B (en) | Automatic teller machine-based safe monitoring device and method and automatic teller machine | |
| US11386756B2 (en) | Counter-fraud measures for an ATM device | |
| CN103514438A (en) | Face judgment system and method | |
| CN104050771B (en) | The system and method for abnormality detection | |
| CN102930243A (en) | Method and system for identifying facial information of special personnel | |
| CN106485225A (en) | Identity card checking method and system based on biological nature identification | |
| KR20200059643A (en) | ATM security system based on image analyses and the method thereof | |
| CN116389094B (en) | Network information user safety detection management system based on Internet of things | |
| JP2960490B2 (en) | Automatic cash transaction system and automatic cash transaction equipment | |
| CN110689694B (en) | Intelligent monitoring system and method based on image processing | |
| CN112818150B (en) | Picture content auditing method, device, equipment and medium | |
| CN109460714B (en) | Method, system and device for identifying object | |
| CN111341040A (en) | Financial self-service equipment and management system thereof | |
| CN111144181A (en) | Risk detection method, device and system based on background collaboration |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20100407 |