CN109211951A - A kind of safe examination system and safety inspection method based on image segmentation - Google Patents
A kind of safe examination system and safety inspection method based on image segmentation Download PDFInfo
- Publication number
- CN109211951A CN109211951A CN201811369163.1A CN201811369163A CN109211951A CN 109211951 A CN109211951 A CN 109211951A CN 201811369163 A CN201811369163 A CN 201811369163A CN 109211951 A CN109211951 A CN 109211951A
- Authority
- CN
- China
- Prior art keywords
- luggage
- baggage
- monitoring video
- target object
- characteristic
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000007689 inspection Methods 0.000 title claims abstract description 93
- 238000000034 method Methods 0.000 title claims abstract description 34
- 238000003709 image segmentation Methods 0.000 title claims abstract description 20
- 238000012545 processing Methods 0.000 claims abstract description 37
- 238000012544 monitoring process Methods 0.000 claims description 99
- 230000002596 correlated effect Effects 0.000 claims description 7
- 238000012216 screening Methods 0.000 claims description 7
- 238000004590 computer program Methods 0.000 description 5
- 230000000875 corresponding effect Effects 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 230000005021 gait Effects 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000001514 detection method Methods 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 230000006399 behavior Effects 0.000 description 2
- 239000003086 colorant Substances 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000003384 imaging method Methods 0.000 description 2
- 238000010521 absorption reaction Methods 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 239000011111 cardboard Substances 0.000 description 1
- 239000000919 ceramic Substances 0.000 description 1
- 238000013270 controlled release Methods 0.000 description 1
- 239000002360 explosive Substances 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000037308 hair color Effects 0.000 description 1
- 231100001261 hazardous Toxicity 0.000 description 1
- 208000015181 infectious disease Diseases 0.000 description 1
- 230000002458 infectious effect Effects 0.000 description 1
- 210000000554 iris Anatomy 0.000 description 1
- 239000010985 leather Substances 0.000 description 1
- 239000002184 metal Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 244000052769 pathogen Species 0.000 description 1
- 230000000149 penetrating effect Effects 0.000 description 1
- 230000002285 radioactive effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 231100000331 toxic Toxicity 0.000 description 1
- 230000002588 toxic effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
- 239000002023 wood Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N23/00—Investigating or analysing materials by the use of wave or particle radiation, e.g. X-rays or neutrons, not covered by groups G01N3/00 – G01N17/00, G01N21/00 or G01N22/00
- G01N23/02—Investigating or analysing materials by the use of wave or particle radiation, e.g. X-rays or neutrons, not covered by groups G01N3/00 – G01N17/00, G01N21/00 or G01N22/00 by transmitting the radiation through the material
- G01N23/06—Investigating or analysing materials by the use of wave or particle radiation, e.g. X-rays or neutrons, not covered by groups G01N3/00 – G01N17/00, G01N21/00 or G01N22/00 by transmitting the radiation through the material and measuring the absorption
- G01N23/10—Investigating or analysing materials by the use of wave or particle radiation, e.g. X-rays or neutrons, not covered by groups G01N3/00 – G01N17/00, G01N21/00 or G01N22/00 by transmitting the radiation through the material and measuring the absorption the material being confined in a container, e.g. in a luggage X-ray scanners
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N2223/00—Investigating materials by wave or particle radiation
- G01N2223/03—Investigating materials by wave or particle radiation by transmission
- G01N2223/04—Investigating materials by wave or particle radiation by transmission and measuring absorption
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N2223/00—Investigating materials by wave or particle radiation
- G01N2223/10—Different kinds of radiation or particles
- G01N2223/101—Different kinds of radiation or particles electromagnetic radiation
- G01N2223/1016—X-ray
Landscapes
- Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Chemical & Material Sciences (AREA)
- Analytical Chemistry (AREA)
- Biochemistry (AREA)
- General Health & Medical Sciences (AREA)
- General Physics & Mathematics (AREA)
- Immunology (AREA)
- Pathology (AREA)
- Analysing Materials By The Use Of Radiation (AREA)
Abstract
It include video acquisition device, safety check apparatus and processing unit this application involves technical field of security inspection equipment more particularly to a kind of safe examination system and safety inspection method based on image segmentation, the safe examination system；Wherein, the video acquisition device, for acquiring the monitor video within the scope of safety check；The safety check apparatus obtains the x-ray image and normal image of the luggage, and the x-ray image and the normal image are associated for being scanned into the luggage of safety check apparatus；The processing unit, for being judged according to the x-ray image with the presence or absence of prohibited items in the luggage, if there are the prohibited items in the luggage determines the target object for carrying the luggage according to the normal image and the monitor video.The embodiment of the present application is able to confirm that in luggage by x-ray image with the presence or absence of prohibited items, be can determine the target object for carrying the luggage equipped with prohibited items according to normal image and monitor video, be can be improved the efficiency and accuracy rate of safety check.
Description
Technical Field
The application relates to the technical field of security check equipment, in particular to a security check system and a security check method based on image segmentation.
Background
The security check equipment sold in the current market relies on the X-ray machine imaging technology, shows the X-ray picture of article through ordinary display screen to rely on security check personnel to judge whether there is forbidden article artificially. The security check mode has the problems of low recognition rate, high omission factor, influence of quality level of security check personnel and the like, and the video monitored by the security check mode cannot be matched with security check articles.
Therefore, how to provide an efficient and intelligent security inspection system is a problem to be solved urgently.
Disclosure of Invention
In view of this, an object of the present application is to provide a security inspection system and a security inspection method based on image segmentation, which can determine whether there are prohibited items in baggage through an X-ray image, and can determine a target object carrying the baggage with the prohibited items according to a conventional image and a surveillance video, thereby improving security inspection efficiency and accuracy.
Mainly comprises the following aspects:
in a first aspect, an embodiment of the present application provides a security inspection system based on image segmentation, where the system includes a video acquisition device, a security inspection device, and a processing device; wherein,
the video acquisition device is used for acquiring monitoring videos in a security check range;
the security inspection device is used for scanning the luggage entering the security inspection device to obtain an X-ray image and a conventional image of the luggage and correlating the X-ray image and the conventional image;
and the processing device is used for judging whether forbidden articles exist in the luggage according to the X-ray image, and if the forbidden articles exist in the luggage, determining a target object carrying the luggage according to the conventional image and the monitoring video.
In combination with the first aspect, the present examples provide a first possible implementation manner of the first aspect, where,
the processing device is specifically configured to determine a target object carrying the baggage according to the following steps:
if the forbidden articles exist in the luggage, extracting a first luggage characteristic of the luggage from the conventional image;
and determining a target object carrying the luggage according to the first luggage characteristic and the monitoring video.
In combination with the first possible implementation manner of the first aspect, the present application provides a second possible implementation manner of the first aspect, wherein,
the processing means are also adapted to,
respectively extracting a biological feature of an individual and a second luggage feature of luggage held by the individual from the monitoring video;
the biometric characteristic of each individual is correlated with a second baggage characteristic of the baggage held by each individual.
In combination with the second possible implementation manner of the first aspect, the present application provides a third possible implementation manner of the first aspect, wherein,
the processing device is specifically configured to determine a target object carrying the baggage according to the following steps:
searching a second luggage characteristic matched with the first luggage characteristic in the monitoring video, and determining a biological characteristic associated with the searched second luggage characteristic;
screening candidate target objects from the monitoring video, wherein the candidate target objects are target objects matched with the biological characteristics associated with the searched second luggage characteristics;
determining the candidate target object as a target object carrying the baggage.
In combination with the first aspect, the present examples provide a fourth possible implementation manner of the first aspect, wherein,
the processing device is specifically further configured to determine the target object carrying the baggage according to the following steps:
acquiring a first moment when the luggage enters the security inspection device;
intercepting a target monitoring video within a preset time length before the first moment from the monitoring video;
associating the target surveillance video with the X-ray image;
and determining a target object carrying the luggage according to the conventional image and the target monitoring video.
With reference to the fourth possible implementation manner of the first aspect, an embodiment of the present application provides a fifth possible implementation manner of the first aspect, and the security inspection system further includes:
the alarm device is used for giving an alarm when the processing device judges that the luggage contains the prohibited articles;
the storage device is used for storing the X-ray image, the conventional image and the monitoring video;
the display device is used for displaying the monitoring video, the X-ray image, the target monitoring video related to the X-ray image and the identification of the contraband determined based on the X-ray image.
In a second aspect, an embodiment of the present application further provides a security inspection method based on image segmentation, where the method includes:
collecting a monitoring video within a security inspection range;
scanning luggage entering a security inspection device to obtain an X-ray image and a conventional image of the luggage, and associating the X-ray image with the conventional image;
and judging whether forbidden articles exist in the luggage according to the X-ray image, and if the forbidden articles exist in the luggage, determining a target object carrying the luggage according to the conventional image and the monitoring video.
In combination with the second aspect, the present embodiments provide a first possible implementation manner of the second aspect, wherein,
if the forbidden articles exist in the luggage, determining the target object carrying the luggage according to the conventional image and the monitoring video comprises:
if the forbidden articles exist in the luggage, extracting a first luggage characteristic of the luggage from the conventional image;
and determining a target object carrying the luggage according to the first luggage characteristic and the monitoring video.
In combination with the first possible implementation manner of the second aspect, the present examples provide a second possible implementation manner of the second aspect, wherein,
the security inspection method further comprises the following steps:
respectively extracting a biological feature of an individual and a second luggage feature of luggage held by the individual from the monitoring video;
the biometric characteristic of each individual is correlated with a second baggage characteristic of the baggage held by each individual.
In combination with the second possible implementation manner of the second aspect, the present examples provide a third possible implementation manner of the second aspect, wherein,
determining a target object carrying the baggage according to the first baggage characteristic and the monitoring video, comprising:
searching a second luggage characteristic matched with the first luggage characteristic in the monitoring video, and determining a biological characteristic associated with the searched second luggage characteristic;
screening candidate target objects from the monitoring video, wherein the candidate target objects are target objects matched with the biological characteristics associated with the searched second luggage characteristics;
determining the candidate target object as a target object carrying the baggage.
In combination with the second aspect, the present examples provide a fourth possible implementation manner of the second aspect, wherein,
the determining the target object carrying the baggage according to the conventional image and the monitoring video comprises:
acquiring a first moment when the luggage enters the security inspection device;
intercepting a target monitoring video within a preset time length before the first moment from the monitoring video;
associating the target surveillance video with the X-ray image;
and determining a target object carrying the luggage according to the conventional image and the target monitoring video.
In combination with the fourth possible implementation manner of the second aspect, the present application provides a fifth possible implementation manner of the second aspect,
the security inspection method further comprises the following steps:
when the processing device judges that the luggage contains the prohibited articles, alarming;
storing the X-ray image, the conventional image and the monitoring video;
displaying the monitoring video, the X-ray image, the target monitoring video associated with the X-ray image and the identification of the contraband determined based on the X-ray image.
In a third aspect, an embodiment of the present application further provides an electronic device, including: a processor, a memory and a bus, the memory storing machine-readable instructions executable by the processor, the processor and the memory communicating via the bus when the electronic device is running, the machine-readable instructions when executed by the processor performing the steps of the security inspection method based on image segmentation of the second aspect, or any possible implementation manner of the second aspect.
In a fourth aspect, this application further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the steps of the security inspection method based on image segmentation in the first aspect or any one of the possible implementations of the first aspect are performed.
In order to make the aforementioned objects, features and advantages of the present application more comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are required to be used in the embodiments will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered as limiting the scope, and for those skilled in the art, other related drawings can be obtained from the drawings without inventive effort.
Fig. 1 is a functional block diagram of a security inspection system according to an embodiment of the present application;
fig. 2 is a functional block diagram of a security inspection system provided in the second embodiment of the present application;
fig. 3 shows a flowchart of a security inspection method provided in the third embodiment of the present application;
fig. 4 shows a flowchart of a security inspection method provided in the fourth embodiment of the present application;
fig. 5 shows a schematic structural diagram of an electronic device provided in the fifth embodiment of the present application.
Icon: 1-a security inspection system; 10-a video capture device; 20-a security inspection device; 30-a processing device; 40-an alarm device; 50-a storage device; 60-a display device; 502-a processor; 504-a memory; 506-bus.
Detailed Description
To make the purpose, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it should be understood that the drawings in the present application are for illustrative and descriptive purposes only and are not used to limit the scope of protection of the present application. Additionally, it should be understood that the schematic drawings are not necessarily drawn to scale. The flowcharts used in this application illustrate operations implemented according to some embodiments of the present application. It should be understood that the operations of the flow diagrams may be performed out of order, and steps without logical context may be performed in reverse order or simultaneously. One skilled in the art, under the guidance of this application, may add one or more other operations to, or remove one or more operations from, the flowchart.
In addition, the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. The components of the embodiments of the present application, generally described and illustrated in the figures herein, can be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present application, presented in the accompanying drawings, is not intended to limit the scope of the claimed application, but is merely representative of selected embodiments of the application. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the present application without making any creative effort, shall fall within the protection scope of the present application.
In order to enable those skilled in the art to use the present disclosure, the following embodiments are given in conjunction with corresponding application scenarios, such as airports, train stations, bus stations, subways, and the like. Specifically, this application can be applied to and carry out safety inspection to the luggage that the passenger carried under the above-mentioned scene to when checking passenger's luggage, in time discover the contraband in the luggage and confirm the passenger who carries the contraband, can discover promptly that there are article and the danger personage of potential safety hazard to public safety, thereby reach the purpose of guaranteeing public place security.
At present, most of security inspection equipment in the prior art only depends on an X-ray machine imaging technology, X-ray pictures of articles are displayed through a common display screen, and security inspection personnel are relied on to artificially judge whether forbidden articles exist, and the security inspection mode has the problems of low recognition rate, high omission factor, influence of quality level of the security inspection personnel and the like, and the video monitoring video cannot be matched with the security inspection articles.
Based on this, the embodiment of the application provides a security inspection system and a security inspection method based on image segmentation, whether forbidden articles exist in luggage can be confirmed through X-ray images, a target object carrying the luggage with the forbidden articles can be determined according to conventional images and monitoring videos, and the efficiency and accuracy of security inspection can be improved.
For the convenience of understanding the present embodiment, a security inspection system based on image segmentation disclosed in the embodiments of the present application will be described in detail first.
Example one
Referring to fig. 1, in an embodiment of the present application, a security inspection system 1 based on image segmentation is provided, where the security inspection system 1 includes a video acquisition device 10, a security inspection device 20, and a processing device 30; wherein,
the video acquisition device 10 is used for acquiring monitoring videos in a security inspection area range;
the security inspection device 20 is configured to scan the baggage entering the security inspection device 20 to obtain an X-ray image and a conventional image of the baggage, and associate the X-ray image with the conventional image;
the processing device 30 is configured to determine whether the baggage has contraband according to the X-ray image, and determine a target object carrying the baggage according to the conventional image and the monitoring video if the baggage has the contraband.
The security inspection system 1 provided by the present application includes a video capture device 10, a security inspection device 20, and a processing device 30. In the specific implementation process of checking baggage, firstly, baggage enters the security inspection device 20, the security inspection device 20 scans the baggage to obtain an X-ray image and a conventional image of the baggage, associates the X-ray image and the conventional image of the baggage, and transmits the associated X-ray image and the conventional image of the baggage to the processing device 30; further, the processing device 30 determines whether the baggage has contraband according to the X-ray image of the baggage, and retrieves a conventional image associated with the X-ray image of the baggage when the baggage has been determined to have contraband; still further, the target object carrying the baggage with the contraband is searched for in the video capturing device 10 according to the regular image of the baggage.
Whether contraband exists in the luggage can be confirmed through the X-ray image of the luggage, and the target object carrying the luggage with the contraband can be determined according to the conventional image of the luggage and the monitoring video in the security inspection area. According to the embodiment of the application, whether forbidden articles exist or not is judged without manual X-ray image judgment of security check personnel, and the accuracy of security check can be improved while the efficiency of security check is improved.
Here, the security check area may be set in advance, and specifically, the video capture device 10 is disposed above the security check area, so that the video capture device 10 can capture a surveillance video about the contents of passengers, baggage, and the like within the security check area.
In addition, the security check device 20 includes an X-ray machine for acquiring X-ray images of baggage entering the security check device 20 and a camera for acquiring conventional images of baggage entering the security check device 20. Wherein, the X-ray image is an image shot by X-ray penetrating irradiation, and the regular image is an image shot by a common camera.
It should be noted that the X-ray machine is an electronic device that performs an inspection by feeding the baggage to be inspected into the X-ray inspection passage by means of the conveyor belt, and by scanning the baggage by means of X-rays. Luggage enters an X-ray inspection channel, a package detection sensor is blocked, a detection signal is sent to a system control part, an X-ray trigger signal is generated to trigger an X-ray source to emit an X-ray beam, a fan-shaped X-ray beam passing through a collimator passes through an object to be detected on a conveying belt, the X-ray is absorbed by the object to be detected and finally bombards a dual-energy semiconductor detector arranged in the channel, the detector converts the X-ray into a signal, the weak signals are amplified and sent to a signal processing case for further processing.
X-rays are electromagnetic waves that can penetrate opaque objects such as wood, cardboard, leather, etc. The X-ray machine can present images with different colors on the screen according to the absorption degree of the object to the X-ray. Generally, orange stands for organic, such as food, plastic, etc.; books, ceramics, etc. appear green; the metal appears blue.
It should be noted that, in general, the contraband mainly includes: flammable, explosive, toxic, corrosive, radioactive, infectious pathogens, and the like, as well as firearms, ammunition, controlled release cutters, and the like, which may be hazardous to public safety.
In the prior art, security personnel need to quickly check perspective images scanned by X-rays and can directly judge whether prohibited articles exist in luggage by virtue of rich experience; the security inspection system provided by the embodiment of the application can intelligently judge whether forbidden articles exist in the luggage from the X-ray image of the luggage, can confirm the target object carrying the forbidden articles from the monitoring video, and does not need security inspection personnel to artificially judge the forbidden articles from the X-ray image.
In the above embodiment, the processing device 30 is specifically configured to determine the target object carrying the baggage according to the following steps:
if the forbidden articles exist in the luggage, extracting a first luggage characteristic of the luggage from the conventional image;
and determining a target object carrying the luggage according to the first luggage characteristic and the monitoring video.
Here, in order to facilitate finding the target object carrying the baggage in the surveillance video according to the regular image of the baggage, the first baggage feature of the baggage may be extracted from the regular image, and then the target object carrying the baggage may be found in the surveillance video according to the first baggage feature of the baggage.
The characteristics of the luggage include the shape, size, color, texture and the like of the luggage.
In the above-described embodiment, the processing device 30 is further configured to,
respectively extracting a biological feature of an individual and a second luggage feature of luggage held by the individual from the monitoring video;
the biometric characteristic of each individual is correlated with a second baggage characteristic of the baggage held by each individual.
Here, in order to find the target object carrying the baggage with the prohibited articles from the surveillance video, the biometric feature of each individual appearing in the surveillance video and the second feature of the baggage held by each individual need to be associated, that is, the individual and the baggage held by the individual are associated through the biometric feature of the individual and the second feature of the baggage held by the individual, so that the biometric feature associated with the individual can be found according to the second feature of the baggage, and then the individual corresponding to the biometric feature is determined according to the biometric feature, that is, the individual is the target object carrying the baggage with the prohibited articles.
It should be noted that each individual has a unique physiological characteristic or behavior pattern, i.e., biometric, that can be measured or automatically identified and verified. The biological characteristics can be divided into physiological characteristics (such as fingerprints, face images, irises, palmprints and the like) and behavior characteristics (such as gait, voice, handwriting and the like), and the biological recognition is to identify and authenticate each individual according to unique biological characteristics, so that a target object can be identified through the biological characteristics of the individual.
The biological features can be one or a combination of several of gait features, human face features and soft biological features (such as hair color, tattoo and the like).
The gait features refer to features of the force magnitude, the direction and the action point of the person walking reflected in the footprints, and the gait features of each individual are different.
In the above embodiment, the processing device 30 is specifically configured to determine the target object carrying the baggage according to the following steps:
searching a second luggage characteristic matched with the first luggage characteristic in the monitoring video, and determining a biological characteristic associated with the searched second luggage characteristic;
screening candidate target objects from the monitoring video, wherein the candidate target objects are target objects matched with the biological characteristics associated with the searched second luggage characteristics;
determining the candidate target object as a target object carrying the baggage.
Here, when the processing device 30 determines that there is an item of contraband in the baggage according to the X-ray image of the baggage, first, a regular image associated with the X-ray image of the baggage is retrieved, and a first baggage feature of the baggage is extracted from the regular image; further, a second luggage characteristic matched with the first luggage characteristic is searched in the monitoring video, and if the second luggage characteristic is searched, the biological characteristic associated with the second luggage characteristic is called; and further, determining an individual corresponding to the biological characteristics according to the biological characteristics, wherein the individual is a candidate target object screened from the monitoring video, and further determining the candidate target object as a target object carrying luggage with prohibited articles.
In the above embodiment, the processing device 30 is further specifically configured to determine the target object carrying the baggage according to the following steps:
acquiring a first moment when the baggage enters the security inspection device 20;
intercepting a target monitoring video within a preset time length before the first moment from the monitoring video;
associating the target surveillance video with the X-ray image;
and determining a target object carrying the luggage according to the conventional image and the target monitoring video.
Here, in order to improve the efficiency of searching for the target object carrying the baggage with contraband from the surveillance video, the target object carrying the baggage with contraband may be searched for only from the target surveillance video within a preset time period before the first time when the baggage enters the security inspection device 20, specifically, the first time when the baggage enters the security inspection device 20 is obtained, further, the target surveillance video within the preset time period before the first time is intercepted from the surveillance video according to the first time, further, the target surveillance video is associated with the X-ray image, and further, the target object is searched for in the target surveillance video according to the regular image of the baggage to determine the target object carrying the baggage.
The preset time period can be determined according to the movement speed of the conveyor belt for conveying the luggage, and the preset time period can be set to be 10-30 s.
Example two
Referring to fig. 2, a security inspection system 1 based on image segmentation is provided in the second embodiment of the present application, where the security inspection system 1 includes a video acquisition device 10, a security inspection device 20, a processing device 30, an alarm device 40, a storage device 50, and a display device 60; wherein,
the video acquisition device 10 is used for acquiring monitoring videos in a security inspection area range;
the security inspection device 20 is configured to scan the baggage entering the security inspection device 20 to obtain an X-ray image and a conventional image of the baggage, and associate the X-ray image with the conventional image;
the processing device 30 is configured to determine whether the baggage has contraband according to the X-ray image, and if the baggage has the contraband, determine a target object carrying the baggage according to the conventional image and the monitoring video;
the processing device 30 is further specifically configured to determine the target object carrying the baggage according to the following steps:
acquiring a first moment when the baggage enters the security inspection device 20;
intercepting a target monitoring video within a preset time length before the first moment from the monitoring video;
associating the target surveillance video with the X-ray image;
determining a target object carrying the luggage according to the conventional image and the target monitoring video;
an alarm device 40, configured to alarm when the processing device 30 determines that there is a contraband in the baggage;
a storage device 50 for storing the X-ray image, the regular image and the monitoring video;
a display device 60 for displaying the monitoring video, the X-ray image, the target monitoring video associated with the X-ray image, and the identification of the contraband determined based on the X-ray image.
Here, the alarm device 40 may be an audible and visual alarm device to remind security personnel that there are forbidden articles in the luggage being subjected to security inspection; the storage device 50 may be divided into two storage spaces, and the X-ray image and its associated target surveillance video in which contraband is not detected are stored in a first storage space, and the X-ray image and its associated target video in which contraband is detected are stored in a second storage space.
In addition, in order to improve the efficiency of searching for the target object carrying the luggage with the prohibited articles from the surveillance video, only a small section of the target surveillance video carrying the luggage can be intercepted from the surveillance video, and then the target object carrying the luggage can be directly determined from the target surveillance video, so that the surveillance video, the X-ray image of the luggage and the target surveillance video associated with the X-ray image are all displayed on the display device 60, and the security inspector can conveniently view the contents. Further, contraband can be marked in the X-ray image displayed on the display device 60, so that the security personnel can directly confirm whether the contraband exists in the luggage from the X-ray image of the luggage displayed on the display device 60. In order to facilitate the security personnel to confirm the types of the prohibited articles, boxes with different colors can be adopted to mark different prohibited articles.
The embodiment of the application can realize intelligent detection of forbidden articles by acquiring the X-ray picture and the conventional picture of the luggage through the security inspection device 20, monitors the luggage entering the security inspection device 20 in real time, displays the monitoring video on the display device 60, marks the target object in the monitoring video, can confirm the target object by playing the monitoring video, and improves the accuracy and the speed of detecting the luggage.
Based on the same inventive concept, the third and fourth embodiments of the present application further provide image segmentation-based security inspection methods corresponding to the image segmentation-based security inspection systems provided in the first and second embodiments of the present application, and since the principle of solving the problem of the security inspection method in the embodiments of the present application is similar to that of the security inspection systems in the first and second embodiments of the present application, the implementation of the method can refer to the implementation of the system, and repeated parts are not described again.
EXAMPLE III
Referring to fig. 3, a security inspection method based on image segmentation provided in the third embodiment of the present application includes:
s301, collecting a monitoring video in a security inspection area range;
s302, scanning the luggage entering a security inspection device to obtain an X-ray image and a conventional image of the luggage, and associating the X-ray image with the conventional image;
s303, judging whether forbidden articles exist in the luggage according to the X-ray image;
s304, if the forbidden articles exist in the luggage, determining a target object carrying the luggage according to the conventional image and the monitoring video.
Example four
Referring to fig. 4, a security inspection method based on image segmentation provided in the fourth embodiment of the present application includes:
s401, collecting a monitoring video in a security inspection area range;
s402, scanning the luggage entering the security inspection device to obtain an X-ray image and a conventional image of the luggage, and associating the X-ray image with the conventional image;
s403, judging whether forbidden articles exist in the luggage according to the X-ray image;
s404, if the forbidden articles exist in the luggage, extracting a first luggage characteristic of the luggage from the conventional image;
s405, determining a target object carrying the luggage according to the first luggage characteristic and the monitoring video.
In the above embodiment, the security inspection method further includes:
respectively extracting a biological feature of an individual and a second luggage feature of luggage held by the individual from the monitoring video;
the biometric characteristic of each individual and a second baggage characteristic of the baggage held by each individual are correlated.
In the above embodiment, the step S405 of determining the target object carrying the baggage according to the first baggage feature and the surveillance video includes:
searching a second luggage characteristic matched with the first luggage characteristic in the monitoring video, and determining a biological characteristic associated with the searched second luggage characteristic;
screening candidate target objects from the monitoring video, wherein the candidate target objects are target objects matched with the biological characteristics associated with the searched second luggage characteristics;
determining the candidate target object as a target object carrying the baggage.
In the above embodiment, the determining, according to the regular image and the monitoring video, the target object carrying the baggage includes:
acquiring a first moment when the luggage enters the security inspection device;
intercepting a target monitoring video within a preset time length before the first moment from the monitoring video;
associating the target surveillance video with the X-ray image;
and determining a target object carrying the luggage according to the conventional image and the target monitoring video.
In the above embodiment, the security inspection method further includes:
when the processing device judges that the luggage contains the prohibited articles, alarming;
storing the X-ray image, the conventional image and the monitoring video;
displaying the monitoring video, the X-ray image, the target monitoring video associated with the X-ray image and the identification of the contraband determined based on the X-ray image.
EXAMPLE five
Referring to fig. 5, an electronic device provided in a fifth embodiment of the present application includes: a processor 502, a memory 504, and a bus 506, the memory 504 storing machine readable instructions controllable by the processor 502, the processor 502 and the memory 504 communicating via the bus 506 when the electronic device is operating, the machine readable instructions when executed by the processor 502 performing the steps of:
collecting a monitoring video within a security inspection area;
scanning luggage entering a security inspection device to obtain an X-ray image and a conventional image of the luggage, and associating the X-ray image with the conventional image;
judging whether forbidden articles exist in the luggage according to the X-ray image;
and if the forbidden articles exist in the luggage, determining a target object carrying the luggage according to the conventional image and the monitoring video.
In the above embodiment, in the steps executed by the processor 502,
if the forbidden articles exist in the luggage, determining the target object carrying the luggage according to the conventional image and the monitoring video comprises:
if the forbidden articles exist in the luggage, extracting a first luggage characteristic of the luggage from the conventional image;
and determining a target object carrying the luggage according to the first luggage characteristic and the monitoring video.
In the above embodiment, in the steps executed by the processor 502,
the method further comprises the following steps:
respectively extracting a biological feature of an individual and a second luggage feature of luggage held by the individual from the monitoring video;
the biometric characteristic of each individual and a second baggage characteristic of the baggage held by each individual are correlated.
In the above embodiment, in the steps executed by the processor 502, the determining, according to the first baggage characteristic and the surveillance video, a target object carrying the baggage includes:
searching a second luggage characteristic matched with the first luggage characteristic in the monitoring video, and determining a biological characteristic associated with the searched second luggage characteristic;
screening candidate target objects from the monitoring video, wherein the candidate target objects are target objects matched with the biological characteristics associated with the searched second luggage characteristics;
determining the candidate target object as a target object carrying the baggage.
In the above embodiment, in the steps executed by the processor 502,
the determining the target object carrying the baggage according to the conventional image and the monitoring video comprises:
acquiring a first moment when the luggage enters the security inspection device;
intercepting a target monitoring video within a preset time length before the first moment from the monitoring video;
associating the target surveillance video with the X-ray image;
and determining a target object carrying the luggage according to the conventional image and the target monitoring video.
In the above embodiment, in the steps executed by the processor 502,
the method further comprises the following steps:
when the processing device judges that the luggage contains the prohibited articles, alarming;
storing the X-ray image, the conventional image and the monitoring video;
displaying the monitoring video, the X-ray image, the target monitoring video associated with the X-ray image and the identification of the contraband determined based on the X-ray image.
EXAMPLE six
An embodiment of the present application provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program controls the steps of any one of the security inspection methods based on image segmentation.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one logical division, and there may be other divisions when actually implemented, and for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of devices or units through some communication interfaces, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a non-volatile computer-readable storage medium executable by a processor. Based on such understanding, the technical solution of the present application or portions thereof that substantially contribute to the prior art may be embodied in the form of a software product stored in a storage medium and including instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
Finally, it should be noted that: the above-mentioned embodiments are only specific embodiments of the present application, and are used for illustrating the technical solutions of the present application, but not limiting the same, and the scope of the present application is not limited thereto, and although the present application is described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: any person skilled in the art can modify or easily conceive the technical solutions described in the foregoing embodiments or equivalent substitutes for some technical features within the technical scope disclosed in the present application; such modifications, changes or substitutions do not depart from the spirit and scope of the exemplary embodiments of the present application, and are intended to be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
Claims (10)
1. A security inspection system based on image segmentation is characterized by comprising a video acquisition device, a security inspection device and a processing device; wherein,
the video acquisition device is used for acquiring monitoring videos in a security check range;
the security inspection device is used for scanning the luggage entering the security inspection device to obtain an X-ray image and a conventional image of the luggage and correlating the X-ray image and the conventional image;
and the processing device is used for judging whether forbidden articles exist in the luggage according to the X-ray image, and if the forbidden articles exist in the luggage, determining a target object carrying the luggage according to the conventional image and the monitoring video.
2. The system according to claim 1, wherein the processing device is specifically configured to determine the target object carrying the baggage according to the following steps:
if the forbidden articles exist in the luggage, extracting a first luggage characteristic of the luggage from the conventional image;
and determining a target object carrying the luggage according to the first luggage characteristic and the monitoring video.
3. The system of claim 2, wherein the processing device is further configured to,
respectively extracting a biological feature of an individual and a second luggage feature of luggage held by the individual from the monitoring video;
the biometric characteristic of each individual is correlated with a second baggage characteristic of the baggage held by each individual.
4. The system according to claim 3, wherein the processing device is specifically configured to determine the target object carrying the baggage according to the following steps:
searching a second luggage characteristic matched with the first luggage characteristic in the monitoring video, and determining a biological characteristic associated with the searched second luggage characteristic;
screening candidate target objects from the monitoring video, wherein the candidate target objects are target objects matched with the biological characteristics associated with the searched second luggage characteristics;
determining the candidate target object as a target object carrying the baggage.
5. The system according to claim 1, wherein the processing device is further configured to determine the target object carrying the baggage according to the following steps:
acquiring a first moment when the luggage enters the security inspection device;
intercepting a target monitoring video within a preset time length before the first moment from the monitoring video;
associating the target surveillance video with the X-ray image;
and determining a target object carrying the luggage according to the conventional image and the target monitoring video.
6. The system of claim 5, further comprising:
the alarm device is used for giving an alarm when the processing device judges that the luggage contains the prohibited articles;
the storage device is used for storing the X-ray image, the conventional image and the monitoring video;
the display device is used for displaying the monitoring video, the X-ray image, the target monitoring video related to the X-ray image and the identification of the contraband determined based on the X-ray image.
7. A security inspection method based on image segmentation is characterized by comprising the following steps:
collecting a monitoring video within a security inspection range;
scanning luggage entering a security inspection device to obtain an X-ray image and a conventional image of the luggage, and associating the X-ray image with the conventional image;
judging whether forbidden articles exist in the luggage according to the X-ray image;
and if the forbidden articles exist in the luggage, determining a target object carrying the luggage according to the conventional image and the monitoring video.
8. The method of claim 7, wherein determining the target object carrying the baggage if the contraband is present in the baggage according to the regular image and the surveillance video comprises:
if the forbidden articles exist in the luggage, extracting a first luggage characteristic of the luggage from the conventional image;
and determining a target object carrying the luggage according to the first luggage characteristic and the monitoring video.
9. The method of claim 8, further comprising:
respectively extracting a biological feature of an individual and a second luggage feature of luggage held by the individual from the monitoring video;
the biometric characteristic of each individual is correlated with a second baggage characteristic of the baggage held by each individual.
10. The method of claim 9, wherein determining the target object carrying the baggage from the first baggage feature and the surveillance video comprises:
searching a second luggage characteristic matched with the first luggage characteristic in the monitoring video, and determining a biological characteristic associated with the searched second luggage characteristic;
screening candidate target objects from the monitoring video, wherein the candidate target objects are target objects matched with the biological characteristics associated with the searched second luggage characteristics;
determining the candidate target object as a target object carrying the baggage.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811369163.1A CN109211951A (en) | 2018-11-16 | 2018-11-16 | A kind of safe examination system and safety inspection method based on image segmentation |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811369163.1A CN109211951A (en) | 2018-11-16 | 2018-11-16 | A kind of safe examination system and safety inspection method based on image segmentation |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109211951A true CN109211951A (en) | 2019-01-15 |
Family
ID=64996358
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811369163.1A Pending CN109211951A (en) | 2018-11-16 | 2018-11-16 | A kind of safe examination system and safety inspection method based on image segmentation |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109211951A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111290040A (en) * | 2020-03-12 | 2020-06-16 | 安徽启新明智科技有限公司 | Active double-view-angle correlation method based on image recognition |
| CN111323835A (en) * | 2020-03-20 | 2020-06-23 | 安徽启新明智科技有限公司 | Security inspection method and device based on personal bag association |
| CN111726572A (en) * | 2020-01-14 | 2020-09-29 | 灞卞嘲 | Instruction signal triggering-based associated personnel locking platform and method |
| CN113267828A (en) * | 2021-06-09 | 2021-08-17 | 杭州海康威视数字技术股份有限公司 | Information association method and device, security check equipment and storage medium |
| CN114419700A (en) * | 2021-12-29 | 2022-04-29 | 南京正驰科技发展有限公司 | X-ray security check system with human identity and luggage correspondence |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1979140A (en) * | 2005-12-08 | 2007-06-13 | 张传忠 | Stereo vision radioactive-rays safety detection apparatus |
| CN202676928U (en) * | 2012-07-13 | 2013-01-16 | 北京铁龙恒通车辆装备有限公司 | Safety inspection system |
| CN104299012A (en) * | 2014-10-28 | 2015-01-21 | 中国科学院自动化研究所 | Gait recognition method based on deep learning |
| CN104991282A (en) * | 2015-07-22 | 2015-10-21 | 北京睿思厚德辐射信息科技开发有限公司 | X-ray luggage bag inspection system with function of synchronous display of luggage bag shape |
| CN106934326A (en) * | 2015-12-29 | 2017-07-07 | 同方威视技术股份有限公司 | Method, system and equipment for safety inspection |
| CN107607562A (en) * | 2017-09-11 | 2018-01-19 | 北京匠数科技有限公司 | A kind of prohibited items identification equipment and method, X-ray luggage security check system |
| CN108171138A (en) * | 2017-12-22 | 2018-06-15 | 银河水滴科技（北京）有限公司 | A kind of biological information acquisition methods and device |
| CN108540756A (en) * | 2017-03-01 | 2018-09-14 | 中国电信股份有限公司 | Recognition methods, apparatus and system based on video and electronic device identification |
-
2018
- 2018-11-16 CN CN201811369163.1A patent/CN109211951A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1979140A (en) * | 2005-12-08 | 2007-06-13 | 张传忠 | Stereo vision radioactive-rays safety detection apparatus |
| CN202676928U (en) * | 2012-07-13 | 2013-01-16 | 北京铁龙恒通车辆装备有限公司 | Safety inspection system |
| CN104299012A (en) * | 2014-10-28 | 2015-01-21 | 中国科学院自动化研究所 | Gait recognition method based on deep learning |
| CN104991282A (en) * | 2015-07-22 | 2015-10-21 | 北京睿思厚德辐射信息科技开发有限公司 | X-ray luggage bag inspection system with function of synchronous display of luggage bag shape |
| CN106934326A (en) * | 2015-12-29 | 2017-07-07 | 同方威视技术股份有限公司 | Method, system and equipment for safety inspection |
| CN108540756A (en) * | 2017-03-01 | 2018-09-14 | 中国电信股份有限公司 | Recognition methods, apparatus and system based on video and electronic device identification |
| CN107607562A (en) * | 2017-09-11 | 2018-01-19 | 北京匠数科技有限公司 | A kind of prohibited items identification equipment and method, X-ray luggage security check system |
| CN108171138A (en) * | 2017-12-22 | 2018-06-15 | 银河水滴科技（北京）有限公司 | A kind of biological information acquisition methods and device |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111726572A (en) * | 2020-01-14 | 2020-09-29 | 灞卞嘲 | Instruction signal triggering-based associated personnel locking platform and method |
| CN111726572B (en) * | 2020-01-14 | 2021-11-16 | 刘恩伯 | Instruction signal triggering-based associated personnel locking platform and method |
| CN111290040A (en) * | 2020-03-12 | 2020-06-16 | 安徽启新明智科技有限公司 | Active double-view-angle correlation method based on image recognition |
| CN111323835A (en) * | 2020-03-20 | 2020-06-23 | 安徽启新明智科技有限公司 | Security inspection method and device based on personal bag association |
| CN113267828A (en) * | 2021-06-09 | 2021-08-17 | 杭州海康威视数字技术股份有限公司 | Information association method and device, security check equipment and storage medium |
| CN114419700A (en) * | 2021-12-29 | 2022-04-29 | 南京正驰科技发展有限公司 | X-ray security check system with human identity and luggage correspondence |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109211951A (en) | A kind of safe examination system and safety inspection method based on image segmentation | |
| US10846966B2 (en) | Suspicious person report system and suspicious person report method | |
| Michel et al. | Computer-based training increases efficiency in X-ray image interpretation by aviation security screeners | |
| US7796733B2 (en) | Personnel security screening system with enhanced privacy | |
| US10347062B2 (en) | Personal identification for multi-stage inspections of persons | |
| CN102460067B (en) | Systems and methods for automated, rapid detection of high-atomic-number materials | |
| US7062074B1 (en) | Method of processing X-ray images | |
| WO2015010531A1 (en) | Human body security screening method and system | |
| CN111612020B (en) | Positioning method for abnormal object to be detected, security inspection analysis equipment and security inspection analysis system | |
| USH2110H1 (en) | Automated security scanning process | |
| CN102077117A (en) | Millimeter wave image pickup device | |
| CN107037493B (en) | Safety check system and method | |
| CN109978892B (en) | Intelligent security inspection method based on terahertz imaging | |
| CN109785446B (en) | Image recognition system and method thereof | |
| CA2757160C (en) | Transport bin identification | |
| KR101717768B1 (en) | Component inspecting method and apparatus | |
| WO2015010619A1 (en) | Privacy protection method for human body security inspection and human body security inspection system | |
| CN209895386U (en) | Image recognition system | |
| EP2546807B1 (en) | Traffic monitoring device | |
| CN109471201A (en) | Security inspection method and device | |
| KR102347854B1 (en) | Apparatus and method of classifying welding state based on image recognition using marker | |
| CN113960687B (en) | X-ray image processing device and X-ray image processing method | |
| US10445591B2 (en) | Automated target recognition based body scanner using database scans | |
| CN113126176B (en) | Terahertz wave security inspection system and method | |
| US11454735B2 (en) | Method and a system for detecting a potential threat in a shoe worn by an individual |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190115 |