CN111612089A - Method and equipment for marking dangerous goods in security inspection machine - Google Patents

Method and equipment for marking dangerous goods in security inspection machine Download PDF

Info

Publication number
CN111612089A
CN111612089A CN202010472398.4A CN202010472398A CN111612089A CN 111612089 A CN111612089 A CN 111612089A CN 202010472398 A CN202010472398 A CN 202010472398A CN 111612089 A CN111612089 A CN 111612089A
Authority
CN
China
Prior art keywords
target
image
target object
display area
area
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010472398.4A
Other languages
Chinese (zh)
Inventor
陶业震
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhejiang Dahua Technology Co Ltd
Original Assignee
Zhejiang Dahua Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhejiang Dahua Technology Co Ltd filed Critical Zhejiang Dahua Technology Co Ltd
Priority to CN202010472398.4A priority Critical patent/CN111612089A/en
Publication of CN111612089A publication Critical patent/CN111612089A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N23/00—Investigating or analysing materials by the use of wave or particle radiation, e.g. X-rays or neutrons, not covered by groups G01N3/00 – G01N17/00, G01N21/00 or G01N22/00
    • G01N23/02—Investigating or analysing materials by the use of wave or particle radiation, e.g. X-rays or neutrons, not covered by groups G01N3/00 – G01N17/00, G01N21/00 or G01N22/00 by transmitting the radiation through the material
    • G01N23/04—Investigating or analysing materials by the use of wave or particle radiation, e.g. X-rays or neutrons, not covered by groups G01N3/00 – G01N17/00, G01N21/00 or G01N22/00 by transmitting the radiation through the material and forming images of the material
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/24—Classification techniques
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/451—Execution arrangements for user interfaces
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/13—Edge detection
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/20—Image preprocessing
    • G06V10/25—Determination of region of interest [ROI] or a volume of interest [VOI]
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N2223/00—Investigating materials by wave or particle radiation
    • G01N2223/03—Investigating materials by wave or particle radiation by transmission
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N2223/00—Investigating materials by wave or particle radiation
    • G01N2223/10—Different kinds of radiation or particles
    • G01N2223/101—Different kinds of radiation or particles electromagnetic radiation
    • G01N2223/1016—X-ray
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N2223/00—Investigating materials by wave or particle radiation
    • G01N2223/40—Imaging
    • G01N2223/426—Imaging image comparing, unknown with known substance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10116—X-ray image
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30204—Marker
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00—Indexing scheme relating to image or video recognition or understanding
    • G06V2201/07—Target detection

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Software Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Data Mining & Analysis (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Biochemistry (AREA)
  • Evolutionary Computation (AREA)
  • Evolutionary Biology (AREA)
  • Health & Medical Sciences (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • General Health & Medical Sciences (AREA)
  • Immunology (AREA)
  • Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Analysing Materials By The Use Of Radiation (AREA)

Abstract

The invention relates to a method and a device for labeling dangerous goods in a security inspection machine, which relate to the technical field of image processing and labeling, and comprise the following steps: collecting an X-ray picture of the package, and identifying a target object in the package from the X-ray picture; determining an image of the target object according to the area of the target object in the X-ray picture; displaying the wrapped X-ray pictures in a first display area of a display screen, and displaying images of all target objects in a second display area of the display screen, wherein the first display area and the second display area are not overlapped. According to the embodiment of the invention, the X-ray picture of the parcel and the image of each target object in the parcel are displayed in regions, so that the image of each target object can be clearly displayed, and display disorder is avoided.

Description

Method and equipment for marking dangerous goods in security inspection machine
Technical Field
The application relates to the technical field of image processing and labeling, in particular to a dangerous goods labeling method and equipment in a security inspection machine.
Background
At present, security check machines are arranged in places with large pedestrian flow, such as stations and airports, so as to ensure public safety. Along with the development of intelligent technology, the security check machine can acquire the hazardous articles in the X-ray picture of parcel to mark and indicate hazardous article information, such as gun, stage property etc..
In the prior art, when a security inspection machine acquires an X-ray picture of a package and identifies a dangerous article in the package according to the X-ray picture, the dangerous article is framed in the X-ray picture of the package and the type of the dangerous article is marked in a marking frame by characters; however, when the package contains more dangerous goods, the number of marking frames of the X-ray pictures is large, the number of prompting characters is large, and the X-ray pictures are displayed in a disordered manner.
Disclosure of Invention
The invention provides a dangerous goods labeling method and equipment in a security check machine, which are used for displaying an X-ray picture of a package and images of a plurality of target goods contained in the package separately, so that the image of each target goods can be displayed clearly, workers can check the images conveniently, and the working efficiency of the workers is improved.
In a first aspect, an embodiment of the present invention provides a method for labeling a hazardous article in a security check machine, including:
collecting an X-ray picture of a package, and identifying a target object in the package from the X-ray picture;
determining an image of the target object according to the area of the target object in the X-ray picture;
displaying the wrapped X-ray pictures in a first display area of a display screen, and displaying images of the target objects in a second display area of the display screen, wherein the first display area and the second display area are not overlapped.
The method comprises the steps of collecting an X-ray picture of a package, identifying a target object in the package, obtaining an image of the target object according to the area of the target object in the X-ray picture, and displaying the X-ray picture of the package and the image of the target object in a first display area and a second display area which are not overlapped with each other on a display screen respectively. According to the invention, the wrapped X-ray picture and the images of the target objects identified from the X-ray picture are respectively displayed in the first display area and the second display area of the display screen, and because the first display area and the second display area are not overlapped, the wrapped X-ray picture and the images of the target objects can be separately displayed, so that a mark frame and prompt characters cannot appear on the wrapped X-ray picture, the X-ray picture is conveniently and clearly displayed, and the display disorder is avoided; and each target article is displayed separately when being displayed, and cannot be overlapped with each other, so that each target article can be displayed clearly, the target article can be recognized by the staff conveniently, and the working efficiency is improved.
In one possible implementation, the determining the image of the target item according to the area of the target item in the X-ray picture includes:
determining the outline of the target object in the X-ray picture;
determining the area of the target object in the X-ray picture according to the contour of the target object in the X-ray picture;
and taking the determined image in the area as the image of the target object.
According to the method, the area of the target object in the X-ray picture is determined by identifying the outline of the target object in the X-ray picture and according to the outline of the target object in the X-ray picture, the image of each target object can be accurately acquired, so that the image of each target object is displayed in the second area of the display screen, the target objects are independent from each other and are not overlapped with the X-ray picture, the target objects can be clearly displayed, and the target objects correspond to the X-ray picture so as to be conveniently viewed by a worker.
In a possible implementation manner, after displaying the X-ray picture of the parcel in a first display area of a display screen, and displaying an image of each of the target items in a second display area of the display screen, the method further includes:
responding to a selection instruction, and determining a target item selected by the selection instruction in the second display area;
highlighting the selected target object in the X-ray picture displayed in the first display area.
According to the method, the target object selected by the corresponding instruction in the second display area is determined by responding to the selection instruction and is highlighted in the X-ray picture displayed in the first display area, the image of each target object corresponds to a certain area in the X-ray picture, so that the X-ray picture can be displayed clearly, the image of each target object corresponds to the X-ray picture, a worker can determine the actual position of the target object in the wrapped X-ray picture according to the image of any target object, and the working efficiency of the worker is improved.
In one possible implementation, the identifying the target item in the package from the X-ray picture further includes:
determining a type of a target item in the package;
displaying the image of each target object in a second display area of the display screen, further comprising:
determining the display position of the type of the target item according to the display position of the image of the target item in the second display area;
and displaying the type of the target item in a second display area of the display screen according to the determined display position of the type of the target item.
According to the method, when the target object is identified from the X-ray picture, the type of the target object is determined, when the image of the target object is displayed in the second display area of the display screen, the type corresponding to the target object is displayed in the second display area, when a worker views the image of each target object, the worker can know the type of the target object at the same time, and the working efficiency of the worker is improved.
In a possible implementation manner, the displaying the X-ray picture of the package in a first display area of a display screen further includes:
and displaying the number of the target objects in the X-ray picture in a first display area of the display screen.
According to the method, the number of the target objects in the package is displayed in the first display area, so that the staff can be helped to know the number of the target objects, and each target object in the package can be better identified by comparing the number of the target objects with the image of the target object displayed in the second display area.
In a second aspect, an embodiment of the present invention provides an apparatus for marking a hazardous article in a security inspection machine, including: a memory and a processor:
the memory is used for storing program codes used when the terminal equipment runs;
the processor is configured to execute the program code to implement the following processes:
collecting an X-ray picture of a package, and identifying a target object in the package from the X-ray picture;
determining an image of the target object according to the area of the target object in the X-ray picture;
displaying the wrapped X-ray pictures in a first display area of a display screen, and displaying images of the target objects in a second display area of the display screen, wherein the first area and the second area are not overlapped.
In one possible implementation, the processor is specifically configured to:
determining the outline of the target object in the X-ray picture;
determining the area of the target object in the X-ray picture according to the contour of the target object in the X-ray picture;
and taking the determined image in the area as the image of the target object.
In one possible implementation, the processor is further configured to:
responding to a selection instruction, and determining a target item selected by the selection instruction in the second display area;
highlighting the selected target object in the X-ray picture displayed in the first display area.
In one possible implementation, the processor is further configured to:
determining a type of a target item in the package;
determining the display position of the type of the target item according to the display position of the image of the target item in the second display area;
and displaying the type of the target item in a second display area of the display screen according to the determined display position of the type of the target item.
In one possible implementation, the processor is further configured to:
and displaying the number of the target objects in the X-ray picture in a first display area of the display screen.
In a third aspect, an embodiment of the present invention provides an apparatus for marking hazardous articles in a security check machine, including an identification module, a processing module, and a display module, where:
the identification module is used for: collecting an X-ray picture of the package, and identifying a target object in the package from the X-ray picture;
the processing module is used for: determining an image of the target object according to the area of the target object in the X-ray picture;
the display module is used for: displaying the wrapped X-ray pictures in a first display area of a display screen, and displaying images of all target objects in a second display area of the display screen, wherein the first display area and the second display area are not overlapped.
In a fourth aspect, the present application further provides a computer storage medium, on which a computer program is stored, which when executed by a processing unit, implements the steps of the method for labeling hazardous materials in a security inspection machine according to the first aspect.
In addition, for technical effects brought by any one implementation manner of the second aspect or the third aspect, reference may be made to technical effects brought by different implementation manners of the first aspect, and details are not described here.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention, as claimed.
Drawings
Fig. 1 is a flowchart illustrating steps of a method for labeling hazardous materials in a security inspection machine according to an embodiment of the present invention;
fig. 2 is a schematic diagram illustrating a dangerous goods displayed on a display screen according to an embodiment of the present invention;
fig. 3 is a schematic diagram illustrating a dangerous goods displayed on a display screen according to an embodiment of the present invention;
FIG. 4 is a flowchart illustrating steps of a method for tagging hazardous materials according to an embodiment of the present invention;
FIG. 5 is a schematic diagram of displaying dangerous goods on a display screen and marking the number of the dangerous goods according to an embodiment of the present invention;
FIG. 6 is a schematic diagram of a display screen with upper and lower screens separated, a dangerous goods displayed on the display screen, and types of the dangerous goods marked according to an embodiment of the present invention;
FIG. 7 is a schematic diagram of a display screen with upper and lower screens separated, a dangerous goods displayed on the display screen, and types of the dangerous goods marked according to an embodiment of the present invention;
FIG. 8 is a schematic diagram of a display screen with upper and lower split screens and a hazardous material displayed in a molecule area of the display screen according to an embodiment of the present invention;
FIG. 9 is a schematic diagram of a display screen with left and right split screens, in which a hazardous material is displayed in a molecular area of the display screen according to an embodiment of the present invention;
FIG. 10 is a schematic view of a display screen with upper and lower split screens, wherein a hazardous material is displayed in a molecular area of the display screen according to an embodiment of the present invention;
FIG. 11 is a schematic diagram of a dangerous goods marked on a non-molecular area of a display screen according to an embodiment of the present invention;
FIG. 12 is a schematic diagram of a display screen displaying a marked hazardous article in a non-molecular area according to an embodiment of the present invention;
FIG. 13 is a schematic diagram of a display screen displaying a marked hazardous article in a non-molecular area according to an embodiment of the present invention;
FIG. 14 is a schematic diagram of a display screen displaying a marked hazardous article in a molecular region according to an embodiment of the present invention;
FIG. 15 is a schematic diagram of a display screen displaying a marked hazardous article in a molecular area according to an embodiment of the present invention;
FIG. 16 is a schematic diagram of a display screen displaying a marked hazardous article in a molecular area according to an embodiment of the present invention;
fig. 17 is a structural diagram of an apparatus for marking hazardous materials in a security inspection machine according to an embodiment of the present invention;
fig. 18 is a block diagram of another apparatus for marking hazardous materials in a security inspection machine according to an embodiment of the present invention.
Detailed Description
In order to make those skilled in the art better understand the technical solution of the present invention, the technical solution in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings.
The application scenario described in the embodiment of the present invention is for more clearly illustrating the technical solution of the embodiment of the present invention, and does not form a limitation on the technical solution provided in the embodiment of the present invention, and it can be known by a person skilled in the art that with the occurrence of a new application scenario, the technical solution provided in the embodiment of the present invention is also applicable to similar technical problems.
At present, the security check machine that people's flow is great such as station, airport sets up when carrying out security check to the parcel, can acquire the X-ray picture of parcel and discern the target object article wherein, adds the mark frame to the target object article in the X-ray picture simultaneously to add the information of characters in order to indicate this target object article in the mark frame, however, when the target object article was more in the parcel, the mark frame of X-ray picture can be very much, and the suggestion characters are also very much, are unfavorable for staff's in time to recognize.
The embodiment of the invention provides a dangerous goods labeling method and equipment in a security check machine, which are used for collecting an X-ray picture of a package, identifying a target goods in the X-ray picture, determining an image of the target goods according to the area of the target goods in the X-ray picture, displaying the X-ray picture of the package in a first display area of a display screen, displaying the image of each target goods in a second display area of the display screen, and enabling the first display area and the second display area not to be overlapped. According to the invention, the target objects in the wrapped X-ray picture are identified, the image of each target object is obtained, and the X-ray picture and the image of the target object are displayed in separate areas, so that the image of the target object is clearly displayed, the image is convenient for workers to check, and the working efficiency of the workers is improved.
The technology of the present invention is explained in detail below with reference to the accompanying drawings.
Referring to fig. 1, a method for labeling a hazardous article in a security inspection machine is shown, which comprises the following steps:
s100: collecting an X-ray picture of the package, and identifying a target object in the package from the X-ray picture;
s101: acquiring an image of the target object according to the area of the target object in the X-ray picture:
s102: displaying the wrapped X-ray pictures in a first display area of a display screen, and displaying images of all target objects in a second display area of the display screen, wherein the first display area and the second display area are not overlapped.
Specifically, in an embodiment, when the X-ray image and the images of the target objects are simultaneously displayed on the display screen, referring to fig. 2, the display screen is divided into an upper portion and a lower portion, the upper portion is a first display area for displaying the X-ray images of the packages, and the lower portion is a second display area for displaying the images of the target objects. When the number of the target articles in the package is large, the target articles can be displayed in rows, and when a worker clicks the second display area, the page can be dragged up and down through the sliding strip to realize page turning, so that the worker can conveniently view images of all the target articles.
Alternatively, in an embodiment, referring to fig. 3, the display screen is divided into a left part and a right part, the left part is a first display area for displaying the X-ray images of the packages, and the right part is a second display area for displaying the images of the target objects, as shown in the figure, the target objects are sequentially arranged from left to right, and the images of the target objects are not overlapped with each other. When the number of the target objects is large, the target objects can be displayed in rows, and when a worker clicks the second display area through a mouse, the page can be dragged up and down through the sliding bar to realize page turning, so that the worker can conveniently view images of all the target objects.
Specifically, when an image of a target object is acquired, the size of the image is based on an area which can just cover the whole target object in an X-ray picture.
Specifically, when identifying a target item from an X-ray picture, the target item may include two types: dangerous goods such as knives and blunt objects and suspected dangerous goods such as sharp objects. When the security inspection machine identifies the target object in the X-ray picture, the outline of each object in the package is obtained, whether the object is the target object is judged according to the outline, if the object is judged to be the target object, the image of the object is obtained, and the image is displayed in the second display area, so that a worker can conveniently check and identify whether the object is a dangerous object.
Further, in order to facilitate the identification of the information of the target item in the package by the staff, when the target item is identified from the X-ray picture, the method further comprises the steps of determining the type of the target item, and displaying the type of the target item in the second display area corresponding to the target item.
Specifically, with reference to fig. 4, the displaying the type of the target item in the second display area corresponding to the target item includes the following steps:
s200: determining the display position of the type of the target item according to the display position of the image of the target item in the second display area;
s201: and displaying the type of the target item in a second display area of the display screen according to the determined display position of the type of the target item.
In one embodiment, as shown in fig. 6, when a target object in a package is identified by an X-ray picture, if the package carries a tool, the contour of the tool is identified, an image of the tool is obtained, and the type of the target object is determined to be the tool; when the image of the cutter is displayed in the second display area, a marking frame is added to the image of the cutter, and a cutter is displayed in the marking frame and on the left side of the image of the cutter, so that a worker is reminded that the type of the target object is the cutter. When the package still carries a blunt object, acquiring an image of the blunt object and displaying the image in the second display area, adding a mark frame to the image of the blunt object, and displaying the 'blunt object' in the mark frame and on the left side of the image of the blunt object so as to remind the staff that the type of the target object is the blunt object. When the package also carries an article suspected of being a dangerous article, the outline of the article is identified through the X-ray picture, an image is obtained, when the image of the article is displayed in the second display area, a marking frame is added to the image, and the suspected dangerous article is displayed in the marking frame and on the left side of the image of the article, so that a worker is reminded to check and confirm whether the article is a dangerous article.
In the above embodiment, the size of the mark frame can just cover the image and the prompt text of the target object. Also, text for presenting information to each target item may be displayed on the right side of the image of the target item.
In one embodiment, as shown in fig. 7, when a target object in a package is identified by an X-ray picture, if the package carries a tool, an image of the tool is obtained by identifying a contour of the tool, and meanwhile, it is determined that the type of the target object is the tool; when the image of the cutter is displayed in the second display area, a marking frame is added to the image of the cutter, and the cutter is displayed in the marking frame and below the image of the cutter so as to remind a worker that the type of the target object is the cutter. Similarly, when a blunt object or a suspected hazardous article is still carried in the package, an image of the article is acquired and a "blunt object" or a "suspected hazardous article" is displayed below the image accordingly to prompt the staff to view.
In the above embodiment, the size of the mark frame can just cover the image and the prompt text of the target object. Further, the text for presenting information to each target article may be displayed above the image of the target article.
Specifically, when it is desired to identify the type of target item in a package, the following method may be used: the method comprises the steps of obtaining an X-ray picture of a package, analyzing a certain area of the X-ray picture carrying an article through a two-dimensional algorithm, further scanning the area to obtain the outline of the article, and identifying the type of the article through further algorithm analysis of the outline. Taking a picture as an example, a cutter is carried in the middle of the package, a target object is arranged in the middle of the X-ray picture through algorithm analysis, the outline of the target object is obtained at the same time, and the target object is identified as the cutter through further algorithm analysis.
Further, when identifying a target item in an X-ray picture, the target item can be classified into the following categories: the tool type can comprise various shapes of tools, blunt devices and the like, the inflammable matter can comprise lighters, alcohol and the like, and the suspected dangerous goods can be articles with a certain volume and a sharp shape.
When the image of each target object is displayed in the second display area, the second display area may be divided into a plurality of sub-areas, each sub-area corresponding to one type of target object, for example, according to the above classification of the target object, the second display area may be divided into 3 sub-areas for displaying tools, inflammable objects, and suspected dangerous objects, respectively, and the target objects corresponding to each type are placed in the corresponding sub-area, so as to better classify the target objects.
In an embodiment, as shown in fig. 8, when the display screen is divided into an upper portion and a lower portion, the upper portion is a first display area, and the lower portion is a second display area, the second display area is divided into 3 sub-areas from left to right, each sub-area corresponds to a tool, an inflammable article and a suspected dangerous article, the object article is identified by the X-ray image of the package, and the image of the object is displayed in the corresponding area. For example, when the package contains a knife, an image of the knife is displayed in the area of the knife, when the package contains a lighter, an image of the lighter is displayed in the area of the inflammable, and so on.
Due to the limited size of the display screen, when a certain type of object in the package is more, images of the object of the type can be sequentially displayed in the sub-area corresponding to the type of object from left to right, and when a worker clicks the sub-area, the page of the sub-area is slid left and right through the sliding bar so as to view the images of all the object objects.
In one embodiment, as shown in fig. 9, when the display screen is divided into a left portion and a right portion, the left portion is a first display area, and the right portion is a second display area, the second display area is divided into 3 sub-areas from top to bottom, and each sub-area corresponds to a tool, an inflammable substance, and a suspected dangerous substance, respectively. After the type of the target object is identified, the image of the object is displayed in the corresponding area, for example, when the package contains a blunt device, the image of the blunt device is displayed in the area of a knife, when the package contains a lighter, the image of the lighter is displayed in the area of a combustible object, and the like.
When a certain type of target object is more, the images of the object of the type can be sequentially displayed in the sub-area corresponding to the type of object from left to right, and when the worker clicks the sub-area, the page of the sub-area is slid left and right through the sliding bar so as to view the images of all the target objects.
Further, when the image of the target object is classified and displayed in regions, the second display region can automatically divide corresponding sub-regions according to the type of the identified target object by identifying the target object and judging the type of the target object from the X-ray image of the package, and hide the sub-regions of the types which are not involved. For example, when only items such as tools are identified in the package, the second display area is used for displaying images of the tools. Alternatively, as shown in fig. 10, when an article carrying a tool and a suspected dangerous article in the package are identified, the second display area is automatically divided into two sub-areas, which are respectively used for displaying images of the tool and the suspected dangerous article.
Specifically, when the image of each target object is displayed in the second display region, the size of the image may be adjusted according to the size of the second display region, and when the second display region is not divided into a plurality of sub-regions, as shown in fig. 6, the image of the target object acquired from the X-ray picture may be displayed in the size obtained from the X-ray picture when the image of the target object is displayed in the second display region. Or, taking fig. 9 as an example, when the second display area is divided into a plurality of sub-areas, because the display area of each sub-area is limited, when the image is acquired according to the X-ray image and then displayed in the corresponding sub-area, the size of the acquired image can be reduced and displayed according to a certain proportion.
Further, when the X-ray picture of the package is displayed in the first display area, the number of the target items in the package can be acquired, and the number of the target items and the X-ray picture of the package are simultaneously displayed in the first display area, so that the staff can acquire the number of the target items in the package at the first time, and the general judgment can be made on the condition of the items in the package.
In one embodiment, taking fig. 5 as an example, when 5 target items in the parcel are identified, when the X-ray picture of the parcel is displayed in the first display area, the following items are displayed in the upper left corner of the X-ray picture: "number of dangerous goods: and 5', the staff can be reminded of the number of the target objects in the package.
In one embodiment, when 5 target items in the parcel are identified, when the X-ray picture of the parcel is displayed in the first display area, the following is displayed in the upper left corner of the X-ray picture: "number of dangerous goods: and 5', the prompt characters are in a flashing state on the display screen to remind workers of the number of the target objects in the package.
Specifically, the quantity of the target item in the package can be obtained by: and acquiring images of all target articles in the X-ray picture, and acquiring the number of the target articles according to the sum of the number of all the images.
Further, when the X-ray picture of the package and the images of all the target objects are displayed on the display screen, a worker can click on one of the target objects displayed in the second display area, so that the target object can be highlighted in the X-ray picture, and the worker can conveniently acquire the position of the target object in the X-ray picture so as to conveniently open the box for inspection.
Specifically, when the worker clicks an image of a certain target item displayed in the second display area so that the target item is highlighted in the first display area, the following scenarios may be used:
scene 1, taking fig. 11 as an example, the upper half of the display screen is a first display area, the lower half is a second display area, 4 target objects are identified according to the wrapped X-ray pictures, when the worker clicks the image of a certain target object displayed in the second display area, the image of the target object enters a highlighted selection state, and meanwhile, the area corresponding to the target object in the X-ray picture in the first display area also presents a highlighted state, so that the worker can correspond the target object to the position in the X-ray picture, and the worker can conveniently open the box to view the target object.
Scene 2, continuing to take fig. 11 as an example, when the staff clicks the image of a certain target item displayed in the second display area, the image of the target item enters a highlighted selection state, and meanwhile, the area corresponding to the target item in the X-ray picture in the first display area is in the highlighted selection state and is in a flashing state, so that the staff can correspond the target item to the position of the target item in the X-ray picture, and the staff can conveniently open the box to view the target item.
Scene 3, taking fig. 12 as an example, when the staff clicks on the image of one target item displayed in the second display area, the image of the target item enters a highlighted selection state, and meanwhile, the area corresponding to the target item in the X-ray picture located in the first display area is in an enlarged state, so that the image of the target item corresponds to the position of the image in the X-ray picture, and the staff can conveniently open the box to view the image.
Scene 4, taking fig. 13 as an example, when a worker clicks an image of a certain target item displayed in the second display area, the upper half of the display screen is the first display area, the image of the target item enters a highlighted selection state, and an area corresponding to the target item in the X-ray image in the first display area is highlighted, optionally, outlines of other items may be blurred, so that the image of the target item corresponds to the position of the image in the X-ray image, and the image is convenient for the worker to view.
Scene 5, taking fig. 14 as an example, the upper half of the display screen is a first display area, the lower half of the display screen is a second display area, and the second display area is divided into a left sub-area and a right sub-area, an image of an article such as a tool is displayed in the left sub-area, an image of a suspected article is displayed in the right sub-area, when a worker clicks the image of a certain target article displayed in the left sub-area, the image of the target article is enlarged, and an area corresponding to the target article in the X-ray picture in the first display area is in a highlighted state, so that the target article corresponds to the position of the target article in the X-ray picture, and the enlarged image of the target article can facilitate the worker to more clearly recognize the target article.
Scene 6, continuing with fig. 14 as an example, when the staff clicks on the image of one of the target items in the left sub-area, the image of the target item is enlarged, and at the same time, the area corresponding to the target item in the X-ray picture in the first display area is in a highlighted state and is in a blinking state, so that the staff can correspond the target item to the position in the X-ray picture while viewing the target item.
Scene 7, taking fig. 15 as an example, when the staff clicks on the image of one target item in the left sub-area, the image of the target item is enlarged, and the area corresponding to the target item in the X-ray picture in the first display area is in an enlarged state, so that the staff can correspond the target item to the position in the X-ray picture while viewing the target item.
In the scene 8, taking fig. 16 as an example, when the worker clicks on the image of a certain target object in the left sub-area, the image of the target object is enlarged, and the area corresponding to the target object in the X-ray picture in the first display area is highlighted, and optionally, the outlines of other objects may be blurred, so that the worker can correspond the target object to the position in the X-ray picture while viewing the target object.
Specifically, when the area of the target object in the X-ray picture is determined according to the outline of the target object in the X-ray picture, the following method can be used: the method comprises the steps of obtaining an X-ray picture of a package from the front side of the package, determining a first coordinate of a target object in the X-ray picture while analyzing that a certain area of the X-ray picture contains the target object through an algorithm, and obtaining an image of the target object in the X-ray picture according to the first coordinate. When the image of the target object displayed in the second display area is clicked, the specific area can be determined according to the first coordinate of the image in the X-ray picture.
Further, the method for determining the area of the target object in the X-ray picture by using the first coordinate may further include the following steps: the method comprises the steps of acquiring an X-ray picture of a parcel from the front side of the parcel, acquiring another X-ray picture of the parcel from the side surface of the parcel, determining a second coordinate of a target object in the X-ray picture while analyzing that a certain area of the other X-ray picture contains the target object through an algorithm, determining the area of the target object by combining the second coordinate on the basis of a first coordinate, and acquiring an image of the target object in the X-ray picture of the front side of the parcel. When the image of the target item displayed in the second display area is clicked, a specific area of the item can be determined according to the first coordinate and the second coordinate of the target item. The method can more refine the area of the target object in the package, and when at least two target objects are stacked, the specific position of each target object in the package can be accurately obtained by obtaining the coordinates of each target object in different directions, so that the specific position can be conveniently checked by a worker.
Based on the same inventive concept, the embodiment of the invention also provides equipment for labeling the dangerous goods in the security inspection machine, the corresponding method of the equipment is the method for labeling the dangerous goods in the security inspection machine in the embodiment of the invention, and the principle of solving the problems of the equipment is similar to that of the equipment, so that the equipment can be implemented by the method, and repeated parts are not repeated.
As shown in fig. 17, an apparatus for labeling a hazardous article in a security inspection machine according to an embodiment of the present invention includes: a memory 300 and a processor 301, wherein:
the memory 300 is used for storing program codes used when the terminal device runs;
the processor 301 is configured to execute program code to implement the following processes:
collecting an X-ray picture of the package, and identifying a target object in the package from the X-ray picture;
determining an image of the target object according to the area of the target object in the X-ray picture;
displaying the wrapped X-ray pictures in a first display area of a display screen, and displaying images of the target objects in a second display area of the display screen, wherein the first area and the second area are not overlapped.
In one possible implementation, the processor 300 is specifically configured to:
determining the outline of the target object in the X-ray picture;
determining the area of the target object in the X-ray picture according to the outline of the target object in the X-ray picture;
and taking the image in the determined area as the image of the target object.
In one possible implementation, the processor 300 is further configured to:
responding to the selection instruction, and determining the target item selected by the selection instruction in the second display area;
and highlighting the selected target object in the X-ray picture displayed in the first display area.
In one possible implementation, the processor 300 is further configured to:
determining a type of a target item in a package;
determining the display position of the type of the target item according to the display position of the image of the target item in the second display area;
and displaying the type of the target item in a second display area of the display screen according to the display position of the determined type of the target item.
In one possible implementation, the processor 300 is further configured to:
and displaying the number of the target objects in the X-ray picture in a first display area of the display screen.
As shown in fig. 18, an apparatus for labeling a hazardous article in a security inspection machine according to an embodiment of the present invention includes: an identification module 400, a processing module 401 and a display module 402; wherein:
the identification module 400 is configured to obtain an X-ray picture of the package, and identify a target item in the package from the X-ray picture of the package;
the processing module 401 is configured to determine an image of the target object according to a region of the target object in the X-ray picture;
the display module 402 is configured to display the wrapped X-ray image in a first area of a display screen, and display an image of each target object in a second area of the display screen, where the first area and the second area are not overlapped.
In a possible implementation manner, the processing module 401 is specifically configured to:
determining the outline of the target object in the X-ray picture;
determining the area of the target object in the X-ray picture according to the outline of the target object in the X-ray picture;
and taking the image in the determined area as the image of the target object.
In one possible implementation, the display module 402 is further configured to:
responding to the selection instruction, and determining the target item selected by the selection instruction in the second display area;
and highlighting the selected target object in the X-ray picture displayed in the first display area.
In one possible implementation, the processing module 401 is further configured to:
determining a type of a target item in a package;
the display module 402 is further configured to:
determining the display position of the type of the target item according to the display position of the image of the target item in the second display area;
and displaying the type of the target item in a second display area of the display screen according to the display position of the determined type of the target item.
In one possible implementation, the display module 402 further includes:
and displaying the number of the target objects in the X-ray picture in a first display area of the display screen.
An embodiment of the present application provides a readable storage medium, which is a non-volatile storage medium, and the readable storage medium is a non-volatile readable storage medium, and includes program code, when the program code runs on a computing device, the program code is used for causing the computing device to execute the method for measuring an object.
Embodiments of the present application provide a computer program product containing instructions, which when run on a computer, cause the computing device to perform the above method for labeling hazardous materials in a security check machine.
The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
The program product generated by the data acquisition of the embodiments of the present application may employ a portable compact disc read only memory (CD-ROM) and include program code, and may be run on a computing device. However, the program product of the present application is not limited thereto, and in this document, a readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with a command execution system, apparatus, or device.
A readable signal medium may include a propagated data signal with readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A readable signal medium may also be any readable medium that is not a readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with a command execution system, apparatus, or device.
Program code embodied on a readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Program code for carrying out operations of the present application may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user computing device, partly on the user equipment, as a stand-alone software package, partly on the user computing device and partly on a remote computing device, or entirely on the remote computing device or server. In the case of remote computing devices, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., through the internet using an internet service provider).
It should be noted that although several modules of the device are mentioned in the above detailed description, such division is merely exemplary and not mandatory. Indeed, the features and functionality of two or more of the modules described above may be embodied in one module according to embodiments of the application. Conversely, the features and functions of one module described above may be further divided into embodiments by a plurality of modules.
Further, while the operations of the methods of the present application are depicted in the drawings in a particular order, this does not require or imply that these operations must be performed in this particular order, or that all of the illustrated operations must be performed, to achieve desirable results. Additionally or alternatively, certain steps may be omitted, multiple steps combined into one step execution, and/or one step broken down into multiple step executions.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It will be understood that the invention is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the invention is limited only by the appended claims.

Claims (10)

1. A method for marking dangerous goods in a security inspection machine is characterized by comprising the following steps:
collecting an X-ray picture of a package, and identifying a target object in the package from the X-ray picture;
determining an image of the target object according to the area of the target object in the X-ray picture;
displaying the wrapped X-ray pictures in a first display area of a display screen, and displaying images of the target objects in a second display area of the display screen, wherein the first display area and the second display area are not overlapped.
2. The labeling method of claim 1, wherein said determining the image of the target item according to the area of the target item in the X-ray picture comprises:
determining the outline of the target object in the X-ray picture;
determining the area of the target object in the X-ray picture according to the contour of the target object in the X-ray picture;
and taking the determined image in the area as the image of the target object.
3. The labeling method of claim 1, further comprising, after displaying the X-ray image of the parcel on a first display area of a display screen and displaying the image of each of the target items on a second display area of the display screen:
responding to a selection instruction, and determining a target item selected by the selection instruction in the second display area;
highlighting the selected target object in the X-ray picture displayed in the first display area.
4. The labeling method of claim 1, wherein said identifying the target item in the package from the X-ray picture further comprises:
determining a type of a target item in the package;
displaying the image of each target object in a second display area of the display screen, further comprising:
determining the display position of the type of the target item according to the display position of the image of the target item in the second display area;
and displaying the type of the target item in a second display area of the display screen according to the determined display position of the type of the target item.
5. The labeling method according to any one of claims 1 to 4, wherein the displaying the X-ray image of the package in a first display area of a display screen further comprises:
and displaying the number of the target objects in the X-ray picture in a first display area of the display screen.
6. An apparatus for hazardous article labeling in a security inspection machine, comprising: a memory and a processor:
the memory is used for storing program codes used when the terminal equipment runs;
the processor is configured to execute the program code to implement the following processes:
collecting an X-ray picture of a package, and identifying a target object in the package from the X-ray picture;
determining an image of the target object according to the area of the target object in the X-ray picture;
displaying the wrapped X-ray pictures in a first display area of a display screen, and displaying images of the target objects in a second display area of the display screen, wherein the first area and the second area are not overlapped.
7. The device of claim 6, wherein the processor is specifically configured to:
determining the outline of the target object in the X-ray picture;
determining the area of the target object in the X-ray picture according to the contour of the target object in the X-ray picture;
and taking the determined image in the area as the image of the target object.
8. The device of claim 6, wherein the processor is further configured to:
responding to a selection instruction, and determining a target item selected by the selection instruction in the second display area;
highlighting the selected target object in the X-ray picture displayed in the first display area.
9. The device of claim 6, wherein the processor is further configured to:
determining a type of a target item in the package;
determining the display position of the type of the target item according to the display position of the image of the target item in the second display area;
and displaying the type of the target item in a second display area of the display screen according to the determined display position of the type of the target item.
10. The device of claim 6, wherein the processor is further configured to:
and displaying the number of the target objects in the X-ray picture in a first display area of the display screen.
CN202010472398.4A 2020-05-29 2020-05-29 Method and equipment for marking dangerous goods in security inspection machine Pending CN111612089A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010472398.4A CN111612089A (en) 2020-05-29 2020-05-29 Method and equipment for marking dangerous goods in security inspection machine

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010472398.4A CN111612089A (en) 2020-05-29 2020-05-29 Method and equipment for marking dangerous goods in security inspection machine

Publications (1)

Publication Number Publication Date
CN111612089A true CN111612089A (en) 2020-09-01

Family

ID=72199429

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010472398.4A Pending CN111612089A (en) 2020-05-29 2020-05-29 Method and equipment for marking dangerous goods in security inspection machine

Country Status (1)

Country Link
CN (1) CN111612089A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113139950A (en) * 2021-05-08 2021-07-20 佳都科技集团股份有限公司 Target object identification method and device
CN113391776A (en) * 2021-05-24 2021-09-14 浙江大华技术股份有限公司 Article information display method, article information display device, electronic device, and storage medium
CN114677541A (en) * 2022-03-23 2022-06-28 成都智元汇信息技术股份有限公司 Method and system for extracting adhesion sample set based on target

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107202808A (en) * 2017-06-14 2017-09-26 上海英曼尼安全装备有限公司 A kind of double source double-visual angle safety inspection method and its system
CN207117839U (en) * 2017-09-13 2018-03-16 姜继翔 A kind of slur marked automatically is as rays safety detection apparatus
CN107885476A (en) * 2017-11-06 2018-04-06 上海联影医疗科技有限公司 A kind of medical image display methods and device
CN109102865A (en) * 2018-09-29 2018-12-28 联想(北京)有限公司 A kind of image processing method and device, equipment, storage medium
CN109374658A (en) * 2018-12-24 2019-02-22 电子科技大学 The neural network reconstruction tomograph imaging method of double-visual angle X-ray safe examination system
CN208902891U (en) * 2018-11-02 2019-05-24 北京中集博源机电设备有限公司 A kind of adaptive logistics delivery line double-visual angle intelligence safety check apparatus
CN110186940A (en) * 2018-08-23 2019-08-30 深圳码隆科技有限公司 Safety check recognition methods, device, computer equipment and storage medium
CN110321800A (en) * 2019-06-05 2019-10-11 浙江大华技术股份有限公司 A kind of method and device that safety check article is shown

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107202808A (en) * 2017-06-14 2017-09-26 上海英曼尼安全装备有限公司 A kind of double source double-visual angle safety inspection method and its system
CN207117839U (en) * 2017-09-13 2018-03-16 姜继翔 A kind of slur marked automatically is as rays safety detection apparatus
CN107885476A (en) * 2017-11-06 2018-04-06 上海联影医疗科技有限公司 A kind of medical image display methods and device
CN110186940A (en) * 2018-08-23 2019-08-30 深圳码隆科技有限公司 Safety check recognition methods, device, computer equipment and storage medium
CN109102865A (en) * 2018-09-29 2018-12-28 联想(北京)有限公司 A kind of image processing method and device, equipment, storage medium
CN208902891U (en) * 2018-11-02 2019-05-24 北京中集博源机电设备有限公司 A kind of adaptive logistics delivery line double-visual angle intelligence safety check apparatus
CN109374658A (en) * 2018-12-24 2019-02-22 电子科技大学 The neural network reconstruction tomograph imaging method of double-visual angle X-ray safe examination system
CN110321800A (en) * 2019-06-05 2019-10-11 浙江大华技术股份有限公司 A kind of method and device that safety check article is shown

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113139950A (en) * 2021-05-08 2021-07-20 佳都科技集团股份有限公司 Target object identification method and device
CN113139950B (en) * 2021-05-08 2024-04-16 佳都科技集团股份有限公司 Target object identification method and device
CN113391776A (en) * 2021-05-24 2021-09-14 浙江大华技术股份有限公司 Article information display method, article information display device, electronic device, and storage medium
CN114677541A (en) * 2022-03-23 2022-06-28 成都智元汇信息技术股份有限公司 Method and system for extracting adhesion sample set based on target

Similar Documents

Publication Publication Date Title
CN111612089A (en) Method and equipment for marking dangerous goods in security inspection machine
CA2841721C (en) Package vision sort system and method
CN106874845B (en) Image recognition method and device
US8718368B2 (en) Text flow in and around irregular containers
CN105335423B (en) Method and device for collecting and processing user feedback of webpage
CN105808681B (en) Published information viewing method and system based on electronic map and mobile positioning
US11055869B2 (en) Security inspection based on scanned images
EP3772722B1 (en) X-ray image processing system and method, and program therefor
CN112686595A (en) Method, device, equipment and storage medium for detecting illegal behavior of logistics operation
KR101980914B1 (en) Image analysis for disposal of explosive ordinance and safety inspections
CN111292153A (en) Information recommendation method, device, system and storage medium
CN110261923B (en) Contraband detection method and device
CN112365607A (en) Augmented reality AR interaction method, device, equipment and storage medium
CN108446693B (en) Marking method, system, equipment and storage medium of target to be identified
CN111753608A (en) Information processing method and device, electronic device and storage medium
CN111062252A (en) Real-time dangerous article semantic segmentation method and device and storage device
CN111258569A (en) Webpage component editing method, device, equipment and computer readable storage medium
US9678990B2 (en) Construction drawing evaluation systems and methods
CN106776745A (en) The processing method of business paper, the processing unit of business paper and terminal
CN113343769A (en) Method and device for automatically receiving text messages
Soltani Excavator pose estimation for safety monitoring by fusing computer vision and RTLS data
CN110648300A (en) Image data synthesis method, image data synthesis device, computer equipment and storage medium
CN111580902B (en) Mobile terminal element positioning method and system based on picture analysis
CN105843949B (en) A kind of image display method and device
CN115565201B (en) Taboo picture identification method, apparatus and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination