CN113391776A - Article information display method, article information display device, electronic device, and storage medium - Google Patents
Article information display method, article information display device, electronic device, and storage medium Download PDFInfo
- Publication number
- CN113391776A CN113391776A CN202110563710.5A CN202110563710A CN113391776A CN 113391776 A CN113391776 A CN 113391776A CN 202110563710 A CN202110563710 A CN 202110563710A CN 113391776 A CN113391776 A CN 113391776A
- Authority
- CN
- China
- Prior art keywords
- article
- information
- parcel
- package
- detection
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1407—General aspects irrespective of display type, e.g. determination of decimal point position, display with fixed or driving decimal point, suppression of non-significant zeros
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/60—Analysis of geometric attributes
- G06T7/62—Analysis of geometric attributes of area, perimeter, diameter or volume
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10116—X-ray image
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Geometry (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Human Computer Interaction (AREA)
- General Engineering & Computer Science (AREA)
- Burglar Alarm Systems (AREA)
- Image Analysis (AREA)
Abstract
The application relates to an article information display method and device, wherein the article information display method comprises the following steps: acquiring parcel detection images acquired at a plurality of visual angles, acquiring article attribute information and parcel information corresponding to each parcel detection image, wherein the parcel information at least comprises the dimension information of a parcel, and displaying the parcel detection images at the plurality of visual angles and the corresponding article attribute information in a correlation manner along a preset direction according to the parcel information. Through the method and the device, the problem that manual identification efficiency is low when whether the article images in the multi-angle images belong to the same article is solved, and the technical effects of displaying the multi-angle images and the article information in a correlation mode and quickly and accurately identifying the same article in the multi-angle images are achieved.
Description
Technical Field
The present application relates to the field of image display, and more particularly, to an article information display method, apparatus, electronic apparatus, and storage medium.
Background
The X-ray security inspection equipment utilizes the characteristic of imaging of X-ray penetrable objects, images the objects in the package under the condition of not opening the package, considers both the reliability and the inspection speed of the object inspection, becomes an important means for inspecting dangerous objects and performing security inspection in public places, and is widely applied to inspecting dangerous objects in high-speed rail stations, subway stations, airports and large-scale activity sites. In the security inspection process, a professional security inspector judges whether forbidden articles exist in the package or not by observing the image displayed on the screen of the equipment.
In practical application, the articles to be detected, which need to be subjected to security inspection, are mostly articles such as luggage packages, wherein a plurality of articles are stacked together, and therefore, some security inspection machines perform detection through imaging in multiple directions, however, due to the fact that imaging results in multiple directions are displayed on a screen, case workers need to spend a great deal of effort to identify whether article images at different positions in multiple angle images belong to the same article, and the security inspection efficiency is reduced.
Aiming at the problem that in the prior art, when the object images in the multi-angle images belong to the same object, the manual identification efficiency is low, no effective solution is provided at present.
Disclosure of Invention
The embodiment provides an article information display method, an article information display device, an electronic device and a storage medium, so as to solve the problem that in the related art, when identifying whether an article image in a multi-angle image belongs to the same article, the manual identification efficiency is low.
In a first aspect, there is provided in this embodiment an article information display method including:
acquiring package detection images acquired under a plurality of visual angles;
acquiring article attribute information and parcel information corresponding to each parcel detection image, wherein the parcel information at least comprises size information of the parcel;
and displaying the parcel detection images at a plurality of visual angles and the corresponding article attribute information in a correlation manner along a preset direction according to the parcel information.
In one embodiment, the displaying, according to the package information, the package detection images and the corresponding item attribute information at multiple viewing angles in a preset direction in an associated manner includes: acquiring the aspect ratio and a preset threshold of the parcel corresponding to each parcel detection image; and comparing each aspect ratio with the preset threshold value, if any aspect ratio is larger than or equal to the preset threshold value, displaying the article attribute information along the horizontal direction, and arranging the parcel detection images along the vertical direction and displaying the parcel detection images in association with the corresponding article attribute information.
In one embodiment, the comparing each aspect ratio with the preset threshold further includes: and if the aspect ratio is smaller than the preset threshold value, displaying the article attribute information in the vertical direction, and arranging the parcel detection images in the horizontal direction and displaying the parcel detection images in association with the corresponding article attribute information.
In one embodiment, the displaying, according to the package information, the package detection images and the corresponding item attribute information at multiple viewing angles in a preset direction in an associated manner further includes: the package inspection images collected at the plurality of viewing angles comprise a first package inspection image and a second package inspection image; and if the package detection image and the corresponding article attribute information are displayed in a horizontal direction in a correlated manner, displaying the article attribute information in the horizontal direction, arranging the first package detection image and the second package detection image on two sides of the article attribute information in the vertical direction, and correlating the article detection image in the first package detection image and the article detection image in the second package detection image with the corresponding article attribute information.
In one embodiment, the displaying, according to the package information, the package detection images and the corresponding item attribute information at multiple viewing angles in a preset direction in an associated manner further includes: the package inspection images collected at the plurality of viewing angles comprise a first package inspection image and a second package inspection image; and if the package detection image and the corresponding article attribute information are displayed in a correlated manner in the vertical direction, the article attribute information is displayed in the vertical direction, the first package detection image and the second package detection image are arranged on two sides of the article attribute information in the horizontal direction, and the article detection image in the first package detection image and the article detection image in the second package detection image are correlated with the corresponding article attribute information.
In one embodiment, the displaying, according to the package information, the package detection images and the corresponding item attribute information at multiple viewing angles in a preset direction in an associated manner further includes: acquiring an article detection image corresponding to each parcel detection image; and connecting the article detection images at multiple visual angles with the corresponding article attribute information through a connecting line according to the package information.
In one embodiment, the displaying, in association with a preset direction, the article detection images from multiple viewing angles and the corresponding article attribute information includes: acquiring article detection frame information according to the article detection image, wherein the article detection frame information at least comprises size information of the article detection frame; and connecting the article detection frames corresponding to the same articles under the multiple viewing angles with the article attribute information through connecting lines according to the article detection frame information.
In a second aspect, there is provided in the present embodiment an article information display device including:
an image acquisition module: the system comprises a display device, a display device and a display device, wherein the display device is used for acquiring package detection images acquired under multiple visual angles;
the information monitoring module: the system is used for acquiring article attribute information and parcel information corresponding to each parcel detection image; the package information includes at least size information of the package;
an information display module: and the system is used for displaying the parcel detection images at multiple visual angles and the corresponding article attribute information in a correlation manner along a preset direction according to the parcel information.
In a third aspect, in this embodiment, there is provided an electronic device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, and when the processor executes the computer program, the article information display method according to the first aspect is implemented.
In a fourth aspect, in the present embodiment, there is provided a storage medium having stored thereon a computer program which, when executed by a processor, implements the article information display method according to the first aspect described above.
Compared with the related art, in the article information display method provided in this embodiment, the article attribute information and the package information corresponding to each package detection image are obtained by obtaining the package detection images collected at a plurality of viewing angles, the package information at least includes the size information of the package, and the package detection images at the plurality of viewing angles and the corresponding article attribute information are displayed in association along the preset direction according to the package information. The display direction of the article attribute information is determined through analyzing the size information of the packages at multiple visual angles, the package detection images and the article attribute information are correlated, a user can determine the corresponding relation between the articles and the article attribute information in the package images at different visual angles through the correlation relation, the problem that the manual identification efficiency is low when whether the article images in the multi-angle images belong to the same article is solved, the multi-visual-angle images and the article information are displayed in a correlated mode, and the same article in the multi-visual-angle images is accurately identified is achieved.
The details of one or more embodiments of the application are set forth in the accompanying drawings and the description below to provide a more thorough understanding of the application.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the application and together with the description serve to explain the application and not to limit the application. In the drawings:
fig. 1 is a block diagram of a hardware configuration of a terminal of the item display method of the present embodiment;
fig. 2 is a flowchart of an item information display method of the present embodiment;
FIG. 3 is a schematic diagram of package information for an item information display method according to an embodiment of the present application;
FIG. 4 is a schematic view of information display of an item information display method according to an embodiment of the present application;
FIG. 5 is a schematic view of information display of an item information display method according to another embodiment of the present application;
FIG. 6 is a flow chart of an item information display method according to an embodiment of the present application;
fig. 7 is a block diagram showing the structure of the article information display device of the present embodiment.
Detailed Description
For a clearer understanding of the objects, aspects and advantages of the present application, reference is made to the following description and accompanying drawings.
Unless defined otherwise, technical or scientific terms used herein shall have the same general meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The use of the terms "a" and "an" and "the" and similar referents in the context of this application do not denote a limitation of quantity, either in the singular or the plural. The terms "comprises," "comprising," "has," "having," and any variations thereof, as referred to in this application, are intended to cover non-exclusive inclusions; for example, a process, method, and system, article, or apparatus that comprises a list of steps or modules (elements) is not limited to the listed steps or modules, but may include other steps or modules (elements) not listed or inherent to such process, method, article, or apparatus. Reference throughout this application to "connected," "coupled," and the like is not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. Reference to "a plurality" in this application means two or more. "and/or" describes an association relationship of associated objects, meaning that three relationships may exist, for example, "A and/or B" may mean: a exists alone, A and B exist simultaneously, and B exists alone. In general, the character "/" indicates a relationship in which the objects associated before and after are an "or". The terms "first," "second," "third," and the like in this application are used for distinguishing between similar items and not necessarily for describing a particular sequential or chronological order.
The method embodiments provided in the present embodiment may be executed in a terminal, a computer, or a similar computing device. For example, the present invention is executed on a terminal, and fig. 1 is a block diagram of a hardware configuration of the terminal of the article information display method according to the present embodiment. As shown in fig. 1, the terminal may include one or more processors 102 (only one shown in fig. 1) and a memory 104 for storing data, wherein the processor 102 may include, but is not limited to, a processing device such as a microprocessor MCU or a programmable logic device FPGA. The terminal may also include a transmission device 106 for communication functions and an input-output device 108. It will be understood by those of ordinary skill in the art that the structure shown in fig. 1 is merely an illustration and is not intended to limit the structure of the terminal described above. For example, the terminal may also include more or fewer components than shown in FIG. 1, or have a different configuration than shown in FIG. 1.
The memory 104 may be used to store computer programs, for example, software programs and modules of application software, such as a computer program corresponding to the article information display method in the embodiment, and the processor 102 executes various functional applications and data processing by running the computer programs stored in the memory 104, so as to implement the method described above. The memory 104 may include high speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 104 may further include memory located remotely from the processor 102, which may be connected to the terminal over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The transmission device 106 is used to receive or transmit data via a network. The network described above includes a wireless network provided by a communication provider of the terminal. In one example, the transmission device 106 includes a Network adapter (NIC) that can be connected to other Network devices through a base station to communicate with the internet. In one example, the transmission device 106 may be a Radio Frequency (RF) module, which is used to communicate with the internet in a wireless manner.
In the security inspection, a professional security inspector judges whether forbidden articles exist in the package by observing the image displayed on the screen of the security inspection equipment. The application of the multi-view security inspection equipment helps security inspectors to observe the images of the articles in the packages from different angles, and the accuracy of package judgment is improved. In recent years, with the development of artificial intelligence technology, the AI algorithm is used to analyze the X-ray parcel image and identify the articles in the parcel. By using the technology as an auxiliary means, the security inspection accuracy is improved, and the security inspection efficiency is also improved. However, a new problem with multi-perspective image detection techniques is that the position of the item in the parcel image is not correlated under the different perspective images. When article information needs to be determined or articles need to be further checked, information intelligently identified by the security check instrument is still independently displayed on images at various viewing angles, and security check workers still need to spend effort to perform related checking on the articles identified in the images at multiple angles.
In the present embodiment, an article information display method is provided, and fig. 2 is a flowchart of the article information display method of the present embodiment, as shown in fig. 2, the flowchart includes the following steps:
step S201, package detection images collected at a plurality of viewing angles are acquired.
And acquiring parcel detection images at least two detection angles. In this embodiment, the parcel refers to an article that needs to be subjected to security inspection, generally, an article such as a luggage, a parcel, and a personal article of an inspected person, and the inspected person puts the parcel to be inspected into security inspection equipment for security inspection, and acquires parcel detection images acquired at a plurality of viewing angles.
Step S202, acquiring article attribute information and parcel information corresponding to each parcel detection image, wherein the parcel information at least comprises size information of the parcel.
According to the parcel detection images at different angles collected by the security inspection instrument, the parcel detection images are analyzed by an intelligent algorithm to obtain the size information and the position information of the parcels and the article attribute information of each article in the parcels. The size information includes the width and height of the package, etc. The article attribute information refers to the type of article, such as knife, gun, liquid, etc.
In one embodiment, a package inspection box may also be generated during the analysis of the package inspection image by the intelligent algorithm. The parcel detection box refers to the smallest circumscribed rectangle of the parcel image. The intelligent algorithm can obtain the size information and the position information of the parcel detection frame of the parcel detection image. The size information may be the actual size information of the package or the size information of the package on the package inspection image. Further, the size information may be a specific width value and a specific height value, or may be proportional information of the parcel width and the parcel height. The position information is the position information of the parcel frame in the parcel detection image. Compared with a method for directly acquiring the parcel information, the method for acquiring the parcel detection frame has the advantages that the parcel outline does not need to be acquired, the calculation amount can be reduced, and the information acquisition speed is improved.
Step S203, according to the package information, the package detection images at multiple visual angles and the corresponding article attribute information are displayed in a correlation mode along a preset direction.
In one embodiment, the displaying, according to the package information, the package detection images and the corresponding item attribute information at multiple viewing angles in a preset direction in an associated manner includes: acquiring the aspect ratio and a preset threshold of the parcel corresponding to each parcel detection image; and comparing each aspect ratio with the preset threshold value, if any aspect ratio is larger than or equal to the preset threshold value, displaying the article attribute information along the horizontal direction, and arranging the parcel detection images along the vertical direction and displaying the parcel detection images in association with the corresponding article attribute information. Specifically, fig. 3 is a schematic diagram of package information of the item information display method according to the embodiment of the present application, as shown in fig. 3, WiIndicates the width of the package, HiIndicating the height of the parcel, calculating the aspect ratio P of the parceli. The aspect ratio is calculated as: pi＝i/Hi. Wherein i represents a parcel detection image at the ith angle, and the value range of the parcel detection image is (1, 2 … n). E.g. W1It means the width, W, of the package inspection image at the first view angle2It indicates the second oneAnd acquiring the width and the height of the package according to the width of the package detection image under the view angle, respectively calculating the aspect ratio corresponding to each value of i if the width and the height of the package are within the value range of i, and comparing each aspect ratio obtained through calculation with a preset threshold value M. Preferably, the preset threshold is 1.0. If any aspect ratio P existsiAnd if the value is larger than or equal to the preset threshold value M, displaying the article attribute information along the horizontal direction, and arranging the package detection images along the vertical direction and displaying the package detection images in association with the corresponding article attribute information.
In one embodiment, the comparing each aspect ratio with the preset threshold further includes: and if the aspect ratio is smaller than the preset threshold value, displaying the article attribute information in the vertical direction, and arranging the parcel detection images in the horizontal direction and displaying the parcel detection images in association with the corresponding article attribute information.
In one embodiment, the displaying, according to the package information, the package detection images and the corresponding item attribute information at multiple viewing angles in a preset direction in an associated manner further includes: the package inspection images collected at the plurality of viewing angles comprise a first package inspection image and a second package inspection image; and if the package detection image and the corresponding article attribute information are displayed in a horizontal direction in a correlated manner, displaying the article attribute information in the horizontal direction, arranging the first package detection image and the second package detection image on two sides of the article attribute information in the vertical direction, and correlating the article detection image in the first package detection image and the article detection image in the second package detection image with the corresponding article attribute information. Specifically, fig. 4 is a schematic information display diagram of an article information display method according to an embodiment of the present application, and as shown in fig. 4, a display screen in the diagram includes three regions, namely, a first viewing angle region, an article information region, and a second viewing angle region. The first visual angle area displays a parcel detection image of the parcel at the first visual angle, and the article information area displays article attribute information corresponding to articles in the parcel, wherein the article attribute information comprises liquid and a knife. The second visual angle area displays a parcel detection image of a parcel under the second visual angle. The article information area is displayed in the horizontal direction. The first package detection image and the second package detection image are arranged on the upper side and the lower side of the article information area in the vertical direction respectively. And connecting the article detection frame corresponding to the article in the package detection image with the article attribute information through a connecting line. The article detection box is an identification box generated by an intelligent algorithm when identifying a parcel article, and is generally a minimum circumscribed rectangle corresponding to the article.
By calculating the aspect ratio, each parcel detection image is compared with a preset threshold value, and then the display direction of the article attribute information is determined, so that the accuracy of associated display is improved, and the information can be conveniently checked by a security inspector. Taking a preset threshold value of 1.0 as an example, if the aspect ratio of the current viewing angle is 1.0, it is indicated that the detection frame of the parcel detection image is approximately square, if the aspect ratio of the parcel image is less than the preset threshold value of 1.0, it is indicated that the height of the parcel image in the vertical direction is greater than the width of the parcel image in the horizontal direction, the image is narrow and high, at this time, if the article attribute information and the parcel detection image are also displayed in the horizontal direction, the corresponding proportion of the articles in the image is reduced, and the articles are stacked together in the vertical direction, at this time, the distance between the association marks between the article image and the article attribute information is relatively small, and the display of the association relationship is not intuitive. If the width-height ratio is higher than the preset threshold value of 1.0, the parcel detection frame is a rectangle with larger width and smaller height, and the image is wider and shorter. At the moment, the article attribute information and the package detection image are displayed along the horizontal direction, so that the distance between the article in the package and the associated mark between the article attribute information is larger, the corresponding relation between the article and the article attribute information is more visual, the distribution of the display screen is more reasonable, and the security inspector can conveniently identify and check the same article at different positions in images at different visual angles.
In one embodiment, according to the parcel information, the display direction of the item attribute information and the parcel detection image is determined by comparing the ratio of the height to the width of the parcel with a preset threshold value according to the size information of the parcel. According to the width of the parcel in the horizontal direction and the height of the parcel in the vertical direction, the preferential display direction of the parcel detection image is determined. The aspect ratio is compared with a preset threshold, or compared with a preset threshold, which is not limited in the present application.
In one embodiment, the displaying, according to the package information, the package detection images and the corresponding item attribute information at multiple viewing angles in a preset direction in an associated manner further includes: the package inspection images collected at the plurality of viewing angles comprise a first package inspection image and a second package inspection image; and if the package detection image and the corresponding article attribute information are displayed in a correlated manner in the vertical direction, the article attribute information is displayed in the vertical direction, the first package detection image and the second package detection image are arranged on two sides of the article attribute information in the horizontal direction, and the article detection image in the first package detection image and the article detection image in the second package detection image are correlated with the corresponding article attribute information. Specifically, fig. 5 is a schematic information display diagram of an article information display method according to another embodiment of the present application, and as shown in fig. 5, the diagram includes three regions. A first viewing angle region, an item information region, and a second viewing angle region. The first visual angle area displays a parcel detection image of the parcel at the first visual angle, and the article information area displays article attribute information corresponding to articles in the parcel, wherein the article attribute information comprises liquid and a knife. The second visual angle area displays a parcel detection image at the second visual angle, and the article information area displays in the vertical direction. The first package detection image and the second package detection image are arranged on the left side and the right side of the article information area in the horizontal direction respectively. The external rectangle outside the article in the figure is the article detection frame. And connecting the article detection frame of the corresponding article in the package detection image with the corresponding article attribute information through a connecting line. Through the correlation effect of the connecting lines, a security inspector can directly determine the corresponding relation between the article images and the article information under multiple visual angles according to the connecting lines. The position corresponding relation of the same object in the images with different visual angles can also be determined. In one embodiment, the manner of associating the article detection image in the first package detection image and the article detection image in the second package detection image with the corresponding article attribute information may also be other association manners. For example: the method comprises the following steps of connecting line mode, arrow pointing mode, same color indication mode and other association modes which can visually display the corresponding relation between the object and the object attribute information in the package detection images at multiple visual angles. Preferably, the color of the corresponding parcel detection frame of the same article in different parcel images and the color of the connecting line can be set to be the same color, and the security inspector is assisted to perform associated viewing on the same article in images with different visual angles by means of visual display of color difference.
In one embodiment, the displaying, according to the package information, the package detection images and the corresponding item attribute information at multiple viewing angles in a preset direction in an associated manner further includes: acquiring an article detection image corresponding to each parcel detection image; and connecting the article detection images at multiple visual angles with the corresponding article attribute information through a connecting line according to the package information. Specifically, an article detection image in the package detection image is identified through an intelligent identification algorithm, and position information and size information of the article detection image are obtained. And connecting the article detection image and the article attribute information of the corresponding article in the package detection image through a connecting line.
In one embodiment, the displaying, in association with a preset direction, the article detection images from multiple viewing angles and the corresponding article attribute information includes: acquiring article detection frame information according to the article detection image, wherein the article detection frame information at least comprises size information of the article detection frame; and connecting the article detection frames corresponding to the same articles under the multiple viewing angles with the article attribute information through connecting lines according to the article detection frame information. Specifically, the information of an article detection frame of the article image is acquired, and the article detection frame is an article identification frame generated during identification and analysis by an intelligent algorithm and is generally the minimum circumscribed rectangle of the article. And acquiring the position information and the size information of the article detection frame. And connecting the article detection frame of the corresponding article in the package detection image and the article attribute information through a connecting line.
In one embodiment, fig. 6 is a flowchart of an article information display method according to an embodiment of the present application, and as shown in fig. 6, package detection images at two viewing angles are first acquired, and the package detection images are respectively sent to an intelligent algorithm module for analysis, so as to obtain a width W of a package detection frame surrounding a package in the two viewing anglesiAnd high HiSince there are only two package detection images at two viewing angles, the value range of i in this embodiment is [0,1 ]]And i denotes a package inspection image at the ith view angle. Calculating the aspect ratio P of the parcel detection boxi，Pi＝i/HiAspect ratio PiComparing with a preset threshold value M, if any P existsiIf the number of the articles is more than or equal to M, displaying the article information area along the horizontal direction; if all PiAnd if not more than M, displaying the article information area along the vertical direction.
Through the steps, the parcel size information is acquired based on parcel detection images at multiple viewing angles. And determining the display direction of the item information area based on the aspect ratio of the parcel images at the plurality of viewing angles. The article information area is displayed between the package display images at the two visual angles, the articles are connected with the corresponding article information in a connecting line mode, the images at the two visual angles are displayed on the same screen, the association between the article names and the article positions is also indicated, and the article information is displayed in the article information area in a centralized mode. The method has the advantages that the security inspector can check the types of the articles and the actual positions of the articles in the packages at different visual angles conveniently, the problem that when the article images in the multi-angle images are identified to belong to the same article, the manual identification efficiency is low is solved, the multi-visual-angle images and the article information are displayed in a correlated mode, and the technical effect of quickly and accurately identifying the same article in the multi-visual-angle images is achieved. It should be noted that the steps illustrated in the above-described flow diagrams or in the flow diagrams of the figures may be performed in a computer system, such as a set of computer-executable instructions, and that, although a logical order is illustrated in the flow diagrams, in some cases, the steps illustrated or described may be performed in an order different than here.
In this embodiment, an article information display device is further provided, and the device is used to implement the above embodiments and preferred embodiments, and the description of the device is omitted. The terms "module," "unit," "subunit," and the like as used below may implement a combination of software and/or hardware for a predetermined function. Although the means described in the embodiments below are preferably implemented in software, an implementation in hardware, or a combination of software and hardware is also possible and contemplated.
Fig. 7 is a block diagram showing the structure of the article information display device of the present embodiment, and as shown in fig. 7, the device includes:
the image acquisition module 10 is configured to acquire package detection images acquired at multiple viewing angles.
The information monitoring module 20 is configured to obtain article attribute information and package information corresponding to each package detection image; the package information includes at least size information of the package.
And the information display module 30 is configured to display the parcel detection images at multiple viewing angles and the corresponding item attribute information in a correlated manner along a preset direction according to the parcel information.
The information display module 30 is further configured to obtain an aspect ratio and a preset threshold of the parcel corresponding to each parcel detection image; and comparing each aspect ratio with the preset threshold value, if any aspect ratio is larger than or equal to the preset threshold value, displaying the article attribute information along the horizontal direction, and arranging the parcel detection images along the vertical direction and displaying the parcel detection images in association with the corresponding article attribute information.
The information display module 30 is further configured to display the article attribute information in a vertical direction if all the aspect ratios are smaller than the preset threshold, and the parcel detection images are arranged in a horizontal direction and displayed in association with the corresponding article attribute information.
The information display module 30 is further configured to acquire package inspection images at the plurality of viewing angles, wherein the package inspection images include a first package inspection image and a second package inspection image; and if the package detection image and the corresponding article attribute information are displayed in a horizontal direction in a correlated manner, displaying the article attribute information in the horizontal direction, arranging the first package detection image and the second package detection image on two sides of the article attribute information in the vertical direction, and correlating the article detection image in the first package detection image and the article detection image in the second package detection image with the corresponding article attribute information.
The information display module 30 is further configured to acquire package inspection images at the plurality of viewing angles, wherein the package inspection images include a first package inspection image and a second package inspection image; and if the package detection image and the corresponding article attribute information are displayed in a correlated manner in the vertical direction, the article attribute information is displayed in the vertical direction, the first package detection image and the second package detection image are arranged on two sides of the article attribute information in the horizontal direction, and the article detection image in the first package detection image and the article detection image in the second package detection image are correlated with the corresponding article attribute information.
The information display module 30 is further configured to obtain an article detection image corresponding to each parcel detection image; and connecting the article detection images at multiple visual angles with the corresponding article attribute information through a connecting line according to the package information.
The information display module 30 is further configured to obtain article detection frame information according to the article detection image, where the article detection frame information at least includes size information of the article detection frame; and connecting the article detection frames corresponding to the same articles under the multiple viewing angles with the article attribute information through connecting lines according to the article detection frame information.
The above modules may be functional modules or program modules, and may be implemented by software or hardware. For a module implemented by hardware, the modules may be located in the same processor; or the modules can be respectively positioned in different processors in any combination.
There is also provided in this embodiment an electronic device comprising a memory having a computer program stored therein and a processor arranged to run the computer program to perform the steps of any of the above method embodiments.
Optionally, the electronic apparatus may further include a transmission device and an input/output device, wherein the transmission device is connected to the processor, and the input/output device is connected to the processor.
Optionally, in this embodiment, the processor may be configured to execute the following steps by a computer program:
acquiring package detection images acquired under a plurality of visual angles;
acquiring article attribute information and parcel information corresponding to each parcel detection image, wherein the parcel information at least comprises size information of the parcel;
and displaying the parcel detection images at a plurality of visual angles and the corresponding article attribute information in a correlation manner along a preset direction according to the parcel information.
It should be noted that, for specific examples in this embodiment, reference may be made to the examples described in the foregoing embodiments and optional implementations, and details are not described again in this embodiment.
In addition, in combination with the article information display method provided in the above embodiment, a storage medium may also be provided to implement in this embodiment. The storage medium having stored thereon a computer program; the computer program, when executed by a processor, implements any of the article information display methods of the above embodiments.
It should be understood that the specific embodiments described herein are merely illustrative of this application and are not intended to be limiting. All other embodiments, which can be derived by a person skilled in the art from the examples provided herein without any inventive step, shall fall within the scope of protection of the present application.
It is obvious that the drawings are only examples or embodiments of the present application, and it is obvious to those skilled in the art that the present application can be applied to other similar cases according to the drawings without creative efforts. Moreover, it should be appreciated that in the development of any such actual implementation, as in any engineering or design project, numerous implementation-specific decisions must be made to achieve the developers' specific goals, such as compliance with system-related and business-related constraints, which may vary from one implementation to another.
The term "embodiment" is used herein to mean that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the present application. The appearances of such phrases in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is to be expressly or implicitly understood by one of ordinary skill in the art that the embodiments described in this application may be combined with other embodiments without conflict.
The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the patent protection. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present application shall be subject to the appended claims.
Claims (10)
1. An article information display method, comprising:
acquiring package detection images acquired under a plurality of visual angles;
acquiring article attribute information and parcel information corresponding to each parcel detection image, wherein the parcel information at least comprises size information of the parcel;
and displaying the parcel detection images at a plurality of visual angles and the corresponding article attribute information in a correlation manner along a preset direction according to the parcel information.
2. The item information display method according to claim 1, wherein the associating and displaying the parcel detection images and the corresponding item attribute information at a plurality of viewing angles in a preset direction according to the parcel information comprises:
acquiring the aspect ratio and a preset threshold of the parcel corresponding to each parcel detection image;
and comparing each aspect ratio with the preset threshold value, if any aspect ratio is larger than or equal to the preset threshold value, displaying the article attribute information along the horizontal direction, and arranging the parcel detection images along the vertical direction and displaying the parcel detection images in association with the corresponding article attribute information.
3. The item information display method according to claim 2, wherein the comparing each aspect ratio with the preset threshold value further comprises:
and if the aspect ratio is smaller than the preset threshold value, displaying the article attribute information in the vertical direction, and arranging the parcel detection images in the horizontal direction and displaying the parcel detection images in association with the corresponding article attribute information.
4. The item information display method according to claim 1, wherein the associating and displaying the parcel detection images and the corresponding item attribute information at a plurality of viewing angles in a preset direction according to the parcel information further comprises:
the package inspection images collected at the plurality of viewing angles comprise a first package inspection image and a second package inspection image;
and if the package detection image and the corresponding article attribute information are displayed in a horizontal direction in a correlated manner, displaying the article attribute information in the horizontal direction, arranging the first package detection image and the second package detection image on two sides of the article attribute information in the vertical direction, and correlating the article detection image in the first package detection image and the article detection image in the second package detection image with the corresponding article attribute information.
5. The item information display method according to claim 4, wherein the associating and displaying the parcel detection images and the corresponding item attribute information at a plurality of viewing angles along a preset direction according to the parcel information further comprises:
the package inspection images collected at the plurality of viewing angles comprise a first package inspection image and a second package inspection image;
and if the package detection image and the corresponding article attribute information are displayed in a correlated manner in the vertical direction, the article attribute information is displayed in the vertical direction, the first package detection image and the second package detection image are arranged on two sides of the article attribute information in the horizontal direction, and the article detection image in the first package detection image and the article detection image in the second package detection image are correlated with the corresponding article attribute information.
6. The item information display method according to claim 1, wherein the associating and displaying the parcel detection images and the corresponding item attribute information at a plurality of viewing angles in a preset direction according to the parcel information further comprises:
acquiring an article detection image corresponding to each parcel detection image;
and connecting the article detection images at multiple visual angles with the corresponding article attribute information through a connecting line according to the package information.
7. The item information display method according to claim 6, wherein the associating and displaying the item detection images and the corresponding item attribute information at a plurality of viewing angles along a preset direction comprises:
acquiring article detection frame information according to the article detection image, wherein the article detection frame information at least comprises size information of the article detection frame;
and connecting the article detection frames corresponding to the same articles under the multiple viewing angles with the article attribute information through connecting lines according to the article detection frame information.
8. An article information display device characterized by comprising:
an image acquisition module: the system comprises a display device, a display device and a display device, wherein the display device is used for acquiring package detection images acquired under multiple visual angles;
the information monitoring module: the system is used for acquiring article attribute information and parcel information corresponding to each parcel detection image; the package information includes at least size information of the package;
an information display module: and the system is used for displaying the parcel detection images at multiple visual angles and the corresponding article attribute information in a correlation manner along a preset direction according to the parcel information.
9. An electronic device comprising a memory and a processor, wherein the memory stores a computer program, and the processor is configured to execute the computer program to perform the item information display method of any one of claims 1 to 7.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the item information display method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110563710.5A CN113391776B (en) | 2021-05-24 | 2021-05-24 | Method, device, electronic device and storage medium for displaying article information |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110563710.5A CN113391776B (en) | 2021-05-24 | 2021-05-24 | Method, device, electronic device and storage medium for displaying article information |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113391776A true CN113391776A (en) | 2021-09-14 |
| CN113391776B CN113391776B (en) | 2023-05-09 |
Family
ID=77619017
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110563710.5A Active CN113391776B (en) | 2021-05-24 | 2021-05-24 | Method, device, electronic device and storage medium for displaying article information |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113391776B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114660097A (en) * | 2022-03-23 | 2022-06-24 | 成都智元汇信息技术股份有限公司 | Synchronous correction method and system based on double sources and double visual angles |
| CN117112816A (en) * | 2023-10-20 | 2023-11-24 | 浙江啄云智能科技有限公司 | Sorting method, device, equipment and storage medium for security inspection images |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20190197721A1 (en) * | 2017-12-26 | 2019-06-27 | Nuctech Company Limited | Method, apparatus and system for assisting security inspection |
| CN109977877A (en) * | 2019-03-28 | 2019-07-05 | 北京邮电大学 | A kind of safety check is intelligent to be assisted sentencing drawing method, system and system control method |
| CN110765990A (en) * | 2019-12-30 | 2020-02-07 | 浙江啄云智能科技有限公司 | Intelligent article detection method and system, computing device and storage medium |
| CN111612089A (en) * | 2020-05-29 | 2020-09-01 | 浙江大华技术股份有限公司 | Method and equipment for marking dangerous goods in security inspection machine |
-
2021
- 2021-05-24 CN CN202110563710.5A patent/CN113391776B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20190197721A1 (en) * | 2017-12-26 | 2019-06-27 | Nuctech Company Limited | Method, apparatus and system for assisting security inspection |
| CN109977877A (en) * | 2019-03-28 | 2019-07-05 | 北京邮电大学 | A kind of safety check is intelligent to be assisted sentencing drawing method, system and system control method |
| CN110765990A (en) * | 2019-12-30 | 2020-02-07 | 浙江啄云智能科技有限公司 | Intelligent article detection method and system, computing device and storage medium |
| CN111612089A (en) * | 2020-05-29 | 2020-09-01 | 浙江大华技术股份有限公司 | Method and equipment for marking dangerous goods in security inspection machine |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114660097A (en) * | 2022-03-23 | 2022-06-24 | 成都智元汇信息技术股份有限公司 | Synchronous correction method and system based on double sources and double visual angles |
| CN117112816A (en) * | 2023-10-20 | 2023-11-24 | 浙江啄云智能科技有限公司 | Sorting method, device, equipment and storage medium for security inspection images |
| CN117112816B (en) * | 2023-10-20 | 2024-02-02 | 浙江啄云智能科技有限公司 | Sorting method, device, equipment and storage medium for security inspection images |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113391776B (en) | 2023-05-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10733723B2 (en) | Methods and system for improved quality inspection | |
| US10706525B2 (en) | Methods and systems for improved quality inspection | |
| CN113391776A (en) | Article information display method, article information display device, electronic device, and storage medium | |
| US10180326B2 (en) | Staying state analysis device, staying state analysis system and staying state analysis method | |
| CN110032916A (en) | A kind of method and apparatus detecting target object | |
| CN109284674A (en) | A kind of method and device of determining lane line | |
| CN105404867B (en) | A kind of substation isolating-switch state identification method of view-based access control model | |
| CN112149658B (en) | Target size determination method, system, electronic device and storage medium | |
| CN107855287A (en) | A kind of express delivery measurement of cargo automatic checkout system | |
| CN108680833A (en) | Composite insulator defect detecting system based on unmanned plane | |
| CN107229560A (en) | A kind of interface display effect testing method, image specimen page acquisition methods and device | |
| CN112414326A (en) | Method and device for detecting surface flatness of object, electronic device and storage medium | |
| CN109242837A (en) | Measure method, system, equipment and the storage medium of collodiaphyseal angle in pelvis X-ray | |
| CN113989743A (en) | Garbage overflow detection method, detection equipment and system | |
| CN106056686B (en) | A kind of indoor patrol estimation analysis method based on three-D profile | |
| CN108181328A (en) | A kind of method and system for being used to detect X-ray machine material discrimination power | |
| CN115861895A (en) | Material tracking method and system for lithium iron phosphate production site | |
| CN116415864A (en) | Intelligent logistics quick inspection machine based on artificial intelligence | |
| CN113284271B (en) | Machine room inspection method, device, electronic equipment and computer readable storage medium | |
| CN105550507A (en) | Intelligent terminal for measuring blood type and measuring method | |
| CN114049552A (en) | Intelligent machine room cable cross-dimension quality inspection method and device based on example segmentation | |
| CN115620235A (en) | Parcel reinspection method, device, equipment and storage medium | |
| CN108418644A (en) | Signal processing method and device | |
| CN111557666B (en) | Height measuring method and height measuring device | |
| CN109051629A (en) | The determination method, apparatus and system that material is fallen |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |