CN115499622A - Image display method, image display device, security check machine, electronic device, and storage medium - Google Patents

Image display method, image display device, security check machine, electronic device, and storage medium Download PDF

Info

Publication number
CN115499622A
CN115499622A CN202110677791.1A CN202110677791A CN115499622A CN 115499622 A CN115499622 A CN 115499622A CN 202110677791 A CN202110677791 A CN 202110677791A CN 115499622 A CN115499622 A CN 115499622A
Authority
CN
China
Prior art keywords
display
image
displayed
parcel
display window
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110677791.1A
Other languages
Chinese (zh)
Inventor
叶希立
潘宏伟
孙文峰
杨斌
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhejiang Huashi Zhijian Technology Co ltd
Original Assignee
Zhejiang Huashi Zhijian Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhejiang Huashi Zhijian Technology Co ltd filed Critical Zhejiang Huashi Zhijian Technology Co ltd
Priority to CN202110677791.1A priority Critical patent/CN115499622A/en
Publication of CN115499622A publication Critical patent/CN115499622A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01V—GEOPHYSICS; GRAVITATIONAL MEASUREMENTS; DETECTING MASSES OR OBJECTS; TAGS
    • G01V5/00—Prospecting or detecting by the use of ionising radiation, e.g. of natural or induced radioactivity
    • G01V5/20—Detecting prohibited goods, e.g. weapons, explosives, hazardous substances, contraband or smuggled objects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20021—Dividing image into blocks, subimages or windows
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computational Linguistics (AREA)
  • Molecular Biology (AREA)
  • Artificial Intelligence (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Computation (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • High Energy & Nuclear Physics (AREA)
  • General Life Sciences & Earth Sciences (AREA)
  • Geophysics (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

The application relates to an image display method, an image display device, a security check machine, an electronic device and a storage medium, wherein the image display method comprises the steps of obtaining a video of a package security check process, and obtaining a package image to be displayed in the video; under the condition that a parcel image to be displayed is obtained, detecting the accumulated width of the parcel image displayed in each display window at the current moment in a plurality of display windows; and determining the display window with the minimum accumulated width in the plurality of display windows as a target display window, and sending the parcel image to be displayed into the target display window for displaying. Through the method and the device, the problems that package rolling display speed is high and the package rolling display speed is not suitable for being watched by human eyes due to increase of package sending speed of the security inspection machine are solved, and the beneficial effect that the rolling display speed of the package images is reduced when the package sending speed of the security inspection machine is increased is achieved.

Description

Image display method, image display device, security check machine, electronic device, and storage medium
Technical Field
The present application relates to the field of security check machine video display technologies, and in particular, to an image display method and apparatus, a security check machine, an electronic apparatus, and a storage medium.
Background
The package can trigger the security check machine to open the light source equipment of X ray after entering the security check machine, when the parcel at the uniform velocity when the gap that the X ray light source sent, different materials in the parcel absorb the decay after to the X ray, the X ray that passes the parcel passes through the data that the parcel obtained of scanning through the photodiode array, change the data that obtain into image data through handling, because the scanning can only obtain a data at every turn, the data column that the scanning obtained at every turn later splices the back of the image data column before, only need splice the data column at even time interval, just can obtain the two-dimensional image of parcel under the X ray, then show the two-dimensional parcel image that obtains at the display with the mode of rolling screen.
In the related art, the security check machine sends packets at a specific rate, and the scrolling playing speed on the display is more suitable for human eyes to watch, for example: 0.2m/s; when the security check machine sends packets according to a specific speed, the image acquisition device of the security check machine acquires row data with a preset number of lines per second, the part of data is sent to the video memory of the display within 1 second of unit time, and the display frame rate of the display is fixed, for example: 60 frames, wherein the data volume sent into the video memory by each frame is 6 rows of data; the security inspection machine adopts the specific package sending speed to perform package security inspection, and has low security inspection efficiency, long queuing waiting time and channel blockage; meanwhile, in the related art, the security inspection efficiency is improved by improving the packet sending rate of the security inspection machine, but the increase of the packet sending rate of the security inspection machine increases the data quantity of the line data collected by the image collecting equipment of the security inspection machine in unit time, the data quantity sent into the video memory of each frame is also increased, the corresponding rolling rate of the package in the display in the security inspection process is increased, and the package is not suitable for being watched by human eyes.
Aiming at the problems that package rolling display speed is high and the package is not suitable for being watched by human eyes due to increase of package sending speed of a security inspection machine in the related technology, no effective solution is provided at present.
Disclosure of Invention
The embodiment provides an image display method and device, a security check machine, an electronic device and a storage medium, so as to solve the problems that the security check speed of the security check machine is increased, the package rolling speed is high, and the package rolling speed is not suitable for being watched by human eyes in the related art.
In a first aspect, the present embodiment provides an image display method, including: the method comprises the steps of obtaining a video of a package security check process, and obtaining a package image to be displayed in the video; under the condition that parcel images to be displayed are obtained, detecting the accumulated width of the parcel images displayed in each display window at the current moment in a plurality of display windows; and determining the display window with the minimum accumulated width in the plurality of display windows as a target display window, and sending the parcel image to be displayed into the target display window for displaying.
In some of these embodiments, the package images include image widths, and detecting, in the plurality of display windows, a cumulative width of the package images displayed within each of the display windows at the current time comprises: detecting the parcel images displayed at the current moment in a plurality of display windows; under the condition that the displayed parcel images are detected, judging whether all the displayed parcel images in the corresponding display windows are completely displayed or not; under the condition that all the parcel images in the corresponding display windows are judged to be completely displayed, accumulating the image widths corresponding to all the displayed parcel images to obtain a first display width; determining that the cumulative width comprises the first display width.
In some embodiments, in a case where it is determined that there is the parcel image that is not completely displayed within the corresponding display window, the image display method includes: detecting that the parcel image has been fully displayed within the corresponding display window; calculating to obtain a second display width according to the image width corresponding to the completely displayed parcel image; detecting a third display width at which the parcel image that is not fully displayed within the corresponding display window has been displayed; determining that the cumulative width of the parcel images displayed within the corresponding display window comprises an accumulated sum of the second display width and the third display width.
In some of these embodiments, determining the display window with the smallest cumulative width of the plurality of display windows as the target display window comprises: acquiring the accumulated width corresponding to the corresponding display window; selecting a first display window with the smallest cumulative width from the plurality of display windows, and determining that the target display window comprises the first display window.
In some embodiments, selecting the first display window with the smallest cumulative width from the plurality of display windows comprises: traversing a plurality of display windows to obtain a plurality of accumulated widths corresponding to the display windows; and selecting the accumulated width with the minimum width value from the plurality of accumulated widths, and determining that the first display window comprises the display window corresponding to the accumulated width with the minimum width value.
In some of these embodiments, determining the display window of the plurality of display windows having the smallest cumulative width as the target display window in the event that the parcel image is not detected within the corresponding display window comprises: and selecting at least one second display window in which the parcel image is not detected from the plurality of display windows, and determining that the target display window comprises one of the at least one second display window.
In some of these embodiments, obtaining in the video an image of a package to be displayed comprises: processing the video by using a preset video segmentation network model to obtain a package image to be displayed, wherein the video segmentation network model is an artificial neural network obtained by training according to a preset package security check video and an actual measurement package image corresponding to the preset package security check video.
In some embodiments, the target display window has a corresponding scrolling display rate, and sending the parcel image to be displayed into the target display window for display includes: and acquiring the scroll display rate, and performing scroll display on the parcel image to be displayed according to the scroll display rate.
In a second aspect, the present embodiment provides an image display apparatus including: the system comprises an acquisition module, a display module and a display module, wherein the acquisition module is used for acquiring a video of a package security check process and acquiring a package image to be displayed in the video; the detecting module is used for detecting the accumulated width of the parcel images displayed in the display windows at the current moment in a plurality of display windows under the condition that the parcel images to be displayed are obtained; and the processing module is used for determining the display window with the minimum accumulated width in the plurality of display windows as a target display window and sending the parcel image to be displayed into the target display window for displaying.
In a third aspect, the present embodiment provides a security inspection machine, including: the system comprises image acquisition equipment, transmission equipment and display equipment; the image acquisition equipment is connected with the display equipment through the transmission equipment; the image acquisition equipment is used for acquiring original energy data of X-ray imaging corresponding to the package and rendering the original energy data into a video of a security check process corresponding to the package; the transmission device is used for transmitting the video to the display device; the display device is used for executing the image display method of the first aspect
In a fourth aspect, this embodiment provides an electronic device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, and the processor implements the image display method according to the first aspect when executing the computer program.
In a fifth aspect, the present embodiment provides a storage medium having stored thereon a computer program that, when executed by a processor, implements the image display method of the first aspect described above.
Compared with the related art, the image display method, the image display device, the security check machine, the electronic device and the storage medium provided by the embodiment acquire the parcel image to be displayed in the video by acquiring the video of the parcel security check process; under the condition that a parcel image to be displayed is obtained, detecting the accumulated width of the parcel image displayed in each display window at the current moment in a plurality of display windows; the display window with the smallest accumulated width in the display windows is determined as the target display window, and the parcel images to be displayed are sent into the target display window for displaying, so that the problems that the package sending speed of the security inspection machine is increased, the parcel rolling display speed is high, and the parcel rolling display speed is not suitable for being watched by human eyes are solved, and the beneficial effect that the rolling display speed of the parcel images is reduced when the package sending speed of the security inspection machine is increased is realized.
The details of one or more embodiments of the application are set forth in the accompanying drawings and the description below to provide a more thorough understanding of the application.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the application and together with the description serve to explain the application and not to limit the application. In the drawings:
fig. 1 is a block diagram of a hardware configuration of a terminal of an image display method according to an embodiment of the present application.
Fig. 2 is a flowchart of an image display method according to an embodiment of the present application.
Fig. 3 is a flowchart of an image display method according to a preferred embodiment of the present application.
FIG. 4 is a schematic diagram of an over-wrap display in accordance with a preferred embodiment of the present application.
Fig. 5 is a block diagram of the structure of an image display device according to an embodiment of the present application.
Detailed Description
For a clearer understanding of the objects, aspects and advantages of the present application, reference is made to the following description and accompanying drawings.
Unless defined otherwise, technical or scientific terms referred to herein shall have the same general meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The use of the terms "a" and "an" and "the" and similar referents in the context of this application do not denote a limitation of quantity, either in the singular or the plural. The terms "comprises," "comprising," "has," "having" and any variations thereof, as referred to in this application, are intended to cover non-exclusive inclusions; for example, a process, method, and system, article, or apparatus that comprises a list of steps or modules (elements) is not limited to the listed steps or modules, but may include other steps or modules (elements) not listed or inherent to such process, method, article, or apparatus. Reference throughout this application to "connected," "coupled," and the like is not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. Reference to "a plurality" in this application means two or more. "and/or" describes an association relationship of associated objects, meaning that three relationships may exist, for example, "A and/or B" may mean: a exists alone, A and B exist simultaneously, and B exists alone. In general, the character "/" indicates a relationship in which the objects associated before and after are an "or". The terms "first," "second," "third," and the like in this application are used for distinguishing between similar items and not necessarily for describing a particular sequential or chronological order.
Various techniques described in this application may be used for display of images of security articles, control of rate of movement.
The method embodiments provided in the present embodiment may be executed in a terminal, a computer, or a similar computing device. For example, the method is executed on a terminal, and fig. 1 is a block diagram of a hardware structure of the terminal according to the image display method of the embodiment. As shown in fig. 1, the terminal may include one or more processors 102 (only one shown in fig. 1) and a memory 104 for storing data, wherein the processor 102 may include, but is not limited to, a processing device such as a microprocessor MCU or a programmable logic device FPGA. The terminal may also include a transmission device 106 for communication functions and an input-output device 108. It will be understood by those of ordinary skill in the art that the structure shown in fig. 1 is merely an illustration and is not intended to limit the structure of the terminal described above. For example, the terminal may also include more or fewer components than shown in FIG. 1, or have a different configuration than shown in FIG. 1.
The memory 104 may be used to store computer programs, for example, software programs and modules of application software, such as a computer program corresponding to the image display method in the present embodiment, and the processor 102 executes various functional applications and data processing by running the computer programs stored in the memory 104, so as to implement the above-mentioned method. The memory 104 may include high speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 104 can further include memory located remotely from the processor 102, which can be connected to the terminal over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The transmission device 106 is used to receive or transmit data via a network. The network described above includes a wireless network provided by a communication provider of the terminal. In one example, the transmission device 106 includes a Network adapter (NIC) that can be connected to other Network devices through a base station to communicate with the internet. In one example, the transmission device 106 may be a Radio Frequency (RF) module, which is used to communicate with the internet via wireless.
The embodiment provides an image display method at least applied to a security check machine for package security check, for example: x-ray security check machine. Fig. 2 is a flowchart of the image display method of the present embodiment, and as shown in fig. 2, the flowchart includes the steps of:
step S201, a video of a package security check process is obtained, and a package image to be displayed is obtained in the video.
In this embodiment, the security inspection machine irradiates the packages to be inspected through an X-ray light source, then obtains original energy data of the scanned packages through an X-ray photodiode array, renders the original energy data to form RGB image data, and then splices data columns obtained by each scanning into a video corresponding to the package security inspection process.
In this embodiment, after the corresponding video is acquired, the packages appearing in the video are detected by a target detection algorithm, and then package images corresponding to the packages are acquired based on the detected packages, in this embodiment, a video package cutting and segmenting technology is adopted to segment the package images corresponding to each package from each frame of video frames of the video; and sending the divided parcel images into corresponding display windows for scrolling display, wherein the divided parcel images comprise the parcel images to be displayed currently and the displayed parcel images.
In step S202, when a parcel image to be displayed is acquired, the cumulative width of parcel images displayed in each display window at the present time is detected in a plurality of display windows.
In this embodiment, the number of the display windows is determined according to the package sending rate of the security check machine and the scrolling display rate set in the display windows, and the package images displayed in each display window at the current time include the historical package images displayed in the corresponding display window in a scrolling manner.
In this embodiment, in order to achieve the scrolling effect that the display image can be scrolled at the preset scrolling display rate, the display image is divided into multiple display windows, and all the divided display windows can be displayed at the scrolling display rate suitable for being viewed by human eyes.
In the embodiment, the division number of the display window is related to the bag feeding speed of the security inspection machine, namely the movement speed of the conveying belt, and the rolling display speed of the display window. Meanwhile, when the packet sending rate is increased, the data volume of the image data collected by the security inspection machine in unit time is increased, the data of each frame of image data sent into the video memory is increased, and the rolling rate of the image data in the display picture is increased.
In this embodiment, when determining the accumulated width displayed in the corresponding display window, the accumulated width needs to be determined according to the image widths corresponding to the displayed and displayed parcel images in the display window; in this embodiment, the displayed parcel images comprise parcel images that are fully disposed in the corresponding display window; the displayed parcel images comprise parcel images partially arranged in corresponding display windows; the accumulated width includes the sum of the total image width of all displayed parcel images in the corresponding display window and the accumulated image width of the parcel images in the display window, which are placed in the display window, for example, if the displayed parcel images in the display window a include a and b, the image widths of a and b are W1 and W2, respectively, the displayed parcel images include c, and the width in the display window is W3, the accumulated width corresponding to the display window a is W1+ W2+ W3.
Step S203, determining the display window with the minimum accumulated width in the plurality of display windows as a target display window, and sending the parcel image to be displayed into the target display window for displaying.
In this embodiment, before the parcel images to be displayed are sent to the corresponding target display windows, the corresponding target display windows need to be determined, and the determination of the target display windows is determined according to the cumulative width of the display of the parcel images already displayed by the plurality of display windows, that is, the target display windows are determined according to the size of the cumulative width of the parcel images; in some alternative embodiments, the display window with the smallest cumulative width of the parcel images is selected as the target display window.
In this embodiment, the parcel images displayed in the display windows at the current time represent the parcel images that have entered the corresponding display windows for display and the parcel images that have been completely displayed, the parcel images in the display windows are used to determine the width of the cumulative display of the corresponding display windows, and the most appropriate display window is determined by the width of the cumulative display to display the parcel images to be displayed.
In this embodiment, the scrolling rate corresponding to the target display window is a scrolling rate suitable for human eyes to watch, for example: 0.2m/s.
In this embodiment, after the target display window is determined, the parcel image to be displayed is sent to the target display window, and the parcel image to be displayed is displayed at the set scroll display rate.
Through the steps S201 to S203, a parcel image to be displayed is acquired in the video by acquiring the video of the parcel security check process; under the condition that a parcel image to be displayed is obtained, detecting the accumulated width of the parcel image displayed in each display window at the current moment in a plurality of display windows; the display window with the smallest cumulative width in the display windows is determined as the target display window, and the package image to be displayed is sent into the target display window for displaying, so that the problems that the package sending speed of the security inspection machine is increased, the package rolling display speed is high, and the package rolling display speed is not suitable for being watched by human eyes are solved, and the rolling display speed of the package image is reduced when the package sending speed of the security inspection machine is increased, so that the motion speed of the package image in display is kept low, and the package image in display is suitable for being watched by human eyes.
The embodiments of the present application are described and illustrated below by means of preferred embodiments.
In some of these embodiments, the package images include image widths, and detecting, in the plurality of display windows, a cumulative width of the package images displayed in the respective display windows at the current time is performed by:
step 1, detecting package images displayed at the current moment in a plurality of display windows.
In this embodiment, when no parcel image is detected in the display window at the current time, it indicates that the corresponding display window has not yet displayed a parcel image, and the display window of this type can be directly used as the target display window.
And 2, under the condition that the displayed parcel images are detected, judging whether all displayed parcel images in the corresponding display windows are completely displayed.
In the embodiment, when a parcel image is detected in the display window, the display width of the accumulated parcel images displayed in the display window is determined, so that an appropriate target display window is determined to display the parcel image to be displayed.
In this embodiment, the parcel images have different display widths corresponding to the volume size of the parcel itself, and the parcel images displayed in the plurality of display windows have different numbers.
And 3, accumulating the image widths corresponding to all displayed parcel images to obtain a first display width under the condition that all parcel images in the corresponding display windows are judged to be completely displayed.
In this embodiment, since the display width of the parcel images is obtained when the corresponding parcel images are acquired, when all the displayed parcel images in the display window are completely placed in the corresponding display window, the cumulative width corresponding to the display window, that is, the image width of each of the accumulated parcel images, can be directly determined.
And 4, determining that the accumulated width comprises a first display width.
Detecting the package images displayed at the current moment in a plurality of display windows in the steps; under the condition that the displayed parcel images are detected, judging whether all the displayed parcel images in the corresponding display windows are completely displayed or not; accumulating the image widths corresponding to all displayed parcel images to obtain a first display width under the condition that all parcel images in the corresponding display windows are judged to be completely displayed; the determination of the accumulated width comprises the first display width, so that the determination of the accumulated width of the displayed parcel images of the corresponding display window is realized, and the accuracy of the measurement of the accumulated width is improved by determining the corresponding accumulated width based on the image width of the parcel images.
In some embodiments, in the case that it is determined that there is a parcel image not completely displayed in the corresponding display window, the following steps are further performed:
step 1, detecting the completely displayed parcel image in the corresponding display window.
In this embodiment, part of the parcel images are already completely displayed in the display window, and a parcel image closest to the current timestamp is partially displayed in the display window, and part of the parcel images is to be displayed; the total display width corresponding to the completely displayed parcel images, namely the second display width, is determined by counting the completely displayed parcel images and according to the image width corresponding to each completely displayed parcel image.
And 2, calculating to obtain a second display width according to the image width corresponding to the completely displayed parcel image.
In this embodiment, the second display widths are calculated by accumulating the second image widths corresponding to the completely displayed parcel images.
And 3, detecting the displayed third display width of the parcel images which are not completely displayed in the corresponding display windows.
In the present embodiment, for a partially displayed parcel image, by measuring the display width that has been displayed in the corresponding display window, it is written as a part of the accumulated width in the display window.
And 4, determining that the first width displayed by the packaging image in the corresponding display window comprises the accumulated sum of the second display width and the third display width.
Detecting the completely displayed parcel image in the corresponding display window through the detection in the step; calculating to obtain a second display width according to the second image width corresponding to the completely displayed parcel image; detecting a displayed third display width of the parcel image which is not completely displayed in the corresponding display window; determining that the first width of the package image displayed in the corresponding display window comprises the accumulated sum of the second display width and the third display width enables detection of the accumulated width of the package image displayed in the display window by the package image.
In some embodiments, determining the display window with the smallest cumulative width as the target display window is performed by:
step 1, acquiring the accumulated width corresponding to the corresponding display window.
And 2, selecting a first display window with the minimum accumulated width from the plurality of display windows, and determining that the target display window comprises the first display window.
In this embodiment, the first display window is at least one of a plurality of display windows, and in some optional embodiments, the display window with the smallest cumulative width may be a plurality of display windows, for example: no package images have appeared in the display window, again for example: a plurality of display windows of equal width are accumulated.
In this embodiment, if there are a plurality of first display windows, any one of the plurality of first display windows is selected as the target display window.
Obtaining the corresponding accumulated width of the corresponding display window in the steps; the first display window with the smallest accumulated width is selected from the plurality of display windows, and the target display window is determined to comprise the first display window, so that the target display window is determined according to the size of the accumulated width.
In some embodiments, selecting the first display window with the smallest cumulative width from the plurality of display windows is performed by:
step 1, traversing a plurality of display windows to obtain a plurality of accumulated widths corresponding to the plurality of display windows.
And 2, selecting the cumulative width with the minimum width value from the plurality of cumulative widths, and determining that the first display window comprises the display window corresponding to the cumulative width with the minimum width value.
Through the steps, the display window with the minimum accumulated width is selected.
In some embodiments, in a case that no parcel image is detected in the corresponding display window, determining the display window with the smallest cumulative width in the plurality of display windows as the target display window is performed by: and selecting at least one second display window in which the parcel image is not detected from the plurality of display windows, and determining that the target display window comprises one of the at least one second display window.
In this embodiment, the second display window is at least one of the plurality of display windows.
In some embodiments, the target display window is provided with a corresponding scrolling display rate, and the sending of the parcel image to be displayed into the target display window for display is implemented by the following steps: and acquiring the scroll display rate, and performing scroll display on the parcel image to be displayed according to the scroll display rate.
In some embodiments, capturing the package image to be displayed in the video is achieved by: and processing the video by using a preset video segmentation network model to obtain a package image to be displayed, wherein the video segmentation network model is an artificial neural network obtained by training according to a preset package security check video and an actual measurement package image corresponding to the preset package security check video.
It should be noted that, in this embodiment, the preset package security inspection video used for training the video segmentation network model includes a video acquired in a historical package security inspection process, or a video obtained by performing machine security inspection on a preset package; meanwhile, the actually measured parcel image is a parcel image obtained through target recognition detection or a shot preset parcel image.
In some optional embodiments, the training method of the video segmentation network model of this embodiment is obtained by training in the following manner:
step 1: and training the feature extraction module by using the single-frame training image.
The video segmentation network model comprises a plurality of feature extraction modules, a plurality of recurrent neural modules and a plurality of output modules, wherein the feature extraction modules, the recurrent neural modules and the output modules are in one-to-one correspondence.
Due to the redundancy and the large quantity of the continuous video frames, in order to avoid influencing the video segmentation result when the continuous frame training images are subjected to semantic segmentation directly, in the specific training process, a single frame training image is used for training the feature extraction module, and the network weight in the feature extraction module is determined; moreover, a single frame of training image is input into the image semantic segmentation network model, and the image semantic segmentation network model is supervised by adopting a cross entropy loss function, namely the cross entropy loss function is reduced to be a target training image semantic segmentation network model until the requirements are met; the image semantic segmentation network model is formed by connecting a feature extraction module and an output module, and can be a Convolutional Neural Network (CNN).
And 2, training the recurrent neural module by using the continuous frame training image set.
The network weight of the feature extraction module obtained in the above-mentioned step is to train the recurrent neural network module by using the continuous frame training image set, and to supervise the segmentation result of the continuous frame training image by using the cross entropy loss function, specifically, the network weight of the feature extraction module obtained in the above-mentioned step 1 is added into the video segmentation network model, the video segmentation network model is trained by using the continuous frame training image set, and the cross entropy loss function is reduced to be the target training video segmentation network model until the requirements are met, wherein the recurrent neural module is a Long Short-Term Memory network LSTM (Long Short-Term Memory).
In order to fully utilize the time sequence information among the continuous frame training image sets and be beneficial to distinguishing different classes of objects with the same spatial characteristics in the continuous frame training image sets, in the recurrent neural module, the input of the recurrent neural module of the current frame comprises the output of the recurrent neural module of the previous frame and the output of the characteristic extraction module of the current frame.
It should be noted that, a single frame of training image is used to train the feature extraction module, spatial information of each frame of training image is obtained, and network weight in the feature extraction module is determined; the recurrent neural module is trained by utilizing the continuous frame training image set, and the time sequence information of the continuous frame training images is obtained, so that the video is segmented semantically according to the obtained spatial information and the time sequence information, the error accumulation is avoided, and the accuracy of video semantic segmentation is improved.
For the feature extraction module, the last two down-sampling layers are replaced by the hole convolution layer to store more information, the feature extraction module can be a residual error network, the last two down-sampling layers in the residual error network are replaced by the hole convolution layer, the two down-sampling layers are set to be the hole convolution layers with expansion coefficients of 2 and 4, and network parameters of the feature extraction modules are the same.
For the recurrent neural module, the recurrent neural module is formed by splicing two convolution layers, namely a first convolution layer and a second convolution layer, and time sequence unit parameters among the recurrent neural modules are the same; the input of each recurrent neural module is the output of the recurrent neural module in the previous time sequence and the output of the characteristic extraction module corresponding to the current time sequence.
For the output module, the output module includes a plurality of convolutional layers followed by a BatchNorm active layer and a Relu active layer. The convolution layer of the output module comprises a convolution kernel of 3 multiplied by 3 and a convolution kernel of 1 multiplied by 1, and the output module is formed by splicing the convolution kernel of 3 multiplied by 3 and the convolution kernel of 1 multiplied by 1 of channels with equal category number.
Fig. 3 is a flowchart of an image display method according to a preferred embodiment of the present application, as shown in fig. 3, the flowchart including the steps of:
and S301, acquiring a video of the package security check process output by the security check machine.
And S302, the video passes through a video packet cutting module to be divided into independent package images.
Step S303, the number of display windows is set according to the packet sending rate.
In this embodiment, to realize the scrolling effect of the display screen at a predetermined scrolling rate (e.g., 0.2 m/s), the display screen is divided into a plurality of segments, where if the packet sending rate is s, the number of segments of the display screen is s/0.2= n, i.e., n display windows.
And step S304, calculating the accumulated width of the displayed parcel images in each display window.
In this embodiment, the width of the package image output by the video cut-package module is w, the package image is sent to the display window for display, and the display window displays the accumulated width d of the package image General assembly = d + w, where d is the width fed to the display.
Step S305 selects a display window having the smallest cumulative width.
In this embodiment, when the parcel image to be displayed is sent to the corresponding displayWhen displaying the windows, traversing all the display windows and selecting the accumulated width d General (1) The smallest display window.
And S306, scrolling and displaying the parcel images to be displayed at a preset scrolling speed.
In the present embodiment, the package image to be displayed is fed into the accumulation width d General assembly And the smallest display window is scrolled and displayed at a preset scrolling speed.
FIG. 4 is a schematic diagram of a package-over display according to the preferred embodiment of the present application, as shown in FIG. 4, the display process is as follows:
at the moment of T1, the parcel 1 is played in a display window 1 in a rolling way; when the parcel 2 is to be displayed, the cumulative width corresponding to the display window 1 is greater than the cumulative width corresponding to the display window 2 (at this time, the cumulative width corresponding to the display window 1 is 0); at time T2, package 2 is completely displayed in display window 2; when the parcel 3 is to be displayed, the cumulative width corresponding to the display window 1 is greater than the cumulative width corresponding to the display window (since the width of the parcel 1 is greater than the width of the parcel 2); at time T3, the package 3 is fully displayed in the display window 2.
In this embodiment, an image display device is further provided, and the image display device is used to implement the above embodiments and preferred embodiments, which have already been described and will not be described again. The terms "module," "unit," "subunit," and the like as used below may implement a combination of software and/or hardware for a predetermined function. Although the means described in the embodiments below are preferably implemented in software, an implementation in hardware, or a combination of software and hardware is also possible and contemplated.
Fig. 5 is a block diagram of the structure of an image display apparatus according to an embodiment of the present application, as shown in fig. 5, the apparatus including:
the acquisition module 51 is used for acquiring a video of a package security check process and acquiring a package image to be displayed in the video;
the detecting module 52 is coupled to the acquiring module 51, and configured to detect, in the multiple display windows, an accumulated width of the parcel images displayed in each display window at the current time when the parcel images to be displayed are acquired;
and the processing module 53, coupled to the dividing module 53, configured to determine a display window with the smallest cumulative width in the multiple display windows as a target display window, and send the parcel image to be displayed into the target display window for display.
In some of these embodiments, the package images include an image width, and the detection module 52 is configured to detect the package images displayed at the current time in the plurality of display windows; under the condition that the displayed parcel images are detected, judging whether all the displayed parcel images in the corresponding display windows are completely displayed or not; accumulating the image widths corresponding to all displayed parcel images to obtain a first display width under the condition that all parcel images in the corresponding display windows are judged to be completely displayed; the determining the cumulative width includes a first display width.
In some embodiments, the detecting module 52 is further configured to detect a parcel image that is completely displayed in the corresponding display window in the case that it is determined that there is a parcel image that is not completely displayed in the corresponding display window; calculating to obtain a second display width according to the image width corresponding to the completely displayed parcel image; detecting a displayed third display width of the parcel image that is not fully displayed within the corresponding display window; determining the cumulative width of the parcel images displayed within the corresponding display window comprises an accumulated sum of the second display width and the third display width.
In some embodiments, the processing module 53 is configured to obtain a cumulative width corresponding to the corresponding display window; a first display window with the smallest cumulative width is selected from the plurality of display windows, and the target display window is determined to comprise the first display window.
In some embodiments, the processing module 53 is further configured to traverse the plurality of display windows to obtain a plurality of accumulated widths corresponding to the plurality of display windows; and selecting the cumulative width with the minimum width value from the plurality of cumulative widths, and determining that the first display window comprises the display window corresponding to the cumulative width with the minimum width value.
In some embodiments, the image display apparatus is further configured to, in a case that no parcel image is detected in the corresponding display window, determine a display window with the smallest cumulative width among the plurality of display windows as the target display window, where the determination includes: and selecting at least one second display window in which the parcel image is not detected from the plurality of display windows, and determining that the target display window comprises one of the at least one second display window.
In some embodiments, the obtaining module 51 is configured to process a video by using a preset video segmentation network model to obtain a package image to be displayed, where the video segmentation network model is an artificial neural network obtained by training according to a preset package security check video and an actual package image corresponding to the preset package security check video.
In some embodiments, the target display window has a corresponding scrolling speed, and the processing module 53 is further configured to obtain the scrolling speed and scroll-display the parcel images to be displayed at the scrolling speed.
It should be noted that the above modules may be functional modules or program modules, and may be implemented by software or hardware. For a module implemented by hardware, the above modules may be located in the same processor; or the modules can be respectively positioned in different processors in any combination.
This embodiment still provides a security check machine, includes: the system comprises image acquisition equipment, transmission equipment and display equipment; the image acquisition equipment is connected with the display equipment through the transmission equipment;
the image acquisition equipment is used for acquiring original energy data of X-ray imaging corresponding to the package and rendering the original energy data into a video of a security inspection process corresponding to the package;
the transmission equipment is used for transmitting the video to the display equipment;
the display device is used for executing the steps in any one of the above image display method embodiments.
There is also provided in this embodiment an electronic device comprising a memory having a computer program stored therein and a processor configured to run the computer program to perform the steps of any of the method embodiments described above.
Optionally, the electronic apparatus may further include a transmission device and an input/output device, wherein the transmission device is connected to the processor, and the input/output device is connected to the processor.
Optionally, in this embodiment, the processor may be configured to execute the following steps by a computer program:
s1, a video of a package security check process is obtained, and a package image to be displayed is obtained in the video.
And S2, under the condition that the parcel images to be displayed are acquired, detecting the accumulated width of the parcel images displayed in each display window at the current moment in the plurality of display windows.
And S3, determining a display window with the minimum accumulated width in the plurality of display windows as a target display window, and sending the parcel image to be displayed into the target display window for displaying.
It should be noted that, for specific examples in this embodiment, reference may be made to the examples described in the foregoing embodiments and optional implementations, and details are not described again in this embodiment.
In addition, in combination with the image display method provided in the above embodiment, a storage medium may also be provided to implement in the present embodiment. The storage medium having stored thereon a computer program; the computer program, when executed by a processor, implements any of the image display methods of the above embodiments.
It should be understood that the specific embodiments described herein are merely illustrative of this application and are not intended to be limiting. All other embodiments, which can be derived by a person skilled in the art from the examples provided herein without any inventive step, shall fall within the scope of protection of the present application.
It is obvious that the drawings are only examples or embodiments of the present application, and it is obvious to those skilled in the art that the present application can be applied to other similar cases according to the drawings without creative efforts. Moreover, it should be appreciated that in the development of any such actual implementation, as in any engineering or design project, numerous implementation-specific decisions must be made to achieve the developers' specific goals, such as compliance with system-related and business-related constraints, which may vary from one implementation to another.
The term "embodiment" is used herein to mean that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the present application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is to be expressly or implicitly understood by one of ordinary skill in the art that the embodiments described in this application may be combined with other embodiments without conflict.
The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the patent protection. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present application should be subject to the appended claims.

Claims (12)

1. An image display method, comprising:
acquiring a video of a package security check process, and acquiring a package image to be displayed in the video;
under the condition that parcel images to be displayed are obtained, detecting the accumulated width of the parcel images displayed in each display window at the current moment in a plurality of display windows;
and determining the display window with the minimum accumulated width in the plurality of display windows as a target display window, and sending the parcel image to be displayed into the target display window for displaying.
2. The image display method according to claim 1, wherein the parcel image comprises an image width, and detecting a cumulative width of parcel images displayed within each of the display windows at a current time in a plurality of display windows comprises:
detecting the parcel images displayed at the current moment in a plurality of display windows;
under the condition that the displayed parcel images are detected, judging whether all the displayed parcel images in the corresponding display windows are completely displayed or not;
under the condition that all the parcel images in the corresponding display windows are judged to be completely displayed, accumulating the image widths corresponding to all the displayed parcel images to obtain a first display width;
determining that the cumulative width comprises the first display width.
3. The image display method according to claim 2, wherein in a case where it is determined that the parcel image is not completely displayed within the corresponding display window, the image display method comprises:
detecting the parcel image that has been fully displayed within the corresponding display window;
calculating to obtain a second display width according to the image width corresponding to the completely displayed parcel image;
detecting a third display width at which the parcel image that is not fully displayed within the corresponding display window has been displayed;
determining that the cumulative width of the parcel images displayed within the corresponding display window comprises an accumulated sum of the second display width and the third display width.
4. The image display method according to claim 2, wherein determining the display window with the smallest cumulative width among the plurality of display windows as a target display window comprises:
acquiring the accumulated width corresponding to the corresponding display window;
selecting a first display window with the smallest cumulative width from the plurality of display windows, and determining that the target display window includes the first display window.
5. The image display method according to claim 4, wherein selecting the first display window having the smallest cumulative width from among the plurality of display windows comprises:
traversing the plurality of display windows to obtain a plurality of accumulated widths corresponding to the plurality of display windows;
and selecting the accumulated width with the minimum width value from the plurality of accumulated widths, and determining that the first display window comprises the display window corresponding to the accumulated width with the minimum width value.
6. The image display method according to claim 2, wherein, in a case where the parcel image is not detected within the corresponding display window, determining that the display window with the smallest cumulative width among the plurality of display windows is a target display window comprises: and selecting at least one second display window in which the parcel image is not detected from the plurality of display windows, and determining that the target display window comprises one of the at least one second display window.
7. The image display method according to claim 1, wherein acquiring the package image to be displayed in the video comprises:
processing the video by using a preset video segmentation network model to obtain a package image to be displayed, wherein the video segmentation network model is an artificial neural network obtained by training according to a preset package security check video and an actual measurement package image corresponding to the preset package security check video.
8. The image display method according to claim 1, wherein the target display window is provided with a corresponding scrolling display rate, and sending the parcel image to be displayed into the target display window for display comprises: and acquiring the scroll display rate, and performing scroll display on the parcel image to be displayed according to the scroll display rate.
9. An image display apparatus, comprising:
the system comprises an acquisition module, a display module and a display module, wherein the acquisition module is used for acquiring a video of a package security check process and acquiring a package image to be displayed in the video;
the display device comprises a detection module, a display module and a display module, wherein the detection module is used for detecting the accumulated width of the parcel images displayed in each display window at the current moment in a plurality of display windows under the condition of acquiring the parcel images to be displayed;
and the processing module is used for determining the display window with the minimum accumulated width in the plurality of display windows as a target display window and sending the parcel image to be displayed into the target display window for displaying.
10. A security inspection machine, comprising: the system comprises image acquisition equipment, transmission equipment and display equipment; the image acquisition equipment is connected with the display equipment through the transmission equipment;
the image acquisition equipment is used for acquiring original energy data of X-ray imaging corresponding to the package and rendering the original energy data into a video of a security check process corresponding to the package;
the transmission device is used for transmitting the video to the display device;
the display apparatus is configured to execute the image display method according to any one of claims 1 to 8.
11. An electronic device comprising a memory and a processor, wherein the memory has a computer program stored therein, and the processor is configured to run the computer program to perform the image display method according to any one of claims 1 to 8.
12. A computer-readable storage medium, on which a computer program is stored, which computer program, when being executed by a processor, carries out the steps of an image display method as claimed in any one of claims 1 to 8.
CN202110677791.1A 2021-06-18 2021-06-18 Image display method, image display device, security check machine, electronic device, and storage medium Pending CN115499622A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110677791.1A CN115499622A (en) 2021-06-18 2021-06-18 Image display method, image display device, security check machine, electronic device, and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110677791.1A CN115499622A (en) 2021-06-18 2021-06-18 Image display method, image display device, security check machine, electronic device, and storage medium

Publications (1)

Publication Number Publication Date
CN115499622A true CN115499622A (en) 2022-12-20

Family

ID=84465139

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110677791.1A Pending CN115499622A (en) 2021-06-18 2021-06-18 Image display method, image display device, security check machine, electronic device, and storage medium

Country Status (1)

Country Link
CN (1) CN115499622A (en)

Similar Documents

Publication Publication Date Title
US7860343B2 (en) Constructing image panorama using frame selection
CN104123519B (en) System for automatically detecting electronic products through two-dimension codes and method thereof
CN108521583A (en) A kind of a large amount of barrage information concurrent processing methods and cloud computing server based on cloud computing
CN108737689A (en) A kind of splicing display method and display control apparatus of video
US11711509B2 (en) Early video equipment failure detection system
CN103942773B (en) Method and device for obtaining queuing length through image analysis
CN102087746A (en) Image processing device, image processing method and program
CN110399831B (en) Inspection method and device
CN208476830U (en) The system synchronous applied to the image capture and display of existing screening machine
US20190297297A1 (en) Video playing method and device
CN110475124A (en) Video cardton detection method and device
CN102833622A (en) Method and device for detecting video file playing times
CN106060523A (en) Methods for collecting and displaying panoramic stereo images, and corresponding devices
CN110069194B (en) Page blockage determining method and device, electronic equipment and readable storage medium
CN115499622A (en) Image display method, image display device, security check machine, electronic device, and storage medium
US11438545B2 (en) Video image-based media stream bandwidth reduction
CN110809166B (en) Video data processing method and device and electronic equipment
CN108563479A (en) Redirect control method, device, virtual machine and the Redirectional system of window
CN113781327A (en) Security inspection image artifact removing method and device, security inspection machine, electronic device and medium
CN108964947A (en) Background service quality determining method and device, computer equipment
CN108881119A (en) A kind of methods, devices and systems of video concentration
US11706389B2 (en) Data transmission method, camera and electronic device
CN114898274A (en) Package detection method and device
CN108896070A (en) The method, apparatus and terminal of detection sensor error in mobile device
CN109051629A (en) The determination method, apparatus and system that material is fallen

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination