CN112116283B - Logistics information acquisition method, video search method, device and electronic equipment - Google Patents

Logistics information acquisition method, video search method, device and electronic equipment Download PDF

Info

Publication number
CN112116283B
CN112116283B CN201910544347.5A CN201910544347A CN112116283B CN 112116283 B CN112116283 B CN 112116283B CN 201910544347 A CN201910544347 A CN 201910544347A CN 112116283 B CN112116283 B CN 112116283B
Authority
CN
China
Prior art keywords
information
visual characteristic
characteristic information
video frame
waybill
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910544347.5A
Other languages
Chinese (zh)
Other versions
CN112116283A (en
Inventor
蒋赵贵
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou Hikvision Digital Technology Co Ltd
Original Assignee
Hangzhou Hikvision Digital Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou Hikvision Digital Technology Co Ltd filed Critical Hangzhou Hikvision Digital Technology Co Ltd
Priority to CN201910544347.5A priority Critical patent/CN112116283B/en
Publication of CN112116283A publication Critical patent/CN112116283A/en
Application granted granted Critical
Publication of CN112116283B publication Critical patent/CN112116283B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/08Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
    • G06Q10/083Shipping
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06KGRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K17/00Methods or arrangements for effecting co-operative working between equipments covered by two or more of main groups G06K1/00 - G06K15/00, e.g. automatic card files incorporating conveying and reading operations
    • G06K17/0022Methods or arrangements for effecting co-operative working between equipments covered by two or more of main groups G06K1/00 - G06K15/00, e.g. automatic card files incorporating conveying and reading operations arrangements or provisious for transferring data to distant stations, e.g. from a sensing device
    • G06K17/0025Methods or arrangements for effecting co-operative working between equipments covered by two or more of main groups G06K1/00 - G06K15/00, e.g. automatic card files incorporating conveying and reading operations arrangements or provisious for transferring data to distant stations, e.g. from a sensing device the arrangement consisting of a wireless interrogation device in combination with a device for optically marking the record carrier
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/40Scenes; Scene-specific elements in video content
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/40Scenes; Scene-specific elements in video content
    • G06V20/46Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames

Abstract

The embodiment of the invention provides a logistics information acquisition method, a video searching method, a device and electronic equipment, wherein the logistics information acquisition method comprises the following steps: and receiving the device identification information and the waybill bar code information sent by the code scanning device, inquiring first visual characteristic information corresponding to the device identification information, acquiring second visual characteristic information obtained by carrying out characteristic analysis on the video frame shot by the monitoring equipment, and establishing a corresponding relation between the video frame containing the second visual characteristic information and the waybill bar code information when the second visual characteristic information is identical to the first visual characteristic information. The embodiment of the invention establishes the corresponding relation between the video frame shot by the monitoring equipment and the waybill bar code information through the first visual characteristic information and the second visual characteristic information, and does not need to be in one-to-one correspondence with the monitoring equipment, so that the corresponding relation between the waybill bar code and the video frame when the code scanning device scans goods can be established when the code scanning device and the monitoring equipment are not in one-to-one correspondence.

Description

Logistics information acquisition method, video search method, device and electronic equipment
Technical Field
The present invention relates to the field of logistics technologies, and in particular, to a method and apparatus for collecting logistics information, and a video searching method and apparatus, and an electronic device.
Background
In the current logistics industry, when an article is delivered to another place from one place, the article is transferred by a plurality of transfer stations, and in the process of transferring the goods, a worker always scans a bill bar code of the goods, and the bar code information obtained by scanning is input into a server, so that a user can check the logistics information of the goods.
In the transfer process of goods, the conditions of damage or package falling and the like often exist, a one-to-one correspondence between a code scanning device and monitoring equipment is pre-established for facilitating evidence collection and investigation, and then when a worker scans a bill bar code of the goods by adopting the code scanning device, the monitoring equipment corresponding to the code scanning device can shoot videos of the worker when the worker scans the goods, so that the correspondence between the bill bar code and the videos of the worker when the worker scans the goods can be established. Thus, the shot video can be conveniently inquired according to the waybill bar code.
However, the inventor finds that in the prior art, the code scanning device and the monitoring device are required to be in one-to-one correspondence, when a staff member holding the code scanning device scans the freight bill bar code of the goods in a monitoring area of the monitoring device which does not have a corresponding relation with the code scanning device, the corresponding relation between the freight bill bar code and the video when the staff member scans the goods cannot be established, and therefore the shot video cannot be queried according to the freight bill bar code.
Disclosure of Invention
The embodiment of the invention aims to provide a logistics information acquisition method, a video searching method, a device and electronic equipment, so that when a code scanning device and monitoring equipment do not correspond one by one, a corresponding relation between a waybill bar code and a video when the code scanning device scans goods is established. The specific technical scheme is as follows:
in a first aspect, an embodiment of the present invention provides a method for collecting logistics information, where the method includes:
inquiring first visual characteristic information corresponding to the device identification information when receiving the device identification information and the waybill bar code information sent by the code scanning device, wherein the device identification information and the first visual characteristic information have a pre-established one-to-one correspondence;
acquiring second visual characteristic information obtained by carrying out characteristic analysis on video frames shot by monitoring equipment, wherein the video frames shot by the monitoring equipment are video frames when the cargo bill bar codes are scanned;
and when the second visual characteristic information is the same as the first visual characteristic information, establishing a corresponding relation between the video frame containing the second visual characteristic information and the waybill barcode information.
Optionally, obtaining second visual feature information obtained by performing feature analysis on a video frame shot by the monitoring device includes:
Acquiring a plurality of groups of second visual characteristic information obtained by carrying out characteristic analysis on a plurality of video frames shot by a plurality of monitoring devices, wherein each video frame corresponds to one group of second visual characteristic information;
when the second visual characteristic information is the same as the first visual characteristic information, establishing a corresponding relation between the video frame containing the second visual characteristic information and the waybill barcode information, wherein the method comprises the following steps:
determining second visual characteristic information which is the same as the first visual characteristic information in a plurality of groups of second visual characteristic information;
and establishing a corresponding relation between the video frame containing the second visual characteristic information identical to the first visual characteristic information and the waybill barcode information.
Optionally, the waybill barcode information carries code scanning time, and the video frames shot by the monitoring equipment carry video frame shooting time;
obtaining multiple groups of second visual characteristic information obtained by performing characteristic analysis on multiple video frames shot by multiple monitoring devices comprises the following steps:
acquiring at least one candidate video frame of which the time difference between the video frame shooting time and the code scanning time is smaller than a preset time difference from a plurality of video frames shot by a plurality of monitoring devices;
performing feature analysis on each candidate video frame to obtain second visual feature information of each candidate video frame;
Determining second visual feature information identical to the first visual feature information among the plurality of sets of second visual feature information, comprising:
among the second visual characteristic information of each candidate video frame, the same second visual characteristic information as the first visual characteristic information is determined.
Optionally, the first visual characteristic information is pre-established human visual characteristic information of a worker corresponding to the device identification information or visual characteristic information of the code scanning device;
the method for obtaining the second visual characteristic information obtained by carrying out characteristic analysis on the video frames shot by the monitoring equipment comprises the following steps:
and acquiring second visual characteristic information obtained by performing characteristic analysis on staff or a code scanning device in a video frame shot by the monitoring equipment.
Optionally, the human visual characteristic information is: color characteristic information of clothing, face characteristic information of staff or body type characteristic information of staff;
the visual characteristic information of the code scanning device is as follows: color characteristic information of the code scanning device, color characteristic information of automatic equipment provided with the code scanning device, shape characteristic information of the code scanning device or shape characteristic information of the automatic equipment provided with the code scanning device;
optionally, establishing a correspondence between the video frame containing the second visual feature information and the waybill barcode information includes:
Acquiring OSD (on-screen display) information corresponding to the waybill bar code information;
and the OSD information is overlapped into the video stream containing the second visual characteristic information to obtain the video stream overlapped with the OSD information, and the waybill bar code information and the index of the video stream containing the second visual characteristic information and overlapped with the OSD information are established.
In a second aspect, an embodiment of the present invention further provides a video searching method, where the method includes:
acquiring the bar code information of the to-be-queried freight bill;
and inquiring the video frames corresponding to the to-be-inquired waybill bar code information in a plurality of pre-stored video frames based on a preset corresponding relation, wherein the preset corresponding relation is a corresponding relation which is established by adopting the logistics information acquisition method of the first aspect in advance.
Optionally, based on a preset corresponding relation, searching a video frame corresponding to the to-be-searched waybill barcode information in a plurality of pre-stored video frames, including:
and inquiring the video frames corresponding to the to-be-inquired waybill bar code information in a plurality of pre-stored video frames based on the pre-established index, wherein the pre-established index is the index established by the logistics information acquisition method in advance.
In a third aspect, an embodiment of the present invention further provides a device for collecting logistics information, where the device includes:
the inquiry module is used for inquiring first visual characteristic information corresponding to the device identification information when receiving the device identification information and the waybill barcode information sent by the code scanning device, wherein the device identification information and the first visual characteristic information have a one-to-one correspondence established in advance;
the feature information acquisition module is used for acquiring second visual feature information obtained by carrying out feature analysis on video frames shot by the monitoring equipment, wherein the video frames shot by the monitoring equipment are video frames when the goods waybill bar codes are scanned;
and the corresponding relation establishing module is used for establishing a corresponding relation between the video frame containing the second visual characteristic information and the waybill bar code information when the second visual characteristic information is the same as the first visual characteristic information.
Optionally, the feature information obtaining module is specifically configured to obtain multiple sets of second visual feature information obtained by performing feature analysis on multiple video frames shot by multiple monitoring devices, where each video frame corresponds to one set of second visual feature information;
optionally, the correspondence establishing module includes:
The characteristic information determining sub-module is used for determining second visual characteristic information which is the same as the first visual characteristic information in a plurality of groups of second visual characteristic information;
and the corresponding relation establishing sub-module is used for establishing the corresponding relation between the video frame containing the second visual characteristic information identical to the first visual characteristic information and the waybill bar code information.
Optionally, the waybill barcode information carries code scanning time, and the video frames shot by the monitoring equipment carry video frame shooting time;
the feature information acquisition module comprises:
the candidate video frame acquisition sub-module is used for acquiring at least one candidate video frame of which the time difference between the video frame shooting time and the code scanning time is smaller than a preset time difference from a plurality of video frames shot by a plurality of monitoring devices;
the feature analysis sub-module is used for carrying out feature analysis on each candidate video frame to obtain second visual feature information of each candidate video frame;
the feature information determining sub-module is specifically configured to determine, among the second visual feature information of each candidate video frame, second visual feature information identical to the first visual feature information.
Optionally, the first visual characteristic information is pre-established human visual characteristic information of a worker corresponding to the device identification information or visual characteristic information of the code scanning device;
The characteristic information acquisition module is specifically used for acquiring second visual characteristic information obtained by carrying out characteristic analysis on staff or a code scanning device in a video frame shot by the monitoring equipment.
Optionally, the human visual characteristic information is: color characteristic information of clothing, face characteristic information of staff or body type characteristic information of staff;
the visual characteristic information of the code scanning device is as follows: color characteristic information of the code scanning device, color characteristic information of automatic equipment provided with the code scanning device, shape characteristic information of the code scanning device or shape characteristic information of the automatic equipment provided with the code scanning device;
optionally, the correspondence establishing module includes:
the OSD information acquisition sub-module is used for acquiring OSD information corresponding to the waybill bar code information when the second visual characteristic information is the same as the first visual characteristic information;
and the OSD information superposition sub-module is used for superposing the OSD information into the video stream containing the second visual characteristic information to obtain the video stream superposed with the OSD information, and establishing the waybill bar code information and the index of the video stream containing the second visual characteristic information and superposed with the OSD information.
In a fourth aspect, an embodiment of the present invention further provides a video searching apparatus, where the apparatus includes:
The waybill bar code information acquisition module is used for acquiring the to-be-inquired waybill bar code information;
the searching module is used for searching video frames corresponding to the to-be-searched waybill bar code information in a plurality of pre-stored video frames based on a preset corresponding relation, wherein the preset corresponding relation is a corresponding relation pre-established by adopting the logistics information acquisition method of the first aspect.
Optionally, the search module is specifically configured to:
and inquiring the video frames corresponding to the to-be-inquired waybill bar code information in a plurality of pre-stored video frames based on the pre-established index, wherein the pre-established index is the index established by the logistics information acquisition method in advance.
In a fifth aspect, an embodiment of the present invention provides an electronic device, which is characterized by including a processor, a communication interface, a memory, and a communication bus, where the processor, the communication interface, and the memory complete communication with each other through the communication bus;
a memory for storing a computer program;
and the processor is used for realizing the logistics information acquisition method step of the first aspect and/or the video searching method step of the second aspect when executing the program stored in the memory.
In a sixth aspect, an embodiment of the present invention further provides a computer readable storage medium, where a computer program is stored, where the computer program, when executed by a processor, implements the steps of the method for collecting logistics information in the first aspect and/or the steps of the method for searching video in the second aspect.
According to the logistics information acquisition method, the video searching method, the device and the electronic equipment, when the device identification information and the waybill bar code information sent by the code scanning device are received, the first visual characteristic information corresponding to the device identification information can be inquired, and then the second visual characteristic information obtained by carrying out characteristic analysis on the video frame shot by the monitoring equipment is acquired; therefore, the second visual characteristic information can reflect the visual characteristic information when the code scanning device is used for scanning the freight note bar code in the video frame. After the first visual characteristic information and the second visual characteristic information are obtained, whether the first visual characteristic information is the same as the second visual characteristic information or not can be judged, and when the second visual characteristic information is the same as the first visual characteristic information, the video frame shot by the monitoring equipment can be explained to be the video frame when the code scanning device is used for scanning the freight bill bar code. And finally, establishing a corresponding relation between the video frame shot by the monitoring equipment containing the second visual characteristic information and the waybill bar code information so as to find the video frame corresponding to the waybill bar code information through the corresponding relation later.
Therefore, in the embodiment of the invention, the corresponding relation between the video frame shot by the monitoring equipment and the waybill bar code information is established through the first visual characteristic information and the second visual characteristic information, and the one-to-one correspondence between the code scanning device and the monitoring equipment is not needed, so that the corresponding relation between the waybill bar code and the video frame when the code scanning device scans goods can be established when the code scanning device and the monitoring equipment are not in one-to-one correspondence. Of course, it is not necessary for any one product or method of practicing the invention to achieve all of the advantages set forth above at the same time.
Drawings
In order to more clearly illustrate the embodiments of the invention or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described, it being obvious that the drawings in the following description are only some embodiments of the invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1a is a schematic view of a logistics warehouse according to an embodiment of the present invention;
FIG. 1b is a system block diagram of a logistics collection system as applied to the logistics warehouse of FIG. 1 a;
FIG. 2 is a flowchart of a first implementation of a method for collecting logistics information according to an embodiment of the present invention;
FIG. 3 is a flowchart of a second implementation of a method for collecting logistic information according to an embodiment of the present invention;
FIG. 4 is a flowchart of a third embodiment of a method for collecting logistics information according to an embodiment of the present invention;
FIG. 5 is a flowchart of a fourth embodiment of a method for collecting logistic information according to an embodiment of the present invention;
FIG. 6 is a flowchart of a video searching method according to an embodiment of the present invention;
fig. 7 is a schematic structural diagram of a logistic information collection device according to an embodiment of the present invention;
fig. 8 is a schematic structural diagram of a video searching apparatus according to an embodiment of the present invention;
FIG. 9 is a schematic diagram of a back-end storage device according to an embodiment of the present invention;
fig. 10 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
In order to solve the problems in the prior art, the embodiment of the invention provides a logistics information acquisition method, a video searching method, a device and electronic equipment, which can be used for establishing a corresponding relation between a waybill bar code and a video when the code scanning device scans goods when the code scanning device and the monitoring equipment do not correspond one by one.
Next, an application scenario of a logistics information collection method according to an embodiment of the present invention is described, as shown in fig. 1a, which is a schematic diagram of a scenario of a logistics warehouse according to an embodiment of the present invention; in fig. 1a, 6 monitoring devices may be provided in the logistics warehouse, and a transverse line in the middle of the logistics warehouse may divide the logistics warehouse into two parts, each part being provided with 3 monitoring devices.
As shown in fig. 1b, the system is a system structure diagram of a logistics collection system applied to the logistics warehouse shown in fig. 1a, and the system may include a back-end storage device 120, a code scanning device 110 and a monitoring device 130. The back-end storage device 120 may be a server or a personal computer. The back-end storage device 120 may be an electronic device to which the method for collecting logistics information and/or the method for searching video according to the embodiments of the present invention are applied.
As shown in fig. 1a, a plurality of monitoring devices 130 shown in fig. 1b may be disposed in one logistics warehouse, each monitoring device 130 may be responsible for monitoring a certain area, and the shading in the figure may represent the area monitored by each monitoring device 130. In some examples, there may be overlap in the monitoring areas of the monitoring device 130. So that all areas of the logistics warehouse can be monitored.
In still other examples, the back-end storage device 120 shown in fig. 1b may be disposed in the logistics warehouse or in a server room, and the back-end storage device 120 may be communicatively connected to the monitoring device 130.
In still other examples, the back-end storage device 120 may be connected to the code scanning device 110 by a wire, or may be connected to the code scanning device 110 by a wireless communication device, where the wireless communication device may be disposed in the logistic warehouse when the back-end storage device 120 is connected to the code scanning device 110 by a wireless communication device.
It should be understood that the rectangular warehouse is only an exemplary illustration, the number of monitoring devices installed in the warehouse is also only an exemplary illustration, and in practical application, the shape of the logistics warehouse may be polygonal, and the monitoring area of the monitoring devices may be polygonal, which is not limited herein.
Next, a method for collecting logistics information according to an embodiment of the present invention is described, as shown in fig. 2, which is a flowchart of a first implementation of the method for collecting logistics information according to an embodiment of the present invention, where the method may include:
s210, inquiring first visual characteristic information corresponding to the device identification information when the device identification information and the waybill barcode information sent by the code scanning device are received.
Wherein the device identification information and the first visual characteristic information have a one-to-one correspondence established in advance. The device identification information is device identification information of the code scanning device, for example: the identification number of the code scanning device and the name of the code scanning device can be adopted, and the network address of the code scanning device can be an IP (Internet Protocol Address ) address or a MAC (Media Access Control Address, media access control address) address and the like.
In some examples, a method for collecting logistics information according to the embodiments of the present invention may be applied to the back-end storage device 120 shown in fig. 1b, where the back-end storage device 120 may be communicatively connected to a plurality of code scanning apparatuses 110, and each code scanning apparatus 110 may send the scanned waybill barcode information to the back-end storage device 120 after scanning the waybill barcode information of the goods. Therefore, the back-end storage device 120 can receive the waybill barcode information sent by the code scanning device.
In some examples, the code scanning device that scans the waybill barcode information may send its own device identification information to the back-end storage device 120 in addition to the waybill barcode information.
When the back-end storage device receives the device identification information and the waybill barcode information sent by the code scanning device, the visual characteristic information corresponding to the device identification information of the code scanning device, namely the first visual characteristic information, can be searched in a pre-established corresponding relation table of the code scanning device and the visual characteristic information.
As shown in table 1, in the table 1, the correspondence table between the code scanning device and the visual characteristic information may include an identification number of the code scanning device and the visual characteristic information, where the identification number of the code scanning device may include: "0000001", "0000002" and "0000003", the visual characteristic information may include: "visual feature 1", "visual feature 2" and "visual feature 3". The identification number "0000001" of the code scanning device has a preset corresponding relation with the visual characteristic information "visual characteristic 1", the identification number "0000002" of the code scanning device has a preset corresponding relation with the visual characteristic information "visual characteristic 2", and the identification number "0000003" of the code scanning device has a preset corresponding relation with the visual characteristic information "visual characteristic 3".
Table 1 correspondence table between code scanning device and visual characteristic information
Identification number of code scanning device Visual characteristic information
0000001 Visual characteristics 1
0000002 Visual characteristics 2
0000003 Visual characteristics 3
In some examples, the first visual characteristic information may be human visual characteristic information or visual characteristic information of a code scanning device, and the human visual characteristic information may include: color characteristic information of clothing, face characteristic information of staff or body type characteristic information of staff. The visual characteristic information of the code scanning device can comprise: color characteristic information of the code scanning device, color characteristic information of automation equipment provided with the code scanning device, shape characteristic information of the code scanning device or shape characteristic information of the automation equipment provided with the code scanning device. For example, the color characteristic information of the garment may be blue work clothes, green work clothes, red work clothes, and the like.
In still other examples, when the code scanning device is installed on an automation device, the visual characteristic information of the code scanning device may be visual characteristic information including the automation device and the code scanning device. For example, the automation device may be: high-speed logistics scanning equipment or logistics sorting pipelines and the like.
S220, obtaining second visual characteristic information obtained by performing characteristic analysis on the video frames shot by the monitoring equipment.
The video frames shot by the monitoring equipment are video frames when the cargo bill bar codes are scanned.
In some examples, the back-end storage device described above is also communicatively coupled to a monitoring device, which may send video frames to the back-end storage device in real-time, i.e., the back-end storage device may receive video frames sent by the monitoring device in real-time.
The back-end storage device can also receive the device identification information and the waybill bar code information sent by the code scanning device in real time. The back-end storage device can perform feature analysis on the front N frames of video frames received simultaneously after receiving the device identification information and the waybill bar code information sent by the code scanning device so as to obtain second visual feature information contained in the video frames. Here, N may be a value set in advance empirically.
That is, when the back-end storage device can simultaneously receive the device identification information and the waybill barcode information sent by the code scanning device and the video frame sent by the monitoring device, the back-end storage device can perform feature analysis on the first N frames of images of the video frame.
In some examples, the second visual characteristic information may be human visual characteristic information or specific characteristic information of the code scanning device, and the human visual characteristic information may include: color characteristic information of clothing, face characteristic information of staff or body type characteristic information of staff. The visual characteristic information of the code scanning device can comprise: color characteristic information of the code scanning device, color characteristic information of automation equipment provided with the code scanning device, shape characteristic information of the code scanning device or shape characteristic information of the automation equipment provided with the code scanning device. For example, the color characteristic information of the garment may be blue work clothes, green work clothes, red work clothes, and the like.
In still other examples, the video frame may be subjected to feature analysis using prior art feature analysis techniques, for example, a pre-trained neural network for feature analysis may be used, and the pre-trained neural network for feature analysis may be trained using a picture or a video frame pre-labeled with visual feature information, where the structure of the neural network is not limited, as long as the neural network can be used for feature analysis.
In still other examples, the monitoring device may perform feature analysis on the captured video frame, and send the obtained second visual feature information and the captured video frame to the back-end storage device.
In some examples, the code scanning device in the video frame for scanning the barcode information of the freight note sent by the monitoring device may or may not be the code scanning device described above, and in order to determine whether the code scanning device in the video frame for scanning the barcode information of the freight note sent by the monitoring device is the code scanning device described above, step S230 may be executed.
And S230, when the second visual characteristic information is the same as the first visual characteristic information, establishing a corresponding relation between the video frame containing the second visual characteristic information and the waybill bar code information.
The back-end storage device may compare the first visual feature information with the second visual feature information after obtaining the first visual feature information and the second visual feature information. When the first visual feature information is the same as the second visual feature information, the code scanning device in the video frame containing the second visual feature information can be described, and the code scanning device corresponding to the first visual feature information is the same code scanning device. The corresponding relation between the waybill bar code information sent by the code scanning device and the video frame containing the code scanning device can be established. Therefore, the video frame containing the code scanning device for scanning the waybill bar code information can be searched through the waybill bar code information during the subsequent searching.
In still other examples, the back-end storage device may store the waybill barcode information, the video frame captured by the monitoring device including the second visual feature information, and the established correspondence between the video frame captured by the monitoring device including the second visual feature information and the waybill barcode information after establishing the correspondence between the video frame captured by the monitoring device including the second visual feature information and the waybill barcode information.
For the sake of more clear explanation of the embodiment of the present invention, it is assumed that the above-mentioned back-end storage device receives the identification information 1 and the waybill barcode information 1 sent by the code scanning device 1, and the identification information 2 and the waybill barcode information 2 sent by the code scanning device 2, and then can search the visual characteristic information 1 corresponding to the identification information 1, and find the visual characteristic information 2 corresponding to the identification information 2.
Meanwhile, the rear-end storage device also receives a video frame 1 sent by the monitoring device 1 and a video frame 2 sent by the monitoring device 2, wherein the video frame 1 is a video frame of the cargo bill bar code information scanned by one code scanning device shot by the monitoring device 1, and the video frame 2 is a video frame of the cargo bill bar code information scanned by the other code scanning device shot by the monitoring device 2. The back-end storage device may perform feature analysis on the video frame 1 and the video frame 2 to obtain visual feature information 3 of the video frame 1 and visual feature information 4 of the video frame 2.
The back-end storage device can compare the visual characteristic information 1 with the visual characteristic information 3, compare the visual characteristic information 2 with the visual characteristic information 4, and when the visual characteristic information 1 and the visual characteristic information 2 are the same, it can be explained that the video frame 1 sent by the monitoring device 1 is the video frame of the shot code scanning device 1 scanning the freight note barcode information, and the video frame 2 sent by the monitoring device 2 is the video frame of the shot code scanning device 2 scanning the freight note barcode information. Therefore, the corresponding relation between the waybill barcode information 1 sent by the code scanning device 1 and the video frame 1 sent by the monitoring equipment 1 can be established, and the corresponding relation between the waybill barcode information 2 sent by the code scanning device 2 and the video frame 2 sent by the monitoring equipment 2 can be established.
In some examples, when establishing the correspondence between the waybill barcode information and the video frame, the correspondence between the waybill barcode information and the frame number of the video frame in the complete video where the video frame is located may be established. For example, the established correspondence may be a correspondence table as shown in table 2.
Table 2 correspondence table
Bill bar code information Video frame number
Bill bar code information 1 Frame number of video frame 1
Bill bar code information 2 Frame number of video frame 2
It can be seen that, in the correspondence table shown in table 2, when the frame number of the video frame 1 in the complete video where it is located is "0024", the waybill barcode information 1 corresponds to "0024". When the frame number of the video frame 2 in the complete video where the video frame itself is located is "0026", the waybill barcode information 1 corresponds to "0026".
According to the logistics information acquisition method provided by the embodiment of the invention, when the device identification information and the waybill bar code information sent by the code scanning device are received, the first visual characteristic information corresponding to the device identification information can be inquired, and then the second visual characteristic information obtained by carrying out characteristic analysis on the video frame shot by the monitoring equipment is acquired, wherein the video frame shot by the monitoring equipment is the video frame when the waybill bar code of the goods is scanned; therefore, the second visual characteristic information can reflect the visual characteristic information when the code scanning device is used for scanning the freight note bar code in the video frame. After the first visual characteristic information and the second visual characteristic information are obtained, whether the first visual characteristic information is the same as the second visual characteristic information or not can be judged, and when the second visual characteristic information is the same as the first visual characteristic information, the video frame shot by the monitoring equipment can be explained to be the video frame when the code scanning device is used for scanning the freight bill bar code. And finally, establishing a corresponding relation between the video frame shot by the monitoring equipment containing the second visual characteristic information and the waybill bar code information so as to find the video frame corresponding to the waybill bar code information through the corresponding relation later.
Therefore, in the embodiment of the invention, the corresponding relation between the video frame shot by the monitoring equipment and the waybill bar code information is established through the first visual characteristic information and the second visual characteristic information, and the one-to-one correspondence between the code scanning device and the monitoring equipment is not needed, so that the corresponding relation between the waybill bar code and the video frame when the code scanning device scans goods can be established when the code scanning device and the monitoring equipment are not in one-to-one correspondence.
In some examples, the back-end storage device in the above-mentioned logistics information collection system may receive a video frame sent by one monitoring device, or may receive a plurality of video frames sent by a plurality of monitoring devices, where, on the basis of a logistics information collection method shown in fig. 2, an embodiment of the present invention further provides a possible implementation manner, as shown in fig. 3, which is a flowchart of a second implementation manner of a logistics information collection method in an embodiment of the present invention, where the method may include:
s310, inquiring first visual characteristic information corresponding to the device identification information when the device identification information and the waybill barcode information sent by the code scanning device are received.
The device identification information and the first visual characteristic information have a one-to-one correspondence established in advance.
S320, obtaining a plurality of groups of second visual characteristic information obtained by characteristic analysis of a plurality of video frames shot by a plurality of monitoring devices.
Wherein each video frame corresponds to a set of second visual characteristic information.
S330, determining second visual characteristic information which is the same as the first visual characteristic information in the plurality of groups of second visual characteristic information.
S340, establishing a corresponding relation between the video frame containing the second visual characteristic information identical to the first visual characteristic information and the waybill bar code information.
In some examples, after receiving a plurality of video frames sent by a plurality of monitoring devices, the back-end storage device may perform feature analysis on each video frame, so as to obtain a set of visual feature information corresponding to each video frame.
In still other examples, the first visual characteristic information described above may also be a set of visual characteristic information.
In some examples, each set of second visual characteristic information may include one characteristic or may include a plurality of characteristics, and the number of characteristics is not limited herein. The number of features in each set of second visual feature information is the same as the number of features in each set of first visual feature information.
For example, the first visual characteristic information and the second visual characteristic information may each include: shape features, color features, etc.
In still other examples, each of the plurality of monitoring cameras may perform feature analysis on a video frame captured by itself to obtain second visual feature information corresponding to the video frame captured by itself. And transmitting the video frames shot by the user and the corresponding second visual characteristic information to the back-end storage device.
After the back-end storage device obtains the plurality of second visual feature information, the first feature information may be compared with the plurality of second visual feature information, so as to determine, from the plurality of second visual feature information, second visual feature information identical to the first visual feature information.
After obtaining the second visual characteristic information identical to the first visual characteristic information, the back-end storage device may determine a target video frame corresponding to the second visual characteristic information identical to the first visual characteristic information from a plurality of video frames sent by the plurality of monitoring devices. And then establishing the corresponding relation between the waybill bar code information corresponding to the first visual characteristic information and the video frame containing the second visual characteristic information identical to the first visual characteristic information.
It should be understood that step S310 in the embodiment of the present invention is the same as step S210 in the first implementation manner of the embodiment of the present invention, and will not be described herein.
In some examples, the first embodiment and the second embodiment may be examples of a method in which the back-end storage device establishes a correspondence between the waybill barcode information sent by the barcode scanning device and the video frame sent by the monitoring device in real time.
In still other examples, the embodiment of the invention can store the waybill barcode information and the device identification information sent by the code scanning device, store the video frame sent by the monitoring device, and establish the corresponding relationship between the waybill barcode information and the video frame sent by the monitoring device by adopting the logistics information acquisition method of the embodiment of the invention after receiving the instruction of establishing the corresponding relationship sent by the user.
In this regard, on the basis of a method for collecting logistics information shown in fig. 3, an embodiment of the present invention further provides a possible implementation manner, as shown in fig. 4, which is a flowchart of a third implementation manner of a method for collecting logistics information in the embodiment of the present invention, where the method may include:
s410, inquiring first visual characteristic information corresponding to the device identification information when receiving the device identification information and the waybill barcode information sent by the code scanning device.
The device identification information and the first visual characteristic information have a one-to-one correspondence established in advance.
S420, acquiring at least one candidate video frame, of which the time difference between the video frame shooting time and the code scanning time is smaller than a preset time difference, in a plurality of video frames shot by a plurality of monitoring devices.
In some examples, when the code scanning device scans the freight bill barcode information of the freight, the code scanning device may record the code scanning time of scanning the freight bill barcode information of the freight, and then send the code scanning time and the freight bill barcode information to the back-end storage device at the same time. The back-end storage equipment can respectively store the waybill bar code information, the code scanning time and the device identification information of the code scanning device sent by different code scanning devices after receiving the waybill bar code information, the code scanning time and the device identification information of the code scanning device sent by different code scanning devices.
For example, the waybill barcode information, the code scanning time, and the device identification information of the code scanning device transmitted by the code scanning device 1 are stored as a whole, and the waybill barcode information, the code scanning time, and the device identification information of the code scanning device transmitted by the code scanning device 2 are stored as a whole.
In still other examples, the monitoring device may record the shooting time of the video frame when shooting the video frame when the scanning device scans the barcode information of the freight note, that is, the video frame sent to the back-end storage device by the monitoring device includes the shooting time of the video frame. The back-end storage device may store the video frame carrying the video frame capturing time after receiving the video frame carrying the video frame capturing time.
In some examples, the preset time difference may be an offset value that is empirically set in advance, e.g., the preset time difference may be 30 seconds or 1 minute, etc.
And S430, performing feature analysis on each candidate video frame to obtain second visual feature information of each candidate video frame.
S440, determining second visual characteristic information identical to the first visual characteristic information among the second visual characteristic information of each candidate video frame.
S450, establishing a corresponding relation between the video frame containing the second visual characteristic information identical to the first visual characteristic information and the waybill bar code information.
When the back-end storage device receives the instruction for establishing the corresponding relation, the waybill barcode information, the code scanning time and the device identification information of the code scanning device, which are sent by one code scanning device, can be obtained from the waybill barcode information, the code scanning time and the device identification information of the code scanning device, which are respectively sent by a plurality of code scanning devices, which are stored locally.
And then searching first visual characteristic information corresponding to the acquired waybill bar code information, and searching at least one candidate video frame with the time difference between the video frame shooting time and the code scanning time smaller than the preset time difference in a plurality of locally stored video frames. When the time difference between the shooting time and the code scanning time of a plurality of video frames is smaller than the preset time difference, the back-end storage device can respectively perform feature analysis on each candidate video frame to obtain second visual feature information of each candidate video frame. And comparing the first visual characteristic information with each piece of second visual characteristic information so as to determine the second visual characteristic information which is the same as the first visual characteristic information from the plurality of pieces of second visual characteristic information.
After the second visual characteristic information identical to the first visual characteristic information is obtained, the back-end storage device can establish a corresponding relationship between the video frame containing the second visual characteristic information identical to the first visual characteristic information and the waybill barcode information.
In still other examples, the back-end storage device may perform feature analysis on the video frame when receiving the video frame sent by the monitoring device, and store the second visual feature information obtained by the feature analysis and the corresponding video frame locally. After receiving the instruction for establishing the corresponding relation, the back-end storage device can directly obtain the second visual characteristic information corresponding to each candidate video frame from the local. This is also possible.
By the embodiment of the invention, the corresponding relationship can be established in real time, and the corresponding relationship can be established again when the user needs to establish the corresponding relationship, so that the flexibility of applying the embodiment of the invention can be improved.
In still other examples, when the second visual characteristic information of the plurality of candidate video frames is the same as the first visual characteristic information, the frame numbers of the plurality of candidate video frames are continuous, and the plurality of candidate video frames are video frames sent by the same monitoring device, the candidate video frames with continuous frame numbers may be stored as one video segment according to the sequence of the plurality of candidate video frames.
It should be understood that steps S410 and S450 in the embodiment of the present invention are the same as steps S310 and S340 in the second implementation manner of the embodiment of the present invention, and will not be described herein.
In some examples, on the basis of a method for collecting logistics information shown in fig. 2, the embodiment of the present invention further provides a possible implementation manner, as shown in fig. 5, which is a flowchart of a fourth implementation manner of a method for collecting logistics information in the embodiment of the present invention, where the method may include:
s510, inquiring first visual characteristic information corresponding to the device identification information when receiving the device identification information and the waybill barcode information sent by the code scanning device.
The device identification information and the first visual characteristic information have a one-to-one correspondence established in advance.
S520, obtaining second visual characteristic information obtained by performing characteristic analysis on the video frames shot by the monitoring equipment.
The video frames shot by the monitoring equipment are video frames when the cargo bill bar codes are scanned.
S530, acquiring OSD information corresponding to the waybill bar code information when the second visual characteristic information is the same as the first visual characteristic information.
S540, the OSD information is overlapped to the video stream containing the second visual characteristic information, the video stream overlapped with the OSD information is obtained, and the waybill bar code information and the index of the video stream containing the second visual characteristic information and overlapped with the OSD information are established.
In some examples, when the corresponding relationship between the waybill barcode information and the video frame is established, the back-end storage device may also use a manner of superimposing OSD information corresponding to the waybill barcode information to the video stream to establish the corresponding relationship.
In some examples, the back-end storage device may store OSD information, and after the waybill barcode information is acquired, the OSD information corresponding to the waybill barcode information may be queried in the locally stored OSD information. The queried OSD information corresponding to the waybill barcode information may then be superimposed into a video stream containing the second visual characteristic information, such that a video stream superimposed with OSD information may be obtained.
In order to be able to subsequently inquire the video frame superimposed with the waybill barcode information through the waybill barcode information, the above-mentioned back-end storage device may establish the index of the video stream superimposed with the OSD information and the waybill barcode information, so when the user inputs the waybill barcode information, the video stream superimposed with the waybill barcode information may be inquired through the waybill barcode information, and then the video stream superimposed with the waybill barcode information is decoded into the corresponding video frame.
And by superposing the OSD information corresponding to the waybill bar code information into the video stream, a user can more intuitively see the corresponding waybill bar code information when watching the video frame superposed with the waybill bar code information.
It should be understood that steps S510 and S520 in the embodiment of the present invention are the same as steps S210 and S220 in one implementation of the embodiment of the present invention, and are not described herein again.
Corresponding to the above-mentioned logistics information collection method, the embodiment of the present invention further provides a video frame searching method, as shown in fig. 6, which is a flowchart of the video frame searching method according to the embodiment of the present invention, where the method may include:
s610, acquiring the to-be-queried waybill bar code information;
s620, inquiring the video frame corresponding to the to-be-inquired waybill bar code information in a plurality of pre-stored video frames based on the preset corresponding relation.
The preset corresponding relation is a corresponding relation established in any one of the first to third embodiments of the logistics information collection method.
After the logistics information collection method of any one of the first to third embodiments of the present invention is adopted in the back-end storage device, and the correspondence between the waybill barcode information and the goods waybill barcode information scanned by the code scanning device shot by the monitoring device is established, the user can input the waybill barcode information to be queried into the back-end storage device to query the corresponding video frame.
After receiving the to-be-queried waybill bar code information, the back-end storage device can scan the corresponding relation of the cargo waybill bar code information based on the pre-established waybill bar code information and the code scanning device shot by the monitoring device, and query the video frame corresponding to the to-be-queried waybill bar code information in a plurality of pre-stored video frames. And sending the queried video frame corresponding to the to-be-queried waybill bar code information to a user terminal or displaying the video frame to a user.
In still other examples, when the above-mentioned back-end storage device establishes a correspondence between the waybill barcode information and the video frame in which the scanning device scans the freight bill barcode information, the OSD information corresponding to the waybill barcode information may be superimposed into the video frame, and an index of the waybill barcode information and the video frame on which the OSD information is superimposed may be established.
The back-end storage device may query, based on the index, a video frame corresponding to the waybill barcode information to be queried among a plurality of video frames stored in advance. The video frame corresponding to the waybill bar code information to be inquired is overlapped with OSD information corresponding to the waybill bar code information.
According to the embodiment of the invention, when the to-be-queried waybill bar code information is received, the video frame corresponding to the to-be-queried waybill bar code information can be queried in a plurality of pre-stored video frames based on the preset corresponding relation. Because the preset corresponding relation is the corresponding relation between the video frame shot by the monitoring equipment and the waybill bar code information, which is established through the first visual characteristic information and the second visual characteristic information, the code scanning device and the monitoring equipment do not need to be in one-to-one correspondence, and therefore, when the scanning device and the monitoring equipment are not in one-to-one correspondence, the video frame corresponding to the waybill bar code information can be queried.
The embodiment of the invention also provides a logistics information acquisition device, as shown in fig. 7, which is a schematic structural diagram of the logistics information acquisition device according to the embodiment of the invention, and the device may include:
and the query module 710 is configured to query, when receiving the device identification information and the waybill barcode information sent by the code scanning device, first visual characteristic information corresponding to the device identification information, where the device identification information and the first visual characteristic information have a one-to-one correspondence established in advance.
The feature information obtaining module 720 is configured to obtain second visual feature information obtained by performing feature analysis on a video frame shot by the monitoring device, where the video frame shot by the monitoring device is a video frame when the cargo bill bar code is scanned.
And a correspondence establishing module 730, configured to establish a correspondence between the video frame including the second visual feature information and the waybill barcode information when the second visual feature information is the same as the first visual feature information.
According to the logistics information acquisition device provided by the embodiment of the invention, when the device identification information and the waybill bar code information sent by the code scanning device are received, the first visual characteristic information corresponding to the device identification information can be inquired, and then the second visual characteristic information obtained by carrying out characteristic analysis on the video frame shot by the monitoring equipment is acquired, wherein the video frame shot by the monitoring equipment is the video frame when the waybill bar code of the goods is scanned; therefore, the second visual characteristic information can reflect the visual characteristic information when the code scanning device is used for scanning the freight note bar code in the video frame. After the first visual characteristic information and the second visual characteristic information are obtained, whether the first visual characteristic information is the same as the second visual characteristic information or not can be judged, and when the second visual characteristic information is the same as the first visual characteristic information, the video frame shot by the monitoring equipment can be explained to be the video frame when the code scanning device is used for scanning the freight bill bar code. And finally, establishing a corresponding relation between the video frame shot by the monitoring equipment containing the second visual characteristic information and the waybill bar code information so as to find the video frame corresponding to the waybill bar code information through the corresponding relation later.
Therefore, in the embodiment of the invention, the corresponding relation between the video frame shot by the monitoring equipment and the waybill bar code information is established through the first visual characteristic information and the second visual characteristic information, and the one-to-one correspondence between the code scanning device and the monitoring equipment is not needed, so that the corresponding relation between the waybill bar code and the video frame when the code scanning device scans goods can be established when the code scanning device and the monitoring equipment are not in one-to-one correspondence.
Optionally, the feature information obtaining module 720 is specifically configured to obtain multiple sets of second visual feature information obtained by performing feature analysis on multiple video frames shot by multiple monitoring devices, where each video frame corresponds to one set of second visual feature information.
Optionally, the correspondence establishing module 730 includes:
and the characteristic information determining sub-module is used for determining second visual characteristic information which is the same as the first visual characteristic information in a plurality of groups of second visual characteristic information.
And the corresponding relation establishing sub-module is used for establishing the corresponding relation between the video frame containing the second visual characteristic information identical to the first visual characteristic information and the waybill bar code information.
Optionally, the waybill barcode information carries code scanning time, and the video frame shot by the monitoring device carries shooting video frame time.
The feature information obtaining module 720 includes:
the candidate video frame acquisition sub-module is used for acquiring at least one candidate video frame of which the time difference between the video frame shooting time and the code scanning time is smaller than a preset time difference from a plurality of video frames shot by a plurality of monitoring devices;
the feature analysis sub-module is used for carrying out feature analysis on each candidate video frame to obtain second visual feature information of each candidate video frame;
the feature information determining sub-module is specifically configured to determine, among the second visual feature information of each candidate video frame, second visual feature information identical to the first visual feature information.
Optionally, the first visual characteristic information is pre-established human visual characteristic information of a worker corresponding to the device identification information or visual characteristic information of the code scanning device.
The feature information obtaining module 720 is specifically configured to obtain second visual feature information obtained by performing feature analysis on a worker or a code scanning device in a video frame shot by the monitoring device.
Optionally, the human visual characteristic information is: color characteristic information of clothing, face characteristic information of staff or body type characteristic information of staff.
The visual characteristic information of the code scanning device is as follows: color characteristic information of the code scanning device, color characteristic information of automation equipment provided with the code scanning device, shape characteristic information of the code scanning device or shape characteristic information of the automation equipment provided with the code scanning device.
Optionally, the correspondence establishing module 730 includes:
the OSD information acquisition sub-module is used for acquiring OSD information corresponding to the waybill bar code information when the second visual characteristic information is the same as the first visual characteristic information;
and the OSD information superposition sub-module is used for superposing the OSD information into the video stream containing the second visual characteristic information to obtain the video stream superposed with the OSD information, and establishing the waybill bar code information and the index of the video stream containing the second visual characteristic information and superposed with the OSD information.
The embodiment of the invention also provides a video frame searching device, as shown in fig. 8, which is a schematic structural diagram of the video frame searching device in the embodiment of the invention, and the device may include:
the waybill barcode information acquisition module 810 is used for acquiring the to-be-queried waybill barcode information.
The searching module 820 is configured to query, from among a plurality of pre-stored video frames, a video frame corresponding to the to-be-queried waybill barcode information, where the pre-set correspondence is a correspondence established in advance by adopting any one of the first to third embodiments of the above-mentioned logistic information collection method.
Optionally, the search module 820 is specifically configured to:
And inquiring the video frames corresponding to the to-be-inquired waybill bar code information in a plurality of pre-stored video frames based on the pre-established index, wherein the pre-established index is the index established in advance by adopting the fourth implementation mode of the logistics information acquisition method.
According to the embodiment of the invention, when the to-be-queried waybill bar code information is received, the video frame corresponding to the to-be-queried waybill bar code information can be queried in a plurality of pre-stored video frames based on the preset corresponding relation. Because the preset corresponding relation is the corresponding relation between the video frame shot by the monitoring equipment and the waybill bar code information, which is established through the first visual characteristic information and the second visual characteristic information, the code scanning device and the monitoring equipment do not need to be in one-to-one correspondence, and therefore, when the scanning device and the monitoring equipment are not in one-to-one correspondence, the video frame corresponding to the waybill bar code information can be queried.
The embodiment of the invention also provides a back-end storage device, as shown in fig. 9, which is a schematic structural diagram of the back-end storage device according to the embodiment of the invention, where the device may include: a positioning unit 910, an OSD information superimposing unit 920, a video storage unit 930, and a search playback unit 940.
The positioning unit 910 is configured to query, when receiving the device identification information and the waybill barcode information sent by the code scanning device, first visual feature information corresponding to the device identification information, and obtain second visual feature information obtained by performing feature analysis on a video frame shot by the monitoring device, where the device identification information and the first visual feature information have a pre-established one-to-one correspondence, and the video frame shot by the monitoring device is a video frame when the waybill barcode is scanned.
The OSD information superimposing unit 920 is configured to obtain OSD information corresponding to the waybill barcode information when the second visual feature information is the same as the first visual feature information;
the OSD information superimposing unit 920 is further configured to superimpose OSD information on the video stream including the second visual feature information, obtain a video stream superimposed with OSD information, and establish a waybill barcode information and an index of the video stream including the second visual feature information and superimposed with OSD information.
And a video storage unit 930 for storing the waybill barcode information, the video stream superimposed with the OSD information, and the index of the established waybill barcode information and the video stream containing the second visual characteristic information and superimposed with the OSD information.
The search playback unit 940 is configured to obtain the barcode information of the to-be-queried waybill, and query, based on the pre-established index, a video stream corresponding to the barcode information of the to-be-queried waybill in the pre-stored video stream superimposed with the OSD information.
When receiving the device identification information and the waybill bar code information sent by the code scanning device, the rear-end storage equipment provided by the embodiment of the invention can inquire the first visual characteristic information corresponding to the device identification information, and then acquire the second visual characteristic information obtained by carrying out characteristic analysis on the video frame shot by the monitoring equipment, wherein the video frame shot by the monitoring equipment is the video frame when the waybill bar code of the goods is scanned; therefore, the second visual characteristic information can reflect the visual characteristic information when the code scanning device is used for scanning the freight note bar code in the video frame. After the first visual characteristic information and the second visual characteristic information are obtained, whether the first visual characteristic information is the same as the second visual characteristic information or not can be judged, and when the second visual characteristic information is the same as the first visual characteristic information, the video frame shot by the monitoring equipment can be explained to be the video frame when the code scanning device is used for scanning the freight bill bar code. And finally, establishing a corresponding relation between the video frame shot by the monitoring equipment containing the second visual characteristic information and the waybill bar code information so as to find the video frame corresponding to the waybill bar code information through the corresponding relation later.
The embodiment of the invention also provides an electronic device, as shown in fig. 10, which comprises a processor 1001, a communication interface 1002, a memory 1003 and a communication bus 1004, wherein the processor 1001, the communication interface 1002 and the memory 1003 complete communication with each other through the communication bus 1004,
a memory 1003 for storing a computer program;
the processor 1001 is configured to implement the above-mentioned physical distribution information collecting method step and/or the above-mentioned video searching method step according to the second aspect when executing the program stored in the memory 1003.
For example, the following steps may be implemented:
inquiring first visual characteristic information corresponding to the device identification information when receiving the device identification information and the waybill bar code information sent by the code scanning device, wherein the device identification information and the first visual characteristic information have a pre-established one-to-one correspondence;
acquiring second visual characteristic information obtained by carrying out characteristic analysis on video frames shot by monitoring equipment, wherein the video frames shot by the monitoring equipment are video frames when the cargo bill bar codes are scanned;
and when the second visual characteristic information is the same as the first visual characteristic information, establishing a corresponding relation between the video frame containing the second visual characteristic information and the waybill barcode information.
For another example, the following steps may also be implemented:
acquiring the bar code information of the to-be-queried freight bill;
and inquiring the video frames corresponding to the to-be-inquired waybill bar code information in a plurality of pre-stored video frames based on a preset corresponding relation, wherein the preset corresponding relation is the corresponding relation established by adopting any one of the first embodiment to the third embodiment of the logistics information acquisition method in advance.
According to the electronic equipment provided by the embodiment of the invention, when the device identification information and the waybill bar code information sent by the code scanning device are received, the first visual characteristic information corresponding to the device identification information can be inquired, and then the second visual characteristic information obtained by carrying out characteristic analysis on the video frame shot by the monitoring equipment is obtained; therefore, the second visual characteristic information can reflect the visual characteristic information when the code scanning device is used for scanning the freight note bar code in the video frame. After the first visual characteristic information and the second visual characteristic information are obtained, whether the first visual characteristic information is the same as the second visual characteristic information or not can be judged, and when the second visual characteristic information is the same as the first visual characteristic information, the video frame shot by the monitoring equipment can be explained to be the video frame when the code scanning device is used for scanning the freight bill bar code. And finally, establishing a corresponding relation between the video frame shot by the monitoring equipment containing the second visual characteristic information and the waybill bar code information so as to find the video frame corresponding to the waybill bar code information through the corresponding relation later.
Therefore, in the embodiment of the invention, the corresponding relation between the video frame shot by the monitoring equipment and the waybill bar code information is established through the first visual characteristic information and the second visual characteristic information, and the one-to-one correspondence between the code scanning device and the monitoring equipment is not needed, so that the corresponding relation between the waybill bar code and the video frame when the code scanning device scans goods can be established when the code scanning device and the monitoring equipment are not in one-to-one correspondence.
The communication bus mentioned above for the electronic devices may be a peripheral component interconnect standard (Peripheral Component Interconnect, PCI) bus or an extended industry standard architecture (Extended Industry Standard Architecture, EISA) bus, etc. The communication bus may be classified as an address bus, a data bus, a control bus, or the like. For ease of illustration, the figures are shown with only one bold line, but not with only one bus or one type of bus.
The communication interface is used for communication between the electronic device and other devices.
The Memory may include random access Memory (Random Access Memory, RAM) or may include Non-Volatile Memory (NVM), such as at least one disk Memory. Optionally, the memory may also be at least one memory device located remotely from the aforementioned processor.
The processor may be a general-purpose processor, including a central processing unit (Central Processing Unit, CPU), a network processor (Network Processor, NP), etc.; but also digital signal processors (Digital Signal Processing, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), field programmable gate arrays (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.
The embodiment of the invention also provides a computer readable storage medium, wherein a computer program is stored in the computer readable storage medium, and the computer program realizes the steps of the logistics information acquisition method and/or the steps of the video searching method in the second aspect when being executed by a processor.
For example, the following steps may be implemented:
inquiring first visual characteristic information corresponding to the device identification information when receiving the device identification information and the waybill bar code information sent by the code scanning device, wherein the device identification information and the first visual characteristic information have a pre-established one-to-one correspondence;
acquiring second visual characteristic information obtained by carrying out characteristic analysis on video frames shot by monitoring equipment, wherein the video frames shot by the monitoring equipment are video frames when the cargo bill bar codes are scanned;
And when the second visual characteristic information is the same as the first visual characteristic information, establishing a corresponding relation between the video frame containing the second visual characteristic information and the waybill barcode information.
For another example, the following steps may also be implemented:
acquiring the bar code information of the to-be-queried freight bill;
and inquiring the video frames corresponding to the to-be-inquired waybill bar code information in a plurality of pre-stored video frames based on a preset corresponding relation, wherein the preset corresponding relation is the corresponding relation established by adopting any one of the first embodiment to the third embodiment of the logistics information acquisition method in advance.
The embodiment of the invention provides a computer readable storage medium, which can inquire first visual characteristic information corresponding to device identification information when receiving the device identification information and the waybill bar code information sent by a code scanning device, and then acquire second visual characteristic information obtained by carrying out characteristic analysis on video frames shot by monitoring equipment, wherein the video frames shot by the monitoring equipment are video frames when the waybill bar code is scanned; therefore, the second visual characteristic information can reflect the visual characteristic information when the code scanning device is used for scanning the freight note bar code in the video frame. After the first visual characteristic information and the second visual characteristic information are obtained, whether the first visual characteristic information is the same as the second visual characteristic information or not can be judged, and when the second visual characteristic information is the same as the first visual characteristic information, the video frame shot by the monitoring equipment can be explained to be the video frame when the code scanning device is used for scanning the freight bill bar code. And finally, establishing a corresponding relation between the video frame shot by the monitoring equipment containing the second visual characteristic information and the waybill bar code information so as to find the video frame corresponding to the waybill bar code information through the corresponding relation later.
Therefore, in the embodiment of the invention, the corresponding relation between the video frame shot by the monitoring equipment and the waybill bar code information is established through the first visual characteristic information and the second visual characteristic information, and the one-to-one correspondence between the code scanning device and the monitoring equipment is not needed, so that the corresponding relation between the waybill bar code and the video frame when the code scanning device scans goods can be established when the code scanning device and the monitoring equipment are not in one-to-one correspondence.
It is noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
In this specification, each embodiment is described in a related manner, and identical and similar parts of each embodiment are all referred to each other, and each embodiment mainly describes differences from other embodiments. In particular, for system embodiments, since they are substantially similar to method embodiments, the description is relatively simple, as relevant to see a section of the description of method embodiments.
The foregoing description is only of the preferred embodiments of the present invention and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention are included in the protection scope of the present invention.

Claims (9)

1. The logistics information acquisition method is characterized by comprising the following steps:
inquiring first visual characteristic information corresponding to the device identification information when receiving the device identification information and the waybill barcode information sent by the code scanning device, wherein the device identification information and the first visual characteristic information have a pre-established one-to-one correspondence, and the first visual characteristic information is pre-established human visual characteristic information of a worker corresponding to the device identification information or visual characteristic information of the code scanning device;
Acquiring second visual characteristic information obtained by characteristic analysis of staff or a code scanning device in a video frame shot by monitoring equipment, wherein the video frame shot by the monitoring equipment is a video frame when a cargo bill bar code is scanned;
and when the second visual characteristic information is the same as the first visual characteristic information, establishing a corresponding relation between the video frame containing the second visual characteristic information and the waybill bar code information.
2. The method according to claim 1, wherein the obtaining the second visual feature information obtained by performing feature analysis on the video frame shot by the monitoring device includes:
acquiring a plurality of groups of second visual characteristic information obtained by carrying out characteristic analysis on a plurality of video frames shot by a plurality of monitoring devices, wherein each video frame corresponds to one group of second visual characteristic information;
when the second visual feature information is the same as the first visual feature information, establishing a corresponding relation between the video frame containing the second visual feature information and the waybill barcode information, including:
determining second visual characteristic information which is the same as the first visual characteristic information in the plurality of groups of second visual characteristic information;
And establishing a corresponding relation between the video frame containing the second visual characteristic information which is the same as the first visual characteristic information and the waybill bar code information.
3. The method of claim 2, wherein the waybill barcode information carries a barcode scanning time, and the video frames shot by the monitoring device carry a video frame shooting time;
the obtaining a plurality of groups of second visual characteristic information obtained by performing characteristic analysis on a plurality of video frames shot by a plurality of monitoring devices comprises the following steps:
acquiring at least one candidate video frame of which the time difference between the video frame shooting time and the code scanning time is smaller than a preset time difference from a plurality of video frames shot by the monitoring equipment;
performing feature analysis on each candidate video frame to obtain second visual feature information of each candidate video frame;
the determining, in the plurality of sets of second visual feature information, second visual feature information identical to the first visual feature information includes:
and determining second visual characteristic information which is the same as the first visual characteristic information in the second visual characteristic information of each candidate video frame.
4. The method of claim 1, wherein the establishing a correspondence between the video frame containing the second visual characteristic information and the waybill barcode information comprises:
Acquiring screen display (OSD) information corresponding to the waybill bar code information;
and superposing the OSD information on the video stream containing the second visual characteristic information to obtain a video stream superposed with the OSD information, and establishing the index of the waybill bar code information and the video stream containing the second visual characteristic information and superposed with the OSD information.
5. A video search method, the method comprising:
acquiring the bar code information of the to-be-queried freight bill;
inquiring a video frame corresponding to the to-be-inquired waybill bar code information in a plurality of pre-stored video frames based on a preset corresponding relation, wherein the preset corresponding relation is a corresponding relation established by adopting the logistics information acquisition method according to any one of claims 1-3 in advance.
6. The method of claim 5, wherein the querying the video frame corresponding to the waybill barcode information to be queried among a plurality of pre-stored video frames based on a preset correspondence, comprises:
and inquiring a video frame corresponding to the to-be-inquired waybill bar code information in a plurality of pre-stored video frames based on a pre-established index, wherein the pre-established index is an index established by adopting the logistics information acquisition method of claim 4 in advance.
7. A logistic information acquisition device, characterized in that the device comprises:
the inquiry module is used for inquiring first visual characteristic information corresponding to the device identification information when receiving the device identification information and the waybill barcode information sent by the code scanning device, wherein the device identification information and the first visual characteristic information have a one-to-one correspondence established in advance, and the first visual characteristic information is human visual characteristic information of a worker corresponding to the device identification information or visual characteristic information of the code scanning device;
the characteristic information acquisition module is used for acquiring second visual characteristic information obtained by characteristic analysis of staff or a code scanning device in a video frame shot by the monitoring equipment, wherein the video frame shot by the monitoring equipment is a video frame when a cargo bill bar code is scanned;
and the corresponding relation establishing module is used for establishing a corresponding relation between the video frame containing the second visual characteristic information and the waybill bar code information when the second visual characteristic information is the same as the first visual characteristic information.
8. A video search device, the device comprising:
The waybill bar code information acquisition module is used for acquiring the to-be-inquired waybill bar code information;
the searching module is used for searching video frames corresponding to the to-be-searched waybill bar code information in a plurality of pre-stored video frames based on a preset corresponding relation, wherein the preset corresponding relation is a corresponding relation established by adopting the logistics information acquisition method of any one of claims 1-3 in advance.
9. The electronic equipment is characterized by comprising a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory are communicated with each other through the communication bus;
a memory for storing a computer program;
a processor for carrying out the method steps of any one of claims 1 to 4 and/or 5 to 6 when executing a program stored on a memory.
CN201910544347.5A 2019-06-21 2019-06-21 Logistics information acquisition method, video search method, device and electronic equipment Active CN112116283B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910544347.5A CN112116283B (en) 2019-06-21 2019-06-21 Logistics information acquisition method, video search method, device and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910544347.5A CN112116283B (en) 2019-06-21 2019-06-21 Logistics information acquisition method, video search method, device and electronic equipment

Publications (2)

Publication Number Publication Date
CN112116283A CN112116283A (en) 2020-12-22
CN112116283B true CN112116283B (en) 2024-04-09

Family

ID=73795338

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910544347.5A Active CN112116283B (en) 2019-06-21 2019-06-21 Logistics information acquisition method, video search method, device and electronic equipment

Country Status (1)

Country Link
CN (1) CN112116283B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113190194A (en) * 2021-04-22 2021-07-30 杭州腾纵科技有限公司 Method and device for displaying video monitoring information

Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN203982448U (en) * 2013-12-30 2014-12-03 同方威视技术股份有限公司 A kind of visualized system of logistic article
CN104766102A (en) * 2014-01-02 2015-07-08 曲立东 Waybill-free express goods identification system based on data labels
WO2017113576A1 (en) * 2015-12-31 2017-07-06 杭州海康威视数字技术股份有限公司 Image processing method, system, image acquisition apparatus and server
CN106934330A (en) * 2015-12-31 2017-07-07 杭州海康威视系统技术有限公司 Logistics information acquisition method, platform, system and image capture device
CN107330660A (en) * 2017-07-25 2017-11-07 杭州纳戒科技有限公司 Shared box for material circulation management system and method
KR20180009330A (en) * 2017-12-28 2018-01-26 에스지생활안전 주식회사 System and method for tracking products
CN107993032A (en) * 2016-10-27 2018-05-04 苏宁云商集团股份有限公司 The monitoring method and system of a kind of packaging process
CN108564325A (en) * 2018-04-18 2018-09-21 上海钊易数码科技有限公司 Logistics visualization system and method
CN109034699A (en) * 2018-07-25 2018-12-18 广州倚天网络科技有限公司 A kind of intelligent marketing system based on multiple network technology
CN109472176A (en) * 2018-10-16 2019-03-15 江苏天通设备科技有限公司 A kind of logistics package bar code scanning system based on digital picture
KR101968543B1 (en) * 2018-11-02 2019-04-12 정희섭 Video data management apparatus for tracking the damage history of the shipment and operating method thereof
CN109657760A (en) * 2019-01-11 2019-04-19 成都铀链科技有限公司 Information collection Verification System and method based on Internet of Things Yu block chain
CN110443551A (en) * 2019-08-08 2019-11-12 上海中通吉网络技术有限公司 Express delivery tracking, electronic equipment and express delivery management system
CN110537189A (en) * 2017-11-14 2019-12-03 深圳市海柔创新科技有限公司 A kind of transfer robot and the picking method based on transfer robot
CN112036785A (en) * 2020-07-14 2020-12-04 浙江大工新能源有限公司 Logistics data monitoring processing method, device and system

Patent Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN203982448U (en) * 2013-12-30 2014-12-03 同方威视技术股份有限公司 A kind of visualized system of logistic article
CN104766102A (en) * 2014-01-02 2015-07-08 曲立东 Waybill-free express goods identification system based on data labels
WO2017113576A1 (en) * 2015-12-31 2017-07-06 杭州海康威视数字技术股份有限公司 Image processing method, system, image acquisition apparatus and server
CN106934330A (en) * 2015-12-31 2017-07-07 杭州海康威视系统技术有限公司 Logistics information acquisition method, platform, system and image capture device
CN107993032A (en) * 2016-10-27 2018-05-04 苏宁云商集团股份有限公司 The monitoring method and system of a kind of packaging process
CN107330660A (en) * 2017-07-25 2017-11-07 杭州纳戒科技有限公司 Shared box for material circulation management system and method
CN110537189A (en) * 2017-11-14 2019-12-03 深圳市海柔创新科技有限公司 A kind of transfer robot and the picking method based on transfer robot
KR20180009330A (en) * 2017-12-28 2018-01-26 에스지생활안전 주식회사 System and method for tracking products
CN108564325A (en) * 2018-04-18 2018-09-21 上海钊易数码科技有限公司 Logistics visualization system and method
CN109034699A (en) * 2018-07-25 2018-12-18 广州倚天网络科技有限公司 A kind of intelligent marketing system based on multiple network technology
CN109472176A (en) * 2018-10-16 2019-03-15 江苏天通设备科技有限公司 A kind of logistics package bar code scanning system based on digital picture
KR101968543B1 (en) * 2018-11-02 2019-04-12 정희섭 Video data management apparatus for tracking the damage history of the shipment and operating method thereof
CN109657760A (en) * 2019-01-11 2019-04-19 成都铀链科技有限公司 Information collection Verification System and method based on Internet of Things Yu block chain
CN110443551A (en) * 2019-08-08 2019-11-12 上海中通吉网络技术有限公司 Express delivery tracking, electronic equipment and express delivery management system
CN112036785A (en) * 2020-07-14 2020-12-04 浙江大工新能源有限公司 Logistics data monitoring processing method, device and system

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
基于条形码识别的物流包裹自动分拣系统设计;王昆;刘晓山;;洛阳理工学院学报(自然科学版)(第02期);全文 *

Also Published As

Publication number Publication date
CN112116283A (en) 2020-12-22

Similar Documents

Publication Publication Date Title
CN106934330B (en) Logistics information acquisition method, platform and system and image acquisition equipment
US10410171B2 (en) System and method for inventory management
US20180120408A1 (en) Method, system, and processing server for determining track information of target person
US9477891B2 (en) Surveillance system and method based on accumulated feature of object
US20230020493A1 (en) Mechanism for video review at a self-checkout terminal
CN103916626A (en) Monitoring video information providing method and device and video monitoring system
CN106302477A (en) A kind of net cast method of testing and system
CN112116283B (en) Logistics information acquisition method, video search method, device and electronic equipment
CN110619308A (en) Aisle sundry detection method, device, system and equipment
CN110620988A (en) Information reporting method, device and equipment
CN111832983A (en) Detection method, device and system for asset entry information
US20230156161A1 (en) Failure identification and handling method, and system
CN111369703A (en) Online time determination method, device, server and medium
CN109063855A (en) Aid in treatment method and device for the identification of vehicle vehicle condition
CN113920750B (en) Information obtaining method, system, device, electronic equipment and program product
US10095714B2 (en) Mobile device capable of offline and online synchronous image identifying, an image identifying system, and a storage medium for the same
CN115456984A (en) High-speed image recognition defect detection system based on two-dimensional code
CN112116035B (en) Logistics information acquisition method and device, electronic equipment and storage medium
CN110493818B (en) Detection method and device of wireless fidelity module, storage medium and electronic device
CN111698413B (en) Object image acquisition method and device and electronic equipment
CN115564700A (en) Image processing method and system, storage medium, and electronic device
EP3635610A1 (en) Data collection systems and methods to capture images of and decode information from machine-readable symbols
CN107993130B (en) Service processing method and system and electronic equipment
CN104515862A (en) Automatic optical inspection method and automatic optical inspection system for implementing same
CN111160330A (en) Training method for improving image recognition accuracy with assistance of electronic tag recognition

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant