WO2022022451A1 - 快递柜监控方法、装置、电子设备及存储介质 - Google Patents

快递柜监控方法、装置、电子设备及存储介质 Download PDF

Info

Publication number
WO2022022451A1
WO2022022451A1 PCT/CN2021/108415 CN2021108415W WO2022022451A1 WO 2022022451 A1 WO2022022451 A1 WO 2022022451A1 CN 2021108415 W CN2021108415 W CN 2021108415W WO 2022022451 A1 WO2022022451 A1 WO 2022022451A1
Authority
WO
WIPO (PCT)
Prior art keywords
warehouse
image
state image
goods
process node
Prior art date
Application number
PCT/CN2021/108415
Other languages
English (en)
French (fr)
Inventor
徐婷
程伟兵
Original Assignee
深圳市丰巢科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市丰巢科技有限公司 filed Critical 深圳市丰巢科技有限公司
Publication of WO2022022451A1 publication Critical patent/WO2022022451A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/08—Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
    • G06Q10/083—Shipping
    • G06Q10/0833—Tracking
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/018—Certifying business or products
    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07F—COIN-FREED OR LIKE APPARATUS
    • G07F17/00—Coin-freed apparatus for hiring articles; Coin-freed facilities or services
    • G07F17/10—Coin-freed apparatus for hiring articles; Coin-freed facilities or services for means for safe-keeping of property, left temporarily, e.g. by fastening the property
    • G07F17/12—Coin-freed apparatus for hiring articles; Coin-freed facilities or services for means for safe-keeping of property, left temporarily, e.g. by fastening the property comprising lockable containers, e.g. for accepting clothes to be cleaned
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/30—Computing systems specially adapted for manufacturing

Definitions

  • the present application relates to the technical field of logistics monitoring, for example, to a method, device, electronic device and storage medium for monitoring express cabinets.
  • the express locker is a temporary storage place for the user to store the goods.
  • the process of using the express cabinet includes the delivery operation and the pickup operation of the goods.
  • the customer service personnel need to make a retrospective inquiry on the order complained by the customer.
  • the usual query method is that the customer service personnel query the order by contacting the courier or querying the outbound record of the courier cabinet, and the retrospective query efficiency of the order is low.
  • the present application provides a method, device, electronic device and storage medium for monitoring express cabinets, so as to improve the efficiency of traceability and inquiry of orders.
  • the present application provides a method for monitoring express cabinets, including:
  • the warehouse status image and the process nodes of the warehouse status image are fed back to the customer service personnel, so that the customer service personnel can trace the goods.
  • the application also provides a monitoring device for express cabinets, including:
  • the image acquisition module is set to acquire the warehouse status image when the warehouse door is opened or closed according to the preset process node of the order information
  • the storage module is set to store the warehouse state image and the process node for obtaining the warehouse state image
  • the feedback module is set to feed back the warehouse status image and the process node of the warehouse status image to the customer service personnel when the tracking of the order information is triggered, so that the customer service personnel can trace the goods.
  • the present application also provides an electronic device, including a memory, a processor, and a computer program stored on the memory and running on the processor, where the processor implements the above-mentioned method for monitoring express cabinets when the program is executed.
  • the present application also provides a storage medium containing computer-executable instructions, and the computer-executable instructions, when executed by a computer processor, are used to execute the above-mentioned express locker monitoring method.
  • FIG. 1 is a flowchart of a method for monitoring express cabinets provided in Embodiment 1 of the present application;
  • FIG. 2 is a schematic structural diagram of an express cabinet monitoring device provided in Embodiment 2 of the present application.
  • FIG. 3 is a schematic structural diagram of an electronic device according to Embodiment 3 of the present application.
  • Embodiment 1 is a flow chart of a method for monitoring express delivery cabinets provided in Embodiment 1 of the present application. This embodiment is applicable to the situation of tracing goods in express delivery cabinets.
  • the method can be executed by an intelligent express delivery cabinet, and includes the following steps:
  • Step 110 in the case of opening or closing the warehouse door according to the preset process node of the order information, obtain a warehouse state image.
  • the order information involved in the express locker is that one item needs to be stored in the express locker.
  • the preset process nodes involved in the order information include the delivery stage and the pickup stage.
  • the delivery stage can be the process in which the courier stores the goods in the express cabinet through the delivery port.
  • the pickup stage may be a process of picking up the goods stored in the express cabinet through the pickup port.
  • the express cabinet may be designed to receive the goods put in by the courier through the delivery port, and use an automated mechanical structure to automatically allocate the storage location and space of the goods.
  • the pickup operation is triggered, the goods are moved from the storage rack to the pickup port.
  • the footprint of the express cabinet in the present application is smaller than that of the traditional intelligent express cabinet, which is the development trend of the intelligent express cabinet.
  • the courier scans the code to store the items through the application (Application, APP) set on the display screen of the express cabinet, and generates an order, which is used to store the information of the goods.
  • the node that is about to open the door of the delivery port is the first process node.
  • the delivery port warehouse door is opened.
  • the courier puts the goods into the delivery port, and the delivery port warehouse door is closed.
  • the node after the warehouse door of the delivery port is closed is the second process node.
  • the goods will be continuously stored on the shelves inside the express cabinet.
  • the user goes to the express locker to pick up the goods, it enters the pickup stage.
  • the node at which the warehouse door of the pickup port is about to be opened is the third process node.
  • the user takes the goods from the pickup port.
  • the door to the pickup port is closed.
  • the node after the warehouse door of the pickup port is closed is the fourth process node. In the above four process nodes, the corresponding state images are obtained through the camera respectively.
  • the first state image Before opening the warehouse door of the delivery port in the delivery stage, the first state image is acquired.
  • the second state image is acquired after closing the door of the delivery port in the delivery stage.
  • a third state image is acquired before the door of the pickup port is opened during the pickup phase.
  • the fourth state image is acquired after the door of the pickup port is closed during the pickup phase.
  • the pick-up port and the delivery port may be the same delivery port.
  • the delivery port is the delivery port
  • the delivery port is the pick-up port.
  • a camera A can be set above the transport interface.
  • the first state image is obtained through the camera A.
  • the second state image is obtained through the camera A.
  • a third state image is obtained through the camera A.
  • a fourth state image is obtained through the camera A.
  • the pickup port and the delivery port may be two different delivery interfaces.
  • the delivery port is set to be used by couriers to deliver goods.
  • the pick-up port is set to face users for picking up goods.
  • one camera B can be set above the delivery port
  • another camera C can be set above the pickup port.
  • a first state image is obtained through the camera B.
  • the camera B acquires the second state image.
  • a third state image is obtained through the camera C.
  • a fourth state image is obtained through the camera C.
  • the express cabinet may include shelves of different specifications, which are set to store goods of different specifications. After acquiring the second state image, first size information of the goods is determined according to the first state image and the second state image; a target rack with matching size is determined according to the first size information; and the goods are transported to the target rack for storage.
  • the first state image is an image in the delivery port when no goods are put in
  • the second state image is an image in the delivery port after the goods are put in the delivery port.
  • the first size information of the cargo can be determined by comparing the first state image and the second state image.
  • the first size information is matched with the goods specifications suitable for the shelves provided by the express cabinet, a target shelf suitable for storing the goods of the first size information is determined, and the goods are transported to a position on the target shelf for storage. Further, it is possible to determine a suitable target shelf for storage according to the first size information of the goods, thereby storing the goods more efficiently and improving the storage space utilization rate of the express cabinet.
  • the acquisition of the third state image can be implemented in the following manner: in the pickup stage, the location where the goods are located is determined according to the order information.
  • Target shelf transport the goods on the target shelf to the pick-up port; acquire the third state image in the pick-up port, and open the warehouse door of the pick-up port.
  • acquiring the fourth state image after the warehouse door of the pickup port is closed in the pickup phase can be implemented in the following manner: in the pickup phase, after the warehouse door of the pickup port is closed, the fourth state image is acquired.
  • the QR code provided by the user equipment is a QR code generated by the courier after storing the goods in the express cabinet, and the storage location indication sent by the express cabinet.
  • the express cabinet obtains the order information, it determines the position on the target shelf where the goods corresponding to the order information are located, and moves the goods on the target shelf to the pick-up port.
  • a third state image is acquired.
  • the third state image is used to represent the state of the goods in the express locker before the user picks up the goods.
  • open the warehouse door of the pickup port After the user takes away the goods in the pickup port, the warehouse door of the pickup port is closed. After the warehouse door of the pickup port is closed, as the fourth process node, the fourth state image is acquired.
  • the warehouse state images captured by the depth camera include color images and depth images.
  • the color image may be a Red-Green-Blud (RGB) image.
  • the second size information of the object in the depth image may be calculated according to the depth parameter provided by the depth image.
  • the second size information can be calculated by using an existing algorithm, and details are not described here.
  • the second size information represents the size of the object in the image. If the second size information is greater than the preset size threshold, it indicates that the object is a missing cargo. If there are missing goods, carry out goods leftover feedback. For example, continue to reserve the storage space used by the leftover goods, and prompt the user to return to pick up the leftover goods. If the second size information is smaller than the preset size threshold, it means that the object is a sundry, and the storage space of the goods is released.
  • the second size information of the object can be calculated according to the depth image captured by the depth camera. According to the second size information, it can be determined whether the residual objects are residual goods, so as to avoid identifying debris such as discarded paper balls as residual goods, triggering unnecessary logistics processes, and avoiding unnecessary waste of manpower and material resources.
  • Calculating the second size information according to the depth image requires a certain amount of computing power.
  • the depth image can be sent to the image processing server, so that the image processing server can determine the second size information according to the depth image; Size Information.
  • the above-mentioned first size information may be calculated according to the depth images obtained by the first process node and the second process node.
  • the first size information may be calculated locally in the express cabinet, or the depth images obtained by the first process node and the second process node may be sent to the image processing server, and the first size information fed back by the image server may be received.
  • the image processing server has a faster calculation speed, and the image processing server can quickly and stably feed back the second size information to the express cabinet, thereby improving the calculation efficiency.
  • Step 120 Store the warehouse state image and acquire the process node of the warehouse state image.
  • Color and depth images can be captured at all four process nodes. And store color images and depth images in the order information directory. Color images, depth images, and process node identifications can be stored as key-value pairs in the order information catalog. For example, at the end of the first process node, the order information catalog includes (color image A, depth image A, first process node identifier A) key-value pairs. At the end of the second process node, the order information catalog includes key-value pairs of (color image A, depth image A, first process node identifier A), (color image B, depth image B, second process node identifier B) .
  • the order information catalog includes (color image A, depth image A, first process node identifier A), (color image B, depth image B, second process node identifier B), (color image C, the depth image C, the key-value pair of the second process node identifier C).
  • the order information directory includes (color image A, depth image A, first process node identifier A), (color image B, depth image B, second process node identifier B), (color image C, the depth image C, the second process node identifier C), the key-value pair of (color image D, the depth image D, the second process node identifier D).
  • Step 130 When the tracking of the order information is triggered, the warehouse status image and the process nodes of the warehouse status image are fed back to the customer service personnel, so that the customer service personnel can trace the goods.
  • the user When there is a dispute in the logistics of goods, the user will contact the customer service, and the customer service needs to provide the user with an accurate problem node, which triggers the tracking of the order information. For example, the user indicates that there is no goods in the express cabinet, and the courier indicates that the goods have been put into the express cabinet. At this time, the user will contact the customer service, and the customer service needs to provide the user with the process link of the problem.
  • the customer service obtains the warehouse status images of multiple preset process nodes by obtaining the data in the order information directory in the express cabinet, and analyzes the problematic process nodes according to the warehouse status images.
  • the customer service terminal initiates a tracking request through the background server, and the tracking request carries the order information; searches for the warehouse status image and process node corresponding to the order information according to the order information; The process nodes are fed back to the customer service terminal, so that the customer service personnel can trace the goods according to the warehouse status image displayed by the customer service terminal and the process nodes of the warehouse status image.
  • the warehouse state image when the warehouse door is opened or closed according to the preset process node of the order information, the warehouse state image is obtained; the warehouse state image is stored and the process node for obtaining the warehouse state image; when triggering the tracking of the order information
  • the customer service staff can trace the goods.
  • the warehouse state image can record the state of the warehouse when the warehouse door is opened or closed at the preset process node.
  • the express cabinet can provide the customer service staff with the warehouse status image of the preset process node, and then efficiently restore the status of the goods in the warehouse, so that the customer service staff can quickly locate the problem process node and improve the order. Retrospective query efficiency.
  • Step 1 The courier places the order through the APP on the display of the express cabinet.
  • Step 2 The order signal is transmitted to the industrial computer in the express cabinet for processing, and the industrial computer sends a signal to a programmable logic controller (PLC) for step 3.
  • PLC programmable logic controller
  • Step 3 The PLC sends an instruction to control the pickup mechanism in the express cabinet to take the pallet, and take the empty pallet to the delivery port; after the pallet transportation is completed, the PLC controls the depth camera to take pictures of the first process node, and takes pictures of the empty pallet. Take background photos and measurements to generate a first state image.
  • the first state image includes a color image (RGB map) and a depth image.
  • the depth image is uploaded to the image processing server in the cloud, and the image processing server sends the size of the item in the first state image back to the local express cabinet through the local router.
  • the express cabinet stores the first state image to the local hard disk.
  • Step 4 After the first state image is photographed, the PLC controls the warehouse door on the express cabinet to open.
  • the warehouse door is generally slidably installed on the warehouse cabinet, and the warehouse door is moved by the synchronous belt mechanism to realize the opening and closing of the warehouse door, and the synchronous belt
  • the drive motor of the mechanism is electrically connected with the PLC.
  • the courier delivers the goods to the delivery port.
  • the courier needs to click on the APP of the express cabinet to confirm the completion of the delivery.
  • the industrial computer receives the signal and transmits it to the PLC, and the PLC controls the synchronous belt mechanism to close the warehouse door again.
  • Step 5 After closing the warehouse door, the sensor set on the warehouse door, such as a slot photoelectric sensor, will feedback a signal to the PLC, and the PLC will send a signal to the depth camera again to take a photo of the second process node and generate a second state image.
  • the second state image includes a color image (RGB map) and a depth image.
  • the depth image is uploaded to the image processing server in the cloud, and the image processing server sends the size of the item in the second state image back to the local express cabinet through the local router.
  • the express cabinet stores the second state image on the local hard disk.
  • Step 6 After the photographing is completed, the PLC compares and subtracts the second state image obtained by the second photographing and the first state image obtained by the first photographing, calculates the first size information of the goods, that is, the volume, and then controls the The pick-up agency allocates the goods to the corresponding storage shelves, so as to realize the reasonable distribution of the goods storage space and save the storage space in the warehouse as much as possible. After the goods are stored in the proper location, the pickup mechanism stops working.
  • Step 7 The customer picks up the package and clicks the APP on the main screen of the express cabinet to pick up the package.
  • the package can be picked up by the pick-up code or scan code.
  • the industrial computer sends a signal to the PLC, and the PLC controls the pick-up agency to pick up the goods of the corresponding order.
  • the PLC sends a signal to the depth camera again to take pictures of the third process node and generate a third state image.
  • the third state image includes a color image (RGB map) and a depth image.
  • the depth image is uploaded to the image processing server in the cloud, and the image processing server sends the result of calculating the size of the item in the third state image back to the local express cabinet through the local router.
  • the express cabinet stores the third state image on the local hard disk, and the third state image represents the state in which the goods stored in the warehouse are delivered to the delivery port.
  • Step 8 After the pickup mechanism stops operating, the PLC controls the synchronous belt mechanism to open the warehouse door. After the customer finishes picking up the items, click on the APP to confirm the completion of the pickup, and the PLC controls the synchronous belt mechanism to close the warehouse door again.
  • the photoelectric The sensor sends a signal to the depth camera to take a picture of the fourth process node to generate a fourth state image.
  • the fourth state image includes a color image (RGB map) and a depth image.
  • the depth image is uploaded to the image processing server in the cloud, and the image processing server sends the item size in the fourth state image back to the local express cabinet through the local router.
  • the express cabinet stores the fourth state image to the local hard disk.
  • the function of taking pictures at the fourth process node is to facilitate checking whether the goods are completely taken away and whether there are any omissions.
  • the size of the item in the fourth state image is the second size information.
  • the customer service can find out the problem by querying the records of the status images generated by the above process.
  • the customer service queries the order number signal through the background, and the background is remotely connected to the express cabinet through the 4th Generation mobile communication technology (4G) router.
  • 4G 4th Generation mobile communication technology
  • the PLC controller calls The status image in the order information directory in the local hard disk, the 4G router sends the status image data on the local hard disk to the background.
  • the customer service can compare the photos of the delivery port of the order through the mobile phone or computer.
  • the situation of the stored goods can be found, and the visible appearance and size of the stored goods can be queried, avoiding the airdrop disputes of the courier; by comparing the second state image and In the third state image, it can be found whether the goods are lost in the warehouse. If the goods in the third state image are less than those in the second state image, it can be judged that the goods fell into the warehouse during the transportation of the warehouse; With the three-state image and the fourth-state image, the pickup status can be found. If there are still goods on the fourth-state image, it means that the customer forgot to pick up or missed some parts. At the same time, by calling the depth dimension, it can be analyzed that the remaining items are The cargo package is also foreign object garbage.
  • the size of the item in the depth image is obtained by calculating the depth image, and the size of the item is returned to the local through the router. By comparing the size of the item with the preset size threshold, the remaining foreign matter paper balls or pieces of paper in the tray can be removed.
  • the cabinet machine will not send the residual information of the goods to the background, which avoids the pallet space not being released and the background information alarm caused by the foreign objects not being taken, and reduces unnecessary operation and maintenance. times, saving labor costs.
  • the residual items are not within the foreign matter value range, the residual items are identified as cargo residues, and an alarm message will be sent to the background, and the operation and maintenance or customer service can send the information to the customer to prompt the incomplete pickup.
  • the express cabinet monitoring method provided by the embodiment of the present application can quickly and comprehensively check the entire status of the access to express goods, and realize rapid response of monitoring and analysis.
  • the introduction of in-depth photos makes it easier to check the size of the stored goods and assist in the analysis of foreign matter residues in the warehouse.
  • FIG. 2 is a schematic structural diagram of an express cabinet monitoring device provided in Embodiment 2 of the present application.
  • the device is located in an intelligent express cabinet and includes an image acquisition module 210 , a storage module 220 and a feedback module 230 .
  • the image acquisition module 210 is configured to acquire the warehouse state image when the warehouse door is opened or closed according to the preset process node of the order information;
  • the storage module 220 is configured to store the warehouse state image and the process of acquiring the warehouse state image. node;
  • the feedback module 230 is configured to feed back the warehouse status image and the process node of the warehouse status image to the customer service personnel when the tracking of the order information is triggered, so that the customer service personnel can trace the goods.
  • the image acquisition module 210 is configured to acquire the first state image before opening the warehouse door of the delivery port in the delivery stage; acquire the second state image after closing the warehouse door of the delivery port in the delivery stage; Before the warehouse door, the third state image is acquired; after the warehouse door of the pickup port is closed in the pickup stage, the fourth state image is acquired.
  • the image acquisition module 210 is further configured to determine the first size information of the goods according to the first state image and the second state image; determine the target rack with matching size according to the first size information; and transport the goods to the target rack for storage.
  • the image acquisition module 210 is configured to acquire a third state image before opening the warehouse door of the pickup port in the pickup stage in the following manner: in the pickup stage, determine the target shelf where the goods are located according to the order information; The goods are delivered to the pickup port; the third state image in the pickup port is obtained, and the warehouse door of the pickup port is opened; the image acquisition module 210 is set to obtain the third state image after closing the warehouse door of the pickup port in the pickup stage in the following manner.
  • Four-state image In the pickup stage, after the door of the pickup port is closed, the fourth state image is acquired.
  • the feedback module 230 is configured to search the warehouse status image and the warehouse status image corresponding to the order information according to the order information when the customer service terminal initiates a tracking request carrying the order information through the background server; The received warehouse status image and the process node of the warehouse status image are fed back to the customer service terminal, so that the customer service personnel can trace the goods according to the warehouse status image and the process node of the warehouse status image displayed by the customer service terminal.
  • the warehouse state image includes a color image and a depth image; the image acquisition module 210 is configured to capture the color image and the depth image; the image acquisition module 210 is also configured to acquire the second size information of the object in the depth image according to the depth image; The size information determines whether there is a missing cargo; if there is a missing cargo, the cargo leftover feedback is carried out.
  • the image acquisition module 210 is configured to acquire the second size information of the object in the depth image according to the depth image in the following manner: sending the depth image to the image processing server, so that the image processing server determines the second size information according to the depth image; receiving the image processing server Feedback second size information.
  • the express cabinet monitoring device acquires the warehouse state image when the warehouse door is opened or closed according to the preset process node of the order information; stores the warehouse state image and obtains the process node of the warehouse state image; When the tracking of the order information is triggered, the warehouse status image and the process nodes of the warehouse status image are fed back to the customer service staff, so that the customer service staff can trace the goods.
  • the warehouse state image can record the state of the warehouse when the warehouse door is opened or closed at the preset process node.
  • the express cabinet can provide the customer service staff with the warehouse status image of the preset process node, and then efficiently restore the status of the goods in the warehouse, so that the customer service staff can quickly locate the problem process node and improve the order. Retrospective query efficiency.
  • FIG. 3 is a schematic structural diagram of an electronic device provided in Embodiment 3 of the present application.
  • the electronic device includes a processor 30, a memory 31, an input device 32, and an output device 33;
  • the number can be one or more, and one processor 30 is taken as an example in FIG. 3;
  • the processor 30, the memory 31, the input device 32 and the output device 33 in the electronic device can be connected by a bus or in other ways. Take bus connection as an example.
  • the memory 31 can be configured to store software programs, computer-executable programs, and modules, such as program instructions/modules corresponding to the express cabinet monitoring method in the embodiments of the present application (for example, in the express cabinet monitoring device).
  • the processor 30 executes various functional applications and data processing of the electronic device by running the software programs, instructions and modules stored in the memory 31 , that is, the above-mentioned method for monitoring express cabinets is implemented.
  • the memory 31 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to the use of the terminal, and the like.
  • the memory 31 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid-state storage device.
  • memory 31 may include memory located remotely from processor 30, which may be connected to the electronic device through a network. Examples of such networks include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.
  • the input device 32 may be configured to receive input numerical or character information, and to generate key signal input related to user settings and function control of the electronic device.
  • the output device 73 may include a display device such as a display screen.
  • the fourth embodiment of the present application also provides a storage medium containing computer-executable instructions, where the computer-executable instructions are used to execute a method for monitoring express cabinets when executed by a computer processor, and the method includes:
  • the warehouse state image is obtained; the warehouse state image is stored and the process node for obtaining the warehouse state image; when tracking the trigger order information, the warehouse state image is stored.
  • the warehouse status image and the process nodes of the warehouse status image are fed back to the customer service personnel, so that the customer service personnel can trace the goods.
  • the method further includes: determining the first size information of the goods according to the first state image and the second state image; determining a size matching target according to the first size information Shelves; deliver the goods to the target shelf for storage.
  • a third state image including: in the pickup stage, determining the target shelf where the goods are located according to the order information; transporting the old goods on the target shelf to the pickup port; obtaining The third state image in the pickup port opens the warehouse door of the pickup port; correspondingly, after the warehouse door of the pickup port is closed in the pickup stage, a fourth state image is obtained, including: in the pickup stage, at the pickup port After the warehouse door is closed, the fourth state image is acquired.
  • the warehouse status image and the process node information of the warehouse status image are fed back to the customer service personnel, including: when the customer service terminal initiates a tracking request with the order information through the background server, according to the order Information to find the warehouse status image and warehouse status image process nodes corresponding to the order information; feedback the found warehouse status image and warehouse status image process nodes to the customer service terminal through the background server, so that the customer service personnel can display it according to the customer service terminal.
  • the warehouse status image and the process node of the warehouse status image are traced back.
  • the warehouse state image includes a color image and a depth image; acquiring the warehouse state image includes: photographing a color image and a depth image; acquiring second size information of the object in the depth image according to the depth image; determining whether there is missing goods according to the second size information ; If there are missing goods, carry out goods leftover feedback.
  • Acquiring the second size information of the object in the depth image according to the depth image includes: sending the depth image to the image processing server, so that the image processing server determines the second size information according to the depth image; and receiving the second size information fed back by the image processing server.
  • a storage medium containing computer-executable instructions provided by an embodiment of the present application the computer-executable instructions of which are not limited to the above method operations, and can also perform related operations in the express locker monitoring method provided by any embodiment of the present application.
  • the present application can be implemented by means of software and necessary general-purpose hardware, and can also be implemented by hardware.
  • the technical solution of the present application can be embodied in the form of a software product in essence, and the computer software product can be stored in a computer-readable storage medium, such as a floppy disk of a computer, a read-only memory (Read-Only Memory, ROM), a random access A memory (Random Access Memory, RAM), a flash memory (FLASH), a hard disk or an optical disc, etc., including multiple instructions to enable a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the embodiments of the present application.
  • a computer-readable storage medium such as a floppy disk of a computer, a read-only memory (Read-Only Memory, ROM), a random access A memory (Random Access Memory, RAM), a flash memory (FLASH), a hard disk or an optical disc, etc.
  • the multiple units and modules included are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be realized; in addition, the names of the multiple functional units It is only for the convenience of distinguishing from each other, and is not used to limit the protection scope of the present application.

Abstract

本文公开了一种快递柜监控方法、装置、电子设备及存储介质。该快递柜监控方法包括：在根据订单信息的预设流程节点开启或关闭仓门的情况下，获取货仓状态图像；存储货仓状态图像以及获取货仓状态图像的流程节点；在触发对订单信息的追踪的情况下，将货仓状态图像和货仓状态图像的流程节点反馈至客服人员，以便客服人员对货物进行追溯。

Description

快递柜监控方法、装置、电子设备及存储介质
本申请要求在2020年07月27日提交中国专利局、申请号为202010732499.0的中国专利申请的优先权，该申请的全部内容通过引用结合在本申请中。
技术领域
本申请涉及物流监控技术领域，例如涉及一种快递柜监控方法、装置、电子设备及存储介质。
背景技术
快递柜是用户存放货物的临时存放地点。对快递柜的使用过程包括货物的投递操作和取货操作。当客户投诉快递柜中没有货物等问题时，客服人员需要对客户投诉的订单进行追溯查询。通常的查询方式是客服人员通过联系快递员或者查询快递柜的出库记录对订单进行查询，对订单的追溯查询效率低。
发明内容
本申请提供一种快递柜监控方法、装置、电子设备及存储介质，以提高订单的追溯查询效率。
本申请提供了一种快递柜监控方法，包括：
在根据订单信息的预设流程节点开启或关闭仓门的情况下，获取货仓状态图像；
存储货仓状态图像以及获取货仓状态图像的流程节点；
在触发对订单信息的追踪的情况下，将货仓状态图像和货仓状态图像的流程节点反馈至客服人员，以便客服人员对货物进行追溯。
本申请还提供了一种快递柜监控装置，包括：
图像获取模块，设置为在根据订单信息的预设流程节点开启或关闭仓门的情况下，获取货仓状态图像；
存储模块，设置为存储货仓状态图像以及获取货仓状态图像的流程节点；
反馈模块，设置为在触发对订单信息的追踪的情况下，将货仓状态图像和货仓状态图像的流程节点反馈至客服人员，以便客服人员对货物进行追溯。
本申请还提供了一种电子设备，包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序，处理器执行程序时实现上述的快递柜监控方 法。
本申请还提供了一种包含计算机可执行指令的存储介质，计算机可执行指令在由计算机处理器执行时用于执行上述的快递柜监控方法。
附图说明
图1是本申请实施例一提供的一种快递柜监控方法的流程图；
图2是本申请实施例二提供的一种快递柜监控装置的结构示意图；
图3是本申请实施例三提供的一种电子设备的结构示意图。
具体实施方式
下面结合附图和实施例对本申请进行说明。
实施例一
图1是本申请实施例一提供的一种快递柜监控方法的流程图，本实施例可适用于对快递柜中货物进行追溯的情况，该方法可以由智能快递柜来执行，包括如下步骤：
步骤110、在根据订单信息的预设流程节点开启或关闭仓门的情况下，获取货仓状态图像。
快递柜涉及的订单信息为需要在快递柜中存放一个货物。订单信息涉及的预设流程节点包括投放阶段和取件阶段。投放阶段可以为快递员通过投递口将货物存储到快递柜的过程。取件阶段可以为通过取货口领取快递柜中存储的货物的过程。
示例性的，快递柜可以被设计为通过投递口接收快递员放入的货物，利用自动化的机械结构自动分配货物存放位置及空间。当取货操作被触发时，将货物从存放的货架上移动到取货口。本申请中的快递柜的占地面积相比传统的智能快递柜的占地面积要小，是智能快递柜发展的趋势。
快递员通过快递柜的显示屏上设置的应用(Application，APP)进行扫码存件，生成一个订单，该订单用于存放货物信息。在投放阶段，即将打开投递口仓门的节点为第一流程节点。投递口仓门打开，在投放阶段，快递员将货物放入投递口中，投递口仓门关闭。投递口的仓门关闭后的节点为第二流程节点。货物会持续存放在快递柜内的货架上。当用户前往快递柜领取货物时，进入取件阶段。在取件阶段，即将打开取货口的仓门的节点为第三流程节点。取货口的仓门打开后，用户从取货口取走货物。取货口的仓门关闭。取货口的仓门关 闭后的节点为第四流程节点。在上述四个流程节点分别通过摄像机获取相应的状态图像。
在投放阶段开启投递口的仓门之前，获取第一状态图像。在投放阶段关闭投递口的仓门之后，获取第二状态图像。在取件阶段开启取货口的仓门之前，获取第三状态图像。在取件阶段关闭取货口的仓门之后，获取第四状态图像。
在一种实现方式中，取货口和投递口可以为同一个输送接口，在投放阶段，该输送接口为投递口，在取货阶段，输送接口为取货口。此时，可以在该输送接口的上方设置一个摄像机A。在投放阶段开启投递口的仓门之前，即第一流程节点，通过摄像机A获取第一状态图像。在投放阶段关闭投递口的仓门之后，即第二流程节点，通过摄像机A获取第二状态图像。在取件阶段开启取货口的仓门之前，即第三流程节点，通过摄像机A获取第三状态图像。在取件阶段关闭取货口的仓门之后，即第四流程节点，通过摄像机A获取第四状态图像。
在另一种实现方式中，取货口和投递口可以为两个不同的输送接口。投递口设置为面向快递人员进行投递货物使用。取货口设置为面向用户进行领取货物使用。此时，可以在投递口的上方设置一个摄像机B，在取货口的上方设置另一个摄像机C。在投放阶段开启投递口的仓门之前，即第一流程节点，通过摄像机B获取第一状态图像。在投放阶段关闭投递口的仓门之后，即第二流程节点，通过摄像机B获取第二状态图像。在取件阶段开启取货口的仓门之前，即第三流程节点，通过摄像机C获取第三状态图像。在取件阶段关闭取货口的仓门之后，即第四流程节点，通过摄像机C获取第四状态图像。
快递柜可以包括不同规格的货架，设置为存放不同规格的货物。获取第二状态图像之后，根据第一状态图像和第二状态图像，确定货物的第一尺寸信息；根据第一尺寸信息确定尺寸匹配的目标货架；将货物运送至目标货架进行仓储。
第一状态图像为未放入货物时的投递口内的图像，第二状态图像为货物放入投递口后，投递口内的图像。通过比较第一状态图像和第二状态图像可确定货物的第一尺寸信息。将第一尺寸信息与快递柜可提供的货架适配的货物规格进行匹配，确定适于存储第一尺寸信息的货物的目标货架，将货物运送至该目标货架上的一个位置进行仓储。进而实现根据货物的第一尺寸信息确定合适的目标货架进行仓储，进而更加高效地存放货物，提高快递柜的存储空间利用率。
当采用上述结构的快递柜进行取件时，在取件阶段开启取货口的仓门之前，获取第三状态图像，可通过下述方式实施：在取件阶段，根据订单信息确定货物所在的目标货架；将目标货架上的该货物运送至取货口；获取取货口内的第三状态图像，开启取货口的仓门。相应的，在取件阶段关闭取货口的仓门之后，获取第四状态图像，可通过下述方式实施：在取件阶段，在取货口的仓门关闭 之后，获取第四状态图像。
通过扫描用户设备提供的二维码的方式，获取订单信息。用户设备提供的二维码为快递员在将货物存放到快递柜后，由快递柜发送的存储位置标示生成的二维码。快递柜获取订单信息后，确定订单信息对应的货物所在的目标货架上的位置，将目标货架上的货物移动到取货口。当货物移动到取货口时，作为第三流程节点，获取第三状态图像。第三状态图像用于表示用户在取货前货物在快递柜中的状态。获取第三状态图像后，开启取货口的仓门。用户取走取货口中的货物后，关闭取货口的仓门。取货口的仓门关闭后，作为第四流程节点，获取第四状态图像。
拍摄彩色图像和深度图像；根据深度图像获取深度图像中物体的第二尺寸信息；根据第二尺寸信息确定是否存在遗漏货物；若存在遗漏货物，则进行货物遗留反馈。
可以使用深度相机替代上述步骤中的摄像机。深度相机拍摄获取的货仓状态图像包括彩色图像和深度图像。彩色图像可以为红-绿-蓝(Red-Green-Blud，RGB)图像。根据深度图像提供的深度参数可计算深度图像中物体的第二尺寸信息。可使用已有算法计算第二尺寸信息，此处不做赘述。第二尺寸信息表示图像中物体的尺寸。若第二尺寸信息大于预设尺寸阈值，则说明物体为遗漏货物。若存在遗漏货物，则进行货物遗留反馈。例如，继续保留遗留货物使用的存储空间，提示用户返回领取遗留货物。若第二尺寸信息小于预设尺寸阈值，则说明物体为杂物，释放货物的存储空间。
根据深度摄像机拍摄的深度图像能够计算出物体的第二尺寸信息。根据第二尺寸信息可确定残留的物体是否为残留的货物，进而避免将废弃纸团等杂物识别为残留货物，触发不必要的物流流程，避免浪费不必要的人力物力。
根据深度图像计算第二尺寸信息需要一定的计算能力，为了提高处理速度，可以将深度图像发送至图像处理服务器，以便图像处理服务器根据深度图像确定第二尺寸信息；接收图像处理服务器反馈的第二尺寸信息。
可以根据第一流程节点和第二流程节点获取的深度图像计算上述第一尺寸信息。可以在快递柜本地计算第一尺寸信息，也可以将第一流程节点和第二流程节点获取的深度图像发送至图像处理服务器，接收图像服务器反馈的第一尺寸信息。
图像处理服务器相对于快递柜具有更快的计算速度，图像处理服务器能够快速稳定地向快递柜反馈第二尺寸信息，提高计算效率。
步骤120、存储货仓状态图像以及获取货仓状态图像的流程节点。
可以在四个流程节点均拍摄彩色图像和深度图像。并将彩色图像和深度图像存储在订单信息目录中。可以将彩色图像、深度图像和流程节点标识作为键值对存储在订单信息目录中。例如，在第一流程节点结束时，订单信息目录中包括(彩色图像A，深度图像A，第一流程节点标识A)的键值对。在第二流程节点结束时，订单信息目录中包括(彩色图像A，深度图像A，第一流程节点标识A)、(彩色图像B，深度图像B，第二流程节点标识B)的键值对。在第三流程节点结束时，订单信息目录中包括(彩色图像A，深度图像A，第一流程节点标识A)、(彩色图像B，深度图像B，第二流程节点标识B)、(彩色图像C，深度图像C，第二流程节点标识C)的键值对。在第四流程节点结束时，订单信息目录中包括(彩色图像A，深度图像A，第一流程节点标识A)、(彩色图像B，深度图像B，第二流程节点标识B)、(彩色图像C，深度图像C，第二流程节点标识C)、(彩色图像D，深度图像D，第二流程节点标识D)的键值对。随着流程节点的增加，订单信息目录中陆续增加键值对。
步骤130、当触发对订单信息的追踪时，将货仓状态图像和货仓状态图像的流程节点反馈至客服人员，以便客服人员进行货物追溯。
当货物物流发生纠纷时用户会联系客服，客服需要为用户提供准确的问题节点，此时触发对订单信息的追踪。例如用户表示快递柜中没有货物，快递人员表示已将货物放进快递柜。此时用户会联系客服，客服需要为用户提供出问题的流程环节。客服通过获取快递柜中订单信息目录中的数据，得到多个预设流程节点的货仓状态图像，根据货仓状态图像分析出有问题的流程节点。
示例性的，客服终端通过后台服务器发起追踪请求，追踪请求中携带有订单信息；根据订单信息查找订单信息对应的货仓状态图像和流程节点；通过后台服务器将货仓状态图像和货仓状态图像的流程节点反馈至客服终端，以便客服人员根据客服终端显示的货仓状态图像和货仓状态图像的流程节点进行货物追溯。
本申请实施例在根据订单信息的预设流程节点开启或关闭仓门的情况下，获取货仓状态图像；存储货仓状态图像以及获取货仓状态图像的流程节点；当触发对订单信息的追踪时，将货仓状态图像和货仓状态图像的流程节点反馈至客服人员，以便客服人员进行货物追溯。货仓状态图像能够记载在预设流程节点开启或关闭仓门的情况下货仓的状态。当触发对订单信息的追踪时，快递柜可以为客服人员提供预设流程节点的货仓状态图像，进而高效还原货仓内货物的状态，使得客服人员能够快速定位出现问题的流程节点，提高订单追溯查询效率。
下面通过一个示例对上述实施例进行说明：
步骤1：快递员通过快递柜显示屏上的APP下投递订单。
步骤2：订单信号传给快递柜中的工控机进行处理，工控机发送信号给可编程逻辑控制器(Programmable Logic Controller，PLC)进行步骤3。
步骤3：PLC发指令，控制快递柜内的取货机构进行取托盘操作，将空托盘取到投递口处；完成托盘运送工作后，PLC控制深度相机进行第一流程节点的拍照，对空托盘进行背景拍照和测量，生成第一状态图像。第一状态图像包括彩色图像(RGB图)和深度图像。深度图像被上传到云端的图像处理服务器，图像处理服务器将第一状态图像中的物品尺寸通过本地路由器发回到快递柜本地。快递柜将第一状态图像存储到本地硬盘。
步骤4：第一状态图像拍照完毕后，PLC控制快递柜上的仓门打开，仓门一般滑动安装在货仓柜体上，并通过同步带机构移动仓门，实现仓门的开闭，同步带机构的驱动电机与PLC电连接。仓门打开后，快递员将货物投递到投递口。投递完毕后，快递员需在快递柜的APP上进行点击操作以确认投递完毕，此时，工控机收到信号，传给PLC，PLC再次控制同步带机构关闭仓门。
步骤5:关闭仓门后，仓门上设置的传感器，例如槽型光电传感器，会反馈信号给PLC，PLC再次发送信号给深度相机，进行第二流程节点的拍照，生成第二状态图像。第二状态图像包括彩色图像(RGB图)和深度图像。深度图像被上传到云端的图像处理服务器，图像处理服务器将第二状态图像中的物品尺寸通过本地路由器发回到快递柜本地。快递柜将第二状态图像存储到本地硬盘上。
步骤6：拍照完成后，PLC对第二次拍摄得到的第二状态图像和第一次拍照得到的第一状态图像进行对比减除后，测算出货物的第一尺寸信息，即体积，然后控制取货机构将货物分配到相应的存储货架上，以实现货物存放空间合理分配，尽量节省货仓内的存放空间。货物被存放到合适位置后，取货机构停止运作。
步骤7：客户进行取件，点击快递柜的主屏幕上的APP进行取件，一般可通过取件码或者扫码取件，工控机发送信号给PLC，PLC控制取货机构将相应订单的货物运送至取货口，PLC再次发送信号给深度相机，进行第三流程节点的拍照，生成第三状态图像。第三状态图像包括彩色图像(RGB图)和深度图像。深度图像被上传到云端的图像处理服务器，图像处理服务器将第三状态图像中的物品尺寸计算的结果通过本地路由器发回到快递柜本地。快递柜将第三状态图像存储在本地硬盘上，第三状态图像代表货仓内存储的货物被运送到投递口的状态。
步骤8：取货机构停止运作后，PLC控制同步带机构开启仓门，客户取件完毕后，通过点击APP以确认取件完毕，PLC再次控制同步带机构关闭仓门，仓门关闭后，光电传感器发信号给深度相机，进行第四流程节点的拍照，生成第四状态图像。第四状态图像包括彩色图像(RGB图)和深度图像。深度图像被上传到云端的图像处理服务器，图像处理服务器将第四状态图像中的物品尺寸通过本地路由器发回到快递柜本地。快递柜将第四状态图像存储到本地硬盘。第四流程节点的拍照的作用是方便查看货物是否完全取走，是否会有遗漏的情况。第四状态图像中的物品尺寸为第二尺寸信息，通过设置异物值范围，当第二尺寸信息位于该异物值范围内时识别第四状态图像中的物品为异物残留，将不会发报警信息至后台。
当有快递员投诉货物丢失，或者客户投诉快递包装破损时，客服查询上述流程产生的状态图像的记录即可找出问题所在。客服通过后台查询订单号信号，后台通过第四代的移动通信技术(the 4th Generation mobile communication technology，4G)路由器与快递柜远程连接，当后台发出照片查看需求即追踪请求时，PLC控制器调取本地硬盘中的订单信息目录中的状态图像，4G路由器将本地硬盘上的状态图像数据发送到后台。客服可通过手机或电脑对该订单的投递口照片进行对比。通过对比第一状态图像和第二状态图像，可发现存入货物的情况，查询到存入货物的肉眼可见的外貌视觉及货物尺寸状况，避免了快递员空投纠纷；通过对比第二状态图像和第三状态图像，可发现货物是否在货仓内丢失，若第三状态图像的货物比第二状态图像的货物少，则可判断货物在货仓运送途中掉落在货仓内；通过对比第三状态图像和第四状态图像，可发现取货状态，若第四状态图像上还存留货物，则证明客户忘取件或者遗漏部分件，同时通过调取深度尺寸，可以分析得到遗留的物品是货物包裹还是异物垃圾。
通过深度图像计算获得深度图像中的物品的尺寸，并通过路由器将该物品的尺寸返回到本地，通过将该物品的尺寸与预设尺寸阈值比较，可以将托盘内残留的异物纸团或纸片等识别出来，当残留物品在异物尺寸值范围内，柜机就不发送货物残留信息至后台，这样避免了因异物未取导致的托盘空间不释放及后台信息报警，减少了不必要的运维次数，节省了人工成本。当残留物品不在异物值范围内，则残留物品被识别为货物残留，会发送报警信息至后台，运维或客服可以将信息发送给客户提示未完全取件。以此，提高运维效率，提高客户满意度，同时及时释放托盘空间。因为一旦货物残留，该层托盘状态显示为满，代表此托盘不能存件，也影响了整个智能快递货仓的存件量。
本申请实施例提供的快递柜监控方法，能够快速全面地查看快递货物存取的整个状态，实现监控分析的快速响应。此外，引入深度照片，更加方便查看存入货物的尺寸，辅助分析货仓内的异物残留。
实施例二
图2是本申请实施例二提供的一种快递柜监控装置的结构示意图，该装置位于智能快递柜，包括：图像获取模块210、存储模块220和反馈模块230。
图像获取模块210，设置为在根据订单信息的预设流程节点开启或关闭仓门的情况下，获取货仓状态图像；存储模块220，设置为存储货仓状态图像以及获取货仓状态图像的流程节点；反馈模块230，设置为当触发对订单信息的追踪时，将货仓状态图像和货仓状态图像的流程节点反馈至客服人员，以便客服人员进行货物追溯。
图像获取模块210，设置为在投放阶段开启投递口的仓门之前，获取第一状态图像；在投放阶段关闭投递口的仓门之后，获取第二状态图像；在取件阶段开启取货口的仓门之前，获取第三状态图像；在取件阶段关闭取货口的仓门之后，获取第四状态图像。
图像获取模块210，还设置为根据第一状态图像和第二状态图像，确定货物的第一尺寸信息；根据第一尺寸信息确定尺寸匹配的目标货架；将货物运送至目标货架进行仓储。
图像获取模块210，设置为通过如下方式在取件阶段开启取货口的仓门之前，获取第三状态图像：在取件阶段，根据订单信息确定货物所在的目标货架；将目标货架上的该货物运送至取货口；获取取货口内的第三状态图像，开启取货口的仓门；图像获取模块210，设置为通过如下方式在取件阶段关闭取货口的仓门之后，获取第四状态图像：在取件阶段，在取货口的仓门关闭之后，获取第四状态图像。
反馈模块230，设置为在客服终端通过后台服务器发起携带有订单信息的追踪请求的情况下，根据订单信息查找订单信息对应的货仓状态图像和货仓状态图像的流程节点；通过后台服务器将查找到的货仓状态图像和货仓状态图像的流程节点反馈至客服终端，以便客服人员根据客服终端显示的货仓状态图像和货仓状态图像的流程节点进行货物追溯。
货仓状态图像包括彩色图像和深度图像；图像获取模块210，设置为拍摄彩色图像和深度图像；图像获取模块210，还设置为根据深度图像获取深度图像中物体的第二尺寸信息；根据第二尺寸信息确定是否存在遗漏货物；若存在遗漏货物，则进行货物遗留反馈。
图像获取模块210，设置为通过如下方式根据深度图像获取深度图像中物体的第二尺寸信息：将深度图像发送至图像处理服务器，以便图像处理服务器根据深度图像确定第二尺寸信息；接收图像处理服务器反馈的第二尺寸信息。
本申请实施例提供的快递柜监控装置，在根据订单信息的预设流程节点开启或关闭仓门的情况下，获取货仓状态图像；存储货仓状态图像以及获取货仓状态图像的流程节点；当触发对订单信息的追踪时，将货仓状态图像和货仓状态图像的流程节点反馈至客服人员，以便客服人员进行货物追溯。货仓状态图像能够记载在预设流程节点开启或关闭仓门的情况下货仓的状态。当触发对订单信息的追踪时，快递柜可以为客服人员提供预设流程节点的货仓状态图像，进而高效还原货仓内货物的状态，使得客服人员能够快速定位出现问题的流程节点，提高订单追溯查询效率。
实施例三
图3是本申请实施例三提供的一种电子设备的结构示意图，如图3所示，该电子设备包括处理器30、存储器31、输入装置32和输出装置33；电子设备中处理器30的数量可以是一个或多个，图3中以一个处理器30为例；电子设备中的处理器30、存储器31、输入装置32和输出装置33可以通过总线或其他方式连接，图3中以通过总线连接为例。
存储器31作为一种计算机可读存储介质，可设置为存储软件程序、计算机可执行程序以及模块，如本申请实施例中的快递柜监控方法对应的程序指令/模块(例如，快递柜监控装置中的图像获取模块210、存储模块220和反馈模块230)。处理器30通过运行存储在存储器31中的软件程序、指令以及模块，从而执行电子设备的多种功能应用以及数据处理，即实现上述的快递柜监控方法。
存储器31可主要包括存储程序区和存储数据区，其中，存储程序区可存储操作系统、至少一个功能所需的应用程序；存储数据区可存储根据终端的使用所创建的数据等。此外，存储器31可以包括高速随机存取存储器，还可以包括非易失性存储器，例如至少一个磁盘存储器件、闪存器件、或其他非易失性固态存储器件。在一些实例中，存储器31可包括相对于处理器30远程设置的存储器，这些远程存储器可以通过网络连接至电子设备。上述网络的实例包括但不限于互联网、企业内部网、局域网、移动通信网及其组合。
输入装置32可设置为接收输入的数字或字符信息，以及产生与电子设备的用户设置以及功能控制有关的键信号输入。输出装置73可包括显示屏等显示设备。
实施例四
本申请实施例四还提供一种包含计算机可执行指令的存储介质，计算机可执行指令在由计算机处理器执行时用于执行一种快递柜监控方法，该方法包括：
在根据订单信息的预设流程节点开启或关闭仓门的情况下，获取货仓状态 图像；存储货仓状态图像以及获取货仓状态图像的流程节点；当对触发订单信息的追踪时，将货仓状态图像和货仓状态图像的流程节点反馈至客服人员，以便客服人员进行货物追溯。
根据订单信息的预设流程节点开启或关闭仓门，获取货仓状态图像，包括：在投放阶段开启投递口的仓门之前，获取第一状态图像；在投放阶段关闭投递口的仓门之后，获取第二状态图像；在取件阶段开启取货口的仓门之前，获取第三状态图像；在取件阶段关闭取货口的仓门之后，获取第四状态图像。
在投放阶段关闭投递口的仓门之后，获取第二状态图像之后，还包括：根据第一状态图像和第二状态图像，确定货物的第一尺寸信息；根据第一尺寸信息确定尺寸匹配的目标货架；将货物运送至目标货架进行仓储。
在取件阶段开启取货口的仓门之前，获取第三状态图像，包括：在取件阶段，根据订单信息确定货物所在的目标货架；将目标货架上的故货物运送至取货口；获取取货口内的第三状态图像，开启取货口的仓门；相应的，在取件阶段关闭取货口的仓门之后，获取第四状态图像，包括：在取件阶段，在取货口的仓门关闭之后，获取第四状态图像。
当触发对订单信息的追踪时，将货仓状态图像和货仓状态图像的流程节点信息反馈至客服人员，包括：在客服终端通过后台服务器发起携带有订单信息的追踪请求的情况下，根据订单信息查找订单信息对应的货仓状态图像和货仓状态图像的流程节点；通过后台服务器将查找到的货仓状态图像和货仓状态图像的流程节点反馈至客服终端，以便客服人员根据客服终端显示的货仓状态图像和货仓状态图像的流程节点进行追溯。
货仓状态图像包括彩色图像和深度图像；获取货仓状态图像，包括：拍摄彩色图像和深度图像；根据深度图像获取深度图像中物体的第二尺寸信息；根据第二尺寸信息确定是否存在遗漏货物；若存在遗漏货物，则进行货物遗留反馈。
根据深度图像获取深度图像中物体的第二尺寸信息，包括：将深度图像发送至图像处理服务器，以便图像处理服务器根据深度图像确定第二尺寸信息；接收图像处理服务器反馈的第二尺寸信息。
本申请实施例所提供的一种包含计算机可执行指令的存储介质，其计算机可执行指令不限于如上的方法操作，还可以执行本申请任意实施例所提供的快递柜监控方法中的相关操作。
通过以上关于实施方式的描述，可以了解到，本申请可借助软件及必需的通用硬件来实现，也可以通过硬件实现。本申请的技术方案本质上可以以软件 产品的形式体现出来，该计算机软件产品可以存储在计算机可读存储介质中，如计算机的软盘、只读存储器(Read-Only Memory，ROM)、随机存取存储器(Random Access Memory，RAM)、闪存(FLASH)、硬盘或光盘等，包括多个指令用以使得一台计算机设备(可以是个人计算机，服务器，或者网络设备等)执行本申请实施例所述的方法。
上述搜索装置的实施例中，所包括的多个单元和模块只是按照功能逻辑进行划分的，但并不局限于上述的划分，只要能够实现相应的功能即可；另外，多个功能单元的名称也只是为了便于相互区分，并不用于限制本申请的保护范围。

Claims (10)

  1. 一种快递柜监控方法，包括：
    在根据订单信息的预设流程节点开启或关闭仓门的情况下，获取货仓状态图像；
    存储所述货仓状态图像以及获取所述货仓状态图像的流程节点；
    在触发对所述订单信息的追踪的情况下，将所述货仓状态图像和所述货仓状态图像的流程节点反馈至客服人员，以便所述客服人员对货物进行追溯。
  2. 根据权利要求1所述的方法，其中，所述根据订单信息的预设流程节点开启或关闭仓门，获取货仓状态图像，包括：
    在投放阶段开启投递口的仓门之前，获取第一状态图像；
    在投放阶段关闭投递口的仓门之后，获取第二状态图像；
    在取件阶段开启取货口的仓门之前，获取第三状态图像；
    在取件阶段关闭取货口的仓门之后，获取第四状态图像。
  3. 根据权利要求2所述的方法，在所述在投放阶段关闭投递口的仓门之后，获取第二状态图像之后，还包括：
    根据所述第一状态图像和所述第二状态图像，确定所述货物的第一尺寸信息；
    根据所述第一尺寸信息确定尺寸匹配的目标货架；
    将所述货物运送至所述目标货架进行仓储。
  4. 根据权利要求2所述的方法，其中，所述在取件阶段开启取货口的仓门之前，获取第三状态图像，包括：
    在取件阶段，根据所述订单信息确定所述货物所在的目标货架；
    将所述目标货架上的所述货物运送至取货口；
    获取所述取货口内的所述第三状态图像；
    在所述获取第三状态图像之后，还包括：
    开启所述取货口的仓门；
    所述在取件阶段关闭取货口的仓门之后，获取第四状态图像，包括：
    在取件阶段，在所述取货口的仓门关闭之后，获取所述第四状态图像。
  5. 根据权利要求2所述的方法，其中，所述在触发对所述订单信息的追踪的情况下，将所述货仓状态图像和所述货仓状态图像的流程节点信息反馈至客 服人员，以便所述客服人员对货物进行追溯，包括：
    在客服终端通过后台服务器发起携带有所述订单信息的追踪请求的情况下，根据所述订单信息查找所述订单信息对应的货仓状态图像和货仓状态图像的流程节点；
    通过所述后台服务器将查找到的所述货仓状态图像和所述货仓状态图像的流程节点反馈至所述客服终端，以便所述客服人员根据所述客服终端显示的所述货仓状态图像和所述货仓状态图像的流程节点对所述货物进行追溯。
  6. 根据权利要求1-5中任一项所述的方法，其中，所述货仓状态图像包括深度图像；
    所述获取货仓状态图像，包括：
    拍摄所述深度图像；
    在所述获取货仓状态图像之后，还包括：
    根据所述深度图像获取所述深度图像中物体的第二尺寸信息；
    根据所述第二尺寸信息确定是否存在遗漏货物；
    响应于存在遗漏货物，进行货物遗留反馈。
  7. 根据权利要求6所述的方法，其中，所述根据所述深度图像获取所述深度图像中物体的第二尺寸信息，包括：
    将所述深度图像发送至图像处理服务器，以便所述图像处理服务器根据所述深度图像确定所述第二尺寸信息；
    接收所述图像处理服务器反馈的所述第二尺寸信息。
  8. 一种快递柜监控装置，包括：
    图像获取模块，设置为在根据订单信息的预设流程节点开启或关闭仓门的情况下，获取货仓状态图像；
    存储模块，设置为存储所述货仓状态图像以及获取所述货仓状态图像的流程节点；
    反馈模块，设置为在触发对所述订单信息的追踪的情况下，将所述货仓状态图像和所述货仓状态图像的流程节点反馈至客服人员，以便所述客服人员对货物进行追溯。
  9. 一种电子设备，包括存储器、处理器及存储在所述存储器上并可在所述处理器上运行的计算机程序，其中，所述处理器执行所述程序时实现如权利要求1-7中任一项所述的快递柜监控方法。
  10. 一种包含计算机可执行指令的存储介质，所述计算机可执行指令在由计算机处理器执行时用于执行如权利要求1-7中任一项所述的快递柜监控方法。
PCT/CN2021/108415 2020-07-27 2021-07-26 快递柜监控方法、装置、电子设备及存储介质 WO2022022451A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010732499.0A CN111915251B (zh) 2020-07-27 2020-07-27 快递柜监控方法、装置、电子设备及存储介质
CN202010732499.0 2020-07-27

Publications (1)

Publication Number Publication Date
WO2022022451A1 true WO2022022451A1 (zh) 2022-02-03

Family

ID=73281572

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/108415 WO2022022451A1 (zh) 2020-07-27 2021-07-26 快递柜监控方法、装置、电子设备及存储介质

Country Status (2)

Country Link
CN (1) CN111915251B (zh)
WO (1) WO2022022451A1 (zh)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114516509A (zh) * 2022-03-07 2022-05-20 武汉科技大学 一种自动化精确取货系统
CN115399653A (zh) * 2022-10-31 2022-11-29 山东和合信息科技有限公司 多锅体智能烹饪机器人控制方法、系统、介质及电子设备

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111915251B (zh) * 2020-07-27 2023-08-04 深圳市丰巢科技有限公司 快递柜监控方法、装置、电子设备及存储介质
CN113065410A (zh) * 2021-03-10 2021-07-02 广州云从鼎望科技有限公司 集装箱掏箱流程智能化控制方法、系统、介质及装置
CN113592376B (zh) * 2021-06-11 2022-05-20 中国农业大学 应用于快递驿站的智能存取信息管理系统

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109272647A (zh) * 2018-08-29 2019-01-25 北京华沁智联科技有限公司 自动售卖仓库物品状态的更新方法及装置
CN109463969A (zh) * 2018-09-10 2019-03-15 深圳蓝胖子机器人有限公司 快递柜及其快递件的识别方法、机器人和计算机存储介质
CN109508934A (zh) * 2018-11-28 2019-03-22 李志朋 一种快递包裹监控系统
CN110197558A (zh) * 2019-06-27 2019-09-03 李嘉驹 一种智能邮箱的控制方法及装置
CN110610341A (zh) * 2019-09-20 2019-12-24 深圳市丰巢科技有限公司 一种智能仓、智能仓的派件方法和智能仓的取件方法
US20200092398A1 (en) * 2017-09-25 2020-03-19 Alibaba Group Holding Limited Goods order processing method and apparatus, server, shopping terminal, and system
CN111915251A (zh) * 2020-07-27 2020-11-10 深圳市丰巢科技有限公司 快递柜监控方法、装置、电子设备及存储介质

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108985478A (zh) * 2018-07-05 2018-12-11 北京智行者科技有限公司 一种取货监控方法
CN110147977A (zh) * 2019-05-29 2019-08-20 北京云迹科技有限公司 一种库存盘点方法及装置

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20200092398A1 (en) * 2017-09-25 2020-03-19 Alibaba Group Holding Limited Goods order processing method and apparatus, server, shopping terminal, and system
CN109272647A (zh) * 2018-08-29 2019-01-25 北京华沁智联科技有限公司 自动售卖仓库物品状态的更新方法及装置
CN109463969A (zh) * 2018-09-10 2019-03-15 深圳蓝胖子机器人有限公司 快递柜及其快递件的识别方法、机器人和计算机存储介质
CN109508934A (zh) * 2018-11-28 2019-03-22 李志朋 一种快递包裹监控系统
CN110197558A (zh) * 2019-06-27 2019-09-03 李嘉驹 一种智能邮箱的控制方法及装置
CN110610341A (zh) * 2019-09-20 2019-12-24 深圳市丰巢科技有限公司 一种智能仓、智能仓的派件方法和智能仓的取件方法
CN111915251A (zh) * 2020-07-27 2020-11-10 深圳市丰巢科技有限公司 快递柜监控方法、装置、电子设备及存储介质

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114516509A (zh) * 2022-03-07 2022-05-20 武汉科技大学 一种自动化精确取货系统
CN115399653A (zh) * 2022-10-31 2022-11-29 山东和合信息科技有限公司 多锅体智能烹饪机器人控制方法、系统、介质及电子设备

Also Published As

Publication number Publication date
CN111915251B (zh) 2023-08-04
CN111915251A (zh) 2020-11-10

Similar Documents

Publication Publication Date Title
WO2022022451A1 (zh) 快递柜监控方法、装置、电子设备及存储介质
US10449572B2 (en) Household hazardous waste recovery
CN108335408B (zh) 用于自动售货机的物品识别方法、装置、系统及存储介质
WO2022001610A1 (zh) 物料盘点方法、装置、仓储机器人和仓储系统
CN105931005B (zh) 自动仓储系统
CN107871370B (zh) 基于移动互联网与物联网的智能收转系统
CN104463542A (zh) 物流运输的选择方法及装置、电子设备
US11257033B2 (en) Inventory verification device
CN105164481A (zh) 利用影像识别的冰箱的保管品目管理方法及其冰箱
CN111476515A (zh) 外卖配送方法、装置、服务器、终端及存储介质
JP2019101693A (ja) 物流倉庫内作業把握システム
CN107995458B (zh) 一种拍摄包装过程的方法及装置
CN110322202B (zh) 一种仓库打包台的管理方法、装置、终端及系统
CN111967322A (zh) 数据处理方法、装置、电子设备和存储介质
JP2020015576A (ja) 自動倉庫システム
CN112507820A (zh) 自动盘点货物的方法、装置、系统和电子设备
CN112508144A (zh) 包裹查询方法、装置及系统
WO2022222801A1 (zh) 仓储管理方法、装置、仓储机器人、仓储系统及介质
CN111703800A (zh) 货物存放、领取方法、装置、八面体智能柜及存储介质
WO2020082990A1 (zh) 自动售货机及其货物检测方法、电子设备和存储介质
CN110979853B (zh) 一种基于机器视觉的自动化包装方法及系统
CN108557364B (zh) 一种自动盘库方法和装置
KR20190031435A (ko) 폐기물 식별 시스템 및 방법
CN106709683A (zh) 一种物品线下存储、领取方法和装置
US11823129B2 (en) Item collection guidance system

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21850338

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205N DATED 21/03/2023)

122 Ep: pct application non-entry in european phase

Ref document number: 21850338

Country of ref document: EP

Kind code of ref document: A1