WO2022143203A1 - 货品拣选的方法、装置、设备、存储介质及程序产品 - Google Patents

货品拣选的方法、装置、设备、存储介质及程序产品 Download PDF

Info

Publication number
WO2022143203A1
WO2022143203A1 PCT/CN2021/138937 CN2021138937W WO2022143203A1 WO 2022143203 A1 WO2022143203 A1 WO 2022143203A1 CN 2021138937 W CN2021138937 W CN 2021138937W WO 2022143203 A1 WO2022143203 A1 WO 2022143203A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
goods
image
operated
item
Prior art date
Application number
PCT/CN2021/138937
Other languages
English (en)
French (fr)
Inventor
杨穗梅
朱开磊
Original Assignee
深圳市海柔创新科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市海柔创新科技有限公司 filed Critical 深圳市海柔创新科技有限公司
Publication of WO2022143203A1 publication Critical patent/WO2022143203A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23—Updating
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/08—Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
    • G06Q10/087—Inventory or stock management, e.g. order filling, procurement or balancing against orders

Definitions

  • the present disclosure relates to the technical field of intelligent warehousing, and in particular, to a method, device, device, storage medium and program product for picking goods.
  • the present disclosure provides a method, device, equipment, storage medium and program product for picking goods, which are used to solve the problem of requiring operators to interact with computers or electronic label systems, etc. in goods picking scenarios, with high probability of operation errors and low operation efficiency. question.
  • a first aspect of the present disclosure is to provide a method for picking goods, applied to a wearable smart interactive glasses system, including:
  • Receive and display task information in the process of the operator performing operations according to the task information, collect the first item information of the goods to be operated during the operation; send the first item information to the quantity monitoring and computing system; according to the quantity Monitoring the verification result of the first commodity information by the computing system, if the verification of the first commodity information is passed, the first commodity information is sent to the warehouse management system.
  • collecting the first commodity information of the commodity to be operated in the operation process includes: in the process of the operator performing the operation according to the task information. In the process, a first image of the operated product is collected; according to the first image of the operated product, the first product information of the operated product during the operation is determined.
  • the displaying the task information includes: displaying the task information through a display device; and/or playing the task information through a voice interaction device.
  • the task information includes an operation type and second item information, where the second item information includes a storage location, category, and quantity of the item to be operated.
  • the displaying task information includes: displaying feature information of the item to be operated according to the second item information; wherein the feature information of the item to be operated includes the following at least one item to be operated image, logo information, appearance information.
  • the collecting the first image of the operated goods during the operation of the operator according to the task information includes: monitoring the operator's operation actions according to the task information; When the operator performs the operation action corresponding to the task information on the goods, a first image of the operated goods is collected.
  • the determining, according to the first image of the operated product, the first product information of the operated product during the operation includes: performing image processing on the first image of the operated product. , identify the operated goods in the first image; determine the type and quantity of the operated goods in the operation process according to the identified identification information of the operated goods in the first image.
  • performing image processing on the first image of the operated goods to identify the operated goods in the first image includes: performing image processing on the first image of the operated goods. Image processing, extracting the product feature data in the first image; matching the product feature data with the feature data corresponding to the identification information of all the products to determine the identification information of the operated product in the first image.
  • the method before determining the identification information of the operated goods in the first image by matching the characteristic data of the goods with characteristic data corresponding to the identification information of all goods, the method further includes: acquiring And store the characteristic data corresponding to the identification information of all the goods.
  • monitoring the operation actions of the operator according to the task information includes: collecting a second image of the operator; Image recognition is performed to recognize the operation action corresponding to the operation type in the second image.
  • performing image recognition on the second image according to the operation type in the task information, and identifying the operation action corresponding to the operation type in the second image including: : Perform image recognition on the second image according to the operation type in the task information through the neural network model, and identify the operation action corresponding to the operation type in the second image.
  • the collecting the first image of the operated goods when the operator performs the operation action corresponding to the task information on the goods includes: determining that the operator performs the task information corresponding to the goods.
  • the first image acquisition device is started to collect the first image of the operated goods.
  • the method further includes: if a certain operated goods cannot be identified. For the operated goods in the first image, the first prompt information is displayed, and the first prompt information is used to prompt the operator to align the identification information of the operated goods with the first image acquisition device.
  • the method further includes: collecting a third image including identification information of the operated goods; and identifying the identification information of the operated goods in the third image.
  • the method further includes: extracting and saving characteristic data of the operated goods in the first image.
  • the method further includes: sending the third image and the data in the first image to the quantity monitoring computing system.
  • the characteristic data of the operated goods is
  • the method further includes: sending the information to the quantity monitoring computing system. first image.
  • the method further includes: according to the verification result of the first commodity information by the quantity monitoring computing system, if the verification of the first commodity information fails, displaying second prompt information, so The second prompt information is used to prompt the operator to check the information of the goods to be operated during the operation.
  • the method further includes: receiving fourth item information sent by the item monitoring system of the handling equipment, where the fourth item information includes all the items.
  • the method further includes: according to the fourth item information, if the verification of the first item information fails, displaying third prompt information, and the third prompt information is used to prompt the operation The personnel check the information of the goods handled during the operation.
  • the method further includes: sending the first item information to the item monitoring system of the handling equipment.
  • a second aspect of the present disclosure is to provide a method for picking goods, which is applied to a quantity monitoring and computing system, including:
  • the third item information includes:
  • fourth item information sent by the item monitoring system of the handling equipment where the fourth item information includes the category and quantity of the handled items in the container of the handling equipment during the operation; and/or, the handling equipment
  • the fifth commodity information sent by the weight monitoring system, the fifth commodity information includes the quantity of the handled commodities in the container of the handling equipment during the operation.
  • the verifying the first item information according to the third item information includes: judging whether the first item information is consistent with the fourth item information; if the If the first commodity information is consistent with the fourth commodity information, the verification of the first commodity information is passed; if the first commodity information is inconsistent with the fourth commodity information, the verification of the first commodity information is not successful. pass.
  • the verifying the first item information according to the third item information includes: judging the difference between the fifth item information and the operated item in the first item information. Whether the quantity is consistent; if the fifth item information is consistent with the quantity of the operated item in the first item information, the verification of the first item information is passed; if the fifth item information is consistent with the first item information If the quantity of the operated goods in the goods information is inconsistent, the verification of the first goods information fails.
  • the method further includes: receiving a first image and a third image of the operated item during the operation of the task sent by the smart interactive glasses system, and the third image includes the image of the operated item. Identification information; verifying the first item information according to the first image and the third image of the operated item.
  • the method further includes: receiving characteristic data of the operated goods in the first image sent by the smart interactive glasses system; and storing the characteristic data of the operated goods in the first image.
  • the method further includes: receiving a fourth image and a sixth image of the operated goods during the operation of the task sent by the goods monitoring system, the sixth image including the identification of the operated goods information; verifying the fourth item information according to the fourth image and the sixth image of the operated item.
  • the method further includes: receiving characteristic data of the operated goods in the fourth image sent by the goods monitoring system; and storing the characteristic data of the operated goods in the fourth image.
  • a third aspect of the present disclosure is to provide a product picking method, which is applied to a product monitoring system of a handling device, the handling device includes a container for accommodating products, and the product monitoring system includes a product monitoring system for collecting information in the container.
  • a second image acquisition device for images of goods the method comprising:
  • Receive task information in the process of operating according to the task information, collect the fourth item information of the goods to be operated in the container of the handling equipment during the operation; send the fourth item information to the quantity monitoring and computing system, so that the The fourth item information is used to verify the first item information of the operated item collected by the intelligent interactive glasses system during the operation of the operator according to the task information.
  • collecting the first commodity information of the commodity to be operated in the operation process includes: in the process of the operator performing the operation according to the task information.
  • a fourth image of the operated product in the container is collected; according to the fourth image of the operated product in the container, the fourth product information of the operated product in the container during the operation is determined.
  • the collecting the fourth image of the operated goods in the container during the operation of the operator according to the task information includes: monitoring, according to the task information, on the The operation action of the goods in the container; when the operator performs the operation action corresponding to the task information on the goods, a fourth image of the operated goods in the container is collected; wherein, the operation action corresponding to the task information includes: The operation of putting into the container, or the operation of taking out the goods from the container.
  • the determining, according to the fourth image of the operated product in the container, the fourth product information of the operated product in the container during the operation includes: performing an operation on the fourth image. Image processing, identifying the operated goods in the fourth image; determining the type and quantity of the operated goods in the container during the operation process according to the identified identification information of the operated goods in the fourth image .
  • performing image processing on the fourth image to identify the operated goods in the fourth image includes: performing image processing on the fourth image, extracting the fourth image.
  • the product feature data in the image; the product feature data is matched with the feature data corresponding to the identification information of all the products, and the identification information of the operated product in the fourth image is determined.
  • the method before determining the identification information of the operated goods in the fourth image by matching the characteristic data of the goods with characteristic data corresponding to the identification information of all goods, the method further includes: acquiring And store the characteristic data corresponding to the identification information of all the goods.
  • the monitoring of the operation action on the goods in the container according to the task information includes: collecting a fifth image of the operator within the shooting range; according to the operation type in the task information , performing image recognition on the fifth image, and identifying the operation action corresponding to the operation type in the fifth image.
  • performing image recognition on the fifth image according to the operation type in the task information, and identifying the operation action corresponding to the operation type in the fifth image including: : Perform image recognition on the fifth image according to the operation type in the task information through the neural network model, and identify the operation action corresponding to the operation type in the fifth image.
  • the collecting a fourth image of the operated goods in the container when the operator performs the operation action corresponding to the task information on the goods includes: determining that the operator performs all operations on the goods.
  • the second image acquisition device is started to collect the fourth image of the operated goods in the container.
  • the method further includes: if the fourth image of a certain operated goods cannot be recognized. For the operated goods in , the fourth prompt information is displayed, and the fourth prompt information is used to prompt the operator to align the identification information of the operated goods with the second image acquisition device.
  • the method further includes: collecting a sixth image including identification information of the operated goods; and identifying the identification information of the operated goods in the sixth image.
  • the method further includes: extracting and saving feature data of the operated goods in the fourth image.
  • the method further includes: sending the sixth image and the fourth image to the quantity monitoring computing system.
  • the characteristic data of the operated goods is
  • the method further includes: monitoring the quantity.
  • the computing system sends the fourth image.
  • the method further includes: adjusting the position of the fork. , so that the second image capturing device can capture the image of the goods in the container.
  • the method further includes: receiving an intelligent interaction.
  • the first commodity information sent by the glasses system the first commodity information includes the category and quantity of the commodities to be operated during the operation; the fourth commodity information is verified according to the first commodity information.
  • the method further includes: according to the first product information, if the verification of the fourth product information fails, displaying fifth prompt information, and the fifth prompt information is used to prompt the operation The personnel check the information of the goods handled during the operation.
  • the method further includes: reporting to the intelligent interaction The glasses system sends the fourth item information.
  • a fourth aspect of the present disclosure is to provide a method for picking goods, applied to a weight monitoring system of a handling device, the handling equipment comprising a container for accommodating goods, the weight monitoring system comprising a method for detecting the presence of the goods in the container A weight detection device for the weight of goods, the method comprising:
  • collecting the fifth item information of the operated goods in the container of the handling equipment during the operation process includes: collecting the information about the goods handled during the operation process. The total weight of the goods to be handled in the container of the equipment; according to the single weight of the goods to be handled in the task information and the overall weight, the quantity of the goods to be handled in the container of the equipment is calculated during the operation.
  • collecting the total weight of the goods in the container of the handling equipment during the operation process includes: collecting the first weight of the goods in the container at the beginning of the operation process, and collecting the first weight of the goods in the container at the beginning of the operation process. The second weight of the goods in the container at the end of the process; the difference between the first weight and the second weight is calculated to obtain the total weight of the goods to be handled in the container of the handling equipment during the operation.
  • the collecting of the first weight of the goods in the container at the beginning of the operation process and the second weight of the goods in the container at the end of the operation process includes: when receiving When the task information is used, the weight of the goods in the container is collected to obtain the first weight; when the next task information is received, or the task end instruction corresponding to the task information is received, the goods in the container are collected. weight to obtain the second weight.
  • the collecting the weight of the goods in the container includes: receiving weight values of multiple weight sensors, all of which are used to collect the weight of the goods in the container; The weight value with the largest number of occurrences among the detection values of the plurality of weight sensors is used as the weight of the goods in the container.
  • a fifth aspect of the present disclosure is to provide a method for picking goods, applied to a warehouse management system, including:
  • Send task information where the task information includes the operation type and second item information; receive first item information, where the first item information is collected by the intelligent interactive glasses system during the operation of the operator according to the task information
  • the first commodity information of the commodity to be operated during the operation according to the first commodity information and the second commodity information, confirm whether the task is completed, and update the commodity inventory information.
  • the sending the task information includes: sending the task information to the intelligent interactive glasses system, the goods monitoring system and the weight monitoring system of the handling equipment.
  • a sixth aspect of the present disclosure is to provide an apparatus for picking goods, which is applied to a smart interactive glasses system, including:
  • the task information processing module is used to receive and display task information
  • a commodity information management module configured to collect the first commodity information of the commodity to be operated during the operation during the operation of the operator according to the task information
  • the commodity information management module is further configured to send the first commodity information to the quantity monitoring computing system;
  • the commodity information management module is further configured to, according to the verification result of the first commodity information by the quantity monitoring computing system, send the first commodity information to the warehouse management if the verification of the first commodity information is passed. system.
  • a seventh aspect of the present disclosure is to provide a device for picking goods, which is applied to a quantity monitoring and computing system, including:
  • an item information acquisition module configured to receive first item information sent by the intelligent interactive glasses system, where the first item information is information of an item to be operated during an operation of a task;
  • the commodity information acquisition module is further configured to acquire third commodity information sent by the monitoring system of the handling equipment, where the third commodity information is the information of the handled commodity in the container of the handling equipment during the operation of the same task. information;
  • the commodity information verification module is configured to verify the first commodity information according to the third commodity information, and send the verification result to the intelligent interactive glasses system.
  • An eighth aspect of the present disclosure is to provide an apparatus for picking goods, which is applied to a goods monitoring system of a handling equipment, the handling equipment includes a container for accommodating goods, and the goods monitoring system includes a container for collecting information in the container.
  • a second image acquisition device for images of goods, the device for picking goods includes:
  • the task receiving module is used to receive task information
  • the goods information management module is used for collecting fourth goods information of the goods to be operated in the container of the handling equipment during the operation process of the operator according to the task information;
  • the commodity information management module is further configured to send the fourth commodity information to the quantity monitoring and computing system, where the fourth commodity information is used to collect information collected by the intelligent interactive glasses system during the operation of the operator according to the task information.
  • the first item information of the operated item is verified.
  • a ninth aspect of the present disclosure is to provide an apparatus for sorting goods, which is applied to a weight monitoring system of a handling equipment, the handling equipment includes a container for accommodating goods, and the weight monitoring system includes a weight monitoring system for detecting in the container.
  • a weight detection device for the weight of goods, the device for picking goods includes:
  • the task receiving module is used to receive task information
  • the goods information management module is used for collecting the fifth goods information of the goods to be operated in the container of the handling equipment during the operation process of the operator according to the task information;
  • the commodity information management module is further configured to send the fifth commodity information to the quantity monitoring and computing system, and the fifth commodity information is used to collect the information collected by the intelligent interactive glasses system during the operation of the operator according to the task information.
  • the first item information of the operated item is verified.
  • a tenth aspect of the present disclosure is to provide a device for picking goods, which is applied to a warehouse management system, including:
  • a task issuing module configured to send task information, where the task information includes operation type and second item information;
  • the product information receiving module is used to receive first product information, the first product information is the first product of the operated product collected by the intelligent interactive glasses system during the operation process according to the task information. information;
  • the task confirmation module is used for confirming whether the task is completed according to the first commodity information and the second commodity information, and updating the commodity inventory information.
  • An eleventh aspect of the present disclosure is to provide an apparatus for picking goods, including:
  • a processor a memory, and a computer program stored on the memory and executable on the processor; wherein the processor implements the method of any one of the above aspects when running the computer program .
  • a twelfth aspect of the present disclosure is to provide a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, implements any one of the above-mentioned aspects. method described.
  • a thirteenth aspect of the present disclosure is to provide a computer program product, comprising a computer program that, when executed by a processor, implements the method of any one of the above aspects.
  • the method, device, device, storage medium and program product for picking goods provided by the present disclosure can receive and display task information issued by the warehouse management system through the intelligent interactive glasses system, so that operators can perform operations according to the displayed task information. .
  • the intelligent interactive glasses system automatically collects the first product information of the operated product during the operation, and sends the first product information to the quantity monitoring computing system.
  • the quantity monitoring computing system can verify the first product information based on the third product information collected by at least one monitoring system of the handling equipment during the operation, and feed back the verification result.
  • the intelligent interactive glasses system determines that the verification of the first commodity information is passed, the first commodity information is sent to the warehouse management system, and the warehouse management system confirms whether the task is completed according to the first commodity information, and updates the inventory information.
  • the embodiments of the present disclosure can realize an automated intelligent picking process. During the entire picking process, the operator does not need to manually operate electronic equipment such as a computer or an electronic label system, and can synchronize the flow of the physical goods with the information system to ensure the actual operation. The accuracy of the product information ensures the continuous inertia of personnel operations and greatly improves the operation efficiency.
  • FIG. 1 is a frame diagram of a product picking system according to an embodiment of the present disclosure
  • FIG. 2 is a frame diagram of a product picking system according to another embodiment of the present disclosure.
  • FIG. 3 is a flowchart of a method for picking goods provided by an embodiment of the present disclosure
  • FIG. 4 is a flowchart of a method for picking goods provided by another embodiment of the present disclosure.
  • FIG. 5 is a schematic structural diagram of a product monitoring system provided by an embodiment of the present disclosure.
  • FIG. 6 is a flowchart of a method for picking goods according to another embodiment of the present disclosure.
  • FIG. 7 is a flowchart of a method for picking goods according to another embodiment of the present disclosure.
  • FIG. 8 is a schematic structural diagram of a weight monitoring system provided by an embodiment of the present disclosure.
  • FIG. 9 is a flowchart of a method for picking goods provided by another embodiment of the present disclosure.
  • FIG. 10 is a schematic overall flow diagram of an intelligent picking system provided by another embodiment of the present disclosure.
  • FIG. 11 is a schematic structural diagram of an apparatus for picking goods provided by an embodiment of the present disclosure.
  • FIG. 12 is a schematic structural diagram of an apparatus for picking goods provided by an embodiment of the present disclosure.
  • FIG. 13 is a schematic structural diagram of an apparatus for picking goods provided by an embodiment of the present disclosure.
  • FIG. 14 is a schematic structural diagram of an apparatus for picking goods provided by an embodiment of the present disclosure.
  • FIG. 15 is a schematic structural diagram of an apparatus for picking goods provided by an embodiment of the present disclosure.
  • FIG. 16 is a schematic structural diagram of a device for picking goods according to an embodiment of the present disclosure.
  • the current common automated warehouses realize goods-to-person picking, adding automation equipment such as information systems, automated handling robots, three-dimensional warehouses, conveyor lines, and picking workstations.
  • automation equipment such as information systems, automated handling robots, three-dimensional warehouses, conveyor lines, and picking workstations.
  • the operator needs to interact with the computer or the electronic label system to meet the synchronization between the flow of the physical goods and the information system.
  • the error probability of employees operating the information system is high, and the personnel The disconnected inertia of the work leads to low work efficiency.
  • the dismantling of the picking action the robot enters the picking workstation ⁇ the employee reads the picking information prompted by the picking computer interface ⁇ finds the target picking position ⁇ scans the target product ⁇ Operate the picking computer interface to input the number of goods to be picked ⁇ The electronic label light on the distribution wall lights up to remind the staff of the destination location of the goods to be distributed ⁇ The staff delivers the goods ⁇ The light is confirmed ⁇ The staff checks the information prompts on the computer interface ⁇ Prepare for the next picking operation.
  • Embodiments of the present disclosure provide an intelligent picking system, which is used in scenarios where robots or other automated warehouses actually come into contact with goods in the warehouse, such as warehouse delivery, shelving, inventory, tally, and warehouse transfer.
  • the intelligent picking system will automatically receive and display Task information, and automatically check the accuracy of the operation, the record of goods change.
  • the operator only needs to operate the whole process, and does not need to interact with other devices such as a computer system or a PDA (Personal Digital Assistant, referred to as PDA).
  • PDA Personal Digital Assistant
  • FIG. 1 is a frame diagram of a product picking system according to an embodiment of the present disclosure.
  • the product picking system 10 includes an intelligent interactive glasses system 11 , a warehouse management system (Warehouse Management System, WMS for short) 12 , a picking table 13 and a handling device 14 .
  • WMS Warehouse Management System
  • the handling equipment 14 is used to carry or transport the goods during the process of being transported, and may be a robot, a conveyor line, a shelf, or the like.
  • any two devices, or two systems, or the communication connection between the system and the device may be an electrical connection or a wireless/wired signal connection, which can realize data communication between the two.
  • This embodiment does not specifically limit the connection used for the two.
  • the smart interactive glasses 110 and the first processor 111 are included in the smart interactive glasses system 11 .
  • the smart interactive glasses 110 include a glasses body 112 , and a first image acquisition device 113 and an information display device 114 are disposed on the glasses body 112 .
  • the warehouse management system 12 has a communication connection with the first processor 111 for sending task information to the first processor 111 .
  • the warehouse management system 12 There is a communication connection between the warehouse management system 12 and the first processor 111 , and the warehouse management system 12 is configured to issue task information to the first processor 111 .
  • the first processor 111 is electrically connected to the information display device 114 for controlling the information display device 114 to display task information, and the task information is used to instruct an operator wearing the smart interactive glasses 110 to perform an item picking operation on the picking table 13 .
  • the operator needs to wear the smart interactive glasses 110 , receive task information through the information display device 114 of the smart interactive glasses 110 , and perform an item picking operation on the picking table 13 according to the task information.
  • the first processor 111 is electrically connected to the first image acquisition device 113, and is used to control the first image acquisition device 113 to acquire images of the operated goods on the picking table 13 according to the task information, and to determine the image of the operated goods according to the images of the operated goods.
  • First product information is used to control the first image acquisition device 113 to acquire images of the operated goods on the picking table 13 according to the task information, and to determine the image of the operated goods according to the images of the operated goods.
  • the first processor 111 is further configured to transmit the first commodity information to the warehouse management system 12 .
  • the first processor 111 may be disposed on the glasses body 112 , or the first processor 111 may be disposed independently of the smart interactive glasses 110 , and may communicate with the smart interactive glasses 110 .
  • This embodiment realizes an automated intelligent picking process. During the entire picking process, the operator does not need to manually operate electronic equipment such as computers or electronic label systems, and can synchronize the flow of physical goods with the information system to ensure the actual operation of the goods. The accuracy of the information ensures the continuous inertia of personnel operations and greatly improves the operation efficiency.
  • the information display device 114 may include: a display device and/or a voice interaction device.
  • the display device and/or the voice interaction device may be used for displaying.
  • the display device can be used as a lens part of the smart interactive glasses 110 as a display screen to display dynamic information during the operation.
  • the display device is not a full-screen display of information. While displaying information, the operator can still see the actual operation actions and goods through the display screen.
  • the display device may be a microscopic electronic screen.
  • the voice interaction device is used to realize the voice interaction function between the intelligent interactive glasses system 11 and the operator.
  • the voice interaction device may include a voice playback device such as a headset or a voice external player, for playing voice information to the operator wearing the smart interactive glasses 110 .
  • the audio information to be played by the intelligent interactive glasses system 11 can be transmitted to the ears of the operator through the earphone or the voice external player, and the operator can interact with the intelligent interactive glasses system without manual operation.
  • the voice interaction device may further include an audio collection device for collecting voice information input by the operator.
  • a power supply is also provided on the glasses body 112 .
  • the power supply is used to power the first image capturing device 113 and the information display device 114 .
  • the power source may be a battery or a wireless charger, etc., to ensure the battery life of the smart interactive glasses 110 .
  • the handling device 14 is provided with a product monitoring system 15 and/or a weight monitoring system 16, and the handling device 14 is also configured as a container (not shown in the figure) for accommodating products. out).
  • the warehouse management system 12 is also used to send task information to the intelligent interactive glasses system 11 , the goods monitoring system 15 and the weight monitoring system 16 , and start the automatic monitoring function of goods picking for the task.
  • the connection relationship between any two of the intelligent interactive glasses system 11, the warehouse management system 12, the handling equipment 14, the goods monitoring system 15, the weight monitoring system 16 and the quantity monitoring computing system 17 in the goods picking system is shown in Figure 2. There is a connection line between any two, indicating that there is a communication connection between the two, and data communication can be performed.
  • the goods monitoring system 15 is used to monitor the type and first quantity of goods to be operated in the container of the handling equipment 14 during the operation during the operation according to the task information, and to monitor the type and first quantity of the goods in the container of the handling equipment 14 during the operation.
  • the category and first quantity of the operating goods are sent to the quantity monitoring computing system 17 .
  • the "fourth product information” is used to refer to the information of the operated product in the container of the handling device 14 monitored by the product monitoring system 15 during the operation according to the task information. Category and first quantity.
  • the weight monitoring system 16 is used to monitor the second quantity of the goods to be handled in the container of the handling equipment 14 during the operation during the operation of the operator according to the task information, and to calculate the handled goods in the container of the handling equipment 14 during the operation.
  • the second quantity of is sent to the quantity monitoring arithmetic system 17 .
  • "fifth product information" is used to refer to the first product to be operated in the container of the handling equipment 14 during the operation monitored by the weight monitoring system 16 during the operation according to the task information. Two quantity.
  • the item picking system 10 may further include a quantity monitoring computing system 17 .
  • the intelligent interactive glasses system 11 is also used for sending the first item information to the quantity monitoring computing system 17 .
  • the quantity monitoring and computing system 17 is used for verifying the first item information, and feeding back the verification result to the smart interactive glasses system 11 .
  • the quantity monitoring computing system 17 is further configured to verify the first product information according to the fourth product information sent by the product monitoring system 15 and/or the fifth product information sent by the weight monitoring system 16; that is, The quantity monitoring computing system 17 verifies the first commodity information according to the fourth commodity information and/or the fifth commodity information.
  • FIG. 3 is a flowchart of a method for picking goods according to an embodiment of the present disclosure. Based on the product picking system shown in FIG. 1 or FIG. 2 , this embodiment provides a method for picking products, as shown in FIG. 3 , and the specific steps of the method are as follows:
  • Step S200 the warehouse management system sends task information to the intelligent interactive glasses system, where the task information includes the operation type and the second item information.
  • the warehouse management system sends task information to the intelligent interactive glasses system according to the needs of the task.
  • the task information includes the operation type of the operator when the task is performed, and the second commodity information.
  • the second commodity information includes the storage location, category and quantity of the commodity to be operated.
  • Step S201 the intelligent interactive glasses system receives and displays task information.
  • the operator wears intelligent interactive glasses when performing tasks.
  • the intelligent interactive glasses system is responsible for receiving the task information of the pending tasks issued by the warehouse management system WMS, and displays the task information through the intelligent interactive glasses. Operators can perform actual operations according to the task information displayed by the smart interactive glasses.
  • Step S202 in the process of the operator performing the operation according to the task information, collect the first commodity information of the commodity to be operated in the operation process.
  • the intelligent interactive glasses can monitor the operation actions of the operator in real time through the first image acquisition device, and monitor and collect the images of the operated goods in real time during the operation of the operator according to the task information.
  • the processor of the intelligent interactive glasses system automatically recognizes and determines the first item information of the item to be operated in the operation process of this task according to the collected image of the item to be operated during the operation process.
  • the first commodity information may include the category and quantity of the commodity being operated.
  • Step S203 sending the first commodity information to the quantity monitoring computing system.
  • Step S204 the quantity monitoring and computing system receives the first item information sent by the intelligent interactive glasses system, where the first item information is the information of the item to be operated during the operation of a task.
  • Step S205 the quantity monitoring computing system acquires third item information sent by the monitoring system of the handling equipment, where the third item information is the information of the handled items in the container of the handling equipment during the operation of the same task.
  • the quantity monitoring computing system may also interact with the product monitoring system and/or the quality monitoring system of the handling equipment to acquire third product information sent by the monitoring system of the handling equipment.
  • the third product information may include fourth product information sent by the product monitoring system, and/or fifth product information sent by the quality monitoring system.
  • the fourth commodity information is the information of the commodity to be operated in the container of the transport equipment determined by the commodity monitoring system automatically monitoring during the operation of the same task.
  • the fourth item information includes the category and quantity of the item being operated.
  • the fifth item information is the information about the items to be handled in the container of the determined handling equipment that is automatically monitored by the quality monitoring system during the operation of the same task.
  • the fifth item information includes the quantity of the item being handled.
  • Step S206 the quantity monitoring computing system verifies the first commodity information according to the third commodity information, and sends the verification result to the intelligent interactive glasses system.
  • the quantity monitoring computing system verifies the first commodity information according to the third commodity information, determines whether the verification of the first commodity information is passed, and sends the verification result to the intelligent interactive glasses system.
  • Step S207 the intelligent interactive glasses system sends the first product information to the warehouse management system according to the verification result of the first product information by the quantity monitoring and computing system, if the verification of the first product information is passed.
  • the intelligent interactive glasses system receives the verification result of the first commodity information by the quantity monitoring computing system. According to the verification result of the first commodity information, if the verification of the first commodity information is passed, the first commodity information is accurate, and the first commodity information is sent to the warehouse management system.
  • Step S208 according to the verification result of the first commodity information by the quantity monitoring computing system, if the verification of the first commodity information fails, display the second prompt information, and the second prompt information is used to prompt the operator to check the goods to be operated during the operation. Information.
  • the intelligent interactive glasses system displays the second prompt information, and the second prompt information uses It prompts the operator to check the information of the goods being operated during the operation.
  • the display manner of the first prompt information is the same as the display manner of the task information, which will not be repeated here.
  • Step S209 the warehouse management system receives first product information, which is the first product information of the operated product collected by the intelligent interactive glasses system during the operation according to the task information by the operator.
  • Step S210 according to the first product information and the second product information, confirm whether the task is completed, and update the product inventory information.
  • the warehouse management system After the warehouse management system receives the first item information sent by the smart interactive glasses system, it confirms whether the task is completed according to the second item information of the item to be operated in the task information and the first item information of the item to be operated during the actual operation. , and update the product inventory information according to the first product information.
  • the warehouse management system can also send a task success message to the smart interactive glasses system, and the smart interactive glasses system can display the task success message to the operator.
  • the warehouse management system re-formulates a new task for correcting the current task according to the difference between the first item information and the second item information, and lowers the task information of the new task. Based on the task information of the new task, the intelligent warehousing system executes the new task.
  • the intelligent interactive glasses system can receive and display the task information issued by the warehouse management system, so that the operator can perform operations according to the displayed task information.
  • the intelligent interactive glasses system automatically collects the first product information of the operated product during the operation, and sends the first product information to the quantity monitoring computing system.
  • the quantity monitoring computing system can verify the first product information based on the third product information collected by at least one monitoring system of the handling equipment during the operation, and feed back the verification result.
  • the intelligent interactive glasses system determines that the verification of the first commodity information is passed, the first commodity information is sent to the warehouse management system, and the warehouse management system confirms whether the task is completed according to the first commodity information, and updates the inventory information.
  • the embodiments of the present disclosure can realize an automated intelligent picking process.
  • the operator does not need to manually operate electronic equipment such as a computer or an electronic label system, and can synchronize the flow of the physical goods with the information system to ensure the actual operation.
  • the accuracy of the product information ensures the continuous inertia of personnel operations and greatly improves the operation efficiency.
  • FIG. 4 is a flowchart of a method for picking goods according to another embodiment of the present disclosure. On the basis of the above method embodiment corresponding to FIG. 3 , in this embodiment, the method flow of goods picking is described in detail. As shown in Figure 4, the specific steps of the method are as follows:
  • Step S300 the warehouse management system sends task information to the intelligent interactive glasses system, where the task information includes the operation type and the second item information.
  • This step is the same as the above-mentioned step S200, and will not be repeated here.
  • Step S301 the intelligent interactive glasses system receives and displays task information.
  • the task information includes the operation type and second item information
  • the second item information includes the storage location, category and quantity of the item to be operated.
  • displaying the task information includes: displaying the task information through a display device; and/or playing the task information through a voice interaction device.
  • task information can be displayed through the lenses of the smart interactive glasses, and/or audio information corresponding to the task information can be played through a voice interaction device.
  • the feature information of the item to be operated may also be displayed according to the second item information.
  • the feature information of the goods to be operated includes at least one of the following: an image of the goods to be operated, identification information, and appearance information.
  • the identification information of the goods may be able to uniquely identify information such as a one-dimensional code, a two-dimensional code and the like of the goods.
  • the operator After receiving the task information through the intelligent interactive glasses system, the operator does not need manual feedback operation of the task, and can directly perform the corresponding operation according to the task information, or can operate freely to complete the task.
  • collecting the first commodity information of the commodity to be operated in the operation process includes: in the process of the operator performing the operation according to the task information In the process, the first image of the operated product is collected; according to the first image of the operated product, the first product information of the operated product during the operation is determined.
  • steps S302-S303 may be used to collect the first image of the operated goods during the operation of the operator according to the task information.
  • steps S304-S305 the first item information of the operated item in the operation process can be determined according to the first image of the operated item.
  • Step S302 monitor the operation actions of the operator according to the task information.
  • the intelligent interactive glasses system can monitor the operation actions of the operator in real time through the first image acquisition device, and when it is determined that the operator performs the corresponding operation action to operate the physical goods, the first image acquisition device is activated to collect the operated goods Image.
  • this step can be implemented in the following manner:
  • Collect the second image of the operator perform image recognition on the second image according to the operation type in the task information, and identify the operation action corresponding to the operation type in the second image.
  • the second image refers to an image that includes the operator's operation action within the collection range of the first image collection device.
  • the operation action corresponding to the operation type in the task information it is monitored whether the operator performs the operation of the current task. If the second image contains an operation action corresponding to the operation type in the task information, it means that the operator has started the operation, and the first image capture device can be started to capture the first image of the operated product. If the second image does not contain an operation action corresponding to the operation type in the task information, it means that the operator has not started the operation of this task, and the first image continues the operator's operation action until the operator starts the operation.
  • a neural network model may be used to perform image recognition on the second image according to the operation type in the task information, so as to identify the operation action corresponding to the operation type in the second image.
  • the intelligent interactive glasses system uses the pre-trained neural network model to determine whether the second image contains the corresponding operation action, and when the second image contains the corresponding operation action, automatically triggers the first image acquisition device to collect the operated goods , store the first image.
  • Step S303 when the operator performs an operation action corresponding to the task information on the goods, collect a first image of the operated goods.
  • the first image acquisition device is started to collect the first image of the operated goods.
  • Step S304 performing image processing on the first image of the operated goods, and identifying the operated goods in the first image.
  • the intelligent interactive glasses system can store the category information and feature data of all goods, and bind the identification information of the goods with the category information and feature data.
  • the characteristic data of the goods includes the appearance characteristics of the goods, specifically including size, color, shape, special graphics included, and other characteristics. Items appearing in the image can be identified based on the feature data of the item.
  • the intelligent interactive glasses system Before performing image processing on the first image of the operated goods and identifying the operated goods in the first image, the intelligent interactive glasses system acquires and stores characteristic data corresponding to the identification information of all goods.
  • this step can be implemented in the following manner:
  • Image processing is performed on the first image of the operated goods, and the characteristic data of the goods in the first image are extracted; the characteristic data of the goods are matched with the characteristic data corresponding to the identification information of all goods, and the identification of the operated goods in the first image is determined. information.
  • Step S305 according to the identified identification information of the operated goods in the first image.
  • all the operated goods in the operation process of this task can be determined, and the quantity of the operated goods can be further obtained by statistics. Further, according to the category information bound to the identification information of all the goods, the category of all the operated goods in the operation process can be determined.
  • Step S306 If the operated item in the first image of a certain operated item cannot be identified, first prompt information is displayed, and the first prompt information is used to prompt the operator to align the identification information of the operated item with the first image.
  • Image acquisition device If the operated item in the first image of a certain operated item cannot be identified, first prompt information is displayed, and the first prompt information is used to prompt the operator to align the identification information of the operated item with the first image.
  • the intelligent interactive glasses system displays the first prompt information to prompt the operator to match the identification information such as the barcode of the operated item to the operator.
  • the first image acquisition device can acquire a third image including identification information of the operated goods.
  • the display manner of the first prompt information in this step is the same as the display manner of the task information, and details are not repeated here.
  • Step S307 Collect a third image including identification information of the operated goods, and identify the identification information of the operated goods in the third image.
  • the operator After receiving the first prompt information, the operator re-aligns the identification information such as the barcode of the operated product with the first image capture device, and the first image capture device captures a third image including the identification information of the operated product.
  • the intelligent interactive glasses system can identify the identification information of the operated goods in the third image, thereby successfully identifying the operated goods.
  • the operator may be required to align the identification information of the goods with the first image acquisition device during operation, and the first image acquisition device can directly A third image containing identification information of the operated goods is collected, and identification is performed based on the third image.
  • the goods that require higher accuracy of the goods information include but are not limited to: pharmaceutical goods, precision instruments, and high-priced goods.
  • Step S308 extract and save the feature data of the operated goods in the first image.
  • step S304 if the operated product in the first image of a certain operated product cannot be identified, it means that the stored feature data does not contain the feature data of the product, or the feature data of the product has changed, for example Change the packaging, etc.
  • the intelligent interactive glasses system After collecting the third image containing the identification information of the operated goods, and identifying the identification information of the operated goods in the third image, the intelligent interactive glasses system extracts the characteristic data of the operated goods in the first image, and updates the relevant data with the goods.
  • the feature data bound to the identification information of the product realizes the self-learning of the product features.
  • the intelligent interactive glasses system can identify the product by collecting the first image of the product.
  • the intelligent interactive glasses system can also update the feature data bound to the identification information of all goods synchronously with the quantity monitoring computing system in real time or at regular intervals.
  • Step S309 determine the category and quantity of the goods to be operated in the operation process, and obtain the first goods information.
  • the intelligent interactive glasses system can obtain the category information bound to the identification information, so as to determine the category of the operated goods, and can further count the number of the operated goods to obtain the first goods. information.
  • Step S310 sending the first commodity information to the quantity monitoring computing system.
  • the intelligent interactive glasses system After determining the first product information, the intelligent interactive glasses system sends the first product information to the quantity monitoring and computing system.
  • Step S311 the quantity monitoring and computing system receives the first item information sent by the intelligent interactive glasses system, where the first item information is the information of the item to be operated during the operation of a task.
  • Step S312 acquiring third item information sent by the monitoring system of the handling equipment, where the third item information is information of the handled item in the container of the handling equipment during the operation process of the same task.
  • the product monitoring system and/or the weight monitoring system of the handling equipment can monitor the information of the operated product in real time.
  • the quantity monitoring computing system may also interact with the goods monitoring system and/or the quality monitoring system of the handling equipment to obtain third item information sent by the monitoring system of the handling equipment.
  • the third product information includes:
  • the fourth product information sent by the product monitoring system of the handling equipment, and/or the fifth product information sent by the weight monitoring system of the handling equipment includes the type and quantity of the operated items in the container of the handling equipment during the operation, and the fifth item information includes the quantity of the handled item in the container of the handling equipment during the operation.
  • Step S313 verify the first product information according to the third product information, and send the verification result to the intelligent interactive glasses system.
  • the first item information is the category and quantity of the item operated by the operator during the operation
  • the fourth item information is the category and quantity of the item to be operated in the container of the handling equipment during the same operation
  • the first item information is the same as the The fourth item information should be consistent.
  • verifying the first item information according to the fourth item information may be implemented in the following manner:
  • the fifth item information includes the quantity of the operated items in the container of the handling equipment during the operation, and the quantity of the operated items in the fifth item information should be consistent with the quantity of the operated items in the first item information.
  • verifying the first item information according to the fifth item information may be implemented in the following manner:
  • the intelligent interactive glasses system may also send the first image and the third image to the quantity monitoring computing system.
  • the quantity monitoring computing system receives the first image and the third image of the operated item during the operation of the task sent by the intelligent interactive glasses system, and verifies the first item information according to the first image and the third image of the operated item.
  • the quantity monitoring computing system performs image processing on the first image to identify the operated goods in the first image; performs image processing on the third image to identify the identification information of the operated goods in the third image;
  • the operated goods in the first image and the third image determine the type and quantity of the operated goods during the operation.
  • the quantity monitoring computing system performs image processing on the first image to identify the operated goods in the first image
  • the intelligent interactive glasses system performs image processing on the first image of the operated goods in the above step S304 to identify the operated goods in the first image.
  • the implementation of the operated goods is the same, and will not be repeated this time.
  • the quantity monitoring computing system performs image processing on the third image, and identifies the identification information of the operated goods in the third image, which is consistent with the implementation manner in which the intelligent interactive glasses system identifies the identification information of the operated goods in the third image in the above step S307 , which will not be repeated this time.
  • the quantity monitoring and computing system determines the type and quantity of the operated goods in the operation process according to the identified operated goods in the first image and the third image, and the intelligent interactive glasses system in the above step S309 determines the operated goods in the operation process.
  • the realization methods of category and quantity are the same, and will not be repeated this time.
  • the intelligent interactive glasses system also sends the feature data of the operated goods in the first image that fails to be identified to the quantity monitoring computing system.
  • the quantity monitoring computing system receives the characteristic data of the operated goods in the first image sent by the intelligent interactive glasses system, and stores the characteristic data of the operated goods in the first image.
  • the quantity monitoring computing system stores the characteristic data of the operated goods in the first image in correspondence with the identification information of the operated goods, so as to associate the characteristic data of the operated goods in the first image with the identification information of the operated goods. Information binding.
  • the quantity monitoring computing system may also acquire the commodity inventory data, and verify the first commodity information based on the change information of the commodity inventory data in this task.
  • the quantity monitoring computing system After obtaining the verification result of the first commodity information, the quantity monitoring computing system sends the verification result to the intelligent interactive glasses system.
  • Step S314 the intelligent interactive glasses system sends the first item information to the warehouse management system according to the verification result of the first item information by the quantity monitoring and computing system.
  • the warehouse management system After receiving the first product information sent by the intelligent interactive glasses system, the warehouse management system performs the processing of the above steps S209-S210, which will not be repeated here in this embodiment.
  • Step S315 according to the verification result of the quantity monitoring computing system for the first commodity information, if the verification of the first commodity information fails, display the second prompt information, and the second prompt information is used to prompt the operator to check the operated goods during the operation. Information.
  • This step is the same as the real-time manner of the above-mentioned step S208, and will not be repeated here.
  • the first item information determined by the intelligent interactive glasses system and the fourth item information determined by the item monitoring system of the handling equipment can be checked and verified with each other. test.
  • the intelligent interactive glasses system receives fourth item information sent by the item monitoring system of the handling equipment, where the fourth item information includes the category and quantity of the items to be handled in the container of the handling equipment during the operation; A product information for verification.
  • the specific verification process is the same as the process in which the quantity monitoring computing system verifies the first commodity information according to the fourth commodity information in the above-mentioned step S313, and will not be repeated here.
  • third prompt information is displayed, and the third prompt information is used to prompt the operator to check the information of the operated item during the operation.
  • the display mode of the third prompt information is the same as the display mode of the task information, which will not be repeated here.
  • the intelligent interactive glasses system can also send the first item information to the item monitoring system of the handling equipment, so that the item monitoring system of the handling equipment can verify the fourth item information determined by the item monitoring system according to the first item information.
  • the operator can use the voice interaction device or auxiliary function key of the intelligent interactive glasses system to feedback the operator's manual verification. correct data.
  • the intelligent interactive glasses system updates the correct data after verification to the quantity monitoring computing system synchronously.
  • the intelligent interactive glasses system can automatically monitor the operation actions of the operator, collect the first image of the operated goods, and realize the automatic identification of the operated goods according to the first image; further, when identifying the first image After the failure, a third image containing the product identification information can also be collected, and the operated product can be identified based on the third image, which further improves the accuracy of the automatically monitored first product information.
  • the quantity monitoring computing system can also obtain the fourth product information automatically collected by the product monitoring system of the handling equipment and/or the fifth product information automatically collected by the weight monitoring system. The product information is further verified, which improves the accuracy of the product information in actual operation, ensures the continuity of personnel operations, and improves the operation efficiency.
  • FIG. 5 is a schematic structural diagram of a product monitoring system provided by an embodiment of the present disclosure.
  • the product monitoring system 15 includes: a second image acquisition device 151 and a second processor 152 .
  • the second image capturing device 151 is used for capturing images of the goods in the container of the handling equipment.
  • the second processor 152 has a communication connection with the warehouse management system 12 for receiving task information issued by the warehouse management system 12 .
  • the second processor 152 is electrically connected to the second image acquisition device 151, and is configured to control the second image acquisition device 151 to acquire images of the goods in the container according to the task information, and determine the image of the operated goods in the container according to the images of the goods in the container.
  • the category and the first quantity are obtained, and the fourth item information is obtained.
  • handling equipment 14 includes a plurality of containers for holding goods.
  • the product monitoring system 15 may include a plurality of second image capturing devices 151 installed at different positions on the handling equipment 14 .
  • each container is correspondingly provided with at least one second image capturing device 151 , and each second image capturing device 151 is used to capture an image of the product in the corresponding container.
  • a second image capturing device 151 may be installed near each container, and each second image capturing device 151 is aligned with the corresponding container for capturing images of the goods in the corresponding container.
  • the handling device 14 further includes a movable device, and the movable device is provided with a second image capturing device 151 .
  • the second processor 152 is electrically connected to the movable device, and the second processor 152 is further configured to control the movable device to move to a position corresponding to the container, so that the second image capture device 151 is aligned with the container, and controls the image capturing device on the movable device.
  • the second image capturing device 151 captures images of the goods in the container.
  • the handling equipment can be a robot, including two containers, a fork and a back basket, and a camera can be installed on the fork and near the back basket to capture images corresponding to the goods in the fork or the back basket respectively;
  • a camera is installed on the fork, which can collect the image of the goods in the fork.
  • the goods monitoring system can send control instructions to the robot, so that the robot can control the fork to move to the corresponding position, so that the fork can be moved to the corresponding position.
  • the camera can capture the image of the goods in the bag.
  • the product monitoring system 15 further includes a light indicating device 153, and the light indicating device 153 is used to indicate the picking position of the product to be operated.
  • the light indicating device 153 corresponding to the picking position of the product is lit, so that the operator can quickly find the product, and the operation efficiency can be improved.
  • the quantity monitoring and computing system 17 includes a fourth processor 171, and the fourth processor 171 has a communication connection with the second processor 152 of the product monitoring system 15, and the second processor 152 is used to operate the container.
  • the category of the goods (ie, the fourth item information) and the first quantity are transmitted to the fourth processor 171 .
  • the fourth processor 171 is used for transmitting the first item information to the fourth processor 171 .
  • the fourth processor 171 is further configured to verify the first commodity information according to the category and the first quantity of the processed commodities in the container (ie, the fourth commodity information), and transmit the verification result to the first processor 111 .
  • FIG. 6 is a flowchart of a method for picking goods according to another embodiment of the present disclosure.
  • the method flow of the product picking performed by the product monitoring system is exemplarily described.
  • the specific steps of the method are as follows:
  • Step S401 the warehouse management system sends task information to the goods monitoring system of the handling equipment.
  • the warehouse management system when the task of picking goods needs to be performed, sends task information to the goods monitoring system of the handling equipment according to the needs of the task.
  • the task information includes the operation type of the operator when the task is performed, and the second commodity information.
  • the second commodity information includes the storage location, category and quantity of the commodity to be operated.
  • Step S402 the product monitoring system receives task information.
  • Step S403 in the process of the operator performing the operation according to the task information, collect fourth commodity information of the commodity to be operated in the container of the handling equipment during the operation.
  • the second image acquisition device of the goods monitoring system can monitor the operation actions of the operator on the goods in the container of the handling equipment in real time. During the operation of the operator according to the task information, the operation in the container of the handling equipment can be monitored and collected in real time. product information.
  • the processor of the product monitoring system automatically identifies and determines the fourth product information of the operated product in the container of the handling equipment in the current operation process according to the collected information of the operated product during the operation.
  • the fourth commodity information may include the category and quantity of the commodity being operated.
  • Step S404 Send fourth item information to the quantity monitoring computing system, where the fourth item information is used to verify the first item information of the operated item collected by the intelligent interactive glasses system during the operation of the operator according to the task information.
  • the product monitoring system After determining the fourth product information, the product monitoring system sends the fourth product information to the quantity monitoring computing system, so that the quantity monitoring computing system can, according to the fourth product information, perform operations on the smart interactive glasses system when the operator performs operations according to the task information.
  • the collected first item information of the operated item is verified.
  • Step S405 the quantity monitoring computing system receives the fourth commodity information.
  • Step S406 the quantity monitoring computing system verifies the first product information according to the fourth product information.
  • step S313 The implementation manner of this step has been described in detail in the foregoing step S313 .
  • step S313 please refer to step S313 , which will not be repeated here.
  • the product monitoring system can automatically collect the fourth product information of the operated product in the container of the handling equipment according to the task information, and the fourth The commodity information is sent to the quantity monitoring computing system, and the quantity monitoring computing system can verify the first commodity information automatically collected by the intelligent interactive glasses system in the same operation process based on the fourth commodity information, and feed back the verification result.
  • the intelligent interactive glasses system determines that the verification of the first commodity information is passed, the first commodity information is sent to the warehouse management system, and the warehouse management system confirms whether the task is completed according to the first commodity information, and updates the inventory information.
  • the embodiments of the present disclosure can realize an automated intelligent picking process.
  • the operator does not need to manually operate electronic equipment such as a computer or an electronic label system, and can synchronize the flow of the physical goods with the information system to ensure the actual operation.
  • electronic equipment such as a computer or an electronic label system
  • the accuracy of the product information ensures the continuous inertia of personnel operations and greatly improves the operation efficiency.
  • FIG. 7 is a flowchart of a method for picking an item according to another embodiment of the present disclosure.
  • a detailed description is given of the method flow of the item picking performed by the item monitoring system of the handling equipment.
  • the specific steps of the method are as follows:
  • Step S501 receiving task information.
  • the collection of the first commodity information of the commodity to be operated in the operation process includes:
  • the operator collects the fourth image of the operated product in the container; and determines the fourth product information of the operated product in the container according to the fourth image of the operated product in the container.
  • the fourth image of the operated goods in the container can be collected.
  • the fourth item information of the operated item in the container during the operation is determined according to the fourth image of the operated item in the container.
  • the second image capturing device is mounted on the fork. After receiving the task information, the product monitoring system adjusts the position of the fork, so that the second image capturing device can capture the image of the product in the container.
  • the container of the currently monitored handling equipment may be the back bag of the robot
  • the second image acquisition device may be a camera installed on the fork of the robot.
  • the product monitoring system adjusts the position of the fork so that the camera is aligned with the fork.
  • the back basket can collect images of the goods in the back basket, so that the operator can monitor the operation of the goods in the back basket.
  • Step S502 monitor the operation actions on the goods in the container according to the task information.
  • the operation action corresponding to the task information includes: an operation action of putting the goods into the container, or an operation action of taking out the goods from the container.
  • monitor the operation of the goods in the container including:
  • Collect a fifth image of the operator within the shooting range ; perform image recognition on the fifth image according to the operation type in the task information, and identify the operation action corresponding to the operation type in the fifth image.
  • a neural network model may be used to perform image recognition on the fifth image according to the operation type in the task information, so as to identify the operation action corresponding to the operation type in the fifth image.
  • Step S503 when the operator performs an operation action corresponding to the task information on the goods, collect a fourth image of the operated goods in the container.
  • the second image acquisition device is started to collect a fourth image of the operated goods in the container.
  • Step S504 Perform image processing on the fourth image to identify the operated goods in the fourth image.
  • the goods monitoring system After image processing is performed on the fourth image to identify the operated goods in the fourth image, the goods monitoring system acquires and stores characteristic data corresponding to the identification information of all goods.
  • this step can be implemented in the following manner:
  • Image processing is performed on the fourth image to extract the product feature data in the fourth image; the product feature data is matched with the feature data corresponding to the identification information of all the products to determine the identification information of the operated product in the fourth image.
  • Step S505 according to the identified identification information of the operated goods in the fourth image, determine the type and quantity of the operated goods in the container during the operation.
  • Step S506 if the operated product in the fourth image of a certain operated product cannot be identified, display fourth prompt information, and the fourth prompt information is used to prompt the operator to align the identification information of the operated product with the second image.
  • Image acquisition device if the operated product in the fourth image of a certain operated product cannot be identified, display fourth prompt information, and the fourth prompt information is used to prompt the operator to align the identification information of the operated product with the second image.
  • step S504 if the operated product in the fourth image of a certain operated product cannot be identified, the product monitoring system displays fourth prompt information to prompt the operator to align the identification information of the operated product with the second image.
  • the image acquisition device, the second image acquisition device can acquire the sixth image including the identification information of the operated goods.
  • the fourth prompt information may be displayed by the display device or the voice interaction device of the product monitoring system, or may also be displayed by other means such as lighting the corresponding prompt light, which will not be repeated here.
  • Step S507 Collect a sixth image including identification information of the operated goods, and identify the identification information of the operated goods in the sixth image.
  • Step S508 extract and save the feature data of the operated goods in the fourth image.
  • the goods monitoring system extracts and saves the characteristic data of the operated goods in the sixth image.
  • step S504 if the operated product in the fourth image of a certain operated product cannot be identified, it means that the stored feature data does not contain the feature data of the product, or the feature data of the product has changed, for example Change the packaging, etc.
  • the goods monitoring system After collecting the sixth image containing the identification information of the operated goods and identifying the identification information of the operated goods in the sixth image, the goods monitoring system extracts the characteristic data of the operated goods in the fourth image, and updates the identification information with the goods. Identify the feature data bound to the information to realize the autonomous learning of product features. The next time the item is operated, the item monitoring system can identify the item by collecting the fourth image of the item.
  • the commodity monitoring system can also update the characteristic data bound to the identification information of all commodities synchronously with the quantity monitoring computing system in real time or at regular intervals.
  • the product monitoring system sends the fourth image to the quantity monitoring computing system.
  • the quantity monitoring computing system receives the fourth image of the operated product during the operation of the task sent by the product monitoring system; and verifies the fourth product information according to the fourth image of the operated product.
  • the goods monitoring system sends the sixth image and the characteristic data of the operated goods in the sixth image to the quantity monitoring computing system.
  • the quantity monitoring and computing system receives the sixth image of the operated goods and the characteristic data of the operated goods in the sixth image during the operation of the task sent by the goods monitoring system, and the sixth image contains the identification information of the operated goods; according to the sixth image and the fourth image, verifying the fourth item information; and storing the feature data of the operated item in the sixth image.
  • the first item information determined by the intelligent interactive glasses system may be checked and verified with the fourth item information determined by the item monitoring system of the handling equipment.
  • the commodity monitoring system receives the first commodity information sent by the intelligent interactive glasses system, the first commodity information includes the category and quantity of the commodity being operated during the operation; and the fourth commodity information is verified according to the first commodity information.
  • the specific verification process is the same as the process in which the quantity monitoring computing system verifies the first commodity information according to the fourth commodity information in the above-mentioned step S313, and will not be repeated here.
  • fifth prompt information is displayed, and the fifth prompt information is used to prompt the operator to check the information of the operated product during the operation.
  • the display manner of the fifth prompt information is the same as the display manner of the fourth prompt information, which will not be repeated here.
  • the product monitoring system can also send fourth product information to the intelligent interactive glasses system, so that the intelligent interactive glasses system can verify the first product information determined by the intelligent interactive glasses system according to the fourth product information.
  • the goods monitoring system can automatically monitor the operation actions of the operators, collect a fourth image of the operated goods in the container of the handling equipment, and realize automatic identification of the operated goods in the container of the handling equipment according to the fourth image; further Alternatively, after failing to recognize the fourth image, a sixth image containing the product identification information can also be collected, and the operated product can be identified based on the sixth image, further improving the accuracy of the automatically monitored fourth product information.
  • the quantity monitoring and computing system further verifies the first product information automatically collected by the intelligent interactive glasses system during the same operation process according to the fourth product information automatically collected by the product monitoring system, which improves the accuracy of the actual product information and ensures the operation of personnel.
  • the continuous inertia improves the work efficiency.
  • FIG. 8 is a schematic structural diagram of a weight monitoring system according to an embodiment of the present disclosure.
  • the weight monitoring system 16 includes: a third processor 161, and a weight detection device 162 provided on each container of the handling equipment. Wherein, the weight detection device 162 is used to collect the weight of the goods in the container.
  • the third processor 161 has a communication connection with the warehouse management system 12 for receiving task information issued by the warehouse management system.
  • the third processor 161 is electrically connected to the weight detection device 162, and is configured to control the weight detection device 162 to collect the first weight of the goods in the container at the beginning of the task according to the task information, and collect the second weight of the goods in the container at the end of the task;
  • the third processor 161 is further configured to calculate the second quantity of the operated goods in the container according to the single weight of the operated goods in the task information, as well as the first weight and the second weight, to obtain fifth goods information.
  • the third processor 161 is further configured to calculate the difference between the first weight and the second weight, to obtain the overall weight of the operated goods in the container during the operation; and according to the single weight of the operated goods in the task information, and the container The total weight of the goods to be operated in the operation process is calculated, and the second quantity of the goods to be operated in the container during the operation is calculated to obtain fifth goods information.
  • the weight detection device 162 provided on each container of the handling equipment may include a plurality of weight sensors, and each weight sensor is used to detect the weight of the goods in the container.
  • the third processor 161 is electrically connected to each weight sensor, and is configured to receive detection values of the multiple weight sensors, and use the weight value that occurs most frequently among the detection values of the multiple weight sensors as the weight of the goods in the container.
  • a weight sensor can be installed inside the container of the handling equipment, which can detect the amount of change in the weight of the goods in the container during the operation.
  • a plurality of weight sensors can be checked with each other to improve the detection accuracy of the weight of the goods inside the container.
  • the weight sensor may be a strain gauge mass detection sensor.
  • the accuracy of the weight sensor can be set according to the quality of the goods stored in the container, and the quality of the goods stored in the container is different, and weight sensors with different precisions can be used.
  • the fourth processor 171 of the quantity monitoring computing system 17 there is a communication connection between the fourth processor 171 of the quantity monitoring computing system 17 and the third processor 161 of the weight monitoring system 16, and the third processor 161 is used to calculate the second quantity ( That is, the fifth item information) is transmitted to the fourth processor 171 .
  • the processor 111 is configured to transmit the first item information to the fourth processor 171 .
  • the fourth processor 171 is further configured to verify the first commodity information according to the second quantity of the processed commodities in the container (ie, the fifth commodity information), and transmit the verification result to the first processor 111 .
  • the fourth processor 171 is further configured to verify the first item information according to the second quantity of the handled items in the container (ie, the fifth item information), and to verify the first item information according to the category and the first quantity of the handled items in the container. (ie, the fourth item information) verifies the first item information, and then transmits the verification result to the first processor 111 .
  • FIG. 9 is a flowchart of a method for picking goods according to another embodiment of the present disclosure.
  • the method flow of the goods picking performed by the weight monitoring system is exemplarily described.
  • the specific steps of the method are as follows:
  • Step S601 the warehouse management system sends task information to the weight monitoring system of the handling equipment.
  • the warehouse management system when the task of picking goods needs to be performed, the warehouse management system sends task information to the weight monitoring system of the handling equipment according to the needs of the task.
  • the task information includes the operation type of the operator when the task is performed, and the second commodity information.
  • the second commodity information includes the storage location, category and quantity of the commodity to be operated.
  • the warehouse management system can send task information to the handling equipment, and the handling equipment sends the task information to the product monitoring system and the weight monitoring system.
  • Step S602 the weight monitoring system receives task information.
  • Step S603 in the process of the operator performing the operation according to the task information, collect fifth commodity information of the commodity to be operated in the container of the handling equipment during the operation.
  • this step can be implemented in the following manner:
  • Collect the total weight of the handled goods in the container of the handling equipment during the operation calculate the quantity of the handled goods in the container of the handling equipment during the operation according to the individual weight of the handled goods and the overall weight in the task information.
  • collecting the overall weight of the goods in the container of the handling equipment during the operation includes: collecting the first weight of the goods in the container at the beginning of the operation process, and the second weight of the goods in the container at the end of the operation process; calculating the first weight of the goods in the container; The difference between the first weight and the second weight obtains the total weight of the goods being handled in the container of the handling equipment during the operation.
  • the weight detection device measures and obtains the first measurement value
  • the weight detection device measures and obtains the first measurement value
  • the weight detection device measures and obtains the first measurement value.
  • the second measurement value is calculated by calculating the difference between the first measurement value and the second measurement value, so as to obtain the overall quality of the operated goods during the operation.
  • the weight of the goods in the container is collected to obtain the first weight.
  • the weight of the goods in the container is collected to obtain the second weight.
  • the weight detection device may include a plurality of weight sensors.
  • the weight values of multiple weight sensors are received, and the multiple weight sensors are used to collect the weight of the goods in the container; the weight value that occurs most frequently among the detection values of the multiple weight sensors is used as the container.
  • the weight of the item in.
  • each time the weight is detected the values of all the weight sensors are obtained, and the values of all the weight sensors are processed as weight values with the same set precision, and the weight value with the most occurrences is used as the currently measured weight to ensure that The accuracy of measuring the weight of the goods.
  • the third processor of the weight monitoring system calculates the operation process according to the single weight and the overall weight of the goods to be operated in the task information.
  • the number of goods to be handled in the container of the handling equipment, that is, the fifth goods information is obtained.
  • Step S604 Send fifth item information to the quantity monitoring computing system, where the fifth item information is used to verify the first item information of the operated item collected by the intelligent interactive glasses system during the operation of the operator according to the task information.
  • the weight monitoring system sends the fifth item information to the quantity monitoring and computing system, so that the quantity monitoring and computing system, according to the fifth item information, is in the process of the operator performing the operation according to the task information to the intelligent interactive glasses system.
  • the collected first item information of the operated item is verified.
  • Step S605 the quantity monitoring computing system receives the fifth commodity information.
  • Step S606 the quantity monitoring computing system verifies the first product information according to the fifth product information.
  • step S313 The implementation manner of this step has been described in detail in the foregoing step S313 .
  • step S313 please refer to step S313 , which will not be repeated here.
  • the weight monitoring system can automatically collect the total weight of the operated goods in the container of the handling equipment during the operation according to the task information, and calculate and determine the weight of the operated goods. Quantity, obtain the fifth item information, send the fifth item information to the quantity monitoring computing system, and the quantity monitoring computing system can verify the first item information automatically collected by the intelligent interactive glasses system during the same operation process based on the fifth item information, and Feedback verification results. After the intelligent interactive glasses system determines that the verification of the first commodity information is passed, the first commodity information is sent to the warehouse management system, and the warehouse management system confirms whether the task is completed according to the first commodity information, and updates the inventory information.
  • the embodiments of the present disclosure can realize an automated intelligent picking process.
  • the operator does not need to manually operate electronic equipment such as a computer or an electronic label system, and can synchronize the flow of the physical goods with the information system to ensure the actual operation.
  • the accuracy of the product information ensures the continuous inertia of personnel operations and greatly improves the operation efficiency.
  • FIG. 10 is a schematic overall flow diagram of an intelligent picking system provided by another embodiment of the present disclosure. On the basis of any of the above method embodiments, in this embodiment, the overall flow of the intelligent picking system is exemplarily described. As shown in Figure 10, the overall process of the intelligent picking system is as follows:
  • the warehouse management system WMS issues task information to the intelligent interactive glasses system; (2) The intelligent interactive glasses system displays the task information; (3) The operators operate according to the displayed task information and operate the goods on the handling equipment; (4) (5) (6): (4) The intelligent interactive glasses system recognizes the operator's operation action, collects the image of the operated item and the first item information, and sends the image of the operated item and the first item information to the Quantity monitoring and computing system; (5) The weight monitoring system of the handling equipment records the weight change of the operated goods in the container, and calculates the information of the fifth item; (6) The goods monitoring system of the handling equipment recognizes the operation actions of the operators and collects the information of the operated goods.
  • the image and the fourth product information send the image of the operated product and the fourth product information to the quantity monitoring computing system; (7) the quantity monitoring computing system verifies the first (8)
  • the intelligent interactive glasses system sends the first item information to the warehouse management system, and the warehouse management system confirms the task and updates the inventory information; (9) The intelligent interactive glasses system and Interaction between handling equipment and other systems, displaying interactive information and task execution results.
  • the overall process of the intelligent picking system is exemplarily described based on an optional implementation. In other implementations, the process of the intelligent picking system can be changed accordingly, which is not done here in this embodiment. Specific restrictions.
  • FIG. 11 is a schematic structural diagram of an apparatus for picking goods according to an embodiment of the present disclosure.
  • the device for picking goods provided by the embodiments of the present disclosure is applied to a smart interactive glasses system.
  • the product picking device 70 includes: a task information processing module 701 and a product information management module 702 .
  • the task information processing module 701 is configured to receive and display task information.
  • the commodity information management module 702 is configured to collect the first commodity information of the commodity to be operated during the operation during the operation of the operator according to the task information.
  • the commodity information management module 702 is further configured to send the first commodity information to the quantity monitoring computing system.
  • the commodity information management module 702 is further configured to, according to the verification result of the first commodity information by the quantity monitoring computing system, send the first commodity information to the warehouse management system if the verification of the first commodity information is passed.
  • the product information management module is further configured to: collect a first image of the operated product during the operation of the operator according to the task information; determine the operation process according to the first image of the operated product The first item information of the item being handled in .
  • the task information processing module is further configured to: display the task information through the display device; and/or play the task information through the voice interaction device.
  • the task information includes the operation type and second item information
  • the second item information includes the storage location, category, and quantity of the item to be operated.
  • the task information processing module is further configured to: display feature information of the item to be operated according to the second item information; wherein, the feature information of the item to be operated includes at least one image of the item to be operated, Identification information, appearance information.
  • the product information management module is further configured to: monitor the operation actions of the operator according to the task information; collect the first image of the operated product when the operator performs the operation action corresponding to the task information on the product. .
  • the product information management module is further configured to: perform image processing on the first image of the operated product, and identify the operated product in the first image; The identification information of the goods determines the type and quantity of the goods to be operated during the operation.
  • the product information management module is further configured to: perform image processing on the first image of the operated product, and extract the product feature data in the first image; and correspond the product feature data with the identification information of all the products.
  • the feature data is matched to determine the identification information of the operated goods in the first image.
  • the product information management module is further configured to: match the product feature data with the feature data corresponding to the identification information of all the products, and obtain and obtain the identification information of the operated product in the first image before determining the identification information of the operated product.
  • the characteristic data corresponding to the identification information of all goods is stored.
  • the product information management module is further used to: collect the second image of the operator; perform image recognition on the second image according to the operation type in the task information, and identify the operation type in the second image and the operation type. corresponding action.
  • the product information management module is further configured to: perform image recognition on the second image according to the operation type in the task information through the neural network model, and identify the operation corresponding to the operation type in the second image. action.
  • the product information management module is further configured to: start the first image acquisition device to collect the first image of the operated product when it is determined that the operator performs an operation action corresponding to the task information on the product.
  • the product information management module is further configured to: perform image processing on the first image of the operated product, and after recognizing the operated product in the first image, if the operating product cannot be identified.
  • the first prompt information is displayed, and the first prompt information is used to prompt the operator to align the identification information of the operated goods with the first image acquisition device.
  • the product information management module is further configured to: collect a third image including identification information of the operated product; and identify the identification information of the operated product in the third image.
  • the product information management module is further configured to: extract and save the feature data of the operated product in the first image after identifying the identification information of the operated product in the third image.
  • the product information management module is further configured to: after extracting and saving the characteristic data of the operated product in the first image, send the third image and the operated product in the first image to the quantity monitoring computing system. Item characteristic data.
  • the commodity information management module is further configured to: in the process of the operator performing the operation according to the task information, after collecting the first commodity information of the commodity operated in the operation process, send the first commodity information to the quantity monitoring computing system. an image.
  • the commodity information management module is further configured to: according to the verification result of the first commodity information by the quantity monitoring and computing system, if the verification of the first commodity information fails, display the second prompt information, and the second The prompt information is used to prompt the operator to check the information of the goods being operated during the operation.
  • the commodity information management module is further configured to: after collecting the first commodity information of the commodity to be operated during the operation, receive fourth commodity information sent by the commodity monitoring system of the handling equipment, where the fourth commodity information includes: The category and quantity of the goods to be handled in the container of the handling equipment during the operation; the first commodity information is verified according to the fourth commodity information.
  • the product information management module is further configured to: according to the fourth product information, if the verification of the first product information fails, display third prompt information, and the third prompt information is used to prompt the operator. Check the information of the goods being operated during the operation.
  • the commodity information management module is further configured to: after collecting the first commodity information of the commodity to be operated during the operation, send the first commodity information to the commodity monitoring system of the handling equipment.
  • the apparatus provided in this embodiment of the present disclosure may be specifically used to execute the method process performed by the intelligent interactive glasses system in any of the above method embodiments.
  • the apparatus provided in this embodiment of the present disclosure may be specifically used to execute the method process performed by the intelligent interactive glasses system in any of the above method embodiments.
  • FIG. 12 is a schematic structural diagram of an apparatus for picking goods according to an embodiment of the present disclosure.
  • the device for picking goods provided by the embodiments of the present disclosure is applied to a quantity monitoring computing system.
  • the product picking device 80 includes: a product information acquisition module 801 and a product information verification module 802 .
  • the product information acquisition module 801 is configured to receive first product information sent by the smart interactive glasses system, where the first product information is information of a product to be operated during the operation of a task.
  • the commodity information acquisition module 801 is further configured to acquire third commodity information sent by the monitoring system of the handling equipment, where the third commodity information is information of the handled commodity in the container of the handling equipment during the operation of the same task.
  • the commodity information verification module 802 is configured to verify the first commodity information according to the third commodity information, and send the verification result to the intelligent interactive glasses system.
  • the third commodity information includes: fourth commodity information sent by a commodity monitoring system of the handling equipment, where the fourth commodity information includes the type and quantity of the handled commodity in the container of the handling equipment during the operation; And/or, fifth item information sent by the weight monitoring system of the handling equipment, where the fifth item information includes the quantity of handled items in the container of the handling equipment during the operation.
  • the commodity information verification module is further configured to: determine whether the first commodity information is consistent with the fourth commodity information; if the first commodity information is consistent with the fourth commodity information, verify the first commodity information Passed; if the first item information is inconsistent with the fourth item information, the verification of the first item information is not passed.
  • the commodity information verification module is further configured to: determine whether the fifth commodity information is consistent with the quantity of the operated commodity in the first commodity information; If the quantity of the operated goods is the same, the verification of the first goods information passes; if the fifth goods information is inconsistent with the quantity of the operated goods in the first goods information, the verification of the first goods information fails.
  • the product information verification module is further configured to: receive the first image and the third image of the operated product during the operation of the task sent by the smart interactive glasses system, and the third image includes the image of the operated product. Identification information; verifying the first item information according to the first image and the third image of the operated item.
  • the product information verification module is further configured to: receive feature data of the operated product in the first image sent by the smart interactive glasses system; and store the feature data of the operated product in the first image.
  • the product information verification module is further configured to: receive a fourth image and a sixth image of the operated product during the operation of the task sent by the product monitoring system, and the sixth image includes the identifier of the operated product information; verifying the fourth item information according to the fourth image and the sixth image of the operated item.
  • the product information verification module is further configured to: receive characteristic data of the operated product in the fourth image sent by the product monitoring system; and store the characteristic data of the operated product in the fourth image.
  • the apparatus provided in the embodiment of the present disclosure may be specifically used to execute the method process executed by the quantity monitoring computing system in any of the above method embodiments.
  • the apparatus provided in the embodiment of the present disclosure may be specifically used to execute the method process executed by the quantity monitoring computing system in any of the above method embodiments.
  • FIG. 13 is a schematic structural diagram of an apparatus for picking goods according to an embodiment of the present disclosure.
  • the device for picking goods provided by the embodiments of the present disclosure is applied to a goods monitoring system of a handling device, the handling equipment includes a container for accommodating goods, and the product monitoring system further includes a second image capturing device for collecting images of the goods in the container.
  • the apparatus 90 for picking goods includes: a task receiving module 901 and a goods information management module 902 .
  • the task receiving module 901 is configured to receive task information.
  • the commodity information management module 902 is configured to collect fourth commodity information of the commodity to be operated in the container of the handling equipment during the operation during the operation of the operator according to the task information.
  • the commodity information management module 902 is further configured to send fourth commodity information to the quantity monitoring and computing system, and the fourth commodity information is used for the first commodity of the operated commodity collected by the intelligent interactive glasses system during the operation of the operator according to the task information. information to verify.
  • the product information management module is further configured to: collect a fourth image of the operated product in the container during the operation of the operator according to the task information; according to the fourth image of the operated product in the container , to determine the fourth item information of the items to be manipulated in the container during the operation.
  • the product information management module is further configured to: monitor the operation actions on the products in the container according to the task information; when the operator performs the operation actions corresponding to the task information on the products, collect the operated products in the container.
  • the product information management module is further configured to: perform image processing on the fourth image to identify the operated product in the fourth image; according to the identified identification information of the operated product in the fourth image , to determine the type and quantity of goods handled in the container during the operation.
  • the commodity information management module is further configured to: perform image processing on the fourth image, and extract the commodity characteristic data in the fourth image; If matched, the identification information of the operated goods in the fourth image is determined.
  • the product information management module is further configured to: match the product feature data with the feature data corresponding to the identification information of all the products, and obtain and obtain the identification information of the operated product in the fourth image before determining the identification information of the operated product.
  • the characteristic data corresponding to the identification information of all goods is stored.
  • the commodity information management module is further configured to: collect a fifth image of the operator within the shooting range; perform image recognition on the fifth image according to the operation type in the task information, and identify the fifth image in the fifth image. The operation action corresponding to the operation type.
  • the commodity information management module is further configured to: perform image recognition on the fifth image according to the operation type in the task information through the neural network model, and identify the operation corresponding to the operation type in the fifth image. action.
  • the product information management module is further configured to: start the second image capturing device to capture a fourth image of the operated product in the container when it is determined that the operator performs an operation action corresponding to the task information on the product.
  • the product information management module is further configured to: perform image processing on the fourth image, and after identifying the operated product in the fourth image, if the fourth image of a certain operated product cannot be identified.
  • the operated goods are displayed, and fourth prompt information is displayed, and the fourth prompt information is used to prompt the operator to align the identification information of the operated goods with the second image acquisition device.
  • the product information management module is further configured to: collect a sixth image including identification information of the operated product; and identify the identification information of the operated product in the sixth image.
  • the product information management module is further configured to: extract and save the feature data of the operated product in the fourth image after identifying the identification information of the operated product in the sixth image.
  • the product information management module is further configured to: after extracting and saving the feature data of the operated product in the sixth image, send the operated product in the sixth image and the fourth image to the quantity monitoring computing system. Item characteristic data.
  • the product information management module is further configured to: in the process of the operator performing the operation according to the task information, after collecting the fourth product information of the operated product in the container of the handling equipment during the operation, send the information to the quantity.
  • the monitoring computing system sends a fourth image.
  • the second image acquisition device is installed on the fork, and the product information management module is further used to: adjust the position of the fork after receiving the task information, So that the second image capturing device can capture the image of the goods in the container.
  • the product information management module is further configured to: in the process of the operator performing the operation according to the task information, after collecting the fourth product information of the operated product in the container of the handling equipment during the operation, receive the intelligent information.
  • the first item information sent by the interactive glasses system the first item information includes the category and quantity of the items to be operated during the operation; the fourth item information is verified according to the first item information.
  • the commodity information management module is further configured to: according to the first commodity information, if the verification of the fourth commodity information fails, display fifth prompt information, and the fifth prompt information is used to prompt the operator. Check the information of the goods being operated during the operation.
  • the product information management module is further configured to: in the process of the operator performing the operation according to the task information, after collecting the fourth product information of the operated product in the container of the handling equipment during the operation, send the information to the intelligent The interactive glasses system sends fourth item information.
  • the apparatus provided by the embodiment of the present disclosure may be specifically used to execute the method process performed by the product monitoring system of the handling equipment in any of the above method embodiments.
  • the apparatus provided by the embodiment of the present disclosure may be specifically used to execute the method process performed by the product monitoring system of the handling equipment in any of the above method embodiments.
  • FIG. 14 is a schematic structural diagram of an apparatus for picking goods according to an embodiment of the present disclosure.
  • the device for picking goods provided by the embodiments of the present disclosure is applied to a weight monitoring system of a handling equipment, the handling equipment includes a container for accommodating goods, and the weight monitoring system includes a weight detection device for detecting the weight of the goods in the container.
  • the apparatus 100 for picking goods includes: a task receiving module 1001 and a goods information management module 1002 .
  • the task receiving module 1001 is configured to receive task information.
  • the commodity information management module 1002 is configured to collect fifth commodity information of the commodity to be operated in the container of the handling equipment during the operation during the operation of the operator according to the task information.
  • the commodity information management module 1002 is further configured to send fifth commodity information to the quantity monitoring and computing system, and the fifth commodity information is used for the first commodity of the operated commodity collected by the intelligent interactive glasses system during the operation of the operator according to the task information. information to verify.
  • the goods information management module is further configured to: collect the overall weight of the operated goods in the container of the handling equipment during the operation; The quantity of goods handled in the container of the handling equipment during the process.
  • the product information management module is further configured to: collect the first weight of the product in the container at the beginning of the operation process, and the second weight of the product in the container at the end of the operation process; calculate the first weight and the second weight. The difference in weight gives the total weight of the goods being handled in the container of the handling equipment during the operation.
  • the product information management module is further configured to: when receiving the task information, collect the weight of the product in the container to obtain the first weight; when receiving the next task information, or receiving the corresponding task information When the task end command of , collect the weight of the goods in the container to get the second weight.
  • the product information management module is further configured to: receive the weight values of multiple weight sensors, and the multiple weight sensors are all used to collect the weight of the products in the container; The weight value with the most number of times is used as the weight of the goods in the container.
  • the apparatus provided by the embodiment of the present disclosure can be specifically used to execute the method process performed by the weight monitoring system of the handling equipment in any of the above method embodiments.
  • the apparatus provided by the embodiment of the present disclosure can be specifically used to execute the method process performed by the weight monitoring system of the handling equipment in any of the above method embodiments.
  • FIG. 15 is a schematic structural diagram of an apparatus for picking goods according to an embodiment of the present disclosure.
  • the device for picking goods provided by the embodiments of the present disclosure is applied to a warehouse management system.
  • the product picking device 130 includes: a task issuing module 1301 , a product information receiving module 1302 and a task confirmation module 1303 .
  • the task issuing module 1301 is configured to send task information, where the task information includes the operation type and the second item information.
  • the product information receiving module 1302 is configured to receive first product information, which is the first product information of the operated product collected by the intelligent interactive glasses system during the operation according to the task information by the operator.
  • the task confirmation module 1303 is configured to confirm whether the task is completed according to the first commodity information and the second commodity information, and update the commodity inventory information.
  • the task issuing module 1301 is further configured to send task information to the intelligent interactive glasses system, the goods monitoring system and the weight monitoring system of the handling equipment.
  • the apparatus provided in the embodiment of the present disclosure may be specifically used to execute the method process executed by the warehouse management system in any of the above method embodiments.
  • the apparatus provided in the embodiment of the present disclosure may be specifically used to execute the method process executed by the warehouse management system in any of the above method embodiments.
  • FIG. 16 is a schematic structural diagram of a device for picking goods according to an embodiment of the present disclosure.
  • the device 120 for picking goods includes: a processor 1201 , a memory 1202 , and a computer program stored in the memory 1202 and executed on the processor 1201 .
  • the processor 1201 when the processor 1201 runs the computer program, it realizes the method process executed by any one of the intelligent interactive glasses system, the quantity monitoring computing system, the goods monitoring system, the weight monitoring system, and the warehouse management system in any of the above method embodiments, and the specific functions For the technical effect, refer to the above-mentioned embodiments, and details are not repeated here.
  • an embodiment of the present disclosure further provides a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, the intelligent interactive glasses system and quantity monitoring calculation in any of the above method embodiments are implemented.
  • the method process executed by any system in the system, the goods monitoring system, the weight monitoring system and the warehouse management system.
  • An embodiment of the present disclosure also provides a computer program product, the program product includes: a computer program, where the computer program is stored in a readable storage medium, at least one processor of the electronic device can read the computer program from the readable storage medium, at least one The processor executes the computer program so that the electronic device executes the method process performed by any of the intelligent interactive glasses system, quantity monitoring computing system, goods monitoring system, weight monitoring system, and warehouse management system in any of the above method embodiments.

Abstract

本公开提供一种货品拣选的方法、装置、设备、存储介质及程序产品，通过智能交互眼镜系统展示任务信息，在作业人员根据任务信息作业过程中自动采集被操作货品的第一货品信息，并向数量监测运算系统发送第一货品信息；数量监测运算系统基于搬运设备的监测系统采集的同一作业过程中被操作货品的第三货品信息，验证第一货品信息，反馈验证结果。智能交互眼镜系统确定对第一货品信息验证通过后，将第一货品信息发送给仓储管理系统，仓储管理系统根据第一货品信息确认任务是否完成，并更新库存信息，实现自动化智能拣选过程，在拣选作业过程中作业人员无需手动操作电子设备，提高实际操作的货品信息的准确性和人员作业的连惯性，提高了作业效率。

Description

货品拣选的方法、装置、设备、存储介质及程序产品
本公开要求于2020年12月29日提交中国专利局、申请号为202011603164.5、申请名称为“货品拣选的方法、装置、设备、存储介质及程序产品”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本公开涉及智能仓储技术领域，尤其涉及一种货品拣选的方法、装置、设备、存储介质及程序产品。
背景技术
在智能仓储领域，常见的自动化仓库实现了货到人拣选，增加了信息系统、自动化搬运机器人、立体库、输送线、拣选工作站等自动化设备。但是自动化仓库整个作业流程中，在各个货品拣选场景下，都需要作业人员与电脑或者电子标签系统等进行手动交互，以满足货品实物的流量与信息系统同步，员工操作信息系统的差错概率大，人员作业的不连惯性导致作业效率低。
发明内容
本公开提供一种货品拣选的方法、装置、设备、存储介质及程序产品，用以解决货品拣选场景下，需要作业人员与电脑或者电子标签系统等进行交互，作业差错概率大，作业效率低的问题。
本公开的第一个方面是提供一种货品拣选的方法，应用于可穿戴的智能交互眼镜系统，包括：
接收并展示任务信息；在作业人员根据所述任务信息进行作业的过程中，采集作业过程中被操作货品的第一货品信息；向数量监测运算系统发送所述第一货品信息；根据所述数量监测运算系统对所述第一货品信息的验证结果，若对所述第一货品信息验证通过，则将所述第一货品信息发送给仓储管理系统。
一种可选的实施方式中，在作业人员根据所述任务信息进行作业的过程中，采集作业过程中被操作货品的第一货品信息，包括：在作业人员根据所述任务信息进行作业的过程中，采集被操作货品的第一图像；根据所述被操作货品的第一图像，确定作业过程中被操作货品的第一货品信息。
一种可选的实施方式中，所述展示任务信息包括：通过显示装置显示所述任务信息；和/或，通过语音交互装置播放所述任务信息。
一种可选的实施方式中，所述任务信息包括操作类型和第二货品信息，所述第二货品信息包括待操作货品的存储位置、品类及数量。
一种可选的实施方式中，所述展示任务信息包括：根据所述第二货品信息，展示待操作货品的特征信息；其中，所述待操作货品的特征信息包括一下至少一种待操作货品的图像、标识信息、外观信息。
一种可选的实施方式中，所述在作业人员根据所述任务信息进行作业的过程中，采集被操作货品的第一图像，包括：根据所述任务信息，监控作业人员的操作动作；在作业人员对货品进行所述任务信息对应的操作动作时，采集被操作货品的第一图像。
一种可选的实施方式中，所述根据所述被操作货品的第一图像，确定作业过程中被操作货品的第一货品信息，包括：对所述被操作货品的第一图像进行图像处理，识别所述第一图像中的被操作货品；根据识别出的所述第一图像中的被操作货品的标识信息，确定所述作业过程中被操作货品的品类和数量。
一种可选的实施方式中，所述对所述被操作货品的第一图像进行图像处理，识别所述第一图像中的被操作货品，包括：对所述被操作货品的第一图像进行图像处理，提取所述第一图像中的货品特征数据；将所述货品特征数据与所有货品的标识信息对应的特征数据进行匹配，确定所述第一图像中的被操作货品的标识信息。
一种可选的实施方式中，所述将所述货品特征数据与所有货品的标识信息对应的特征数据进行匹配，确定所述第一图像中的被操作货品的标识信息之前，还包括：获取并存储所有货品的标识信息对应的特征数据。
一种可选的实施方式中，所述根据所述任务信息，监控作业人员的操作动作，包括：采集作业人员的第二图像；根据所述任务信息中的操作类型，对所述第二图像进行图像识别，识别出所述第二图像中与所述操作类型对应的操作动作。
一种可选的实施方式中，所述根据所述任务信息中的操作类型，对所述第二图像进行图像识别，识别出所述第二图像中与所述操作类型对应的操作动作，包括：通过神经网络模型，根据所述任务信息中 的操作类型，对所述第二图像进行图像识别，识别出所述第二图像中与所述操作类型对应的操作动作。
一种可选的实施方式中，所述在作业人员对货品进行所述任务信息对应的操作动作时，采集被操作货品的第一图像，包括：在确定作业人员对货品进行所述任务信息对应的操作动作时，启动第一图像采集装置采集被操作货品的第一图像。
一种可选的实施方式中，所述对所述被操作货品的第一图像进行图像处理，识别所述第一图像中的被操作货品之后，还包括：若无法识别出某一被操作货品的第一图像中的被操作货品，则展示第一提示信息，所述第一提示信息用于提示作业人员将该被操作货品的标识信息对准第一图像采集装置。
一种可选的实施方式中，还包括：采集包含被操作货品的标识信息的第三图像；识别出所述第三图像中被操作货品的标识信息。
一种可选的实施方式中，所述识别出所述第三图像中被操作货品的标识信息之后，还包括：提取并保存所述第一图像中的被操作货品的特征数据。
一种可选的实施方式中，所述提取并保存所述第一图像中的被操作货品的特征数据之后，还包括：向数量监测运算系统发送所述第三图像和所述第一图像中的被操作货品的特征数据。
一种可选的实施方式中，所述在作业人员根据所述任务信息进行作业的过程中，采集作业过程中被操作货品的第一货品信息之后，还包括：向数量监测运算系统发送所述第一图像。
一种可选的实施方式中，还包括：根据所述数量监测运算系统对所述第一货品信息的验证结果，若对所述第一货品信息验证不通过，则展示第二提示信息，所述第二提示信息用于提示作业人员核对所述作业过程中被操作货品的信息。
一种可选的实施方式中，所述采集作业过程中被操作货品的第一货品信息之后，还包括：接收搬运设备的货品监测系统发送的第四货品信息，所述第四货品信息包括所述作业过程中所述搬运设备的容器中被操作货品的品类和数量；根据所述第四货品信息，对所述第一货品信息进行验证。
一种可选的实施方式中，还包括：根据所述第四货品信息，若对所述第一货品信息的验证不通过，则展示第三提示信息，所述第三提示信息用于提示作业人员核对所述作业过程中被操作货品的信息。
一种可选的实施方式中，所述采集作业过程中被操作货品的第一货品信息之后，还包括：向搬运设备的货品监测系统发送所述第一货品信息。
本公开的第二个方面是提供一种货品拣选的方法，应用于数量监测运算系统，包括：
接收智能交互眼镜系统发送的第一货品信息，所述第一货品信息为在一次任务的作业过程中被操作货品的信息；获取搬运设备的监测系统发送的第三货品信息，所述第三货品信息为在同一所述任务的作业过程中，所述搬运设备的容器中被操作货品的信息；根据所述第三货品信息对所述第一货品信息进行验证，并将验证结果发送给智能交互眼镜系统。一种可选的实施方式中，所述第三货品信息包括：
所述搬运设备的货品监测系统发送的第四货品信息，所述第四货品信息包括所述作业过程中所述搬运设备的容器中被操作货品的品类和数量；和/或，所述搬运设备的重量监测系统发送的第五货品信息，所述第五货品信息包括所述作业过程中所述搬运设备的容器中被操作货品的数量。
一种可选的实施方式中，所述根据所述第三货品信息对所述第一货品信息进行验证，包括：判断所述第一货品信息与所述第四货品信息是否一致；若所述第一货品信息与所述第四货品信息一致，则对所述第一货品信息验证通过；若所述第一货品信息与所述第四货品信息不一致，则对所述第一货品信息验证不通过。
一种可选的实施方式中，所述根据所述第三货品信息对所述第一货品信息进行验证，包括：判断所述第五货品信息与所述第一货品信息中的被操作货品的数量是否一致；若所述第五货品信息与所述第一货品信息中的被操作货品的数量一致，则对所述第一货品信息验证通过；若所述第五货品信息与所述第一货品信息中的被操作货品的数量不一致，则对所述第一货品信息验证不通过。
一种可选的实施方式中，还包括：接收所述智能交互眼镜系统发送的所述任务的作业过程中被操作货品的第一图像和第三图像，所述第三图像包含被操作货品的标识信息；根据所述被操作货品的第一图像和第三图像，对所述第一货品信息进行验证。
一种可选的实施方式中，还包括：接收所述智能交互眼镜系统发送的所述第一图像中的被操作货品的特征数据；存储所述第一图像中的被操作货品的特征数据。
一种可选的实施方式中，还包括：接收所述货品监测系统发送的所述任务的作业过程中被操作货品的第四图像和第六图像，所述第六图像包含被操作货品的标识信息；根据所述被操作货品的第四图像和第六图像，对所述第四货品信息进行验证。
一种可选的实施方式中，还包括：接收所述货品监测系统发送的所述第四图像中的被操作货品的特征数据；存储所述第四图像中的被操作货品的特征数据。
本公开的第三个方面是提供一种货品拣选的方法，应用于搬运设备的货品监测系统，所述搬运设备 包括用于容纳货品的容器，所述货品监测系统包括用于采集所述容器内货品图像的第二图像采集装置，所述方法包括：
接收任务信息；在作业人员根据所述任务信息进行作业的过程中，采集作业过程中搬运设备的容器中被操作货品的第四货品信息；向数量监测运算系统发送所述第四货品信息，所述第四货品信息用于对智能交互眼镜系统在作业人员根据所述任务信息进行作业的过程中采集的被操作货品的第一货品信息进行验证。
一种可选的实施方式中，在作业人员根据所述任务信息进行作业的过程中，采集作业过程中被操作货品的第一货品信息，包括：在作业人员根据所述任务信息进行作业的过程中，采集所述容器中被操作货品的第四图像；根据所述容器中被操作货品的第四图像，确定作业过程中所述容器中被操作货品的第四货品信息。
一种可选的实施方式中，所述在作业人员根据所述任务信息进行作业的过程中，采集所述容器中被操作货品的第四图像，包括：根据所述任务信息，监控对所述容器中货品的操作动作；在作业人员对货品进行所述任务信息对应的操作动作时，采集所述容器中被操作货品的第四图像；其中，所述任务信息对应的操作动作包括：将货品放入所述容器中的操作动作，或者，从所述容器中拿出货品的操作动作。
一种可选的实施方式中，所述根据所述容器中被操作货品的第四图像，确定作业过程中所述容器中被操作货品的第四货品信息，包括：对所述第四图像进行图像处理，识别所述第四图像中的被操作货品；根据识别出的所述第四图像中的被操作货品的标识信息，确定所述作业过程中所述容器中被操作货品的品类和数量。
一种可选的实施方式中，所述对所述第四图像进行图像处理，识别所述第四图像中的被操作货品，包括：对所述第四图像进行图像处理，提取所述第四图像中的货品特征数据；将所述货品特征数据与所有货品的标识信息对应的特征数据进行匹配，确定所述第四图像中的被操作货品的标识信息。
一种可选的实施方式中，所述将所述货品特征数据与所有货品的标识信息对应的特征数据进行匹配，确定所述第四图像中的被操作货品的标识信息之前，还包括：获取并存储所有货品的标识信息对应的特征数据。
一种可选的实施方式中，所述根据所述任务信息，监控对所述容器中货品的操作动作，包括：采集拍摄范围内作业人员的第五图像；根据所述任务信息中的操作类型，对所述第五图像进行图像识别，识别出所述第五图像中与所述操作类型对应的操作动作。
一种可选的实施方式中，所述根据所述任务信息中的操作类型，对所述第五图像进行图像识别，识别出所述第五图像中与所述操作类型对应的操作动作，包括：通过神经网络模型，根据所述任务信息中的操作类型，对所述第五图像进行图像识别，识别出所述第五图像中与所述操作类型对应的操作动作。
一种可选的实施方式中，所述在作业人员对货品进行所述任务信息对应的操作动作时，采集所述容器中被操作货品的第四图像，包括：在确定作业人员对货品进行所述任务信息对应的操作动作时，启动第二图像采集装置采集所述容器中被操作货品的第四图像。
一种可选的实施方式中，所述对所述第四图像进行图像处理，识别所述第四图像中的被操作货品之后，还包括：若无法识别出某一被操作货品的第四图像中的被操作货品，则展示第四提示信息，所述第四提示信息用于提示作业人员将该被操作货品的标识信息对准第二图像采集装置。
一种可选的实施方式中，还包括：采集包含被操作货品的标识信息的第六图像；识别出所述第六图像中被操作货品的标识信息。
一种可选的实施方式中，所述识别出所述第六图像中被操作货品的标识信息之后，还包括：提取并保存所述第四图像中的被操作货品的特征数据。
一种可选的实施方式中，所述提取并保存所述第六图像中的被操作货品的特征数据之后，还包括：向数量监测运算系统发送所述第六图像和所述第四图像中的被操作货品的特征数据。
一种可选的实施方式中，所述在作业人员根据所述任务信息进行作业的过程中，采集作业过程中搬运设备的容器中被操作货品的第四货品信息之后，还包括：向数量监测运算系统发送所述第四图像。
一种可选的实施方式中，若所述容器为除货叉之外的容器，所述第二图像采集装置安装于货叉上，接收任务信息之后，还包括：调整所述货叉的位置，以使所述第二图像采集装置能够采集到所述容器中货品的图像。
一种可选的实施方式中，所述在作业人员根据所述任务信息进行作业的过程中，采集作业过程中搬运设备的容器中被操作货品的第四货品信息之后，还包括：接收智能交互眼镜系统发送的第一货品信息，所述第一货品信息包括作业过程中被操作货品的品类和数量；根据所述第一货品信息，对所述第四货品信息进行验证。
一种可选的实施方式中，还包括：根据所述第一货品信息，若对所述第四货品信息进行验证不通过，则展示第五提示信息，所述第五提示信息用于提示作业人员核对所述作业过程中被操作货品的信息。
一种可选的实施方式中，所述在作业人员根据所述任务信息进行作业的过程中，采集作业过程中搬运设备的容器中被操作货品的第四货品信息之后，还包括：向智能交互眼镜系统发送所述第四货品信息。
本公开的第四个方面是提供一种货品拣选的方法，应用于搬运设备的重量监测系统，所述搬运设备包括用于容纳货品的容器，所述重量监测系统包括用于检测所述容器中货品重量的重量检测装置，所述方法包括：
接收任务信息；在作业人员根据所述任务信息进行作业的过程中，采集作业过程中搬运设备的容器中被操作货品的第五货品信息；向数量监测运算系统发送所述第五货品信息，所述第五货品信息用于对智能交互眼镜系统在作业人员根据所述任务信息进行作业的过程中采集的被操作货品的第一货品信息进行验证。
一种可选的实施方式中，所述在作业人员根据所述任务信息进行作业的过程中，采集作业过程中搬运设备的容器中被操作货品的第五货品信息，包括：采集作业过程中搬运设备的容器中被操作货品的总体重量；根据所述任务信息中被操作货品的单个重量，以及所述总体重量，计算作业过程中搬运设备的容器中被操作货品的数量。
一种可选的实施方式中，所述采集作业过程中搬运设备的容器中被操作货品的总体重量，包括：采集所述作业过程开始时所述容器中货品的第一重量，以及所述作业过程结束时所述容器中货品的第二重量；计算所述第一重量与第二重量的差值，得到所述作业过程中搬运设备的容器中被操作货品的总体重量。
一种可选的实施方式中，所述采集所述作业过程开始时所述容器中货品的第一重量，以及所述作业过程结束时所述容器中货品的第二重量，包括：当接收到所述任务信息时，采集所述容器中货品的重量，得到所述第一重量；当接收到下一个任务信息、或者接收到所述任务信息对应的任务结束指令时，采集所述容器中货品的重量，得到所述第二重量。
一种可选的实施方式中，所述采集所述容器中货品的重量，包括：接收多个重量传感器的重量值，所述多个重量传感器均用于采集所述容器中货品的重量；将所述多个重量传感器的检测值中出现次数最多的重量值，作为所述容器中货品的重量。
本公开的第五个方面是提供一种货品拣选的方法，应用于仓储管理系统，包括：
发送任务信息，所述任务信息包括操作类型及第二货品信息；接收第一货品信息，所述第一货品信息为在作业人员根据所述任务信息进行作业的过程中，智能交互眼镜系统采集的作业过程中被操作货品的第一货品信息；根据所述第一货品信息和第二货品信息，确认任务是否完成，并更新货品库存信息。
一种可选的实施方式中，所述发送任务信息，包括：向智能交互眼镜系统、搬运设备的货品监测系统和重量监测系统发送任务信息。
本公开的第六个方面是提供一种货品拣选的装置，应用于智能交互眼镜系统，包括：
任务信息处理模块，用于接收并展示任务信息；
货品信息管理模块，用于在作业人员根据所述任务信息进行作业的过程中，采集作业过程中被操作货品的第一货品信息；
所述货品信息管理模块还用于向数量监测运算系统发送所述第一货品信息；
所述货品信息管理模块还用于根据所述数量监测运算系统对所述第一货品信息的验证结果，若对所述第一货品信息验证通过，则将所述第一货品信息发送给仓储管理系统。
本公开的第七个方面是提供一种货品拣选的装置，应用于数量监测运算系统，包括：
货品信息获取模块，用于接收智能交互眼镜系统发送的第一货品信息，所述第一货品信息为在一次任务的作业过程中被操作货品的信息；
所述货品信息获取模块还用于获取搬运设备的监测系统发送的第三货品信息，所述第三货品信息为在同一所述任务的作业过程中，所述搬运设备的容器中被操作货品的信息；
货品信息验证模块，用于根据所述第三货品信息对所述第一货品信息进行验证，并将验证结果发送给智能交互眼镜系统。
本公开的第八个方面是提供一种货品拣选的装置，应用于搬运设备的货品监测系统，所述搬运设备包括用于容纳货品的容器，所述货品监测系统包括用于采集所述容器内货品图像的第二图像采集装置，所述货品拣选的装置包括：
任务接收模块，用于接收任务信息；
货品信息管理模块，用于在作业人员根据所述任务信息进行作业的过程中，采集作业过程中搬运设备的容器中被操作货品的第四货品信息；
所述货品信息管理模块还用于向数量监测运算系统发送所述第四货品信息，所述第四货品信息用于对智能交互眼镜系统在作业人员根据所述任务信息进行作业的过程中采集的被操作货品的第一货品信息进行验证。
本公开的第九个方面是提供一种货品拣选的装置，应用于搬运设备的重量监测系统，所述搬运设备包括用于容纳货品的容器，所述重量监测系统包括用于检测所述容器中货品重量的重量检测装置，所述货品拣选的装置包括：
任务接收模块，用于接收任务信息；
货品信息管理模块，用于在作业人员根据所述任务信息进行作业的过程中，采集作业过程中搬运设备的容器中被操作货品的第五货品信息；
所述货品信息管理模块还用于向数量监测运算系统发送所述第五货品信息，所述第五货品信息用于对智能交互眼镜系统在作业人员根据所述任务信息进行作业的过程中采集的被操作货品的第一货品信息进行验证。
本公开的第十个方面是提供一种货品拣选的装置，应用于仓储管理系统，包括：
任务下发模块，用于发送任务信息，所述任务信息包括操作类型及第二货品信息；
货品信息接收模块，用于接收第一货品信息，所述第一货品信息为在作业人员根据所述任务信息进行作业的过程中，智能交互眼镜系统采集的作业过程中被操作货品的第一货品信息；
任务确认模块，用于根据所述第一货品信息和第二货品信息，确认任务是否完成，并更新货品库存信息。
本公开的第十一个方面是提供一种货品拣选的设备，包括：
处理器，存储器，以及存储在所述存储器上并可在所述处理器上运行的计算机程序；其中，所述处理器运行所述计算机程序时实现上述任一方面中任一项所述的方法。
本公开的第十二个方面是提供一种计算机可读存储介质，所述计算机可读存储介质中存储有计算机程序，所述计算机程序被处理器执行时实现上述任一方面中任一项所述的方法。
本公开的第十三个方面是提供一种计算机程序产品，包括计算机程序，所述计算机程序在被处理器执行时实现上述任一方面中任一项所述的方法。
本公开提供的货品拣选的方法、装置、设备、存储介质及程序产品，通过智能交互眼镜系统可以接收并展示仓储管理系统下发的任务信息，以使作业人员可以依据所展示的任务信息进行作业。在作业人员根据所述任务信息进行作业的过程中，智能交互眼镜系统自动地采集作业过程中被操作货品的第一货品信息，并向数量监测运算系统发送所述第一货品信息。数量监测运算系统能够基于搬运设备的至少一个监测系统在作业过程中采集的第三货品信息对第一货品信息进行验证，并反馈验证结果。智能交互眼镜系统在确定对所述第一货品信息验证通过后，将所述第一货品信息发送给仓储管理系统，仓储管理系统根据第一货品信息确认任务是否完成，并更新库存信息。本公开实施例能够实现自动化的智能拣选过程，在拣选的整个作业过程中，作业人员无需手动操作电脑或者电子标签系统等电子设备，即可实现货品实物的流量与信息系统同步，确保实际操作的货品信息的准确性，保证人员作业的连惯性，大大提高了作业效率。
附图说明
图1为本公开实施例提供的一种货品拣选系统的框架图；
图2为本公开另一实施例提供的一种货品拣选系统的框架图；
图3为本公开实施例提供的货品拣选的方法流程图；
图4为本公开另一实施例提供的货品拣选的方法流程图；
图5为本公开实施例提供的货品监测系统的结构示意图；
图6为本公开另一实施例提供的货品拣选的方法流程图；
图7为本公开另一实施例提供的货品拣选的方法流程图；
图8为本公开实施例提供的重量监测系统的结构示意图；
图9为本公开另一实施例提供的货品拣选的方法流程图；
图10为本公开另一实施例提供的智能拣选系统的总体流程示意图；
图11为本公开实施例提供的货品拣选的装置的结构示意图；
图12为本公开实施例提供的货品拣选的装置的结构示意图；
图13为本公开实施例提供的货品拣选的装置的结构示意图；
图14为本公开实施例提供的货品拣选的装置的结构示意图；
图15为本公开实施例提供的货品拣选的装置的结构示意图；
图16为本公开实施例提供的货品拣选的设备的结构示意图。
附图标记：
10-货品拣选系统   11-智能交互眼镜系统   12-仓储管理系统
13-拣选台         14-搬运设备           15-货品监测系统
16-重量监测系统   17-数量监测运算系统   110-智能交互眼镜
111-第一处理器    112-眼镜本体          113-第一图像采集装置
114-信息展示装置  151-第二图像采集装置  152-第二处理器
153-灯光指示装置  161-第三处理器        162-重量检测装置
171-第四处理器
具体实施方式
这里将详细地对示例性实施例进行说明，其示例表示在附图中。下面的描述涉及附图时，除非另有表示，不同附图中的相同数字表示相同或相似的要素。以下示例性实施例中所描述的实施方式并不代表与本公开相一致的所有实施方式。相反，它们仅是与如所附权利要求书中所详述的、本公开的一些方面相一致的装置和方法的例子。
本公开所涉及的术语“第一”、“第二”、“第三”等仅用于描述目的，而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。在以下各实施例的描述中，“多个”的含义是两个以上，除非另有明确具体的限定。
在智能仓储领域，目前常见的自动化仓库实现了货到人拣选，增加了信息系统、自动化搬运机器人、立体库、输送线、拣选工作站等自动化设备。但是自动化仓库整个作业流程中，在各个货品拣选场景下，都需要作业人员与电脑或者电子标签系统等进行交互，以满足货品实物的流量与信息系统同步，员工操作信息系统的差错概率大，人员作业的不连惯性导致作业效率低。
例如，以仓储搬运机器人货到人拆零拣选场景拣货的场景为例，拣选动作的拆解：机器人进入拣选工作站→员工看拣货电脑界面提示的拣货信息→寻找目标拣选位置→扫描目标商品→操作拣货电脑界面输入拣选的商品数量→分播墙电子标签灯亮提示员工分播商品的目的位置→员工投递商品→拍灯确认→员工查看电脑界面信息提示→准备下一次拣选作业。由此可见，整个作业环节，作业人员并没有全部连续的进行拣选作业，会有较大一部分的时间用于与电脑系统和电子标签系统等进行信息交互。电子标签拣选系统的硬件成本和信息系统交互的电脑成本高，员工与电脑操作的差错概率大，人员作业的不连惯性效率低。
本公开实施例提供一种智能拣选系统，用于机器人或其他自动化仓出库、上架、盘点、理货、移库等与库内货品发生实际接触的场景，该智能拣选系统会自动接收与展示任务信息，并自动核对作业准确性、货品变更记录。操作人员全程只需实际操作即可，完全不需要与电脑系统或者掌上电脑(Personal Digital Assistant，简称PDA)之类的其他设备进行信息交互。
下面以具体地实施例对本公开的技术方案以及本申请的技术方案如何解决上述技术问题进行详细说明。下面这几个具体的实施例可以相互结合，对于相同或相似的概念或过程可能在某些实施例中不再赘述。下面将结合附图，对本公开的实施例进行描述。
图1为本公开实施例提供的一种货品拣选系统的框架图。如图1所示，货品拣选系统10包括智能交互眼镜系统11、仓储管理系统(Warehouse Management System，简称WMS)12、拣选台13和搬运设备14。其中，仓储管理系统12与搬运设备14之间具有通信连接，用于控制搬运设备14将待拣选的货品搬运至拣选台13，拣选台13用于进行货品拣选操作。其中，搬运设备14用于货品被搬运的过程中承载或搬运货品，可以是机器人、输送线、货架等。
本实施例中，任意两个设备，或者两个系统，或者系统与设备之间的通信连接，可以是电连接、或者通过无线/有线信号连接，能够实现两者之间的数据通信即可，本实施例对于两者具体采用何种连接不做具体限定。
智能交互眼镜系统11包括的智能交互眼镜110和第一处理器111。智能交互眼镜110包括眼镜本体112，眼镜本体112上设置有第一图像采集装置113和信息展示装置114。其中，仓储管理系统12与第一处理器111之间具有通信连接，用于向第一处理器111下发任务信息。
仓储管理系统12与第一处理器111之间具有通信连接，仓储管理系统12用于向第一处理器111下发任务信息。
第一处理器111与信息展示装置114电连接，用于控制信息展示装置114展示任务信息，任务信息用于指示穿戴智能交互眼镜110的作业人员在拣选台13上进行货品拣选操作。当作业人员执行任务的过程中，作业人员需穿戴智能交互眼镜110，通过智能交互眼镜110的信息展示装置114接收任务信息， 并按照任务信息在拣选台13上进行货品拣选操作。
第一处理器111与第一图像采集装置113电连接，用于根据任务信息控制第一图像采集装置113采集拣选台13上被操作货品的图像，并根据被操作货品的图像确定被操作货品的第一货品信息。
第一处理器111还用于将第一货品信息传输至仓储管理系统12。
可选地，第一处理器111可以设置于眼镜本体112上，或者第一处理器111可以独立于智能交互眼镜110设置，并可以与智能交互眼镜110进行通信。
本实施例实现了自动化的智能拣选过程，在拣选的整个作业过程中，作业人员无需手动操作电脑或者电子标签系统等电子设备，即可实现货品实物的流量与信息系统同步，确保实际操作的货品信息的准确性，保证人员作业的连惯性，大大提高了作业效率。
可选地，信息展示装置114可以包括：显示装置和/或语音交互装置。在显示任务信息时，可以通过显示装置和/或语音交互装置进行显示。
可选地，显示装置可以作为智能交互眼镜110的镜片部分，作为显示屏幕使用，显示作业过程中的动态信息。显示装置作为显示屏幕，并非全屏幕展示信息，在显示信息的同时，作业人员仍然可通过显示屏幕看清实际的操作动作和货品。可选地，显示装置可以是微观电子屏幕。
语音交互装置用于实现智能交互眼镜系统11与作业人员之间的语音交互功能。具体地，语音交互装置可以包括耳机或者语音外放播放器等语音播放装置，用于向穿戴该智能交互眼镜110的作业人员播放语音信息。智能交互眼镜系统11要播放的音频信息可以通过耳机或者语音外放播放器传输至作业人员的耳朵，作业人员无需手动操作即可与智能交互眼镜系统进行交互。
可选地，语音交互装置还可以包括音频采集装置，用于采集作业人员输入的语音信息。
可选地，眼镜本体112上还设置有电源。电源用于为第一图像采集装置113和信息展示装置114供电。可选地，电源可以是电池或无线充电器等，以保障智能交互眼镜110的续航能力。
一种可选的实施方式中，如图2所示，搬运设备14上设置有货品监测系统15和/或重量监测系统16，搬运设备14还设置为用于容纳货品的容器(图中未示出)。仓储管理系统12还用于向智能交互眼镜系统11、货品监测系统15和重量监测系统16发送任务信息，启动对该任务的货品拣选的自动监测功能。货品拣选系统中的智能交互眼镜系统11、仓储管理系统12、搬运设备14、货品监测系统15、重量监测系统16和数量监测运算系统17中任意两者之间的连接关系如图2所示，任意两者之间具有连接线，说明两者之间具有通信连接，能够进行数据通信。
货品监测系统15用于在作业人员根据任务信息进行作业的过程中，监测作业过程中搬运设备14的容器中被操作货品的品类和第一数量，并将作业过程中搬运设备14的容器中被操作货品的品类和第一数量发送到数量监测运算系统17。本实施例中，为描述方便，用“第四货品信息”指代在作业人员根据任务信息进行作业的过程中，货品监测系统15监测到的作业过程中搬运设备14的容器中被操作货品的品类和第一数量。
重量监测系统16用于在作业人员根据任务信息进行作业的过程中，监测作业过程中搬运设备14的容器中被操作货品的第二数量，并将作业过程中搬运设备14的容器中被操作货品的第二数量发送到数量监测运算系统17。本实施例中，为描述方便，用“第五货品信息”指代在作业人员根据任务信息进行作业的过程中，重量监测系统16监测到的作业过程中搬运设备14的容器中被操作货品第二数量。
可选地，货品拣选系统10还可以包括数量监测运算系统17。智能交互眼镜系统11还用于将第一货品信息发送至数量监测运算系统17。数量监测运算系统17用于对第一货品信息进行验证，并将验证结果反馈给智能交互眼镜系统11。可选地，数量监测运算系统17还用于根据货品监测系统15发送的第四货品信息，和/或，重量监测系统16发送的第五货品信息，对第一货品信息进行验证；也就是，数量监测运算系统17根据第四货品信息和/或第五货品信息，对第一货品信息进行验证。
智能交互眼镜系统11还用于根据数量监测运算系统反馈的验证结果，若对第一货品信息验证通过，则将第一货品信息发送给仓储管理系统12。仓储管理系统12还用于根据第一货品信息和任务信息，确认任务是否完成，并更新货品库存信息。图3为本公开实施例提供的货品拣选的方法流程图。基于上述图1或图2所示的货品拣选系统，本实施例提供了货品拣选的方法，如图3所示，该方法具体步骤如下：
步骤S200、仓储管理系统向智能交互眼镜系统发送任务信息，任务信息包括操作类型及第二货品信息。
在需要进行货品拣选作业的任务时，仓储管理系统根据任务需要，向智能交互眼镜系统发送任务信息。
其中，任务信息包括执行任务时作业人员的操作类型，以及第二货品信息。第二货品信息包括待操作货品的存储位置、品类及数量。
步骤S201、智能交互眼镜系统接收并展示任务信息。
本实施例中，当作业人员执行任务时，穿戴智能交互眼镜。智能交互眼镜系统负责接收仓储管理系统WMS下发的待作业任务的任务信息，并通过智能交互眼镜展示任务信息。作业人员可以按照智能交互眼镜展示的任务信息进行实际作业。
步骤S202、在作业人员根据任务信息进行作业的过程中，采集作业过程中被操作货品的第一货品信息。
智能交互眼镜通过第一图像采集装置，可以实时地监控作业人员的操作动作，在作业人员根据任务信息进行作业的过程中，实时地监控和采集作业过程中被操作货品的图像。智能交互眼镜系统的处理器根据采集的作业过程中被操作货品的图像，自动识别和确定本次任务作业过程中被操作货品的第一货品信息。
其中，第一货品信息可以包括被操作货品的品类和数量。
步骤S203、向数量监测运算系统发送第一货品信息。
步骤S204、数量监测运算系统接收智能交互眼镜系统发送的第一货品信息，第一货品信息为在一次任务的作业过程中被操作货品的信息。
步骤S205、数量监测运算系统获取搬运设备的监测系统发送的第三货品信息，第三货品信息为在同一任务的作业过程中，搬运设备的容器中被操作货品的信息。
本实施例中，数量监测运算系统还可以与搬运设备的货品监测系统和/或质量监测系统进行交互，获取搬运设备的监测系统发送的第三货品信息。
可选地，第三货品信息可以包括货品监测系统发送的第四货品信息，和/或，质量监测系统发送的第五货品信息。其中，第四货品信息为在同一任务的作业过程中，货品监测系统自动监测确定的搬运设备的容器中被操作货品的信息。第四货品信息包括被操作货品的品类和数量。第五货品信息为在同一任务的作业过程中，质量监测系统自动监测确定的搬运设备的容器中被操作货品的信息。第五货品信息包括被操作货品数量。
步骤S206、数量监测运算系统根据第三货品信息对第一货品信息进行验证，并将验证结果发送给智能交互眼镜系统。
数量监测运算系统根据第三货品信息对第一货品信息进行验证，确定对第一货品信息是否验证通过，并将验证结果发送给智能交互眼镜系统。
步骤S207、智能交互眼镜系统根据数量监测运算系统对第一货品信息的验证结果，若对第一货品信息验证通过，则将第一货品信息发送给仓储管理系统。
智能交互眼镜系统接收数量监测运算系统对第一货品信息的验证结果。根据对第一货品信息的验证结果，若对第一货品信息验证通过，则第一货品信息准确无误，将第一货品信息发送给仓储管理系统。
步骤S208、根据数量监测运算系统对第一货品信息的验证结果，若对第一货品信息验证不通过，则展示第二提示信息，第二提示信息用于提示作业人员核对作业过程中被操作货品的信息。
根据对第一货品信息的验证结果，若对第一货品信息验证不通过，说明第一货品信息不准确，需要作业人员人工核对，则智能交互眼镜系统展示第二提示信息，第二提示信息用于提示作业人员核对作业过程中被操作货品的信息。其中第一提示信息的展示方式与任务信息的展示方式一致，此处不再赘述。
步骤S209、仓储管理系统接收第一货品信息，第一货品信息为在作业人员根据任务信息进行作业的过程中，智能交互眼镜系统采集的作业过程中被操作货品的第一货品信息。
步骤S210、根据第一货品信息和第二货品信息，确认任务是否完成，并更新货品库存信息。
仓储管理系统接收到智能交互眼镜系统发送的第一货品信息之后，根据任务信息中需要作业的货品的第二货品信息和实际作业过程中被操作货品的第一货品信息，确认本次任务是否完成，并根据第一货品信息更新货品库存信息。
可选地，如果本次任务完成，仓储管理系统还可以向智能交互眼镜系统发送任务成功消息，智能交互眼镜系统可以向作业人员展示任务成功消息。
可选地，如果本次任务未完成，仓储管理系统根据第一货品信息和第二货品信息之间的差异，重新制定用于修正本次任务的新任务，并下方新任务的任务信息。基于新任务的任务信息，智能仓储系统执行新任务。
本公开实施例通过智能交互眼镜系统可以接收并展示仓储管理系统下发的任务信息，以使作业人员可以依据所展示的任务信息进行作业。在作业人员根据任务信息进行作业的过程中，智能交互眼镜系统自动地采集作业过程中被操作货品的第一货品信息，并向数量监测运算系统发送第一货品信息。数量监测运算系统能够基于搬运设备的至少一个监测系统在作业过程中采集的第三货品信息对第一货品信息进行验证，并反馈验证结果。智能交互眼镜系统在确定对第一货品信息验证通过后，将第一货品信息发送给仓储管理系统，仓储管理系统根据第一货品信息确认任务是否完成，并更新库存信息。本公开实施 例能够实现自动化的智能拣选过程，在拣选的整个作业过程中，作业人员无需手动操作电脑或者电子标签系统等电子设备，即可实现货品实物的流量与信息系统同步，确保实际操作的货品信息的准确性，保证人员作业的连惯性，大大提高了作业效率。
图4为本公开另一实施例提供的货品拣选的方法流程图。在上述图3对应方法实施例的基础上，本实施例中，对货品拣选的方法流程进行详细地说明。如图4所示，该方法具体步骤如下：
步骤S300、仓储管理系统向智能交互眼镜系统发送任务信息，任务信息包括操作类型及第二货品信息。
该步骤与上述步骤S200一致，此处不再赘述。
步骤S301、智能交互眼镜系统接收并展示任务信息。
其中，任务信息包括操作类型和第二货品信息，第二货品信息包括待操作货品的存储位置、品类及数量。
可选地，展示任务信息包括：通过显示装置显示任务信息；和/或，通过语音交互装置播放任务信息。例如，可以通过智能交互眼镜的镜片显示任务信息，和/或，通过语音交互装置播放任务信息对应的音频信息。
可选地，为了便于作业人员了解待作业货品的外观等信息，提高作业人员的拣选效率，在展示信息时，还可以根据第二货品信息，展示待操作货品的特征信息。其中，待操作货品的特征信息包括一下至少一种：待操作货品的图像、标识信息、外观信息。货品的标识信息可以能够唯一标识货品的一维码、二维码等信息。
作业人员通过智能交互眼镜系统接收到任务信息之后，无需任务手动反馈操作，可以直接按照任务信息进行相应的作业，也可以自由操作完成任务。
本实施例的一种可选的实施方式中，在作业人员根据任务信息进行作业的过程中，采集作业过程中被操作货品的第一货品信息，包括：在作业人员根据任务信息进行作业的过程中，采集被操作货品的第一图像；根据被操作货品的第一图像，确定作业过程中被操作货品的第一货品信息。
具体可以通过后续步骤S302-S303，在作业人员根据任务信息进行作业的过程中，采集被操作货品的第一图像。通过后续步骤S304-S305，可以根据被操作货品的第一图像，确定作业过程中被操作货品的第一货品信息。
步骤S302、根据任务信息，监控作业人员的操作动作。
本实施例中，智能交互眼镜系统可以通过第一图像采集装置实时地监控作业人员的操作动作，当确定作业人员进行对应的操作动作，操作实物货品时，启动第一图像采集装置采集被操作货品的图像。
具体地，该步骤可以采用如下方式实现：
采集作业人员的第二图像；根据任务信息中的操作类型，对第二图像进行图像识别，识别出第二图像中与操作类型对应的操作动作。
其中，第二图像是指第一图像采集装置采集范围内的包含作业人员操作动作的图像。该步骤中，通过监控与任务信息中操作类型对应的操作动作，来监控作业人员是否进行本次任务的作业。如果第二图像中包含与任务信息中操作类型对应的操作动作，则说明作业人员开始作业，可以启动第一图像采集装置采集被操作货品的第一图像。如果第二图像中不包含与任务信息中操作类型对应的操作动作，则说明作业人员还未开始本次任务的作业，第一图像继续作业人员的操作动作，直至作业人员开始作业。
可选地，可以通过神经网络模型，根据任务信息中的操作类型，对第二图像进行图像识别，识别出第二图像中与操作类型对应的操作动作。这样，智能交互眼镜系统通过预先训练好的神经网络模型，来判别第二图像中是否包含对应操作动作，并在第二图像中包含对应操作动作时，自动触发第一图像采集装置采集被操作货品的第一图像，存储第一图像。
步骤S303、在作业人员对货品进行任务信息对应的操作动作时，采集被操作货品的第一图像。
示例性地，在确定作业人员对货品进行任务信息对应的操作动作时，启动第一图像采集装置采集被操作货品的第一图像。
步骤S304、对被操作货品的第一图像进行图像处理，识别第一图像中的被操作货品。
本实施例中，智能交互眼镜系统可以存储所有货品的品类信息和特征数据，并将货品的标识信息与品类信息和特征数据绑定。其中，货品的特征数据包括货品的外观特征，具体包括尺寸、颜色、形状、包含的特殊图形、以及其他特征。基于货品的特征数据可以对图像中出现的货品进行识别。
在对被操作货品的第一图像进行图像处理，识别第一图像中的被操作货品之前，智能交互眼镜系统获取并存储所有货品的标识信息对应的特征数据。
进一步地，该步骤具体可以采用如下方式实现：
对被操作货品的第一图像进行图像处理，提取第一图像中的货品特征数据；将货品特征数据与所有 货品的标识信息对应的特征数据进行匹配，确定第一图像中的被操作货品的标识信息。
步骤S305、根据识别出的第一图像中的被操作货品的标识信息。
在识别出所有第一图像中的被操作货品的标识信息之后，可以确定在本次任务的作业过程中所有的被操作货品，可以进一步统计得到被操作货品的数量。进一步地，还可以根据所有货品的标识信息绑定的品类信息，可以确定作业过程中所有的被操作货品的品类。
步骤S306、若无法识别出某一被操作货品的第一图像中的被操作货品，则展示第一提示信息，第一提示信息用于提示作业人员将该被操作货品的标识信息对准第一图像采集装置。
在上述步骤S304中，若无法识别出某一被操作货品的第一图像中的被操作货品，智能交互眼镜系统展示第一提示信息，以提示作业人员将该被操作货品的条形码等标识信息对准第一图像采集装置，第一图像采集装置就可以采集到包含被操作货品的标识信息的第三图像。
该步骤中第一提示信息的展示方式与任务信息的展示方式一致，此处不再赘述。
步骤S307、采集包含被操作货品的标识信息的第三图像，识别出第三图像中被操作货品的标识信息。
作业人员收到第一提示信息后，重新将该被操作货品的条形码等标识信息对准第一图像采集装置，第一图像采集装置采集包含被操作货品的标识信息的第三图像。智能交互眼镜系统可以识别出第三图像中被操作货品的标识信息，从而成功识别该被操作货品。
一种可选的实施方式中，对于某些对于货品信息的精确度要求较高的货品，可以要求作业人员进行操作时将货品的识别信息对准第一图像采集装置，第一图像采集装置直接采集包含被操作货品标识信息的第三图像，并基于第三图像进行识别。其中，对于货品信息的精确度要求较高的货品包括但不限于：医药类的货品、精密仪器、价格高昂的货品。
步骤S308、提取并保存第一图像中的被操作货品的特征数据。
在上述步骤S304中，若无法识别出某一被操作货品的第一图像中的被操作货品，说明已存储的特征数据中不包含该货品的特征数据，或者该货品特征数据发生了变化，例如更换包装等情况。在采集包含被操作货品的标识信息的第三图像，识别出第三图像中被操作货品的标识信息之后，智能交互眼镜系统提取第一图像中的被操作货品的特征数据，并更新与该货品的标识信息绑定的特征数据，实现货品特征的自主学习。下次再操作该货品时，智能交互眼镜系统就可以通过采集该货品的第一图像来识别出该货品。
可选地，智能交互眼镜系统还可以实时地或每间隔一段时间，与数量监测运算系统进行所有货品的标识信息绑定的特征数据同步更新。
步骤S309、确定作业过程中被操作货品的品类和数量，得到第一货品信息。
在识别出所有被操作货品的标识信息之后，智能交互眼镜系统可以获取与标识信息绑定的品类信息，从而确定被操作货品的品类，还可以进一步统计出被操作货品的数量，得到第一货品信息。
步骤S310、向数量监测运算系统发送第一货品信息。
智能交互眼镜系统在确定第一货品信息之后，向数量监测运算系统发送第一货品信息。
步骤S311、数量监测运算系统接收智能交互眼镜系统发送的第一货品信息，第一货品信息为在一次任务的作业过程中被操作货品的信息。
步骤S312、获取搬运设备的监测系统发送的第三货品信息，第三货品信息为在同一任务的作业过程中，搬运设备的容器中被操作货品的信息。
本实施例中，在本次任务的作业过程中，搬运设备的货品监测系统和/或重量监测系统可以实时地监测被操作货品的信息。数量监测运算系统还可以与搬运设备的货品监测系统和/或质量监测系统进行交互，获取搬运设备的监测系统发送的第三货品信息。
其中，第三货品信息包括：
搬运设备的货品监测系统发送的第四货品信息，和/或，搬运设备的重量监测系统发送的第五货品信息。其中，第四货品信息包括作业过程中搬运设备的容器中被操作货品的品类和数量，第五货品信息包括作业过程中搬运设备的容器中被操作货品的数量。
步骤S313、根据第三货品信息对第一货品信息进行验证，并将验证结果发送给智能交互眼镜系统。
本实施例中，第一货品信息为在作业过程中作业人员操作的货品的品类和数量，第四货品信息同一作业过程中搬运设备的容器中被操作货品的品类和数量，第一货品信息与第四货品信息应该一致。
若第三货品信息包括第四货品信息，该步骤中，根据第四货品信息对第一货品信息进行验证，具体可以采用如下方式实现：
判断第一货品信息与第四货品信息是否一致；若第一货品信息与第四货品信息一致，则对第一货品信息验证通过；若第一货品信息与第四货品信息不一致，则对第一货品信息验证不通过。
本实施例中，第五货品信息包括作业过程中搬运设备的容器中被操作货品的数量，第五货品信息中被操作货品的数量应该与第一货品信息中的被操作货品的数量一致。
若第三货品信息包括第五货品信息，该步骤中，根据第五货品信息对第一货品信息进行验证，具体可以采用如下方式实现：
判断第五货品信息与第一货品信息中的被操作货品的数量是否一致；若第五货品信息与第一货品信息中的被操作货品的数量一致，则对第一货品信息验证通过；若第五货品信息与第一货品信息中的被操作货品的数量不一致，则对第一货品信息验证不通过。
本实施例一种可选的实施方式中，智能交互眼镜系统还可以向数量监测运算系统发送第一图像和第三图像。数量监测运算系统接收智能交互眼镜系统发送的任务的作业过程中被操作货品的第一图像和第三图像，根据被操作货品的第一图像和第三图像，对第一货品信息进行验证。
具体地，数量监测运算系统对第一图像进行图像处理，识别第一图像中的被操作货品；对第三图像进行图像处理，识别出第三图像中被操作货品的标识信息；根据识别出的第一图像和第三图像中的被操作货品，确定作业过程中被操作货品的品类和数量。
其中，数量监测运算系统对第一图像进行图像处理，识别第一图像中的被操作货品，与上述步骤S304中智能交互眼镜系统对被操作货品的第一图像进行图像处理，识别第一图像中的被操作货品的实现方式一致，此次不再赘述。数量监测运算系统对第三图像进行图像处理，识别出第三图像中被操作货品的标识信息，与上述步骤S307中智能交互眼镜系统识别出第三图像中被操作货品的标识信息的实现方式一致，此次不再赘述。数量监测运算系统根据识别出的第一图像和第三图像中的被操作货品，确定作业过程中被操作货品的品类和数量，与上述步骤S309中智能交互眼镜系统确定作业过程中被操作货品的品类和数量的实现方式一致，此次不再赘述。
可选地，智能交互眼镜系统还向数量监测运算系统发送识别失败的第一图像中的被操作货品的特征数据。数量监测运算系统接收智能交互眼镜系统发送的第一图像中的被操作货品的特征数据，并存储第一图像中的被操作货品的特征数据。示例性地，数量监测运算系统将第一图像中的被操作货品的特征数据与被操作货品的标识信息对应存储，以将将第一图像中的被操作货品的特征数据与被操作货品的标识信息绑定。
可选地，数量监测运算系统还可以获取货品库存数据，基于本次任务中货品库存数据的变动信息，对第一货品信息进行验证。
在得到对第一货品信息的验证结果之后，数量监测运算系统将验证结果发送给智能交互眼镜系统。
步骤S314、智能交互眼镜系统根据数量监测运算系统对第一货品信息的验证结果，若对第一货品信息验证通过，则将第一货品信息发送给仓储管理系统。
仓储管理系统接收到智能交互眼镜系统发送的第一货品信息之后，进行上述步骤S209-S210的处理，本实施例此处不再赘述。
步骤S315、根据数量监测运算系统对第一货品信息的验证结果，若对第一货品信息验证不通过，则展示第二提示信息，第二提示信息用于提示作业人员核对作业过程中被操作货品的信息。
该步骤与上述步骤S208的实时方式一致，此处不再赘述。
本实施例中的一种可选的实施方式中，在任务的作业过程中，智能交互眼镜系统确定的第一货品信息，与搬运设备的货品监测系统确定的第四货品信息，可以相互核对校验。
具体地，智能交互眼镜系统接收搬运设备的货品监测系统发送的第四货品信息，第四货品信息包括作业过程中搬运设备的容器中被操作货品的品类和数量；根据第四货品信息，对第一货品信息进行验证。具体验证过程与上述步骤S313中，数量监测运算系统根据第四货品信息对第一货品信息进行验证的过程一致，此处不再赘述。
进一步地，根据第四货品信息，若对第一货品信息的验证不通过，则展示第三提示信息，第三提示信息用于提示作业人员核对作业过程中被操作货品的信息。其中第三提示信息的展示方式与任务信息的展示方式一致，此处不再赘述。
可选地，智能交互眼镜系统也可以向搬运设备的货品监测系统发送第一货品信息，以使搬运设备的货品监测系统根据第一货品信息，对货品监测系统确定的第四货品信息进行验证。
本实施例中，当任何一个环节验证不通过时，作业人员人工核对作业过程中被操作货品的信息之后，可以通过智能交互眼镜系统的语音交互装置或者辅助功能键反馈作业人员人工校验后的正确数据。智能交互眼镜系统接收到校验后的正确数据后，将校验后的正确数据同步更新到数量监测运算系统。
本公开实施例中，智能交互眼镜系统能够自动监控作业人员的操作动作，并采集被操作货品的第一图像，根据第一图像实现被操作货品的自动识别；进一步地，在对第一图像识别失败后，还可以采集包含货品标识信息的第三图像，基于第三图像可以识别出被操作货品，进一步提高了自动监控的第一货品 信息的准确性。另外，数量监测运算系统还可以获取搬运设备的货品监测系统自动采集的第四货品信息和/或重量监测系统自动采集的第五货品信息，通过第四货品信息和/或第五货品信息对第一货品信息进一步验证，提高了实际操作的货品信息的准确性，并且保证人员作业的连惯性，提高了作业效率。
图5为本公开实施例提供的货品监测系统的结构示意图。如图5所示，货品监测系统15包括：第二图像采集装置151和第二处理器152。其中第二图像采集装置151用于采集搬运设备容器内货品的图像。
其中，第二处理器152与仓储管理系统12之间具有通信连接，用于接收仓储管理系统12下发的任务信息。
第二处理器152与第二图像采集装置151电连接，用于根据任务信息控制第二图像采集装置151用于采集容器内货品的图像，并根据容器内货品的图像确定容器中被操作货品的品类和第一数量，得到第四货品信息。
在一些场景中，搬运设备14包括多个用于容纳货品的容器。货品监测系统15可以包括多个安装于搬运设备14上不同位置的第二图像采集装置151。
可选地，每个容器对应设置有至少一个第二图像采集装置151，每个第二图像采集装置151用于采集对应容器内货品的图像。例如，可以在每个容器附近安装一个第二图像采集装置151，每个第二图像采集装置151对准对应容器，用于采集对应容器内货品的图像。
可选地，搬运设备14还包括可移动装置，可移动装置上设置有第二图像采集装置151。第二处理器152与可移动装置电连接，第二处理器152还用于控制可移动装置移动至该容器对应位置，使得第二图像采集装置151对准该容器，并控制可移动装置上的第二图像采集装置151采集该容器内货品的图像。
例如，搬运设备可以是机器人，包括货叉和背篓两种容器，可以在货叉上和背篓的附近都安装一个摄像头，分别用于采集对应货叉或背篓内货品的图像；或者，可以在货叉上安装一个摄像头，可以采集货叉内货品的图像，在需要采集背篓内货品的图像时，货品监测系统可以向机器人发送控制指令，以使机器人控制货叉移动至对应位置，使得货叉上的摄像头可以采集到背篓内货品的图像。
可选地，货品监测系统15还包括灯光指示装置153，灯光指示装置153用于指示待操作的货品的拣选位置。当需要对某一货品进行操作时，该货品对应拣选位置的灯光指示装置153点亮，以便于作业人员快速找到该货品，可以提高作业效率。
可选地，数量监测运算系统17包括第四处理器171，第四处理器171与货品监测系统15的第二处理器152之间具有通信连接，第二处理器152用于将容器中被操作货品的品类(即第四货品信息)和第一数量传输至第四处理器171。
另外，第四处理器171与智能交互眼镜系统11的第一处理器111之间具有通信连接(图5中未示出智能交互眼镜系统中的其他部分，其他部分如图1中所示)，第一处理器111用于将第一货品信息传输至第四处理器171。第四处理器171还用于根据容器中被操作货品的品类和第一数量(即第四货品信息)对第一货品信息进行验证，将验证结果传输至第一处理器111。
可选地，货品监测系统15的第二处理器152与智能交互眼镜系统11的第一处理器111之间具有通信连接，第二处理器152与第一处理器111之间可以进行数据通信，进行第四货品信息和第一货品信息的相互验证。
图6为本公开另一实施例提供的货品拣选的方法流程图。在上述任一方法实施例的基础上，本实施例中，基于图5所示的货品监测系统，对货品监测系统执行的货品拣选的方法流程进行示例性地说明。如图6所示，该方法具体步骤如下：
步骤S401、仓储管理系统向搬运设备的货品监测系统发送任务信息。
本实施例中，在需要进行货品拣选作业的任务时，仓储管理系统根据任务需要，向搬运设备的货品监测系统发送任务信息。
其中，任务信息包括执行任务时作业人员的操作类型，以及第二货品信息。第二货品信息包括待操作货品的存储位置、品类及数量。
步骤S402、货品监测系统接收任务信息。
步骤S403、在作业人员根据任务信息进行作业的过程中，采集作业过程中搬运设备的容器中被操作货品的第四货品信息。
货品监测系统第二图像采集装置，可以实时地监控作业人员对搬运设备的容器中货品的操作动作，在作业人员根据任务信息进行作业的过程中，实时地监控和采集搬运设备的容器中被操作货品的信息。货品监测系统的处理器根据采集的作业过程中被操作货品的信息，自动识别和确定本次作业过程中搬运设备的容器中被操作货品的第四货品信息。
其中，第四货品信息可以包括被操作货品的品类和数量。
步骤S404、向数量监测运算系统发送第四货品信息，第四货品信息用于对智能交互眼镜系统在作业人员根据任务信息进行作业的过程中采集的被操作货品的第一货品信息进行验证。
在确定第四货品信息之后，货品监测系统向数量监测运算系统发送第四货品信息，以使数量监测运算系统根据第四货品信息，对智能交互眼镜系统在作业人员根据任务信息进行作业的过程中采集的被操作货品的第一货品信息进行验证。
步骤S405、数量监测运算系统接收第四货品信息。
步骤S406、数量监测运算系统根据第四货品信息对第一货品信息进行验证。
该步骤的实现方式已在上述步骤S313中进行了详细地说明，具体参见步骤S313，此处不再赘述。
本公开实施例中，在任务的作业过程中，无需作业人员手动操作，货品监测系统可以根据任务信息，自动采集作业过程中搬运设备的容器中被操作货品的第四货品信息，并将第四货品信息发送给数量监测运算系统，数量监测运算系统可以基于第四货品信息对同一作业过程中智能交互眼镜系统自动采集的第一货品信息进行验证，并反馈验证结果。智能交互眼镜系统在确定对第一货品信息验证通过后，将第一货品信息发送给仓储管理系统，仓储管理系统根据第一货品信息确认任务是否完成，并更新库存信息。本公开实施例能够实现自动化的智能拣选过程，在拣选的整个作业过程中，作业人员无需手动操作电脑或者电子标签系统等电子设备，即可实现货品实物的流量与信息系统同步，确保实际操作的货品信息的准确性，保证人员作业的连惯性，大大提高了作业效率。
图7为本公开另一实施例提供的货品拣选的方法流程图。在上述图6对应方法实施例的基础上，本实施例中，对搬运设备的货品监测系统执行的货品拣选的方法流程进行详细地说明。如图7所示，该方法具体步骤如下：
步骤S501、接收任务信息。
本实施例中，在作业人员根据任务信息进行作业的过程中，采集作业过程中被操作货品的第一货品信息，包括：
在作业人员根据任务信息进行作业的过程中，采集容器中被操作货品的第四图像；根据容器中被操作货品的第四图像，确定作业过程中容器中被操作货品的第四货品信息。
具体地，可以通过后续步骤S502-S503，在作业人员根据任务信息进行作业的过程中，采集容器中被操作货品的第四图像。
通过后续步骤S504-S505，根据容器中被操作货品的第四图像，确定作业过程中容器中被操作货品的第四货品信息。
一种可选的实施方式中，若容器为除货叉之外的容器，第二图像采集装置安装于货叉上。接收任务信息之后，货品监测系统调整货叉的位置，以使第二图像采集装置能够采集到容器中货品的图像。
例如，当前监控的搬运设备的容器可以是机器人的背篓，第二图像采集装置可以是设置于机器人的货叉上摄像头，接收到任务信息之后，货品监测系统调整货叉的位置，使得摄像头对准背篓，能够采集背篓中货品的图像，从而可以对作业人员对背篓中货品的操作动作进行监控。
步骤S502、根据任务信息，监控对容器中货品的操作动作。
其中，任务信息对应的操作动作包括：将货品放入容器中的操作动作，或者，从容器中拿出货品的操作动作。
根据任务信息，监控对容器中货品的操作动作，包括：
采集拍摄范围内作业人员的第五图像；根据任务信息中的操作类型，对第五图像进行图像识别，识别出第五图像中与操作类型对应的操作动作。
示例性地，可以通过神经网络模型，根据任务信息中的操作类型，对第五图像进行图像识别，识别出第五图像中与操作类型对应的操作动作。
该步骤的具体实现方式与上述步骤S302类似，此处不再赘述。
步骤S503、在作业人员对货品进行任务信息对应的操作动作时，采集容器中被操作货品的第四图像。
示例性地，在确定作业人员对货品进行任务信息对应的操作动作时，启动第二图像采集装置采集容器中被操作货品的第四图像。
步骤S504、对第四图像进行图像处理，识别第四图像中的被操作货品。
在对第四图像进行图像处理，识别第四图像中的被操作货品之后，货品监测系统获取并存储所有货品的标识信息对应的特征数据。
进一步地，该步骤具体可以采用如下方式实现：
对第四图像进行图像处理，提取第四图像中的货品特征数据；将货品特征数据与所有货品的标识信息对应的特征数据进行匹配，确定第四图像中的被操作货品的标识信息。
该步骤的具体实现方式与上述步骤S304类似，此处不再赘述。
步骤S505、根据识别出的第四图像中的被操作货品的标识信息，确定作业过程中容器中被操作货品的品类和数量。
该步骤的具体实现方式与上述步骤S305类似，此处不再赘述。
步骤S506、若无法识别出某一被操作货品的第四图像中的被操作货品，则展示第四提示信息，第四提示信息用于提示作业人员将该被操作货品的标识信息对准第二图像采集装置。
在上述步骤S504中，若无法识别出某一被操作货品的第四图像中的被操作货品，货品监测系统展示第四提示信息，以提示作业人员将该被操作货品的标识信息对准第二图像采集装置，第二图像采集装置就可以采集到包含被操作货品的标识信息的第六图像。
该步骤中第四提示信息可以通过货品监测系统的显示装置或语音交互装置进行展示，或者还可以通过点亮对应提示灯等其他方式进行展示，此处不再赘述。
步骤S507、采集包含被操作货品的标识信息的第六图像，识别出第六图像中被操作货品的标识信息。
该步骤的具体实现方式与上述步骤S307类似，此处不再赘述。
步骤S508、提取并保存第四图像中的被操作货品的特征数据。
本实施例中，识别出第六图像中被操作货品的标识信息之后，货品监测系统提取并保存第六图像中的被操作货品的特征数据。
在上述步骤S504中，若无法识别出某一被操作货品的第四图像中的被操作货品，说明已存储的特征数据中不包含该货品的特征数据，或者该货品特征数据发生了变化，例如更换包装等情况。在采集包含被操作货品的标识信息的第六图像，识别出第六图像中被操作货品的标识信息之后，货品监测系统提取第四图像中的被操作货品的特征数据，并更新与该货品的标识信息绑定的特征数据，实现货品特征的自主学习。下次再操作该货品时，货品监测系统就可以通过采集该货品的第四图像来识别出该货品。
可选地，货品监测系统还可以实时地或每间隔一段时间，与数量监测运算系统进行所有货品的标识信息绑定的特征数据同步更新。
一种可选的实施方式中，货品监测系统向数量监测运算系统发送第四图像。数量监测运算系统接收货品监测系统发送的任务的作业过程中被操作货品的第四图像；根据被操作货品的第四图像，对第四货品信息进行验证。
进一步地，货品监测系统向数量监测运算系统发送第六图像和第六图像中的被操作货品的特征数据。数量监测运算系统接收货品监测系统发送的任务的作业过程中被操作货品的第六图像和第六图像中的被操作货品的特征数据，第六图像包含被操作货品的标识信息；根据第六图像和第四图像，对第四货品信息进行验证；存储第六图像中的被操作货品的特征数据。
本实施例的一种可选的实施方式中，在任务的作业过程中，智能交互眼镜系统确定的第一货品信息，可以与搬运设备的货品监测系统确定的第四货品信息进行相互核对校验。
具体地，货品监测系统接收智能交互眼镜系统发送的第一货品信息，第一货品信息包括作业过程中被操作货品的品类和数量；根据第一货品信息，对第四货品信息进行验证。具体验证过程与上述步骤S313中，数量监测运算系统根据第四货品信息对第一货品信息进行验证的过程一致，此处不再赘述。
进一步地，根据第一货品信息，若对第四货品信息进行验证不通过，则展示第五提示信息，第五提示信息用于提示作业人员核对作业过程中被操作货品的信息。其中第五提示信息的展示方式与第四提示信息的展示方式一致，此处不再赘述。
可选地，货品监测系统也可以向智能交互眼镜系统发送第四货品信息，以使智能交互眼镜系统根据第四货品信息，对智能交互眼镜系统确定的第一货品信息进行验证。
本实施例中对货品监测系统能够自动监控作业人员的操作动作，并采集搬运设备的容器中被操作货品的第四图像，根据第四图像实现搬运设备的容器中被操作货品的自动识别；进一步地，在对第四图像识别失败后，还可以采集包含货品标识信息的第六图像，基于第六图像可以识别出被操作货品，进一步提高了自动监控的第四货品信息的准确性。数量监测运算系统根据货品监测系统自动采集的第四货品信息对智能交互眼镜系统在同一作业过程中自动采集的第一货品信息进一步验证，提高了实际操作的货品信息的准确性，并且保证人员作业的连惯性，提高了作业效率。
图8为本公开实施例提供的重量监测系统的结构示意图。如图8所示，重量监测系统16包括：第三处理器161，以及搬运设备的每个容器上设置的重量检测装置162。其中，重量检测装置162用于采集所在容器中货品的重量。
第三处理器161与仓储管理系统12之间具有通信连接，用于接收仓储管理系统下发的任务信息。
第三处理器161与重量检测装置162电连接，用于根据任务信息控制重量检测装置162在任务开始 采集所在容器中货品的第一重量，在任务结束时采集所在容器中货品的第二重量；第三处理器161还用于并根据任务信息中被操作货品的单个重量，以及第一重量和第二重量，计算容器中被操作货品的第二数量，得到第五货品信息。
具体地，第三处理器161还用于计算第一重量与第二重量的差值，得到作业过程中容器中被操作货品的总体重量；并根据任务信息中被操作货品的单个重量，以及容器中被操作货品总体重量，计算作业过程中容器中被操作货品的第二数量，得到第五货品信息。
可选地，搬运设备的每个容器上设置的重量检测装置162可以包括多个重量传感器，每个重量传感器用于检测所在容器中货品的重量。
第三处理器161与每个重量传感器电连接，用于接收多个重量传感器的检测值，将多个重量传感器的检测值中出现次数最多的重量值，作为容器中货品的重量。
可选地，重量传感器可以安装于搬运设备容器的内部，能够检测作业过程中容器内货品的重量的变化量。多个重量传感器之间可以互相校验，以提高对容器内部货品重量的检测的精确度。
可选地，重量传感器可以是应变式质量检测传感器。
其中，重量传感器的精确度可以根据容器存放货品的质量进行设置，容器存放货品的质量不同，可以使用不同精度的重量传感器。
可选地，数量监测运算系统17的第四处理器171与重量监测系统16的第三处理器161之间具有通信连接，第三处理器161用于将容器中被操作货品的第二数量(即第五货品信息)传输至第四处理器171。
第四处理器171与智能交互眼镜系统11的第一处理器111之间具有通信连接(图8中未示出智能交互眼镜系统中的其他部分，其他部分如图1中所示)，第一处理器111用于将第一货品信息传输至第四处理器171。第四处理器171还用于根据容器中被操作货品的第二数量(即第五货品信息)对第一货品信息进行验证，并将验证结果传输至第一处理器111。
可选地，第四处理器171还用于根据容器中被操作货品的第二数量(即第五货品信息)对第一货品信息进行验证，并根据容器中被操作货品的品类和第一数量(即第四货品信息)对第一货品信息进行验证，然后将验证结果传输至第一处理器111。
图9为本公开另一实施例提供的货品拣选的方法流程图。在上述任一方法实施例的基础上，本实施例中，基于图8所示的重量监测系统，对重量监测系统执行的货品拣选的方法流程进行示例性地说明。如图9所示，该方法具体步骤如下：
步骤S601、仓储管理系统向搬运设备的重量监测系统发送任务信息。
本实施例中，在需要进行货品拣选作业的任务时，仓储管理系统根据任务需要，向搬运设备的重量监测系统发送任务信息。
其中，任务信息包括执行任务时作业人员的操作类型，以及第二货品信息。第二货品信息包括待操作货品的存储位置、品类及数量。
可选地，仓储管理系统可以向搬运设备发送任务信息，由搬运设备将任务信息下发至货品监测系统和重量监测系统。
步骤S602、重量监测系统接收任务信息。
步骤S603、在作业人员根据任务信息进行作业的过程中，采集作业过程中搬运设备的容器中被操作货品的第五货品信息。
本实施例中，该步骤具体可以采用如下方式实现：
采集作业过程中搬运设备的容器中被操作货品的总体重量；根据任务信息中被操作货品的单个重量，以及总体重量，计算作业过程中搬运设备的容器中被操作货品的数量。
示例性地，采集作业过程中搬运设备的容器中被操作货品的总体重量，包括：采集作业过程开始时容器中货品的第一重量，以及作业过程结束时容器中货品的第二重量；计算第一重量与第二重量的差值，得到作业过程中搬运设备的容器中被操作货品的总体重量。
示例性地，在任务的整个作业过程中，当作业人员开始作业时，重量检测装置测量得到第一测量值，当作业人员作业结束(或者下一次任务开始作业)时，重量检测装置测量得到第二测量值，计算第一测量值和第二测量值的差值，可以得到作业过程中被操作货品的总体质量。
示例性地，当接收到任务信息时，采集容器中货品的重量，得到第一重量。当接收到下一个任务信息、或者接收到任务信息对应的任务结束指令时，采集容器中货品的重量，得到第二重量。
可选地，重量检测装置可以包括多个重量传感器。
在采集容器中货品的重量时，接收多个重量传感器的重量值，多个重量传感器均用于采集容器中货品的重量；将多个重量传感器的检测值中出现次数最多的重量值，作为容器中货品的重量。
示例性地，每次重量检测时，获取所有重量传感器的数值，并将所有重量传感器的数值处理为同一设定精度的重量值，将出现次数最多的重量值作为当前测得的重量，以确保测得货品重量的准确性。
在采集到作业过程中搬运设备的容器中被操作货品的总体重量之后，重量监测系统的第三处理器根据任务信息中被操作货品的单个重量，以及总体重量，通过倍数运算计算得到作业过程中搬运设备的容器中被操作货品的数量，也即得到第五货品信息。
步骤S604、向数量监测运算系统发送第五货品信息，第五货品信息用于对智能交互眼镜系统在作业人员根据任务信息进行作业的过程中采集的被操作货品的第一货品信息进行验证。
在确定第五货品信息之后，重量监测系统向数量监测运算系统发送第五货品信息，以使数量监测运算系统根据第五货品信息，对智能交互眼镜系统在作业人员根据任务信息进行作业的过程中采集的被操作货品的第一货品信息进行验证。
步骤S605、数量监测运算系统接收第五货品信息。
步骤S606、数量监测运算系统根据第五货品信息对第一货品信息进行验证。
该步骤的实现方式已在上述步骤S313中进行了详细地说明，具体参见步骤S313，此处不再赘述。
本公开实施例中，在任务的作业过程中，无需作业人员手动操作，重量监测系统可以根据任务信息，自动采集作业过程中搬运设备的容器中被操作货品的总体重量，计算确定被操作货品的数量，得到第五货品信息，将第五货品信息发送给数量监测运算系统，数量监测运算系统可以基于第五货品信息对同一作业过程中智能交互眼镜系统自动采集的第一货品信息进行验证，并反馈验证结果。智能交互眼镜系统在确定对第一货品信息验证通过后，将第一货品信息发送给仓储管理系统，仓储管理系统根据第一货品信息确认任务是否完成，并更新库存信息。本公开实施例能够实现自动化的智能拣选过程，在拣选的整个作业过程中，作业人员无需手动操作电脑或者电子标签系统等电子设备，即可实现货品实物的流量与信息系统同步，确保实际操作的货品信息的准确性，保证人员作业的连惯性，大大提高了作业效率。
图10为本公开另一实施例提供的智能拣选系统的总体流程示意图。在上述任一方法实施例的基础上，本实施例中，对智能拣选系统的总体流程进行示例性地说明。如图10所示，智能拣选系统的总体流程如下：
(1)仓储管理系统WMS向智能交互眼镜系统下发任务信息；(2)智能交互眼镜系统展示任务信息；(3)作业人员按展示的任务信息作业，在搬运设备上操作货品；在作业过程中执行(4)(5)(6)：(4)智能交互眼镜系统识别作业人员操作动作，采集被操作货品的图像和第一货品信息，将被操作货品的图像和第一货品信息发送到数量监测运算系统；(5)搬运设备的重量监测系统记录容器中被操作货品的重量变化，计算第五货品信息；(6)搬运设备的货品监测系统识别作业人员操作动作，采集被操作货品的图像和第四货品信息，将被操作货品的图像和第四货品信息发送到数量监测运算系统；(7)数量监测运算系统根据被操作货品的图像、第四货品信息和第五货品信息验证第一货品信息，并向智能交互眼镜系统反馈验证结果；(8)智能交互眼镜系统将第一货品信息发送给仓储管理系统，仓储管理系统确认任务并更新库存信息；(9)智能交互眼镜系统与搬运设备及其他系统交互，展示交互信息和任务执行结果。
本实施例中，基于一种可选的实施方式对智能拣选系统的总体流程进行示例性地说明，在其他实施方式中，智能拣选系统的流程可以做相应地变化，本实施例此处不做具体限定。
图11为本公开实施例提供的货品拣选的装置的结构示意图。本公开实施例提供的货品拣选的装置应用于智能交互眼镜系统。如图11所示，该货品拣选的装置70包括：任务信息处理模块701和货品信息管理模块702。
具体地，任务信息处理模块701用于接收并展示任务信息。
货品信息管理模块702用于在作业人员根据任务信息进行作业的过程中，采集作业过程中被操作货品的第一货品信息。
货品信息管理模块702还用于向数量监测运算系统发送第一货品信息。
货品信息管理模块702还用于根据数量监测运算系统对第一货品信息的验证结果，若对第一货品信息验证通过，则将第一货品信息发送给仓储管理系统。
一种可选的实施方式中，货品信息管理模块还用于：在作业人员根据任务信息进行作业的过程中，采集被操作货品的第一图像；根据被操作货品的第一图像，确定作业过程中被操作货品的第一货品信息。
一种可选的实施方式中，任务信息处理模块还用于：通过显示装置显示任务信息；和/或，通过语音交互装置播放任务信息。
一种可选的实施方式中，任务信息包括操作类型和第二货品信息，第二货品信息包括待操作货品的存储位置、品类及数量。
一种可选的实施方式中，任务信息处理模块还用于：根据第二货品信息，展示待操作货品的特征信息；其中，待操作货品的特征信息包括一下至少一种待操作货品的图像、标识信息、外观信息。
一种可选的实施方式中，货品信息管理模块还用于：根据任务信息，监控作业人员的操作动作；在作业人员对货品进行任务信息对应的操作动作时，采集被操作货品的第一图像。
一种可选的实施方式中，货品信息管理模块还用于：对被操作货品的第一图像进行图像处理，识别第一图像中的被操作货品；根据识别出的第一图像中的被操作货品的标识信息，确定作业过程中被操作货品的品类和数量。
一种可选的实施方式中，货品信息管理模块还用于：对被操作货品的第一图像进行图像处理，提取第一图像中的货品特征数据；将货品特征数据与所有货品的标识信息对应的特征数据进行匹配，确定第一图像中的被操作货品的标识信息。
一种可选的实施方式中，货品信息管理模块还用于：将货品特征数据与所有货品的标识信息对应的特征数据进行匹配，确定第一图像中的被操作货品的标识信息之前，获取并存储所有货品的标识信息对应的特征数据。
一种可选的实施方式中，货品信息管理模块还用于：采集作业人员的第二图像；根据任务信息中的操作类型，对第二图像进行图像识别，识别出第二图像中与操作类型对应的操作动作。
一种可选的实施方式中，货品信息管理模块还用于：通过神经网络模型，根据任务信息中的操作类型，对第二图像进行图像识别，识别出第二图像中与操作类型对应的操作动作。
一种可选的实施方式中，货品信息管理模块还用于：在确定作业人员对货品进行任务信息对应的操作动作时，启动第一图像采集装置采集被操作货品的第一图像。
一种可选的实施方式中，货品信息管理模块还用于：对被操作货品的第一图像进行图像处理，识别第一图像中的被操作货品之后，若无法识别出某一被操作货品的第一图像中的被操作货品，则展示第一提示信息，第一提示信息用于提示作业人员将该被操作货品的标识信息对准第一图像采集装置。
一种可选的实施方式中，货品信息管理模块还用于：采集包含被操作货品的标识信息的第三图像；识别出第三图像中被操作货品的标识信息。
一种可选的实施方式中，货品信息管理模块还用于：识别出第三图像中被操作货品的标识信息之后，提取并保存第一图像中的被操作货品的特征数据。
一种可选的实施方式中，货品信息管理模块还用于：提取并保存第一图像中的被操作货品的特征数据之后，向数量监测运算系统发送第三图像和第一图像中的被操作货品的特征数据。
一种可选的实施方式中，货品信息管理模块还用于：在作业人员根据任务信息进行作业的过程中，采集作业过程中被操作货品的第一货品信息之后，向数量监测运算系统发送第一图像。
一种可选的实施方式中，货品信息管理模块还用于：根据数量监测运算系统对第一货品信息的验证结果，若对第一货品信息验证不通过，则展示第二提示信息，第二提示信息用于提示作业人员核对作业过程中被操作货品的信息。
一种可选的实施方式中，货品信息管理模块还用于：采集作业过程中被操作货品的第一货品信息之后，接收搬运设备的货品监测系统发送的第四货品信息，第四货品信息包括作业过程中搬运设备的容器中被操作货品的品类和数量；根据第四货品信息，对第一货品信息进行验证。
一种可选的实施方式中，货品信息管理模块还用于：根据第四货品信息，若对第一货品信息的验证不通过，则展示第三提示信息，第三提示信息用于提示作业人员核对作业过程中被操作货品的信息。
一种可选的实施方式中，货品信息管理模块还用于：采集作业过程中被操作货品的第一货品信息之后，向搬运设备的货品监测系统发送第一货品信息。
本公开实施例提供的装置可以具体用于执行上述任一方法实施例中智能交互眼镜系统所执行的方法流程，具体功能和技术效果参见上述实施例，此处不再赘述。
图12为本公开实施例提供的货品拣选的装置的结构示意图。本公开实施例提供的货品拣选的装置应用于数量监测运算系统。如图12所示，该货品拣选的装置80包括：货品信息获取模块801和货品信息验证模块802。
具体地，货品信息获取模块801用于接收智能交互眼镜系统发送的第一货品信息，第一货品信息为在一次任务的作业过程中被操作货品的信息。
货品信息获取模块801还用于获取搬运设备的监测系统发送的第三货品信息，第三货品信息为在同一任务的作业过程中，搬运设备的容器中被操作货品的信息。
货品信息验证模块802用于根据第三货品信息对第一货品信息进行验证，并将验证结果发送给智能交互眼镜系统。
在一种可选的实施方式中，第三货品信息包括：搬运设备的货品监测系统发送的第四货品信息，第四货品信息包括作业过程中搬运设备的容器中被操作货品的品类和数量；和/或，搬运设备的重量监测系统发送的第五货品信息，第五货品信息包括作业过程中搬运设备的容器中被操作货品的数量。
在一种可选的实施方式中，货品信息验证模块还用于：判断第一货品信息与第四货品信息是否一致；若第一货品信息与第四货品信息一致，则对第一货品信息验证通过；若第一货品信息与第四货品信息不一致，则对第一货品信息验证不通过。
在一种可选的实施方式中，货品信息验证模块还用于：判断第五货品信息与第一货品信息中的被操作货品的数量是否一致；若第五货品信息与第一货品信息中的被操作货品的数量一致，则对第一货品信息验证通过；若第五货品信息与第一货品信息中的被操作货品的数量不一致，则对第一货品信息验证不通过。
在一种可选的实施方式中，货品信息验证模块还用于：接收智能交互眼镜系统发送的任务的作业过程中被操作货品的第一图像和第三图像，第三图像包含被操作货品的标识信息；根据被操作货品的第一图像和第三图像，对第一货品信息进行验证。
在一种可选的实施方式中，货品信息验证模块还用于：接收智能交互眼镜系统发送的第一图像中的被操作货品的特征数据；存储第一图像中的被操作货品的特征数据。
在一种可选的实施方式中，货品信息验证模块还用于：接收货品监测系统发送的任务的作业过程中被操作货品的第四图像和第六图像，第六图像包含被操作货品的标识信息；根据被操作货品的第四图像和第六图像，对第四货品信息进行验证。
在一种可选的实施方式中，货品信息验证模块还用于：接收货品监测系统发送的第四图像中的被操作货品的特征数据；存储第四图像中的被操作货品的特征数据。
本公开实施例提供的装置可以具体用于执行上述任一方法实施例中数量监测运算系统所执行的方法流程，具体功能和技术效果参见上述实施例，此处不再赘述。
图13为本公开实施例提供的货品拣选的装置的结构示意图。本公开实施例提供的货品拣选的装置应用于搬运设备的货品监测系统，搬运设备包括用于容纳货品的容器，货品监测系统还包括用于采集容器内货品图像的第二图像采集装置。如图13所示，该货品拣选的装置90包括：任务接收模块901和货品信息管理模块902。
具体地，任务接收模块901用于接收任务信息。
货品信息管理模块902用于在作业人员根据任务信息进行作业的过程中，采集作业过程中搬运设备的容器中被操作货品的第四货品信息。
货品信息管理模块902还用于向数量监测运算系统发送第四货品信息，第四货品信息用于对智能交互眼镜系统在作业人员根据任务信息进行作业的过程中采集的被操作货品的第一货品信息进行验证。
一种可选的实施方式中，货品信息管理模块还用于：在作业人员根据任务信息进行作业的过程中，采集容器中被操作货品的第四图像；根据容器中被操作货品的第四图像，确定作业过程中容器中被操作货品的第四货品信息。
一种可选的实施方式中，货品信息管理模块还用于：根据任务信息，监控对容器中货品的操作动作；在作业人员对货品进行任务信息对应的操作动作时，采集容器中被操作货品的第四图像；其中，任务信息对应的操作动作包括：将货品放入容器中的操作动作，或者，从容器中拿出货品的操作动作。
一种可选的实施方式中，货品信息管理模块还用于：对第四图像进行图像处理，识别第四图像中的被操作货品；根据识别出的第四图像中的被操作货品的标识信息，确定作业过程中容器中被操作货品的品类和数量。
一种可选的实施方式中，货品信息管理模块还用于：对第四图像进行图像处理，提取第四图像中的货品特征数据；将货品特征数据与所有货品的标识信息对应的特征数据进行匹配，确定第四图像中的被操作货品的标识信息。
一种可选的实施方式中，货品信息管理模块还用于：将货品特征数据与所有货品的标识信息对应的特征数据进行匹配，确定第四图像中的被操作货品的标识信息之前，获取并存储所有货品的标识信息对应的特征数据。
一种可选的实施方式中，货品信息管理模块还用于：采集拍摄范围内作业人员的第五图像；根据任务信息中的操作类型，对第五图像进行图像识别，识别出第五图像中与操作类型对应的操作动作。
一种可选的实施方式中，货品信息管理模块还用于：通过神经网络模型，根据任务信息中的操作类型，对第五图像进行图像识别，识别出第五图像中与操作类型对应的操作动作。
一种可选的实施方式中，货品信息管理模块还用于：在确定作业人员对货品进行任务信息对应的操作动作时，启动第二图像采集装置采集容器中被操作货品的第四图像。
一种可选的实施方式中，货品信息管理模块还用于：对第四图像进行图像处理，识别第四图像中的被操作货品之后，若无法识别出某一被操作货品的第四图像中的被操作货品，则展示第四提示信息，第四提示信息用于提示作业人员将该被操作货品的标识信息对准第二图像采集装置。
一种可选的实施方式中，货品信息管理模块还用于：采集包含被操作货品的标识信息的第六图像；识别出第六图像中被操作货品的标识信息。
一种可选的实施方式中，货品信息管理模块还用于：识别出第六图像中被操作货品的标识信息之后，提取并保存第四图像中的被操作货品的特征数据。
一种可选的实施方式中，货品信息管理模块还用于：提取并保存第六图像中的被操作货品的特征数据之后，向数量监测运算系统发送第六图像和第四图像中的被操作货品的特征数据。
一种可选的实施方式中，货品信息管理模块还用于：在作业人员根据任务信息进行作业的过程中，采集作业过程中搬运设备的容器中被操作货品的第四货品信息之后，向数量监测运算系统发送第四图像。
一种可选的实施方式中，若容器为除货叉之外的容器，第二图像采集装置安装于货叉上，货品信息管理模块还用于：接收任务信息之后，调整货叉的位置，以使第二图像采集装置能够采集到容器中货品的图像。
一种可选的实施方式中，货品信息管理模块还用于：在作业人员根据任务信息进行作业的过程中，采集作业过程中搬运设备的容器中被操作货品的第四货品信息之后，接收智能交互眼镜系统发送的第一货品信息，第一货品信息包括作业过程中被操作货品的品类和数量；根据第一货品信息，对第四货品信息进行验证。
一种可选的实施方式中，货品信息管理模块还用于：根据第一货品信息，若对第四货品信息进行验证不通过，则展示第五提示信息，第五提示信息用于提示作业人员核对作业过程中被操作货品的信息。
一种可选的实施方式中，货品信息管理模块还用于：在作业人员根据任务信息进行作业的过程中，采集作业过程中搬运设备的容器中被操作货品的第四货品信息之后，向智能交互眼镜系统发送第四货品信息。
本公开实施例提供的装置可以具体用于执行上述任一方法实施例中搬运设备的货品监测系统所执行的方法流程，具体功能和技术效果参见上述实施例，此处不再赘述。
图14为本公开实施例提供的货品拣选的装置的结构示意图。本公开实施例提供的货品拣选的装置应用于搬运设备的重量监测系统，搬运设备包括用于容纳货品的容器，重量监测系统包括用于检测容器中货品重量的重量检测装置。如图14所示，该货品拣选的装置100包括：任务接收模块1001和货品信息管理模块1002。
具体地，任务接收模块1001用于接收任务信息。
货品信息管理模块1002用于在作业人员根据任务信息进行作业的过程中，采集作业过程中搬运设备的容器中被操作货品的第五货品信息。
货品信息管理模块1002还用于向数量监测运算系统发送第五货品信息，第五货品信息用于对智能交互眼镜系统在作业人员根据任务信息进行作业的过程中采集的被操作货品的第一货品信息进行验证。
一种可选的实施方式中，货品信息管理模块还用于：采集作业过程中搬运设备的容器中被操作货品的总体重量；根据任务信息中被操作货品的单个重量，以及总体重量，计算作业过程中搬运设备的容器中被操作货品的数量。
一种可选的实施方式中，货品信息管理模块还用于：采集作业过程开始时容器中货品的第一重量，以及作业过程结束时容器中货品的第二重量；计算第一重量与第二重量的差值，得到作业过程中搬运设备的容器中被操作货品的总体重量。
一种可选的实施方式中，货品信息管理模块还用于：当接收到任务信息时，采集容器中货品的重量，得到第一重量；当接收到下一个任务信息、或者接收到任务信息对应的任务结束指令时，采集容器中货品的重量，得到第二重量。
一种可选的实施方式中，货品信息管理模块还用于：接收多个重量传感器的重量值，多个重量传感器均用于采集容器中货品的重量；将多个重量传感器的检测值中出现次数最多的重量值，作为容器中货品的重量。
本公开实施例提供的装置可以具体用于执行上述任一方法实施例中搬运设备的重量监测系统所执行的方法流程，具体功能和技术效果参见上述实施例，此处不再赘述。
图15为本公开实施例提供的货品拣选的装置的结构示意图。本公开实施例提供的货品拣选的装置应用于仓储管理系统。如图15所示，该货品拣选的装置130包括：任务下发模块1301、货品信息接收模块1302和任务确认模块1303。
具体地，任务下发模块1301用于发送任务信息，任务信息包括操作类型及第二货品信息。
货品信息接收模块1302用于接收第一货品信息，第一货品信息为在作业人员根据任务信息进行作业的过程中，智能交互眼镜系统采集的作业过程中被操作货品的第一货品信息。
任务确认模块1303用于根据第一货品信息和第二货品信息，确认任务是否完成，并更新货品库存 信息。
一种可选的实施方式中，任务下发模块1301还用于向智能交互眼镜系统、搬运设备的货品监测系统和重量监测系统发送任务信息。
本公开实施例提供的装置可以具体用于执行上述任一方法实施例中仓储管理系统所执行的方法流程，具体功能和技术效果参见上述实施例，此处不再赘述。
图16为本公开实施例提供的货品拣选的设备的结构示意图。如图16所示，该货品拣选的设备120包括：处理器1201，存储器1202，以及存储在存储器1202上并可在处理器1201上运行的计算机程序。
其中，处理器1201运行计算机程序时实现上述任一方法实施例中智能交互眼镜系统、数量监测运算系统、货品监测系统、重量监测系统、仓储管理系统中任一系统所执行的方法流程，具体功能和技术效果参见上述实施例，此处不再赘述。
另外，本公开实施例还提供一种计算机可读存储介质，计算机可读存储介质中存储有计算机程序，计算机程序被处理器执行时实现上述任一方法实施例中智能交互眼镜系统、数量监测运算系统、货品监测系统、重量监测系统、仓储管理系统中任一系统所执行的方法流程。
本公开实施例还提供了一种计算机程序产品，程序产品包括：计算机程序，计算机程序存储在可读存储介质中，电子设备的至少一个处理器可以从可读存储介质读取计算机程序，至少一个处理器执行计算机程序使得电子设备执行上述任一方法实施例中智能交互眼镜系统、数量监测运算系统、货品监测系统、重量监测系统、仓储管理系统中任一系统所执行的方法流程。
本领域技术人员可以清楚地了解到，为描述的方便和简洁，仅以上述各功能模块的划分进行举例说明，实际应用中，可以根据需要而将上述功能分配由不同的功能模块完成，即将装置的内部结构划分成不同的功能模块，以完成以上描述的全部或者部分功能。上述描述的装置的具体工作过程，可以参考前述方法实施例中的对应过程，在此不再赘述。
本领域技术人员在考虑说明书及实践这里公开的发明后，将容易想到本公开的其它实施方案。本公开旨在涵盖本公开的任何变型、用途或者适应性变化，这些变型、用途或者适应性变化遵循本公开的一般性原理并包括本公开未公开的本技术领域中的公知常识或惯用技术手段。说明书和实施例仅被视为示例性的，本公开的真正范围和精神由下面的权利要求书指出。
应当理解的是，本公开并不局限于上面已经描述并在附图中示出的精确结构，并且可以在不脱离其范围进行各种修改和改变。本公开的范围仅由所附的权利要求书来限制。

Claims (62)

  1. 一种货品拣选的方法，其特征在于，应用于智能交互眼镜系统，包括：
    接收并展示任务信息；
    在作业人员根据所述任务信息进行作业的过程中，采集作业过程中被操作货品的第一货品信息；
    向数量监测运算系统发送所述第一货品信息；
    根据所述数量监测运算系统对所述第一货品信息的验证结果，若对所述第一货品信息验证通过，则将所述第一货品信息发送给仓储管理系统。
  2. 根据权利要求1所述的方法，其特征在于，在作业人员根据所述任务信息进行作业的过程中，采集作业过程中被操作货品的第一货品信息，包括：
    在作业人员根据所述任务信息进行作业的过程中，采集被操作货品的第一图像；
    根据所述被操作货品的第一图像，确定作业过程中被操作货品的第一货品信息。
  3. 根据权利要求1所述的方法，其特征在于，所述展示任务信息包括：
    通过显示装置显示所述任务信息；
    和/或，
    通过语音交互装置播放所述任务信息。
  4. 根据权利要求1至3任一项所述的方法，其特征在于，所述任务信息包括操作类型和第二货品信息，所述第二货品信息包括待操作货品的存储位置、品类及数量。
  5. 根据权利要求4所述的方法，其特征在于，所述展示任务信息包括：
    根据所述第二货品信息，展示待操作货品的特征信息；
    其中，所述待操作货品的特征信息包括一下至少一种待操作货品的图像、标识信息、外观信息。
  6. 根据权利要求2所述的方法，其特征在于，所述在作业人员根据所述任务信息进行作业的过程中，采集被操作货品的第一图像，包括：
    根据所述任务信息，监控作业人员的操作动作；
    在作业人员对货品进行所述任务信息对应的操作动作时，采集被操作货品的第一图像。
  7. 根据权利要求6所述的方法，其特征在于，所述根据所述被操作货品的第一图像，确定作业过程中被操作货品的第一货品信息，包括：
    对所述被操作货品的第一图像进行图像处理，识别所述第一图像中的被操作货品；
    根据识别出的所述第一图像中的被操作货品的标识信息，确定所述作业过程中被操作货品的品类和数量。
  8. 根据权利要求7所述的方法，其特征在于，所述对所述被操作货品的第一图像进行图像处理，识别所述第一图像中的被操作货品，包括：
    对所述被操作货品的第一图像进行图像处理，提取所述第一图像中的货品特征数据；
    将所述货品特征数据与所有货品的标识信息对应的特征数据进行匹配，确定所述第一图像中的被操作货品的标识信息。
  9. 根据权利要求8所述的方法，其特征在于，所述将所述货品特征数据与所有货品的标识信息对应的特征数据进行匹配，确定所述第一图像中的被操作货品的标识信息之前，还包括：
    获取并存储所有货品的标识信息对应的特征数据。
  10. 根据权利要求6所述的方法，其特征在于，所述根据所述任务信息，监控作业人员的操作动作，包括：
    采集作业人员的第二图像；
    根据所述任务信息中的操作类型，对所述第二图像进行图像识别，识别出所述第二图像中与所述操作类型对应的操作动作。
  11. 根据权利要求10所述的方法，其特征在于，所述根据所述任务信息中的操作类型，对所述第二图像进行图像识别，识别出所述第二图像中与所述操作类型对应的操作动作，包括：
    通过神经网络模型，根据所述任务信息中的操作类型，对所述第二图像进行图像识别，识别出所述第二图像中与所述操作类型对应的操作动作。
  12. 根据权利要求6-11中任一项所述的方法，其特征在于，所述在作业人员对货品进行所述任务信息对应的操作动作时，采集被操作货品的第一图像，包括：
    在确定作业人员对货品进行所述任务信息对应的操作动作时，启动第一图像采集装置采集被操作货品的第一图像。
  13. 根据权利要求7-9中任一项所述的方法，其特征在于，所述对所述被操作货品的第一图像进行 图像处理，识别所述第一图像中的被操作货品之后，还包括：
    若无法识别出某一被操作货品的第一图像中的被操作货品，则展示第一提示信息，所述第一提示信息用于提示作业人员将该被操作货品的标识信息对准第一图像采集装置。
  14. 根据权利要求13所述的方法，其特征在于，还包括：
    采集包含被操作货品的标识信息的第三图像；
    识别出所述第三图像中被操作货品的标识信息。
  15. 根据权利要求14所述的方法，其特征在于，所述识别出所述第三图像中被操作货品的标识信息之后，还包括：
    提取并保存所述第一图像中的被操作货品的特征数据。
  16. 根据权利要求15所述的方法，其特征在于，所述提取并保存所述第一图像中的被操作货品的特征数据之后，还包括：
    向数量监测运算系统发送所述第三图像和所述第一图像中的被操作货品的特征数据。
  17. 根据权利要求2所述的方法，其特征在于，所述在作业人员根据所述任务信息进行作业的过程中，采集作业过程中被操作货品的第一货品信息之后，还包括：
    向数量监测运算系统发送所述第一图像。
  18. 根据权利要求1所述的方法，其特征在于，还包括：
    根据所述数量监测运算系统对所述第一货品信息的验证结果，若对所述第一货品信息验证不通过，则展示第二提示信息，所述第二提示信息用于提示作业人员核对所述作业过程中被操作货品的信息。
  19. 根据权利要求1所述的方法，其特征在于，所述采集作业过程中被操作货品的第一货品信息之后，还包括：
    接收搬运设备的货品监测系统发送的第四货品信息，所述第四货品信息包括所述作业过程中所述搬运设备的容器中被操作货品的品类和数量；
    根据所述第四货品信息，对所述第一货品信息进行验证。
  20. 根据权利要求19所述的方法，其特征在于，还包括：
    根据所述第四货品信息，若对所述第一货品信息的验证不通过，则展示第三提示信息，所述第三提示信息用于提示作业人员核对所述作业过程中被操作货品的信息。
  21. 根据权利要求1所述的方法，其特征在于，所述采集作业过程中被操作货品的第一货品信息之后，还包括：
    向搬运设备的货品监测系统发送所述第一货品信息。
  22. 一种货品拣选的方法，其特征在于，应用于数量监测运算系统，包括：
    接收智能交互眼镜系统发送的第一货品信息，所述第一货品信息为在一次任务的作业过程中被操作货品的信息；
    获取搬运设备的监测系统发送的第三货品信息，所述第三货品信息为在同一所述任务的作业过程中，所述搬运设备的容器中被操作货品的信息；
    根据所述第三货品信息对所述第一货品信息进行验证，并将验证结果发送给智能交互眼镜系统。
  23. 根据权利要求22所述的方法，其特征在于，所述第三货品信息包括：
    所述搬运设备的货品监测系统发送的第四货品信息，所述第四货品信息包括所述作业过程中所述搬运设备的容器中被操作货品的品类和数量；
    和/或，
    所述搬运设备的重量监测系统发送的第五货品信息，所述第五货品信息包括所述作业过程中所述搬运设备的容器中被操作货品的数量。
  24. 根据权利要求23所述的方法，其特征在于，所述根据所述第三货品信息对所述第一货品信息进行验证，包括：
    判断所述第一货品信息与所述第四货品信息是否一致；
    若所述第一货品信息与所述第四货品信息一致，则对所述第一货品信息验证通过；
    若所述第一货品信息与所述第四货品信息不一致，则对所述第一货品信息验证不通过。
  25. 根据权利要求23所述的方法，其特征在于，所述根据所述第三货品信息对所述第一货品信息进行验证，包括：
    判断所述第五货品信息与所述第一货品信息中的被操作货品的数量是否一致；
    若所述第五货品信息与所述第一货品信息中的被操作货品的数量一致，则对所述第一货品信息验证通过；
    若所述第五货品信息与所述第一货品信息中的被操作货品的数量不一致，则对所述第一货品信息验 证不通过。
  26. 根据权利要求22所述的方法，其特征在于，还包括：
    接收所述智能交互眼镜系统发送的所述任务的作业过程中被操作货品的第一图像和第三图像，所述第三图像包含被操作货品的标识信息；
    根据所述被操作货品的第一图像和第三图像，对所述第一货品信息进行验证。
  27. 根据权利要求26所述的方法，其特征在于，还包括：
    接收所述智能交互眼镜系统发送的所述第一图像中的被操作货品的特征数据；
    存储所述第一图像中的被操作货品的特征数据。
  28. 根据权利要求23所述的方法，其特征在于，还包括：
    接收所述货品监测系统发送的所述任务的作业过程中被操作货品的第四图像和第六图像，所述第六图像包含被操作货品的标识信息；
    根据所述被操作货品的第四图像和第六图像，对所述第四货品信息进行验证。
  29. 根据权利要求28所述的方法，其特征在于，还包括：
    接收所述货品监测系统发送的所述第四图像中的被操作货品的特征数据；
    存储所述第四图像中的被操作货品的特征数据。
  30. 一种货品拣选的方法，其特征在于，应用于搬运设备的货品监测系统，所述搬运设备包括用于容纳货品的容器，所述货品监测系统包括用于采集所述容器内货品图像的第二图像采集装置，所述方法包括：
    接收任务信息；
    在作业人员根据所述任务信息进行作业的过程中，采集作业过程中搬运设备的容器中被操作货品的第四货品信息；
    向数量监测运算系统发送所述第四货品信息，所述第四货品信息用于对智能交互眼镜系统在作业人员根据所述任务信息进行作业的过程中采集的被操作货品的第一货品信息进行验证。
  31. 根据权利要求30所述的方法，其特征在于，在作业人员根据所述任务信息进行作业的过程中，采集作业过程中被操作货品的第一货品信息，包括：
    在作业人员根据所述任务信息进行作业的过程中，采集所述容器中被操作货品的第四图像；
    根据所述容器中被操作货品的第四图像，确定作业过程中所述容器中被操作货品的第四货品信息。
  32. 根据权利要求31所述的方法，其特征在于，所述在作业人员根据所述任务信息进行作业的过程中，采集所述容器中被操作货品的第四图像，包括：
    根据所述任务信息，监控对所述容器中货品的操作动作；
    在作业人员对货品进行所述任务信息对应的操作动作时，采集所述容器中被操作货品的第四图像；
    其中，所述任务信息对应的操作动作包括：将货品放入所述容器中的操作动作，或者，从所述容器中拿出货品的操作动作。
  33. 根据权利要求32所述的方法，其特征在于，所述根据所述容器中被操作货品的第四图像，确定作业过程中所述容器中被操作货品的第四货品信息，包括：
    对所述第四图像进行图像处理，识别所述第四图像中的被操作货品；
    根据识别出的所述第四图像中的被操作货品的标识信息，确定所述作业过程中所述容器中被操作货品的品类和数量。
  34. 根据权利要求33所述的方法，其特征在于，所述对所述第四图像进行图像处理，识别所述第四图像中的被操作货品，包括：
    对所述第四图像进行图像处理，提取所述第四图像中的货品特征数据；
    将所述货品特征数据与所有货品的标识信息对应的特征数据进行匹配，确定所述第四图像中的被操作货品的标识信息。
  35. 根据权利要求34所述的方法，其特征在于，所述将所述货品特征数据与所有货品的标识信息对应的特征数据进行匹配，确定所述第四图像中的被操作货品的标识信息之前，还包括：
    获取并存储所有货品的标识信息对应的特征数据。
  36. 根据权利要求32所述的方法，其特征在于，所述根据所述任务信息，监控对所述容器中货品的操作动作，包括：
    采集拍摄范围内作业人员的第五图像；
    根据所述任务信息中的操作类型，对所述第五图像进行图像识别，识别出所述第五图像中与所述操作类型对应的操作动作。
  37. 根据权利要求36所述的方法，其特征在于，所述根据所述任务信息中的操作类型，对所述第 五图像进行图像识别，识别出所述第五图像中与所述操作类型对应的操作动作，包括：
    通过神经网络模型，根据所述任务信息中的操作类型，对所述第五图像进行图像识别，识别出所述第五图像中与所述操作类型对应的操作动作。
  38. 根据权利要求32至37中任一项所述的方法，其特征在于，所述在作业人员对货品进行所述任务信息对应的操作动作时，采集所述容器中被操作货品的第四图像，包括：
    在确定作业人员对货品进行所述任务信息对应的操作动作时，启动第二图像采集装置采集所述容器中被操作货品的第四图像。
  39. 根据权利要求33至35中任一项所述的方法，其特征在于，所述对所述第四图像进行图像处理，识别所述第四图像中的被操作货品之后，还包括：
    若无法识别出某一被操作货品的第四图像中的被操作货品，则展示第四提示信息，所述第四提示信息用于提示作业人员将该被操作货品的标识信息对准第二图像采集装置。
  40. 根据权利要求39所述的方法，其特征在于，还包括：
    采集包含被操作货品的标识信息的第六图像；
    识别出所述第六图像中被操作货品的标识信息。
  41. 根据权利要求40所述的方法，其特征在于，所述识别出所述第六图像中被操作货品的标识信息之后，还包括：
    提取并保存所述第四图像中的被操作货品的特征数据。
  42. 根据权利要求41所述的方法，其特征在于，所述提取并保存所述第六图像中的被操作货品的特征数据之后，还包括：
    向数量监测运算系统发送所述第六图像和所述第四图像中的被操作货品的特征数据。
  43. 根据权利要求31所述的方法，其特征在于，所述在作业人员根据所述任务信息进行作业的过程中，采集作业过程中搬运设备的容器中被操作货品的第四货品信息之后，还包括：
    向数量监测运算系统发送所述第四图像。
  44. 根据权利要求32至37中任一项所述的方法，其特征在于，若所述容器为除货叉之外的容器，所述第二图像采集装置安装于货叉上，
    接收任务信息之后，还包括：
    调整所述货叉的位置，以使所述第二图像采集装置能够采集到所述容器中货品的图像。
  45. 根据权利要求32至37中任一项所述的方法，其特征在于，所述在作业人员根据所述任务信息进行作业的过程中，采集作业过程中搬运设备的容器中被操作货品的第四货品信息之后，还包括：
    接收智能交互眼镜系统发送的第一货品信息，所述第一货品信息包括作业过程中被操作货品的品类和数量；
    根据所述第一货品信息，对所述第四货品信息进行验证。
  46. 根据权利要求45所述的方法，其特征在于，还包括：
    根据所述第一货品信息，若对所述第四货品信息进行验证不通过，则展示第五提示信息，所述第五提示信息用于提示作业人员核对所述作业过程中被操作货品的信息。
  47. 根据权利要求32至37中任一项所述的方法，其特征在于，所述在作业人员根据所述任务信息进行作业的过程中，采集作业过程中搬运设备的容器中被操作货品的第四货品信息之后，还包括：
    向智能交互眼镜系统发送所述第四货品信息。
  48. 一种货品拣选的方法，其特征在于，应用于搬运设备的重量监测系统，所述搬运设备包括用于容纳货品的容器，所述重量监测系统包括用于检测所述容器中货品重量的重量检测装置，所述方法包括：
    接收任务信息；
    在作业人员根据所述任务信息进行作业的过程中，采集作业过程中搬运设备的容器中被操作货品的第五货品信息；
    向数量监测运算系统发送所述第五货品信息，所述第五货品信息用于对智能交互眼镜系统在作业人员根据所述任务信息进行作业的过程中采集的被操作货品的第一货品信息进行验证。
  49. 根据权利要求48所述的方法，其特征在于，所述在作业人员根据所述任务信息进行作业的过程中，采集作业过程中搬运设备的容器中被操作货品的第五货品信息，包括：
    采集作业过程中搬运设备的容器中被操作货品的总体重量；
    根据所述任务信息中被操作货品的单个重量，以及所述总体重量，计算作业过程中搬运设备的容器中被操作货品的数量。
  50. 根据权利要求49所述的方法，其特征在于，所述采集作业过程中搬运设备的容器中被操作货品的总体重量，包括：
    采集所述作业过程开始时所述容器中货品的第一重量，以及所述作业过程结束时所述容器中货品的第二重量；
    计算所述第一重量与第二重量的差值，得到所述作业过程中搬运设备的容器中被操作货品的总体重量。
  51. 根据权利要求50所述的方法，其特征在于，所述采集所述作业过程开始时所述容器中货品的第一重量，以及所述作业过程结束时所述容器中货品的第二重量，包括：
    当接收到所述任务信息时，采集所述容器中货品的重量，得到所述第一重量；
    当接收到下一个任务信息、或者接收到所述任务信息对应的任务结束指令时，采集所述容器中货品的重量，得到所述第二重量。
  52. 根据权利要求51所述的方法，其特征在于，所述采集所述容器中货品的重量，包括：
    接收多个重量传感器的重量值，所述多个重量传感器均用于采集所述容器中货品的重量；
    将所述多个重量传感器的检测值中出现次数最多的重量值，作为所述容器中货品的重量。
  53. 一种货品拣选的方法，其特征在于，应用于仓储管理系统，包括：
    发送任务信息，所述任务信息包括操作类型及第二货品信息；
    接收第一货品信息，所述第一货品信息为在作业人员根据所述任务信息进行作业的过程中，智能交互眼镜系统采集的作业过程中被操作货品的第一货品信息；
    根据所述第一货品信息和第二货品信息，确认任务是否完成，并更新货品库存信息。
  54. 根据权利要求53所述的方法，其特征在于，所述发送任务信息，包括：
    向智能交互眼镜系统、搬运设备的货品监测系统和重量监测系统发送任务信息。
  55. 一种货品拣选的装置，其特征在于，应用于智能交互眼镜系统，包括：
    任务信息处理模块，用于接收并展示任务信息；
    货品信息管理模块，用于在作业人员根据所述任务信息进行作业的过程中，采集作业过程中被操作货品的第一货品信息；
    所述货品信息管理模块还用于向数量监测运算系统发送所述第一货品信息；
    所述货品信息管理模块还用于根据所述数量监测运算系统对所述第一货品信息的验证结果，若对所述第一货品信息验证通过，则将所述第一货品信息发送给仓储管理系统。
  56. 一种货品拣选的装置，其特征在于，应用于数量监测运算系统，包括：
    货品信息获取模块，用于接收智能交互眼镜系统发送的第一货品信息，所述第一货品信息为在一次任务的作业过程中被操作货品的信息；
    所述货品信息获取模块还用于获取搬运设备的监测系统发送的第三货品信息，所述第三货品信息为在同一所述任务的作业过程中，所述搬运设备的容器中被操作货品的信息；
    货品信息验证模块，用于根据所述第三货品信息对所述第一货品信息进行验证，并将验证结果发送给智能交互眼镜系统。
  57. 一种货品拣选的装置，其特征在于，应用于搬运设备的货品监测系统，所述搬运设备包括用于容纳货品的容器，所述货品监测系统包括用于采集所述容器内货品图像的第二图像采集装置，所述货品拣选的装置包括：
    任务接收模块，用于接收任务信息；
    货品信息管理模块，用于在作业人员根据所述任务信息进行作业的过程中，采集作业过程中搬运设备的容器中被操作货品的第四货品信息；
    所述货品信息管理模块还用于向数量监测运算系统发送所述第四货品信息，所述第四货品信息用于对智能交互眼镜系统在作业人员根据所述任务信息进行作业的过程中采集的被操作货品的第一货品信息进行验证。
  58. 一种货品拣选的装置，其特征在于，应用于搬运设备的重量监测系统，所述搬运设备包括用于容纳货品的容器，所述重量监测系统包括用于检测所述容器中货品重量的重量检测装置，所述货品拣选的装置包括：
    任务接收模块，用于接收任务信息；
    货品信息管理模块，用于在作业人员根据所述任务信息进行作业的过程中，采集作业过程中搬运设备的容器中被操作货品的第五货品信息；
    所述货品信息管理模块还用于向数量监测运算系统发送所述第五货品信息，所述第五货品信息用于对智能交互眼镜系统在作业人员根据所述任务信息进行作业的过程中采集的被操作货品的第一货品信息进行验证。
  59. 一种货品拣选的装置，其特征在于，应用于仓储管理系统，包括：
    任务下发模块，用于发送任务信息，所述任务信息包括操作类型及第二货品信息；
    货品信息接收模块，用于接收第一货品信息，所述第一货品信息为在作业人员根据所述任务信息进行作业的过程中，智能交互眼镜系统采集的作业过程中被操作货品的第一货品信息；
    任务确认模块，用于根据所述第一货品信息和第二货品信息，确认任务是否完成，并更新货品库存信息。
  60. 一种货品拣选的设备，其特征在于，包括：
    处理器，存储器，以及存储在所述存储器上并可在所述处理器上运行的计算机程序；
    其中，所述处理器运行所述计算机程序时实现如权利要求1至54中任一项所述的方法。
  61. 一种计算机可读存储介质，其特征在于，所述计算机可读存储介质中存储有计算机程序，所述计算机程序被处理器执行时实现如权利要求1至54中任一项所述的方法。
  62. 一种计算机程序产品，其特征在于，包括计算机程序，所述计算机程序在被处理器执行时实现根据权利要求1至54中任一项所述的方法。
PCT/CN2021/138937 2020-12-29 2021-12-16 货品拣选的方法、装置、设备、存储介质及程序产品 WO2022143203A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202011603164.5A CN112766053A (zh) 2020-12-29 2020-12-29 货品拣选的方法、装置、设备、存储介质及程序产品
CN202011603164.5 2020-12-29

Publications (1)

Publication Number Publication Date
WO2022143203A1 true WO2022143203A1 (zh) 2022-07-07

Family

ID=75697283

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/138937 WO2022143203A1 (zh) 2020-12-29 2021-12-16 货品拣选的方法、装置、设备、存储介质及程序产品

Country Status (2)

Country Link
CN (1) CN112766053A (zh)
WO (1) WO2022143203A1 (zh)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112766053A (zh) * 2020-12-29 2021-05-07 深圳市海柔创新科技有限公司 货品拣选的方法、装置、设备、存储介质及程序产品

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006306505A (ja) * 2005-04-26 2006-11-09 Daifuku Co Ltd ピッキング設備
CN110033061A (zh) * 2019-03-28 2019-07-19 炬星科技（深圳）有限公司 拣货任务处理方法、电子设备、机器人及存储介质
CN110837743A (zh) * 2018-08-17 2020-02-25 天津京东深拓机器人科技有限公司 一种拣货信息的提示方法和系统
CN112766053A (zh) * 2020-12-29 2021-05-07 深圳市海柔创新科技有限公司 货品拣选的方法、装置、设备、存储介质及程序产品

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006306505A (ja) * 2005-04-26 2006-11-09 Daifuku Co Ltd ピッキング設備
CN110837743A (zh) * 2018-08-17 2020-02-25 天津京东深拓机器人科技有限公司 一种拣货信息的提示方法和系统
CN110033061A (zh) * 2019-03-28 2019-07-19 炬星科技（深圳）有限公司 拣货任务处理方法、电子设备、机器人及存储介质
CN112766053A (zh) * 2020-12-29 2021-05-07 深圳市海柔创新科技有限公司 货品拣选的方法、装置、设备、存储介质及程序产品

Also Published As

Publication number Publication date
CN112766053A (zh) 2021-05-07

Similar Documents

Publication Publication Date Title
JP7463559B2 (ja) 物品処理の方法、装置、システム、電子機器、記憶媒体およびコンピュータプログラム
US9959578B2 (en) Work management system and work management method
US20170322561A1 (en) Robotic inventory dispensary operational enhancements
CN109685425B (zh) 一种基于cps的可视化实物自动盘库系统
WO2022143203A1 (zh) 货品拣选的方法、装置、设备、存储介质及程序产品
US20210268658A1 (en) System and Method of Integrating Robot into Warehouse Management Software
US20200094401A1 (en) System and method for automatic learning of product manipulation
CN110889317A (zh) 操作辅助装置
CN214235144U (zh) 货品拣选系统
CN110979853B (zh) 一种基于机器视觉的自动化包装方法及系统
CN112668409A (zh) 一种视觉测量系统及其应用于药品种类识别的方法
CN210719029U (zh) 一种芯块几何尺寸及密度自动测量系统
CN112024462A (zh) 不良物料剔除设备及其控制方法和控制装置
CN109357772A (zh) 一种基于slam技术的变电设备红外热成像数据收集方法
CN115063670A (zh) 一种自动分拣方法、装置及系统
JP2014091608A (ja) 物品処理設備
CN113837560A (zh) 物品拣选方法及装置
CN112304409A (zh) 一种基于视频分析多品种物品连续自动识别称重机
WO2021090808A1 (ja) 計量装置及び計量システム
KR20210067522A (ko) 부품 정렬 공급 시스템, 부품 정렬 공급 시스템을 이용한 부품 정렬 정보 입력 방법
CN112525914A (zh) 产品检测装置及方法、产品流水线
US20220388777A1 (en) Picking trolley, picking system, and picking program
US20240116172A1 (en) Intelligent robotic system for palletizing and depalletizing
US20230297947A1 (en) Method and system for order picking
CN217915320U (zh) 一种服务器维护机器人以及系统

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21913944

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21913944

Country of ref document: EP

Kind code of ref document: A1