CN113651118A

CN113651118A - Method, device and apparatus for hybrid palletizing of boxes of various sizes and computer-readable storage medium

Info

Publication number: CN113651118A
Application number: CN202110948813.3A
Authority: CN
Inventors: 段文杰; 张致伟; 丁有爽; 邵天兰
Original assignee: Mech Mind Robotics Technologies Co Ltd
Current assignee: Mech Mind Robotics Technologies Co Ltd
Priority date: 2020-11-03
Filing date: 2020-11-03
Publication date: 2021-11-16
Anticipated expiration: 2040-11-03
Also published as: WO2022094968A1; CN113651118B; CN112499276B; CN112499276A

Abstract

The application discloses a method for hybrid palletizing of multi-size boxes, a hybrid palletizing device of multi-size boxes and a non-volatile computer-readable storage medium. The method comprises the following steps: obtaining the corner coordinates and the corner orientations of the corners of the existing stack shape, wherein a plane capable of placing boxes to be stacked exists along the corner orientations; combining the corner coordinates and the corner orientation of each corner with at least two placing modes of the boxes to be coded to obtain a plurality of controls, wherein the sets of the controls form an original control space; simulating to place a box to be coded into each control of the original control space; obtaining optimal control according to simulation; and placing the boxes to be coded in the optimal control. The method, the equipment, the device and the nonvolatile computer readable storage medium for hybrid stacking of the boxes with multiple sizes improve the stacking efficiency of hybrid stacking.

Description

Method, device and apparatus for hybrid palletizing of boxes of various sizes and computer-readable storage medium

The present application is a divisional application of the invention patent application No. cn202011210486.3 entitled "method, apparatus, device and computer readable storage medium for hybrid palletization of boxes of multiple sizes" filed on 3.11/2020.

Technical Field

The application relates to the field of intelligent logistics, in particular to a method for mixing and stacking multi-size boxes, a mixing and stacking device for the multi-size boxes and a non-volatile computer readable storage medium.

Background

With the development of robot intelligent technology, robot intelligent operation gradually replaces manual operation and becomes mainstream labor force in various fields, such as box stacking operation. The stacking refers to the arrangement of boxes in the spaces corresponding to containers such as trays, cage cars and the like, and has important application in the fields of logistics and storage.

The essence of stacking is to partition and plan space, and a traditional stacking algorithm, such as a Manufacturer's Pallet Loading (MPLP) algorithm, can only be applied to the case of consistent box size because the stacking space is hierarchically planned and divided into equal parts by straight lines; for example, a retailer palletizing (DPLP) algorithm adjusts each partitioned space according to the size of a box on the basis of the space obtained by straight line partitioning, and although the adjustment algorithm can be used for the cases with different box sizes, the adjustment algorithm needs to be optimized based on a large number of boxes with the same size in the adjustment process, and further the case that only one or two boxes are arranged in each box cannot be well handled. That is, the MPLP algorithm and the DPLP algorithm cannot perform calculation when the number of boxes of each size is small although the types of boxes are large, and thus cannot be applied to a stacking scene of boxes of multiple sizes and a small number of boxes of each size.

Disclosure of Invention

The embodiment of the application provides a mixed stacking method of multi-size boxes, a mixed stacking device of the multi-size boxes and a non-volatile computer readable storage medium, which are used for intelligently stacking the multi-size boxes with small quantity of each size.

The method for mixing and stacking the boxes with multiple sizes comprises the following steps: obtaining the corner coordinates and the corner orientations of the corners of the existing stack shape, and placing boxes to be stacked along the corner orientation existing plane; combining the corner coordinates and the corner orientations of the corners with at least two placement modes of the boxes to be stacked to obtain a plurality of controls, wherein the sets of the controls form an original control space; simulating and placing the boxes to be coded into each control of the original control space; removing infeasible controls in the original control space according to simulation to obtain an effective control space; obtaining optimal control in the effective control space according to simulation; and placing the box to be coded in the optimal control.

In some embodiments, the method of hybrid palletizing of multi-sized boxes further comprises: and photographing the stacking and establishing a model to obtain the existing stack shape.

In some embodiments, the photographing and modeling the palletized form to obtain the existing palletized form comprises: shooting the current stack shape of the stack and establishing an integral model to obtain the existing stack shape for each stacking; or shooting a first stacking shape of the first stacking, and acquiring the existing stacking shape based on the position and the height of the boxes stacked in the first stacking shape and the subsequent stacking process; or shooting the current stack shape of the stack at each time of stacking, and only establishing a model of the plane of the highest-layer box of the stack shape to obtain the existing stack shape; or shooting a first stacking type of the first stacking, adding the stacked boxes at corresponding positions of the first stacking type every time the subsequent stacking is performed, and correcting the added boxes based on the shot plane model of the highest-layer box to obtain the existing stacking type.

In some embodiments, the obtaining corner coordinates of corners of the existing buttress pattern includes: converting the existing stack shape into a contour map; and acquiring coordinates of each inflection point of the contour map by adopting a geometric calculation method based on the contour map to serve as the coordinates of each corner of the existing buttress shape.

In some embodiments, the obtaining the corner orientation of each corner of the existing buttress pattern comprises: converting the existing buttress shape into a contour map, and taking the height of each inflection point of the contour map as the corner height of each corner of the existing buttress shape; and regarding the direction in which the height in the predetermined area adjacent to each corner is not higher than the corner height of the corresponding corner as the corner orientation of the corner.

In some embodiments, the obtaining the corner orientation of each corner of the existing buttress pattern comprises: converting the existing buttress shape into a contour map, and taking the height of each inflection point of the contour map as the corner height of each corner of the existing buttress shape; simulating two vectors with 90-degree difference to be placed around each corner; and when the height of the two vectors is the same as the height of the corner corresponding to the two vectors and the height of a preset area between 90 degrees different from the two vectors is not higher than the height of the corner corresponding to the two vectors, taking the placing postures of the two vectors as the corner orientation of the corresponding corner.

In some embodiments, the removing infeasible controls in the original control space from simulation to yield an effective control space comprises: and removing the control which cannot be stacked in the simulation, the control which is not stably stacked and the control which does not have an effective filling track to obtain the effective control space.

In some embodiments, the obtaining optimal control in the active control space from the simulation comprises: acquiring a first matching degree between a first parameter set and a first preset parameter set of the box to be coded after the simulation is executed, wherein the first parameter set comprises at least one of the contact area, the supporting surface percentage, the number of the supporting boxes, the distance from an edge or a specified container angle of the box to be coded and an adjacent box; acquiring a second matching degree between a second parameter set and a second preset parameter set of the new buttress form formed after the simulation is executed, wherein the second parameter set comprises at least one of the height, the volume rate and the top surface unevenness of the new buttress form; acquiring the total matching degree of each control according to the first matching degree, the second matching degree, a first weight preset by the first matching degree and a second weight preset by the second matching degree; and taking the control with the highest total matching degree in the plurality of controls as an optimal control.

In some embodiments, the method of hybrid palletizing of multi-sized boxes further comprises: and when the effective control space is an empty set, stopping executing the stacking.

The hybrid palletizing apparatus for multi-size boxes of embodiments of the present application includes one or more processors. One or more of the processors to: obtaining the corner coordinates and the corner orientations of the corners of the existing stack shape, and placing boxes to be stacked along the corner orientation existing plane; combining the corner coordinates and the corner orientations of the corners with at least two placement modes of the boxes to be stacked to obtain a plurality of controls, wherein the sets of the controls form an original control space; simulating and placing the boxes to be coded into each control of the original control space; removing infeasible controls in the original control space according to simulation to obtain an effective control space; obtaining optimal control in the effective control space according to simulation; and controlling to place the box to be coded in the optimal control.

In certain embodiments, one or more of the processors are further configured to: and photographing the stacking and establishing a model to obtain the existing stack shape.

In certain embodiments, one or more of the processors are further configured to: shooting the current stack shape of the stack and establishing an integral model to obtain the existing stack shape for each stacking; or shooting a first stacking shape of the first stacking, and acquiring the existing stacking shape based on the position and the height of the boxes stacked in the first stacking shape and the subsequent stacking process; or shooting the current stack shape of the stack at each time of stacking, and only establishing a model of the plane of the highest-layer box of the stack shape to obtain the existing stack shape; or shooting a first stacking type of the first stacking, adding the stacked boxes at corresponding positions of the first stacking type every time the subsequent stacking is performed, and correcting the added boxes based on the shot plane model of the highest-layer box to obtain the existing stacking type.

In certain embodiments, one or more of the processors are further configured to: converting the existing stack shape into a contour map; and acquiring coordinates of each inflection point of the contour map by adopting a geometric calculation method based on the contour map to serve as the coordinates of each corner of the existing buttress shape.

In certain embodiments, one or more of the processors are further configured to: converting the existing buttress shape into a contour map, and taking the height of each inflection point of the contour map as the corner height of each corner of the existing buttress shape; and regarding the direction in which the height in the predetermined area adjacent to each corner is not higher than the corner height of the corresponding corner as the corner orientation of the corner.

In certain embodiments, one or more of the processors are further configured to: converting the existing buttress shape into a contour map, and taking the height of each inflection point of the contour map as the corner height of each corner of the existing buttress shape; simulating two vectors with 90-degree difference to be placed around each corner; and when the height of the two vectors is the same as the height of the corner corresponding to the two vectors and the height of a preset area between 90 degrees different from the two vectors is not higher than the height of the corner corresponding to the two vectors, taking the placing postures of the two vectors as the corner orientation of the corresponding corner.

In certain embodiments, one or more of the processors are further configured to: and removing the control which cannot be stacked in the simulation, the control which is not stably stacked and the control which does not have an effective filling track to obtain the effective control space.

In certain embodiments, one or more of the processors are further configured to: acquiring a first matching degree between a first parameter set and a first preset parameter set of the box to be coded after the simulation is executed, wherein the first parameter set comprises at least one of the contact area, the supporting surface percentage, the number of the supporting boxes, the distance from an edge or a specified container angle of the box to be coded and an adjacent box; acquiring a second matching degree between a second parameter set and a second preset parameter set of the new buttress form formed after the simulation is executed, wherein the second parameter set comprises at least one of the height, the volume rate and the top surface unevenness of the new buttress form; acquiring the total matching degree of each control according to the first matching degree, the second matching degree, a first weight preset by the first matching degree and a second weight preset by the second matching degree; and taking the control with the highest total matching degree in the plurality of controls as an optimal control.

In certain embodiments, one or more of the processors are further configured to: and when the effective control space is an empty set, stopping executing the stacking.

The mixed stacking device of the multi-size boxes comprises a first acquisition module, a second acquisition module, a simulation module, a third acquisition module, a fourth acquisition module and a control module. The first acquisition module is used for acquiring the corner coordinates and the corner orientation of each corner of an existing stack type, and a box to be stacked can be placed along the corner orientation existing plane. The second acquisition module is used for combining the corner coordinates and the corner orientation of each corner with at least two placing modes of the boxes to be stacked to obtain a plurality of controls, and the sets of the controls form an original control space. And the simulation module is used for simulating and placing the boxes to be coded into each control of the original control space. A third acquisition module is used for removing infeasible controls in the original control space according to simulation to obtain an effective control space. The fourth obtaining module is configured to obtain optimal control in the effective control space according to a simulation. And the control module is used for controlling the box to be coded to be placed in the optimal control.

In some embodiments, the hybrid palletization plant of boxes of multiple sizes further comprises a fifth acquisition module for taking a picture of the palletization and modeling to acquire said existing palletization profile.

In some embodiments, the fifth obtaining module comprises an obtaining component for capturing a current shape of the pallet and establishing an integral model to obtain the existing shape for each time of the pallet; or the acquisition assembly is used for shooting a first stacking shape of the first stacking, and acquiring the existing stacking shape based on the position and the height of the box stacked in the first stacking shape and the subsequent stacking process; or the acquisition assembly is used for shooting the current stacking type of the stacking every time of stacking, and only establishing a model of the plane of the highest-layer box of the stacking type to acquire the existing stacking type; or the acquisition assembly is used for shooting a first stacking type of the first stacking, the stacked boxes are added at corresponding positions of the first stacking type every time the subsequent stacking is stacked, and the added boxes are corrected based on the shot plane model of the highest-layer box, so that the existing stacking type is acquired.

In some embodiments, the first acquisition module comprises a conversion unit for converting the existing buttress shape into a contour map and a first acquisition unit; the first acquisition unit is used for acquiring the coordinates of each inflection point of the contour map by adopting a computational geometry method based on the contour map to serve as the coordinates of each corner of the existing buttress shape.

In some embodiments, the first obtaining module comprises a converting unit and a first obtaining unit, wherein the converting unit is used for converting the existing buttress shape into a contour map, and taking the height of each inflection point of the contour map as the height of each corner of the existing buttress shape; the first acquisition unit is configured to take a direction in which a height in a predetermined region adjacent to each corner is not higher than the corner height of the corresponding corner as a corner orientation of the corner.

In some embodiments, the first obtaining module includes a converting unit, a simulating unit, and a first obtaining unit, where the converting unit is configured to convert the existing buttress shape into a contour map, and use each corner height of the contour map as a corner height of each corner of the existing buttress shape; the simulation unit is used for simulating two vectors with 90-degree phase difference to be placed around each corner; the first obtaining unit is used for taking the placing postures of the two vectors as the corner orientation of the corresponding corner when the two vectors are located at the same height as the corner height of the corresponding corner and the height of a preset area between 90 degrees different from the two vectors is not higher than the corner height of the corresponding corner.

In some embodiments, the third obtaining module includes a second obtaining unit for removing infeasible controls in the original control space from the simulation to obtain an effective control space, including: and removing the control which cannot be stacked in the simulation, the control which is not stably stacked and the control which does not have an effective filling track to obtain the effective control space.

In some embodiments, the fourth obtaining module further comprises a third obtaining unit and a first control unit, the third obtaining unit is configured to obtain the optimal control in the effective control space according to the simulation, and comprises: acquiring a first matching degree between a first parameter set and a first preset parameter set of the box to be coded after the simulation is executed, wherein the first parameter set comprises at least one of the contact area, the supporting surface percentage, the number of the supporting boxes, the distance from an edge or a specified container angle of the box to be coded and an adjacent box; acquiring a second matching degree between a second parameter set and a second preset parameter set of the new buttress form formed after the simulation is executed, wherein the second parameter set comprises at least one of the height, the volume rate and the top surface unevenness of the new buttress form; acquiring the total matching degree of each control according to the first matching degree, the second matching degree, a first weight preset by the first matching degree and a second weight preset by the second matching degree; the first control unit is configured to take the control with the highest total matching degree among the plurality of controls as an optimal control.

In some embodiments, the control module further comprises a second control unit for stopping execution of palletizing when the active control space is empty.

A non-transitory computer readable storage medium of an embodiment of the present application contains a computer program which, when executed by one or more processors, causes a hybrid palletizing apparatus of multi-size boxes to perform a hybrid palletizing method of multi-size boxes as follows: obtaining the corner coordinates and the corner orientations of the corners of the existing stack shape, and placing boxes to be stacked along the corner orientation existing plane; combining the corner coordinates and the corner orientations of the corners with at least two placement modes of the boxes to be stacked to obtain a plurality of controls, wherein the sets of the controls form an original control space; simulating and placing the boxes to be coded into each control of the original control space; removing infeasible controls in the original control space according to simulation to obtain an effective control space; obtaining optimal control in the effective control space according to simulation; and placing the box to be coded in the optimal control.

According to the mixed stacking method of the boxes with the multiple sizes, the mixed stacking equipment of the boxes with the multiple sizes, the mixed stacking device of the boxes with the multiple sizes and the nonvolatile computer readable storage medium, planning of an effective control space is achieved by using the corner coordinates and the corner orientations of the corners of the existing stack shape, optimal control in the effective control space is obtained through simulation, the boxes to be stacked are placed in the optimal control, the situation that a single space is linearly divided equally after space layered planning like an MPLP algorithm is not needed, the situation that optimization is needed on the basis of a large number of boxes with the same size like a DPLP algorithm is not needed, and therefore the method can be suitable for stacking scenes of the boxes with the multiple sizes and small quantity of boxes with each size.

Additional aspects and advantages of embodiments of the present application will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of embodiments of the present application.

Drawings

The above and/or additional aspects and advantages of the present application will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:

FIG. 1 is a schematic flow diagram of a method of hybrid palletizing multi-sized boxes according to certain embodiments of the present application;

FIG. 2 is a schematic view of different placement of boxes to be palletized according to certain embodiments of the present application at the same corner coordinates and with the corners facing downward;

FIG. 3 is a schematic illustration of a hybrid palletizing apparatus for multi-sized boxes in accordance with certain embodiments of the present application;

FIG. 4 is a schematic view of a box to be palletized in accordance with certain embodiments of the present application, positioned in a co-angular coordinate and multi-angular orientation;

FIG. 5 is a schematic illustration of a hybrid palletizer of multi-sized boxes in accordance with certain embodiments of the present application;

FIGS. 6 and 7 are schematic flow diagrams of a method of hybrid palletization of multi-sized boxes according to certain embodiments of the present application;

FIG. 8 is a schematic illustration of a planar model of the topmost box of the stack of certain embodiments of the present application;

FIG. 9 is a schematic illustration of a planar model of a top box of a pack in some embodiments of the present application;

FIG. 10 is a schematic flow diagram of a method of hybrid palletizing multi-sized boxes according to certain embodiments of the present application;

FIG. 11 is a schematic illustration of a hybrid palletization process of multi-sized boxes, performed in accordance with certain embodiments of the present application, to convert an existing palletized form into a contour map;

FIG. 12 is a schematic illustration of a hybrid palletization process of multi-sized boxes, performed to convert a contour map into a coordinate system, in accordance with certain embodiments of the present application;

FIG. 13 is a schematic flow diagram of a method of hybrid palletizing multi-sized boxes according to certain embodiments of the present application;

FIG. 14 is a schematic illustration of the height and placement of actual stacks according to certain embodiments of the present application;

FIG. 15 is a schematic flow diagram of a method of hybrid palletizing multi-sized boxes according to certain embodiments of the present application;

FIG. 16 is a schematic illustration of a hybrid palletization method of multi-sized boxes according to certain embodiments of the present application, performed to lay two vectors simulating 90 deg. apart around each corner;

FIGS. 17-19 are flow diagrams of a method of hybrid palletizing multi-sized boxes according to certain embodiments of the present application;

FIG. 20 is a schematic diagram of a connection state of a non-volatile computer readable storage medium and a processor of some embodiments of the present application.

Detailed Description

Reference will now be made in detail to embodiments of the present application, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below by referring to the drawings are exemplary only for the purpose of explaining the embodiments of the present application, and are not to be construed as limiting the embodiments of the present application.

In the intelligent stacking of the boxes with mixed sizes, the method can be carried out by referring to the mixed stacking method provided by the embodiment of the application. The method provided by the embodiment of the present application may be specifically executed by a processor in combination with a manipulator in communication, and the processor controls the manipulator to operate after obtaining the calculation result.

Referring to fig. 1, the present application provides a method for hybrid palletizing of boxes of multiple sizes. The mixed stacking method of the boxes with multiple sizes comprises the following steps:

01: obtaining the corner coordinates and the corner orientations of the corners of the existing stack shape, and placing boxes to be stacked along the corner orientation existing plane;

02: combining the corner coordinates and the corner orientation of each corner with at least two placing modes of the boxes to be coded to obtain a plurality of controls, wherein the sets of the controls form an original control space;

03: simulating to place a box to be coded into each control of the original control space;

04: removing infeasible controls in the original control space according to the simulation to obtain an effective control space;

05: obtaining optimal control in an effective control space according to simulation; and

06: and placing the boxes to be coded in the optimal control.

In some embodiments, the corner coordinates can be one-dimensional coordinates and two-dimensional coordinates, the one-dimensional coordinates are applied to scenes for stacking a row of boxes along a straight line, and the two-dimensional coordinates are used for scenes for stacking the boxes in a tray space, a stacking platform, a cage car and other placing spaces. Optionally, the corner orientation includes a direction extending to a point in space from the corner coordinate as a starting point. If the corner coordinate is a one-dimensional coordinate, the corner orientation can be selected from the positive direction and the negative direction of the one-dimensional coordinate axis. If the corner coordinate is a two-dimensional coordinate, the corner orientation may be selected from positive and negative directions of two coordinate axes in the two-dimensional coordinate, and optionally may also be selected from a direction forming an angle with any one of the two coordinate axes, for example, the corner coordinate forms an angle of 45 ° with the x-axis, forms an angle of 135 ° with the x-axis, and the like. Of course, the selection range of the corner direction is not limited to the above. Preferably, the orientation of the corners is selected depending on whether the box is to be placed with reference to the orientation. For example, if an edge of a box of a certain size is placed along a certain direction of a corner coordinate, and no obstacle is present to affect the placement of the box, the direction may be determined as the corner coordinate. For another example, if there is a plane in the region of the corner coordinate bounded by a certain direction that can accommodate a box of any size, the direction is determined as the corner orientation.

In some embodiments, a stack model can be established through an optical sensor, a real space is simulated in a computer, and then whether a plane exists or not can be identified, and a box to be stacked can be placed.

In some implementations, if the corner coordinates and the corresponding corner orientation are determined, the placement method of the boxes to be stacked includes: as shown in the lower drawing of fig. 2, the long sides of the box are taken as references, namely the long sides of the box are coincided with the corners; alternatively, as shown in the upper view of fig. 2, the box short side is used as a reference, that is, the box short side and the corner direction are overlapped.

In some embodiments, infeasible controls may include controls that are not conducive to stack stability after the boxes are stacked into the controls; alternatively, the boxes cannot be stacked due to an obstacle existing on a moving path from stacking the boxes to the control.

In some embodiments, the optimal control may be determined based on criteria such as whether stacking of boxes into the control is beneficial to stability of the shape of the stack, whether it is beneficial to flatness the shape of the stack, and the like.

Referring to fig. 3, the present application provides a hybrid palletizing apparatus 100 for multi-size boxes. The multi-size box mixing palletizing apparatus 100 comprises one or more processors 10. The hybrid palletizing method of the multi-size box according to the embodiment of the present application may be applied to the hybrid palletizing apparatus 100 of the multi-size box according to the embodiment of the present application. Wherein one or more processors 10 are configured to perform the methods of 01 to 06. That is, one or more processors 10 may be operable to: obtaining the corner coordinates and the corner orientations of the corners of the existing stack shape, and placing boxes to be stacked along the corner orientation existing plane; combining the corner coordinates and the corner orientation of each corner with at least two placing modes of the boxes to be coded to obtain a plurality of controls, wherein the sets of the controls form an original control space; simulating to place a box to be coded into each control of the original control space; removing infeasible controls in the original control space according to the simulation to obtain an effective control space; obtaining optimal control in an effective control space according to simulation; and placing the boxes to be coded in the optimal control.

In particular, the processor or processors 10 combine the coordinates and orientation of the corners of the existing shape of the pile with at least two ways of placing the boxes to be palletized to obtain a plurality of controls, the collection of which forms the original control space. As shown in fig. 2, the boxes to be coded on one corner coordinate may be placed with the long side as a reference, or may be placed with the short side as a reference. For a corner coordinate, the corner orientation of the corner coordinate may be one of eight orientations, east, west, south, north, southeast, northeast, southwest, and northwest. As shown in fig. 4, sixteen controls can be obtained by combining eight corner orientations and two placement modes for one corner coordinate. For example, when the corner is oriented east, please refer to fig. 4 (a) and (c), and the control of

numbers

1 and 6 can be obtained according to the placement with different sides as the reference. For another example, when the corner is oriented north, please continue to combine graph (a) and graph (c) in FIG. 4, and control of

sequence numbers

2 and 7 can be obtained based on the placement with different sides as the reference. For another example, when the corner is oriented to the northeast, please refer to fig. 4 (b) and (d), and the control of numbers 9 and 14 can be obtained according to the placement based on the different sides. Also for example, when the corner is oriented northwest, please refer to fig. 4 (b) and (d), and depending on the placement with reference to the different edges, control of

numbers

10 and 15 can be obtained. By analogy, sixteen controls can be obtained.

Referring to fig. 5, the present application provides a hybrid palletizer 200 for multiple size boxes. The hybrid palletizer device 200 of boxes of multiple sizes comprises a first acquisition module 211, a second acquisition module 212, a simulation module 213, a third acquisition module 214, a fourth acquisition module 215 and a control module 216. The method for mixing and stacking the multi-size boxes according to the embodiment of the present application can be applied to the mixing and stacking device 200 for the multi-size boxes according to the embodiment of the present application. The first obtaining module 211, the second obtaining module 212, the simulation module 213, the third obtaining module 214, the fourth obtaining module 215, and the control module 216 may be respectively configured to execute the methods in 01, 02, 03, 04, 05, and 06. That is, the first obtaining module 211 may be configured to obtain the corner coordinates and the corner orientations of the corners of the existing stacking type, and a box to be stacked may be placed along the corner orientation existing plane. The second obtaining module 212 may be configured to combine the corner coordinates and the corner orientations of the corners with at least two placement manners of the bins to be coded to obtain a plurality of controls, and a set of the plurality of controls forms an original control space. The simulation module 213 is used for simulating and placing the boxes to be coded into each control of the original control space. The third obtaining module 214 is used to remove the unfeasible controls in the original control space according to the simulation to obtain the effective control space. The fourth acquisition module 215 is used to acquire optimal control in the active control space according to the simulation. The control module 216 is used to place the bins to be coded in optimal control.

The mixed stacking method of the multi-size boxes, the mixed stacking equipment 100 of the multi-size boxes and the mixed stacking device 200 of the multi-size boxes realize planning of an effective control space by using the corner coordinates and the corner orientations of the corners of the existing stack shape, obtain optimal control in the effective control space through simulation of the actual situation, place boxes to be stacked in the optimal control, do not need to equally divide a single space straight line after space layered planning like an MPLP algorithm, do not need to optimize based on a large number of boxes with the same size like the DPLP algorithm, and therefore the mixed stacking method can be suitable for stacking scenes of boxes with multiple sizes and small quantity of each size.

Referring to fig. 6, the method for hybrid stacking of boxes with multiple sizes according to the embodiment of the present application further includes:

07: and photographing the stacking and establishing a model to obtain the existing stack shape.

In some embodiments, the photographing device can be specifically driven to photograph the stack (namely the current situation of the stack), then photographing data fed back by the photographing device is obtained, a model is established according to the photographing data, then the model is identified, and the acquisition of the existing stack shape is completed.

Referring to fig. 3, in some embodiments, one or more processors 10 are also configured to perform the method of 07. I.e. one or more processors 10 are used to take a picture of the stack and to model it to obtain the existing stack type.

Referring to fig. 5, in some embodiments, the hybrid palletizing device 200 for multi-size boxes further comprises a fifth acquiring module 217, and the fifth acquiring module 217 is further used for executing 07 the method. That is, the fifth acquiring module 217 is used to take a picture of the palletized stack and build a model to acquire the existing stack type.

In one embodiment, the device for photographing the code stack may be an industrial camera, a 3D camera, a network camera, or other devices with a photographing function. The mixed stacking device 100 of the multi-size boxes or the mixed stacking device 200 of the multi-size boxes can be in communication connection with the photographing device through cables, the photographing device transmits information after photographing and stacking to the mixed stacking device 100 of the multi-size boxes or the mixed stacking device 200 of the multi-size boxes through cables, and the one or more processors 10 or the fifth acquiring module 217 establish a model through the information, so that the existing stacking type is acquired. For another example, the photographing device may establish a Communication connection with the hybrid palletizing device 100 of the multi-size box or the hybrid palletizing apparatus 200 of the multi-size box through bluetooth, Wireless local area network (WiFi), Near Field Communication (NFC), Wireless optical Communication (LiFi — Light Fidelity, LiFi), etc., the photographing device may transmit the photographing palletizing type information to the hybrid palletizing device 100 of the multi-size box or the hybrid palletizing apparatus 200 of the multi-size box through bluetooth, WiFi, NFC, LiFi, etc., and the one or more processors 10 or the fifth acquiring module 217 may establish a model through the information, thereby acquiring the existing palletizing type. In another embodiment, the device for photographing the stack may be a device with a photographing function installed in the hybrid palletization device 100 of multi-size boxes or the hybrid palletization apparatus 200 of multi-size boxes. The device directly transmits the information after shooting and stacking to one or more processors 10 or a fifth acquisition module 217 through a line, so that a model is established, and the existing stack shape is acquired.

In some embodiments, the imaging device may be mounted to a side of the actual stack to image the stack from a perspective to aid in the modeling and identification of the stack shape. Preferably, the view angle may be an operation view angle of a manipulator actually performing the palletizing operation, and optionally the manipulator may be as illustrated in fig. 3. For example, if the stack shape is stacked from bottom to top, and the stacking reference needs to be performed by referring to the situation of the highest layer of the stack body, the highest layer of the stack shape is the operation visual angle of the manipulator, and then the photographing device is installed above the stack body; if the stack is to be palletized from inside to outside in a certain receiving space (for example a van), it is necessary to reference the outermost layer of the stack, which is the operating point of the manipulator, and the photographing device is mounted on the outside of the stack with respect to the receiving space.

Optionally, the model type in some embodiments may be a point cloud model, or may be a bounding box model; the model can be established based on the surfaces of the whole stacking type, the surfaces exposed outside and the closest to the photographing equipment, or based on the surfaces of the outermost periphery forming the stacking type, or based on the whole stacking type.

Referring to fig. 7, in some embodiments, 07: photographing the stacking and establishing a model to obtain the existing stack shape, which may include:

071: shooting the current stack shape of the stack and establishing an integral model to obtain the existing stack shape for each stacking; or

072: shooting a first stacking type of the first stacking, and acquiring an existing stacking type based on the position and the height of a box stacked in the first stacking type and a subsequent stacking process; or

073: shooting the current stack shape of the stack at each time of stacking, and only establishing a model of the plane of the highest-layer box of the stack shape to obtain the existing stack shape; or

074: shooting a first stacking type of the first stacking, adding the stacked boxes at corresponding positions of the first stacking type every time the subsequent stacking is performed, and correcting the added boxes based on a shot plane model of the highest-layer boxes to obtain the existing stacking type.

Referring to FIG. 3, in some embodiments, one or more processors may be used to perform the

methods

071, 072, 073 and 074, i.e. one or more processors 10 may be used for each palletization to capture the current shape of the pallet and to build an integral model to obtain the existing shape of the pallet; or shooting a first stacking shape of the first stacking, and acquiring the existing stacking shape based on the position and the height of the box stacked in the first stacking shape and the subsequent stacking process; or shooting the current stack shape of the stack at each time of stacking, and only establishing a model of the plane of the highest-layer box of the stack shape to obtain the existing stack shape; or shooting a first stacking type of the first stacking, adding the stacked boxes at corresponding positions of the first stacking type every time the subsequent stacking is performed, and correcting the added boxes based on the shot plane model of the highest-layer box to obtain the existing stacking type.

Referring to fig. 5, in some embodiments, the fifth acquisition module 217 may include an acquisition assembly 2170, and the acquisition assembly 2170 may be used to perform the methods of 071, 072, 073 and 074. That is, acquisition component 2170 is used to take a current stack shape for each stacking and build an integral model to acquire an existing stack shape; or the automatic stacking device is used for shooting a first stacking type of the first stacking, and acquiring the existing stacking type based on the position and the height of a box stacked in the first stacking type and the subsequent stacking process; or shooting the current stack shape of the stack at each time of stacking, and only establishing a model of the plane of the highest-layer box of the stack shape to obtain the existing stack shape; or shooting a first stacking type of the first stacking, adding the stacked boxes at corresponding positions of the first stacking type every time the subsequent stacking is performed, and correcting the added boxes based on the shot plane model of the highest-layer box to obtain the existing stacking type.

Specifically, by capturing the current condition of the buttress, the processor 10 or acquisition component 2170 models the buttress shape, and specifically, there are a variety of ways in which one or more of the processors 10 or acquisition components 2170 may model the buttress shape captured by the photographing device to acquire an existing buttress shape. The equipment for photographing the code stack can be equipment with a photographing function, such as a 3D intelligent camera, an industrial camera, a network camera and the like.

In one embodiment, after a box to be palletized is palletized, the current palletization type is photographed by the photographing device so that the processor 10 can model the current palletization type. So can guarantee that the model is identical completely with the actual buttress type condition, have higher reduction degree, and then guarantee the high accuracy of mixing pile up neatly operation. For example, after the photographing apparatus photographs the initial stack shape, the processor 10 or the obtaining component 2170 creates an initial integral model to obtain the existing stack shape, which can be shown in the left-side perspective part of fig. 11, when the multi-size box hybrid palletizing apparatus 100 or the multi-size box hybrid palletizing device 200 stacks a box to be palletized, the photographing apparatus photographs the new stack shape again, and one or more of the processors 10 or the obtaining component 2170 creates a new integral model according to the newly photographed image to update the existing stack shape. The photographing device is synchronized with the multi-size box mixing and palletizing device 100 or the multi-size box mixing and palletizing device 200, that is, after the multi-size box mixing and palletizing device 100 or the multi-size box mixing and palletizing device 200 performs a palletizing operation, the photographing device performs a photographing operation, so that the one or more processors 10 or the acquiring assembly 2170 performs a palletizing type updating.

In another embodiment, the photographing device only photographs the first palletized form based on which the hybrid palletizing device 100 of the multi-size boxes or the hybrid palletizing apparatus 200 of the multi-size boxes performs the first palletizing, so that the processor 10 or the acquiring component 2170 performs modeling to obtain the existing palletized form, and the one or more processors 10 or the acquiring component 2170 estimates the existing palletized form after each palletizing operation through the position and the height of each palletized box in the existing palletized form and in the subsequent palletizing process without triggering the photographing device to photograph, that is, the photographing device photographs only once during the palletizing process, and the processor 10 or the acquiring component 2170 performs modeling only once. Therefore, the occupied time and the computing resources in the modeling process are saved, and the overall efficiency of the mixing and stacking is improved. The model established for the first time can be a whole model of a stack shape or a plane model of the highest-layer box of the stack shape. For example, if the first-time stacking type is shown in fig. 8, which is a planar model of the highest-level box of the stacking type, the solid part of the tray is the stacked box, and the number is the height of the box, which respectively includes: a box with a height of 50 and a box with a height of 70, wherein if the box with the height of 60 is filled into the area shown by the dotted line based on the primary stacking type, the height 60 of the box filling the area is increased on the basis of the current height 0 of the area, and the box is used as a secondary stacking type estimated after the primary operation and based on the secondary operation; if it is determined that a box with a height of 50 is to be filled on a box with a height of 60 on the basis of the second buttress pattern, the height of the filled area is currently 60+50 to 110, which is taken as the third buttress pattern based on the third operation estimated after the second operation. It should be noted that the size of the area to be filled each time corresponds to the length and width of the box filling the area.

In another embodiment, the photographing device may photograph the current stacking type of the multi-size box hybrid stacking device 100 or the multi-size box hybrid stacking apparatus 200 after each stacking, and then the one or more processors 10 or the obtaining component 2170 establishes the current stacking type model after each stacking based on the result of each photographing, and the established stacking type is a planar model of the highest box of the current stacking type, so that the amount of modeling data calculation can be reduced, the modeling efficiency can be increased, and the modeling accuracy can be ensured to a certain extent, and the accuracy of hybrid stacking can be improved to a certain extent. For example, as shown in fig. 9, modeling based on the photographing data of the current shape of the stack may be as shown in (a), which may be illustrated as including boxes of height 70, height 50 in the tray, respectively, and if it is decided to stack the box of height 60 between the box of height 70 and the edge of the tray, the photographing modeling after stacking obtains the result as shown in (b) in the figure; based on the model shown in (b), if it is determined that a box with a height of 50 is stacked on a box with a height of 70 in (b), the photographed modeling result after the stacking operation can be shown in (c); if it is determined based on the model shown in fig. c that the box with the height of 50 is to be stacked on the box with the height of 50 in the drawing (c), the current model of the pallet after the photographing is updated to the drawing (d).

In yet another embodiment, the photographing device may first photograph the first stacking model based on which the hybrid stacking device 100 of the multi-size boxes is stacked before the first stacking, and when the stacking operation is performed every time, the hybrid stacking device 100 of the multi-size boxes may add the stacked boxes at the corresponding positions of the first stacking model to estimate the current stacking model. And meanwhile, the highest-level box is shot by the shooting equipment, and then the one or more processors 10 establish corresponding plane models and correct the added boxes based on the plane models so as to obtain the existing stack shape. So, this embodiment explores the actual pile up neatly condition through shooing on the basis of establishing the model, through the model of the mode adjustment of highest face modeling established earlier, and the precision of mixed pile up neatly has been guaranteed to the highest degree.

Referring to FIG. 10, in some embodiments, obtaining corner coordinates of corners of an existing buttress pattern includes:

011: converting the existing stack shape into a contour map; and

012: and acquiring coordinates of each inflection point of the contour map by adopting a geometric calculation method based on the contour map to serve as the coordinates of each corner of the existing buttress shape.

Referring to FIG. 3, one or more processors 10 may be configured to perform the methods of 011 and 012, i.e., one or more processors 10 may be configured to convert an existing buttress shape to a contour map; and acquiring coordinates of each inflection point of the contour map by adopting a geometric calculation method based on the contour map to serve as the coordinates of each corner of the existing buttress shape. It will be appreciated by those skilled in the art that the contour map in the embodiments of the present application reflects the height of the upper surface of the topmost box of the pallet from the plane on which the pallet is stacked, and may alternatively be calculated from a depth image, or may be obtained from an established point cloud model.

Referring to fig. 5, the first obtaining module 211 may include a converting unit 2110 and a first obtaining unit 2111. The conversion unit 2110 may be used to perform the method in 011, and the first acquisition unit 2111 may be used to perform the method in 012. That is, the converting unit 2110 is configured to convert the existing buttress shape into a contour map, and the first obtaining unit 2111 is configured to obtain coordinates of each inflection point of the contour map as corner coordinates of each corner of the existing buttress shape by using a geometric calculation method based on the contour map.

In one embodiment, as shown in fig. 11, the left three boxes have a dimension of 55 cm, and the remaining two boxes have dimensions of 55 cm x 75 cm on a side and 110 cm x 75 cm x 100 cm (length, width and height of 110 cm, 75 cm and 100 cm, respectively) from left to right. The right graph is a contour map converted from an existing stack type and is marked with the height in the corresponding area to express the stacking condition of the stacked boxes in the area. Wherein, the area without marked height is represented as the area without boxes, and the height is 0.

In some embodiments, the coordinates of the inflection point in the contour diagram are the coordinates of the point where the extension direction of the contour line changes. Referring to fig. 12, in one embodiment, the one or more processors 10 or the first obtaining unit 2111 obtains coordinates of each inflection point of the contour map by using a computer geometry method according to the contour map as shown in the left diagram of fig. 12, that is, a coordinate system is established for the contour map, so as to obtain the coordinates of each inflection point. For example, as shown in fig. 12, the coordinates of the inflection points of the contour diagram can be obtained by establishing a coordinate system with the lower left corner of the contour diagram as a reference point, and as shown in the right diagram of fig. 12, the points marked by the dashed lines are part of the inflection points of the contour diagram. From left to right, the coordinates of the inflection points from low to high are (55, 55), (55, 110), (110, 35), (110, 55), (110 ), (220, 35), and (220, 110), respectively. And taking the obtained inflection point coordinates as corner coordinates of each corner of the existing stack shape.

Referring to FIG. 13, in some embodiments, obtaining the corner orientation of corners of an existing buttress pattern includes:

013: converting the existing stack shape into a contour map, and taking the height of each inflection point of the contour map as the height of each corner of the existing stack shape; and

014: the direction in which the height in the predetermined region adjacent to each corner is not higher than the corner height corresponding to the corner is defined as the corner orientation of the corner.

Preferably, steps 013 and 014 can help to screen out part of the directions from the corner coordinates to determine the corner orientation, thereby helping to reduce the computation of the simulated placement.

Referring to FIG. 3, one or more processors 10 may be configured to perform the methods of 013 and 014, i.e., one or more processors 10 may be configured to convert the existing shape to a contour map and to use the corner heights of the corners of the existing shape as the corner heights; and regarding the direction in which the height in the predetermined region adjacent to each corner is not higher than the corner height of the corresponding corner as the corner orientation of the corner.

Referring to fig. 5, the transforming unit 2110 may also be used to perform the method of 013, and the first obtaining unit 2111 may also be used to perform the method of 014. That is, the converting unit 2110 may also be configured to convert the existing shape of the pallet into a contour diagram, and to take the height of each inflection point of the contour diagram as the corner height of each corner of the existing shape of the pallet. The first acquisition unit 2111 may be further configured to take, as the corner orientation of the corner, a direction in which the height in the predetermined region adjacent to each corner is not higher than the corner height of the corresponding corner.

Alternatively, the size of the predetermined area may be determined randomly; preferably according to the size of the boxes to be stacked; the average value of the sizes of the boxes to be stacked can be used as the size of a preset area; alternatively, if only one box is to be stacked, the box size may be taken as the predetermined area size. In a preferred embodiment, the predetermined area is rectangular in shape.

Specifically, as shown in FIG. 11, one or more processors 10 or conversion units 2110 convert the existing pallet shape to a contour map and identify the height of the corresponding zone to express the stacking of the palletized boxes within the zone. The height of each inflection point of the contour map can be obtained by the height of the corresponding zone identifier through one or more processors 10 or the first acquisition unit 2111, and is used as the corner height of each corner of the existing buttress shape. The one or more processors 10 or the first acquisition unit 2111 compares the corner height with a predetermined area height adjacent to the corner. The direction not higher than the corner height can be used as the corner orientation of the corner. As shown in the right drawing of fig. 11, the corner heights at point a include 0 cm, 55 cm, 75 cm, and 110 cm. In one embodiment, when the corner height of the point a is 0 cm, all directions from east to south of the corner coordinate satisfy that the corner height is not higher than the corner height in the predetermined area, that is, all directions in the area facing 0 cm in the predetermined area are not higher than 0 cm, the corner orientation may be selected from the areas from east to south, and specifically may include east, south and east. When the height of the corner of the point A is 55 cm, the area of 0 cm is not higher than 55 cm, and the corner of the point A faces east, southeast, south, southwest and south. When the height of the corner of the point a is 75 cm, the 0 cm area is not higher than 75 cm, the 55 cm area is not higher than 75 cm and the 75 cm area is not higher than 75 cm, the corner orientation of the point a can be selected from any one of the above areas, and can be north, northeast, southeast, south, southwest and west. When the height of the corner of the point a is 110 cm, the four areas of 0 cm, 55 cm, 75 cm and 110 cm are not higher than 110 cm, and the orientation of the corner of the point a can be any orientation.

Illustratively as shown in FIG. 14, the corner height of point P includes 40 cm and 0 cm, with the 0 cm area including the gap between stacked boxes in an existing pallet and the area of the right side of the 40 cm box where no boxes are placed. For the corner height of 40 cm, it can be determined that the directions in both the 0 cm region and the 40 cm region satisfy the corner height of not higher than the point P in the predetermined region by 40 cm, that is, the corner orientation of the point P can be selected from the 0 cm region and the 40 cm region, some embodiments may include west, northwest, north, northeast, east, southeast and south, because 50 cm boxes higher than the corner height by 40 cm exist in the neighborhood (predetermined region) of the southwest direction of the point P, the southwest direction cannot be determined as the corner orientation. For the corner height of 0 cm, the corner orientations of north, northeast, east, southeast and south can be judged, and the two orientations of southwest and northwest can not be selected as the corner orientations due to the existence of boxes with the heights of 40 cm and 50 cm respectively; the west-oriented slot is a two-box slot, although no more than 0 cm above the corner height, which does not meet the "within the predetermined area" requirements of some preferred embodiments and thus cannot be selected as a corner orientation.

Exemplary as shown in fig. 14, the corner height of point Q includes 0 cm and 50 cm. For a height of 0 cm, the 0 cm area is no higher than this value, but the corner height is not oriented with a corner because the 0 cm area is a narrow gap between two boxes that cannot meet the requirements of the predetermined area. For a corner height of 50 cm, the direction within the 50 cm area satisfies the requirement that the height is not lower than the height within the predetermined area, i.e. the corner orientation of point Q may comprise any orientation within the 50 cm area, optionally south, east, north, and south.

In some implementations, the direction of the boundary of the stacking area is not oriented as a corner, and boxes cannot be stacked in this direction. Exemplary as shown in fig. 14, the corner height of point M includes 0 cm and 30 cm. For a corner height of 0 cm, the southwest, the west, the northwest, the north, the northeast, the east and the southeast directions all meet the requirement that the height in a preset area is not higher than the corner height. For a corner height of 30 cm, each direction meets the requirement of corner orientation.

Referring to FIG. 15, in some embodiments, obtaining the corner orientation of corners of an existing buttress pattern further comprises:

015: converting the existing stack shape into a contour map, and taking the height of each inflection point of the contour map as the height of each corner of the existing stack shape;

016: simulating two vectors with 90-degree difference to be placed around each corner; and

017: when the height of the two vectors is the same as the height of the corner corresponding to the two vectors, and the height of a preset area between 90 degrees different from the two vectors is not higher than the height of the corner corresponding to the two vectors, the placing postures of the two vectors are taken as the orientation of the corner corresponding to the corner.

Preferably, steps 015, 016, 017 help to select the direction with the greater probability of stable box placement from among the directions of the corner coordinates, thereby helping to improve the effective control space in the original control space.

Alternatively, the size of the preset area may be randomly determined; preferably according to the size of the boxes to be stacked; specifically, the average value of the sizes of the boxes to be stacked can be used as the size of a preset area; alternatively, if only one box is to be stacked, the box size may be taken as the preset area size. In a preferred embodiment, the predetermined area is rectangular.

Referring to FIG. 3, one or more processors 10 may be used to perform the methods in 015, 016, and 017, i.e. one or more processors 10 may be used to convert an existing shape of the stack into a contour map and to use the corner heights of the corners of the contour map as the corner heights of the corners of the existing shape of the stack; simulating two vectors with 90-degree difference to be placed around each corner; when the height of the two vectors is the same as the height of the corner corresponding to the two vectors, and the height of a preset area between 90 degrees different from the two vectors is not higher than the height of the corner corresponding to the two vectors, the placing postures of the two vectors are taken as the orientation of the corner corresponding to the corner.

Referring to fig. 5, the first obtaining module 211 may further include a simulating unit 2112. The converting unit 2110 is further configured to execute the method in 015, the simulating unit 2112 is further configured to execute the method in 016, and the first acquiring unit 2111 is further configured to execute the method in 017. That is, the converting unit 2110 is configured to convert an existing stack shape into a contour diagram, and use each inflection point height of the contour diagram as a corner height of each corner of the existing stack shape, the simulating unit 2112 is configured to simulate that two vectors differing by 90 ° are placed around each corner, and the first acquiring unit 2111 is configured to use the placing postures of the two vectors as the corner orientation of the corresponding corner when the heights of the two vectors themselves are the same as the corner height of the corresponding corner, and the height of a preset region between 90 ° of the two vectors differing is not higher than the corner height of the corresponding corner.

Referring to fig. 16, point B is the determined corner coordinates, the heights of the corners are 0, 55, 75, and 110, respectively, and the xy axes are two vectors with a 90 ° difference. Alternatively, the x-axis can be respectively placed along eight directions of east, west, south, north, southeast, northeast, southwest and northwest. Illustratively, the x-axis faces east and correspondingly the y-axis faces north: if the xy axes are all in the height area of 75, the heights of the xy are all 75, the heights of the corresponding corners are all 75, the heights in the preset areas between the xy are not higher than 75, and the current xy direction is the corner orientation; if the y-axis is located at the edge of the 110 height area due to the slight deviation and the x-axis is still in the 75 height area, the height of the current x is 75 corresponding to the height of the corner, and the height of the y is 110, and the height of the corresponding corner is different from the height of the x-axis, so that the current xy direction cannot be taken as the direction of the corner; if the x-axis is located at the edge of the 0-height area and the y-axis is still located in the 75-height area due to the slight difference, the current x-axis is located at a height of 0 corresponding to the corner height of 0, and the y-axis is located at a height of 75 corresponding to the corner height of 75 different from the corner height corresponding to x, so that the current xy-direction cannot be regarded as the corner orientation. For another example, if the x-axis is oriented to the northeast and the y-axis is oriented to the northwest, the x-axis will necessarily fall within the 75-height region and the y-axis will necessarily fall within the 110-height region, the corner height corresponding to the x-axis is 75 and the corner height corresponding to the y-axis is 110, the corner heights corresponding to the two are different, and the current xy-direction cannot be taken as the corner orientation. For another example, if there is a gap in the height area of 75 at this time, when the x-axis is toward east, correspondingly the y-axis is toward north, and the xy-axes all fall in the height area of 75, the height in the preset area between xy is not higher than 75, then the current xy direction can be taken as the corner orientation. For another example, if there is a protruding obstacle in the height area of 75, when the x-axis faces east and the y-axis faces north correspondingly, and the xy-axes all fall in the height area of 75, if the height in the preset area between xy is 75 higher by the obstacle, the current xy direction cannot be taken as the corner direction; if the obstacle is not in the xy-to-xy preset region and the height in the xy-to-xy preset region is not higher than 75, the current xy direction can be taken as the corner orientation.

The mixed stacking method of the boxes with the multiple sizes, the mixed stacking equipment 100 of the boxes with the multiple sizes and the mixed stacking device 200 of the boxes with the multiple sizes in the embodiment of the application simulate the boxes to be stacked in the same corner coordinate to be placed, and further determine the corner orientation in which the corner coordinate can be placed. Therefore, various postures of boxes to be stacked can be arranged, and the stacking accuracy of the mixed stacking equipment 100 of boxes with multiple sizes or the mixed stacking device 200 of boxes with multiple sizes is improved.

Referring to fig. 17, in some embodiments, 04: removing infeasible controls in the original control space according to simulation to get an effective control space, including 041: the control that the stacking can not be carried out, the unstable stacking can not be carried out and the control that the effective filling track does not exist in the simulation can be removed, so that the effective control space can be obtained.

Referring to FIG. 3, one or more processors 10 may be configured to perform the method 041, i.e., one or more processors 10 are further configured to remove controls that are not stable in the simulation and that do not have valid fill tracks, to obtain valid control spaces.

Referring to fig. 5, the third obtaining module 214 further includes a second obtaining unit 2140. The second obtaining unit 2140 is configured to perform the method 041, that is, the second obtaining unit 2140 is configured to remove the control that the simulation cannot be performed with the placement, the control that the placement is unstable, and the control that no effective filling track exists, so as to obtain an effective control space.

In one embodiment, the one or more processors 10 or the second fetch unit 2140 model places controls of the original control space formed by the multiple control sets of the bin to be palletized based on the model. And an effective control space is obtained by screening the result of the simulated placement. Assuming that the original control space has 5 controls, sequentially simulating and placing the boxes to be coded in the 5 controls, in one example, if the boxes to be coded are simulated and placed in the 1 st to 4 th controls, the 1 st to 4 th controls can be filled with the boxes to be coded, and when the boxes to be coded are simulated and placed in the 5 th control, the 5 th controls cannot be filled with the boxes to be coded, for example, the control size does not conform and the corresponding boxes cannot be coded, the 5 th controls in the original control space will be removed by one or more of the processors 10 or the second obtaining unit 2140. Meanwhile, in the simulation process, after the box to be stacked is placed in the original control space, the box to be stacked cannot be stably placed, and an inclination angle is generated, the one or more processors 10 or the second obtaining unit 2140 will remove the control in the original control space, for example, if the box to be stacked is placed in the 1 st to 4 th controls in a simulation manner, although the box to be stacked can be filled in the 1 st to 4 th controls, after the box to be stacked is filled in the 1 st control, the box to be stacked cannot be stably placed, has a certain inclination angle, and is easily collapsed, the one or more processors 10 or the second obtaining unit 2140 will also remove the 1 st control in the original control space. If in one embodiment, in the simulated placement process, the box to be stacked may be placed in the original space, and the box to be stacked may be placed stably, at this time, it needs to be considered whether the box can be moved from the current position to the position of the control space in the actual placement process, if a kinematic singular point exists in the moving process of the robot, or if an obstacle that cannot be spanned exists between the current position of the box and the position of the control space, it represents that there is no effective filling track in the original control space, then the one or more processors 10 or the second obtaining unit 2140 may also remove the control in the original control space, for example, if the box to be stacked is placed in the 2 nd to 4 th controls in a simulated manner, although the box to be stacked can be filled in the 2 nd to 4 th controls according to a predetermined posture, and after the box to be stacked is filled in the 2 nd to 4 th controls, the boxes to be stacked can be placed stably without an inclination angle, and are not easy to collapse, but if the boxes to be stacked are not stored and filled into the route of the 2 nd control, the 2 nd control in the original control space is also removed by one or more of the processors 10 or the second obtaining unit 2140. Therefore, after the control that the boxes cannot be stacked due to the fact that the boxes cannot be filled in the simulation and the control that the stacking is not stable are removed, and the control that an effective filling track does not exist, the obtained effective control space only comprises the 2 nd control and the 3 rd control.

The hybrid palletizing method of multi-size boxes, the hybrid palletizing apparatus 100 of multi-size boxes, and the hybrid palletizing device 200 of multi-size boxes of the embodiment of the present application simulate removal of infeasible controls by one or more processors 10 or the second acquiring unit 2140 to obtain an effective control space. The foregoing eliminates the possibility of multiple improper palletizing during the actual palletizing process, thereby improving the palletizing efficiency of the hybrid palletizing device 100 for multi-size boxes.

Referring to fig. 18, in some embodiments, 05: obtaining optimal control in an effective control space from a simulation, comprising:

051: acquiring a first matching degree between a first parameter set and a first preset parameter set of a box to be coded after simulation is executed, wherein the first parameter set comprises at least one of the contact area, the supporting surface percentage, the number of the supporting boxes, the distance from an edge or the distance from a specified container corner of the box to be coded and an adjacent box;

053: acquiring a second matching degree between a second parameter set and a second preset parameter set of a new buttress form formed after simulation is executed, wherein the second parameter set comprises at least one of the height, the volume rate and the top surface unevenness of the new buttress form; and

055: acquiring the total matching degree of each control according to the first matching degree, the second matching degree, a first weight preset by the first matching degree and a second weight preset by the second matching degree;

057: the control with the highest total matching degree among the plurality of controls is made to be the optimal control.

Referring to fig. 3, one or more processors 10 may be used to perform the methods of 051, 053, 055, and 057. That is, the one or more processors 10 may be configured to obtain a first matching degree between a first parameter set of the box to be coded after the simulation is performed and a first preset parameter set, where the first parameter set includes at least one of a contact area, a supporting surface percentage, a number of supporting boxes, a distance from an edge, or a distance of a specified container angle between the box to be coded and an adjacent box; acquiring a second matching degree between a second parameter set and a second preset parameter set of a new buttress form formed after simulation is executed, wherein the second parameter set comprises at least one of the height, the volume rate and the top surface unevenness of the new buttress form; acquiring the total matching degree of each control according to the first matching degree, the second matching degree, a first weight preset by the first matching degree and a second weight preset by the second matching degree; the control with the highest total matching degree among the plurality of controls is made to be the optimal control.

Referring to fig. 5, the fourth obtaining module 215 further includes a third obtaining unit 2150 and a first control unit 2151. The third acquisition unit 2140 is used to perform the methods in 051, 053 and 055, and the first control unit 2151 is used to perform the methods in 057. That is, the third obtaining unit 2150 is configured to obtain a first matching degree between a first parameter set and a first preset parameter set of a box to be coded after the simulation is performed, where the first parameter set includes at least one of a contact area, a supporting surface percentage, a number of supporting boxes, a distance from an edge, or a distance of a specified container angle between the box to be coded and an adjacent box; acquiring a second matching degree between a second parameter set and a second preset parameter set of a new buttress form formed after simulation is executed, wherein the second parameter set comprises at least one of the height, the volume rate and the top surface unevenness of the new buttress form; and acquiring the total matching degree of each control according to the first matching degree, the second matching degree, the first weight preset by the first matching degree and the second weight preset by the second matching degree. The first control unit 2151 is configured to control the highest total matching degree among the plurality of controls to be optimal control.

Specifically, one or more of the processors 100 or the third obtaining unit 2150 may set a first preset parameter set for the box to be stacked before performing the simulated placement of the box to be stacked, so as to define an ideal placement condition of the box to be stacked in the existing stacking pattern. And after the box to be coded is subjected to simulated placement, acquiring a first parameter set of the simulated placement condition of the box to be coded. The first parameter set includes the contact area of the box to be palletized with adjacent boxes, the area of the support surface, the percentage of the support surface, the number of supported boxes, the distance from the edge or designated container corner, and the like. The one or more processors 10 or the third obtaining unit 2150 obtains the first matching degree by comparing the first preset parameter set with the first parameter set.

Before the boxes to be stacked are placed in a simulated manner, one or more processors 100 or the third obtaining unit 2150 may further set a second preset parameter set for the placed new stacking type to limit the rational placement condition of the new stacking type, and after the simulated placement of all the boxes to be stacked is completed, obtain a second parameter set of the current stacking type. A second set of parameters includes the height, volume fraction, top surface unevenness, etc. of the new buttress. The one or more processors 10 or the third obtaining unit 2150 obtains a second matching degree by comparing the second preset parameter set with the second parameter set.

The one or more processors 10 or the third obtaining unit 2150 further obtains a total matching degree of each control according to the first matching degree, the second matching degree, a first weight preset for the first matching degree, and a second weight preset for the second matching degree. For example, if the one or more processors 10 perform simulated placement of each control in the original control space formed by the multiple control sets of the boxes to be stacked, and after performing simulated placement of the 2 nd control, the first matching degree is 90%, the second matching degree is 95%, the first weight preset by the first matching degree is 70%, and the second weight preset by the second matching degree is 30%, the total matching degree of the control can be 91.5%. After the 3 rd control in the same control space is subjected to analog code placement, the first matching degree is 95%, the second matching degree is 90%, the first weight preset by the first matching degree is 70%, and the second weight preset by the second matching degree is 30%, so that the total matching degree of the control is 93.5%. The one or more processors 1 or the first control unit 2151 selects the control having the total matching degree of 93.5%, that is, the control having the highest total matching degree (control No. 3), as the optimal control.

The hybrid palletizing method for multi-size boxes, the hybrid palletizing apparatus 100 for multi-size boxes and the hybrid palletizing device 200 for multi-size boxes according to the embodiment of the present application simulate an effective control space by one or more processors 10 or a third obtaining unit 2150 to obtain an optimal control space. The stacking mode with low matching degree in the actual stacking process is filtered in advance, so that the stacking efficiency of the mixed stacking equipment 100 for boxes with multiple sizes is improved.

Referring to fig. 19, the method for hybrid stacking of boxes with multiple sizes according to the embodiment of the present application further includes:

08: and when the effective control space is an empty set, stopping executing the palletizing.

Referring to fig. 3, one or more processors 10 may be configured to execute the method of 08, that is, one or more processors 10 may be configured to stop execution of palletizing when the active control space is empty.

Referring to fig. 5, the control module 216 further includes a second control unit 2160. The second control unit 2160 is arranged to perform the method in 08, i.e. the second control unit 2160 is arranged to stop performing palletising when the active control space is empty.

Specifically, in one embodiment, if all the boxes to be palletized are successfully placed, it represents that the effective control space is an empty set, that is, the palletizing task is completed, and the palletizing is stopped. In another embodiment, when the box to be palletized is not completely placed and remains, and the current palletizing type has no placing space, the effective control space is represented as an empty set, and the palletizing is stopped.

Referring to fig. 20, the present application further provides a non-volatile computer-readable storage medium 300 containing a computer program 301. The computer program 301, when executed by the one or more processors 10, causes the one or more processors 10 to perform the method of hybrid palletising of multi-sized boxes of any of the embodiments described above.

For example, the computer program 301, when executed by the one or more processors 10, causes the processor 10 to perform the following method of hybrid palletization of boxes of multiple sizes: 01: obtaining the corner coordinates and the corner orientations of the corners of the existing stack shape, and placing boxes to be stacked along the corner orientation existing plane; 02: combining the corner coordinates and the corner orientation of each corner with at least two placing modes of the boxes to be coded to obtain a plurality of controls, wherein the sets of the controls form an original control space; 03: simulating to place a box to be coded into each control of the original control space; 04: removing infeasible controls in the original control space according to the simulation to obtain an effective control space; 05: obtaining optimal control in an effective control space according to simulation; and 06: and placing the boxes to be coded in the optimal control.

For example, the computer program 301, when executed by the one or more processors 10, causes the processor 10 to perform the following method of hybrid palletization of boxes of multiple sizes: 07: and photographing the stacking and establishing a model to obtain the existing stack shape. 071: shooting the current stack shape of the stack and establishing an integral model to obtain the existing stack shape for each stacking; or 072: shooting a first stacking type of the first stacking, and acquiring an existing stacking type based on the position and the height of a box stacked in the first stacking type and a subsequent stacking process; or 073: shooting the current stack shape of the stack at each time of stacking, and only establishing a model of the plane of the highest-layer box of the stack shape to obtain the existing stack shape; or 074: shooting a first stacking type of the first stacking, adding the stacked boxes at corresponding positions of the first stacking type every time the subsequent stacking is performed, and correcting the added boxes based on a shot plane model of the highest-layer boxes to obtain the existing stacking type.

For example, the computer program 301, when executed by the one or more processors 10, causes the processor 10 to perform the following method of hybrid palletization of boxes of multiple sizes:

011: converting the existing stack shape into a contour map; and 012: and acquiring coordinates of each inflection point of the contour map by adopting a geometric calculation method based on the contour map to serve as the coordinates of each corner of the existing buttress shape. 013: converting the existing stack shape into a contour map, and taking the height of each inflection point of the contour map as the height of each corner of the existing stack shape; and 014: the direction in which the height in the predetermined region adjacent to each corner is not higher than the corner height corresponding to the corner is defined as the corner orientation of the corner. 015: converting the existing stack shape into a contour map, and taking the height of each inflection point of the contour map as the height of each corner of the existing stack shape; 016: simulating two vectors with 90-degree difference to be placed around each corner; and 017: when the height of the two vectors is the same as the height of the corner corresponding to the two vectors, and the height of a preset area between 90 degrees different from the two vectors is not higher than the height of the corner corresponding to the two vectors, the placing postures of the two vectors are taken as the orientation of the corner corresponding to the corner.

For example, the computer program 201, when executed by the one or more processors 10, causes the processor 10 to perform the following method of hybrid palletization of boxes of multiple sizes: 041: the control that the stacking can not be carried out, the unstable stacking can not be carried out and the control that the effective filling track does not exist in the simulation can be removed, so that the effective control space can be obtained.

As another example, the computer program 301, when executed by the one or more processors 10, causes the processor 10 to perform the following method of hybrid palletization of boxes of multiple sizes:

051: acquiring a first matching degree between a first parameter set and a first preset parameter set of a box to be coded after simulation is executed, wherein the first parameter set comprises at least one of the contact area, the supporting surface percentage, the number of the supporting boxes, the distance from an edge or the distance from a specified container corner of the box to be coded and an adjacent box; 053: acquiring a second matching degree between a second parameter set and a second preset parameter set of a new buttress form formed after simulation is executed, wherein the second parameter set comprises at least one of the height, the volume rate and the top surface unevenness of the new buttress form; and 055: acquiring the total matching degree of each control according to the first matching degree, the second matching degree, a first weight preset by the first matching degree and a second weight preset by the second matching degree; 057: the control with the highest total matching degree among the plurality of controls is made to be the optimal control.

Also for example, the computer program 301, when executed by the one or more processors 10, causes the processor 10 to perform the following method of hybrid palletization of boxes of multiple sizes: 08: and when the effective control space is an empty set, stopping executing the palletizing.

In the description herein, references to the description of the terms "certain embodiments," "one example," "exemplary," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the application. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.

Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps of the process, and alternate implementations are included within the scope of the preferred embodiment of the present application in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the embodiments of the present application.

Although embodiments of the present application have been shown and described above, it is to be understood that the above embodiments are exemplary and not to be construed as limiting the present application, and that changes, modifications, substitutions and alterations can be made to the above embodiments by those of ordinary skill in the art within the scope of the present application.

Claims

1. A method of hybrid palletization of boxes of various sizes, comprising:

obtaining the corner coordinates and the corner orientations of the corners of the existing stack shape, and placing boxes to be stacked along the corner orientation existing plane;

combining the corner coordinates and the corner orientations of the corners with at least two placement modes of the boxes to be stacked to obtain a plurality of controls, wherein the sets of the controls form an original control space;

simulating and placing the boxes to be coded into each control of the original control space;

obtaining optimal control according to simulation; and

and placing the box to be coded in the optimal control.

2. The hybrid palletization method according to claim 1, further comprising:

and photographing the stacking and establishing a model to obtain the existing stack shape.

3. The hybrid palletization method according to claim 2, wherein the photographing of the palletization and the modeling for obtaining the existing palletization type comprise:

shooting the current stack shape of the stack and establishing an integral model to obtain the existing stack shape for each stacking; or

Shooting a first stacking shape of the first stacking, and acquiring the existing stacking shape based on the position and the height of a box stacked in the first stacking shape and a subsequent stacking process; or

Shooting the current stack shape of the stack at each time of stacking, and only establishing a model of the plane of the highest-layer box of the stack shape to obtain the existing stack shape; or

Shooting a first stacking type of the first stacking, adding the stacked boxes at corresponding positions of the first stacking type every time the subsequent stacking is performed, and correcting the added boxes based on a shot plane model of the highest-layer box to obtain the existing stacking type.

4. The hybrid palletization method according to claim 1, wherein the step of acquiring the corner coordinates of each corner of the existing palletized form comprises the following steps:

converting the existing stack shape into a contour map; and

and acquiring coordinates of each inflection point of the contour map by adopting a computational geometry method based on the contour map to serve as the corner coordinates of each corner of the existing buttress shape.

5. The hybrid palletization method as claimed in claim 1, wherein the obtaining of the corner orientation of each corner of the existing palletized form comprises:

converting the existing buttress shape into a contour map, and taking the height of each inflection point of the contour map as the corner height of each corner of the existing buttress shape; and

the direction in which the height in a predetermined region adjacent to each corner is not higher than the corner height of the corresponding corner is taken as the corner orientation of the corner.

6. The hybrid palletization method as claimed in claim 1, wherein the obtaining of the corner orientation of each corner of the existing palletized form comprises:

converting the existing buttress shape into a contour map, and taking the height of each inflection point of the contour map as the corner height of each corner of the existing buttress shape;

simulating two vectors with 90-degree difference to be placed around each corner; and

and when the height of the two vectors is the same as the height of the corner corresponding to the two vectors, and the height of a preset area between 90 degrees different from the two vectors is not higher than the height of the corner corresponding to the two vectors, taking the placing postures of the two vectors as the orientation of the corner corresponding to the two vectors.

7. Hybrid palletization method according to any one of claims 1 to 6, characterized in that said obtaining, according to a simulation, an optimal control in said active control space comprises:

acquiring a first matching degree between a first parameter set and a first preset parameter set of the box to be coded after the simulation is executed, wherein the first parameter set comprises at least one parameter of the contact area, the supporting surface percentage, the number of the supporting boxes, the distance from an edge or a specified container angle of the box to be coded and an adjacent box;

acquiring a second matching degree between a second parameter set and a second preset parameter set of the new buttress form formed after the simulation is executed, wherein the second parameter set comprises at least one parameter of the height, the volume rate and the unevenness of the top surface of the new buttress form;

acquiring the total matching degree of each control according to the first matching degree, the second matching degree, a first weight preset by the first matching degree and a second weight preset by the second matching degree; and

the control with the highest total matching degree among the plurality of controls is taken as an optimal control.

8. A hybrid palletising apparatus for multi-size boxes, comprising one or more processors for:

removing infeasible controls in the original control space according to simulation to obtain an effective control space;

obtaining optimal control in the effective control space according to simulation; and

and controlling to place the box to be coded in the optimal control.

9. A hybrid palletizing device of boxes of various sizes, characterized in that it comprises:

the stacking device comprises a first acquisition module, a second acquisition module and a stacking module, wherein the first acquisition module is used for acquiring corner coordinates and corner orientations of all corners of an existing stack shape, and boxes to be stacked can be placed along a corner orientation existing plane;

a second acquisition module for combining the corner coordinates and the corner orientations of each corner with at least two placement modes of the boxes to be stacked to obtain a plurality of controls, the sets of the controls forming an original control space;

the simulation module is used for simulating and placing the box to be coded into each control of the original control space;

a third obtaining module for obtaining optimal control according to a simulation; and

and the control module is used for controlling the box to be coded to be placed in the optimal control.

10. One or more non-transitory computer-readable storage media storing a computer program that, when executed by one or more processors, implements the hybrid palletization method according to any one of claims 1 to 7.