WO2019123578A1 - Stacking assistance system - Google Patents

Stacking assistance system Download PDF

Info

Publication number
WO2019123578A1
WO2019123578A1 PCT/JP2017/045792 JP2017045792W WO2019123578A1 WO 2019123578 A1 WO2019123578 A1 WO 2019123578A1 JP 2017045792 W JP2017045792 W JP 2017045792W WO 2019123578 A1 WO2019123578 A1 WO 2019123578A1
Authority
WO
WIPO (PCT)
Prior art keywords
article
loading
loading position
dimensional
image
Prior art date
Application number
PCT/JP2017/045792
Other languages
French (fr)
Japanese (ja)
Inventor
朋弘 仲道
克英 鈴木
勉 石田
徐 剛
Original Assignee
Kyoto Robotics株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Kyoto Robotics株式会社 filed Critical Kyoto Robotics株式会社
Priority to PCT/JP2017/045792 priority Critical patent/WO2019123578A1/en
Priority to JP2019559939A priority patent/JPWO2019123578A1/en
Publication of WO2019123578A1 publication Critical patent/WO2019123578A1/en

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B65CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65GTRANSPORT OR STORAGE DEVICES, e.g. CONVEYORS FOR LOADING OR TIPPING, SHOP CONVEYOR SYSTEMS OR PNEUMATIC TUBE CONVEYORS
    • B65G1/00Storing articles, individually or in orderly arrangement, in warehouses or magazines
    • B65G1/02Storage devices
    • B65G1/04Storage devices mechanical
    • B65G1/137Storage devices mechanical with arrangements or automatic control means for selecting which articles are to be removed
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B65CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65GTRANSPORT OR STORAGE DEVICES, e.g. CONVEYORS FOR LOADING OR TIPPING, SHOP CONVEYOR SYSTEMS OR PNEUMATIC TUBE CONVEYORS
    • B65G57/00Stacking of articles

Definitions

  • the present invention relates to a stowing support system for stowing an article which has been aligned and transported onto an article placing portion such as a transport device.
  • the sorted goods are taken out from the corresponding outlet. It is transported to The articles transported to each outlet are stacked on a carrier such as a basket car, pallet, car truck, etc., and after the inspection work of the article is performed there, the carrier is put on a truck etc. and sent to the shipping destination. Will be delivered.
  • a carrier such as a basket car, pallet, car truck, etc.
  • Patent Document 1 discloses a transport facility that transports the articles delivered in order from a plurality of automatic warehouses to a plurality of transport destinations in order.
  • the present invention has been made in view of the above circumstances, and in the step of stacking the aligned and transported articles on an article placing portion such as a transport device, the stacking position of the transported articles is calculated By showing the calculated position to the worker, the worker can eliminate the time for considering the loading and improve the working efficiency, and additionally, by carrying out the inspection work of the goods at the time of the loading work, It is an object of the present invention to provide a stowing support system capable of enhancing the loading efficiency of articles without the need to stow the articles in a substantially V-shape.
  • a loading assistance system uses a first three-dimensional measuring means for performing three-dimensional measurement of articles conveyed in alignment and transported, and a measurement result by the first three-dimensional measuring means.
  • Loading position calculating means for calculating the loading position of the article on the loading portion
  • loading position indicating means for visually presenting the loading position of the article calculated by the loading position calculating means, the article
  • the second three-dimensional measurement means for performing three-dimensional measurement of the articles stacked on the mounting portion, and the measurement result by the second three-dimensional measurement means and the loading position calculated by the loading position calculation means
  • determining means for determining whether or not the loading of the article is correct, and a warning means for issuing a warning when the determination means determines that the loading of the article is incorrect.
  • the loading position presenting means is characterized by projecting an image specifying two adjacent sides of the bottom surface of the item to the loading position of the item.
  • the loading position presenting means displays an image indicating the loading position on the image display device.
  • the articles which have been aligned and transported are subjected to three-dimensional measurement by the first three-dimensional measurement means, and from the measurement results to the article placement portion by the loading position calculation means
  • the loading position of is calculated.
  • the worker since the calculated loading position is visually presented by the loading position presentation means, the worker only has to load the articles transported to the presented loading position, and the worker can load it.
  • the work efficiency can be improved because time for examining the placement position can be eliminated.
  • the second three-dimensional measurement means performs three-dimensional measurement, and the measurement results are compared with the storage positions calculated by the storage position calculation means for storage.
  • the determination means determines whether the load is correct or not, and when the determination means determines that the loading is incorrect, the warning means warns.
  • the loading position presentation means of the loading assistance system projects an image identifying two adjacent sides of the bottom surface of the article to the loading position of the article. Since it is possible to know at a glance how to load the goods to be loaded at what position and in what direction, it is less likely that mistakes in loading will occur, and work efficiency will also increase.
  • the loading position presentation means of the loading assistance system displays an image indicating the loading position on the image display device
  • the operator can display the image indicating the loading position displayed on the image display device. Since it is sufficient to carry out the loading work in accordance with, errors are less likely to occur and work efficiency is also improved.
  • FIG. 1 An embodiment of a stowing support system according to the present invention will be described below with reference to the drawings.
  • the sorted and sequentially arranged articles 10 are conveyed one by one to the mounting place of the car 12 by the conveyor 17.
  • the transported articles 10 are loaded by the worker 15 onto the basket car 12.
  • the loading assistance system 1 according to the present embodiment is used in a process in which the worker 15 loads the transported item 10 onto the basket 12.
  • the article 10 is a substantially rectangular box or case in which a product or the like is packaged inside, such as a cardboard or the like.
  • the basket car 12 is an article placing portion on which the articles 10 are stacked, and the basket 12 provided on the lower surface of the substantially rectangular placing face on which the article 10 which is the bottom face is placed.
  • Caster for moving the object fences standing up substantially vertically upward from three sides of the outer periphery of the mounting surface and surrounding three sides of the side of the basket 12, and the basket 12 for loading and unloading the articles 10.
  • It is a conveying apparatus also called a roll box pallet which has an inlet / outlet which is an opening surface of the remaining one surface of a side.
  • the basket car 12 is used as the article placing portion for loading the articles 10, not only the basket car 12 but also other conveyance devices such as a pallet and a car track can load the articles 10 I hope there is.
  • the loading assistance system 1 is, as shown in FIG. 1, a computer 2, a first three-dimensional measuring unit 3, a second three-dimensional measuring unit 4, and a projector (loading position presenting unit) 5. And a light curtain (detection means) 6 and a speaker (warning means) 7.
  • the computer 2 has a processing unit 21, a storage unit 22, and an input / output unit 23, each of which is connected to a system bus 27. Transmission and reception are possible.
  • the processing unit 21 executes various programs to perform data processing, control of external devices connected to the computer 2, and the like. For example, CPU and RAM.
  • the storage unit 22 can freely store and delete various data, and various programs to be executed by the processing unit 21 are stored in advance, and the data processed by the processing unit 21 and the computer 2 can be stored.
  • the data etc. from the external device input into can be stored.
  • a hard disk or a flash memory for example, a hard disk or a flash memory.
  • the input / output unit 23 is a part to which various external devices are connected, and the computer 2 and the external device can transmit / receive data to / from each other through the input / output unit 23.
  • it is a LAN port or a USB port.
  • the connection between the input / output unit 23 and the external device may be wired or wireless.
  • the first three-dimensional measuring means 3, the second three-dimensional measuring means 4, the projector 5, the light curtain 6 and the speakers 7 which are components of the stowing support system 1 are all connected to the input / output unit 23. Data can be transmitted and received mutually.
  • input means such as a keyboard and a mouse
  • output means such as a display are connected to the input / output unit 23 so that the operator 15 or the like can operate the computer 2 by the input means, or the contents of processing of the computer 2 are output It may be displayed by means.
  • a control / processing program 221 In the storage unit 22, a control / processing program 221, an image processing program 222, a loading position calculation program 225, and a loading determination program 226 are stored in advance. Each program is executed by the processing unit 21.
  • the control and processing program 221 is a program for performing a series of processes of the stowing support system 1 shown in FIG. 3 and processes signals and data received from each component of the stowing support system 1 and processes thereof. Control of each component is performed based on it.
  • the image processing program 222 is a program for analyzing three-dimensional geometric information of an object to be photographed by processing image data photographed by the first three-dimensional measurement means 3 or the second three-dimensional measurement means 4.
  • image data photographed by the first three-dimensional measurement means 3 or the second three-dimensional measurement means 4 By processing the image data from the first three-dimensional measuring means 3, three-dimensional data of the article 10 can be obtained. From the three-dimensional data of the article 10, the size, shape, etc. of the article 10 can be known.
  • three-dimensional data of the basket car 12 can be obtained.
  • the dimensions of the loading space of the substantially rectangular parallelepiped capable of loading the article 10 surrounded by the fence and the entry / exit of the loading surface and side of the cart 12 It is possible to know the size of the article 10 loaded in the car 12 and in what position and in what state the article 10 is loaded.
  • the loading position calculation program (loading position calculation means) 225 uses three-dimensional data of the article 10 obtained by processing the image data taken by the first three-dimensional measuring means 3 by the image processing program 222. , A program for calculating the loading position of the article 10 on the basket 12. In the present embodiment, three-dimensional data of the article 10 and three-dimensional data of the basket 12 obtained by processing the image data captured by the second three-dimensional measuring means 4 by the image processing program 222 are used. Calculate. The calculation result by the loading position calculation program 225 is obtained as three-dimensional data of the loading position, which is obtained by adding the three-dimensional data of the article 10 to the calculated loading position of the three-dimensional data of the cart 12.
  • the calculation of the loading position is, for example, one example, but when calculating the loading position of the article 10b of FIG. 1, the article 10b is first mounted at the lowermost position in the empty space of the loading space of the cart 12 Calculated to be placed, and at least two sides of the side of the article 10b are three sides except the side of the article 10a already loaded on the car 12 and the loading / unloading side of the loading space of the car 12 Calculate to touch either. At this time, it is preferred to contact the side surface of the already loaded article 10a. Also, when the lateral width of the side of the article 10b is longer than the lateral width of the side of the article 10a, contact is made at the side where the length of the article 10b protrudes from the article 10a is shorter.
  • the loading position is calculated so as to eliminate empty space as much as possible instead of being substantially V-shaped, and therefore the loading efficiency is higher than that of substantially V-shaped loading.
  • the calculation of the loading position in the present embodiment is merely an example, and the loading position may be calculated by another known calculation method or simulation.
  • a means for obtaining the weight of the article 10 may be newly provided, and the weight of the article 10 may also be used to calculate the loading position taking into consideration the balance of weight after loading, such as the center of gravity position.
  • the dimensions of the loading space of the cart 12 analyzed from the three-dimensional data of the cart 12, the state of the article 10 loaded on the cart 12, etc. are used.
  • the dimensions of the article placement part may be input in advance to the storage part 22 and used. You may In that case, the three-dimensional data of the article placement unit acquired by the image processing program 222 may be only the dimensions, positions, etc. of the articles 10 stacked on the article placement unit.
  • the loading determination program (determination means) 226 determines whether the item 10 loaded on the car 12 is the correct item 10 to be loaded and at the loading position calculated by the loading position calculation program 225, It is a program to determine if it has been loaded properly. This determination is made by the three-dimensional data of the loading position of the item 10 calculated by the loading position calculation program 225 and the third order of the basket 12 after the item 10 obtained by the second three-dimensional measuring means 4 is loaded. This is performed by comparing with the original data, and it is determined that the loading is correct if the size and the loading position of the article 10 are correct, and it is determined that the loading is incorrect if either one is different.
  • the determination of whether or not the dimensions of the article 10 are correct depends on the dimensions of the article 10 from the three-dimensional data of the loading position by the loading position calculation program 225, that is, the first three-dimensional measuring means when the article 10 is transported.
  • the dimensions of the article 10 from the three-dimensional data of the article 10 according to 3 and the dimensions of the article 10 actually loaded by the operator 15 from the three-dimensional data of the basket 12 by the second three-dimensional measuring means 4 coincide If it does not match, it is determined that it is correct. If it does not match, it is determined that it is incorrect.
  • dimensions three parameters of height, width, depth may be used, or three-dimensional data itself may be used.
  • the tolerance is set and the range If it is inside, it may be determined that they match. It is preferable to set this tolerance as small as possible, because it is considered that the dimensional error does not increase too much, but if it is set too small, it may be determined to be incorrect for the correct article 10 or vice versa. Since it is determined that the product 10 is the correct one even when the container is loaded, the tolerance is set appropriately. For example, although this is merely an example, it may be about 1% of the size of the article 10 acquired by the first three-dimensional measurement means 3.
  • the determination of whether the loading position of the article 10 is correct depends on the bottom surface of the article 10 in the three-dimensional data of the loading position by the loading position calculation program 225 and the three-dimensional data of the cart 12 by the second three-dimensional measuring means 4 Are compared with the bottom of the article 10 at the point of.
  • the determination of the loading position the loading operation is carried out by the worker 15 who is a person, and it is difficult to load the calculated loading position completely completely, so that a shift is generated as it occurs.
  • a tolerance is set, and if it is within the tolerance, it is determined that the loading position is correct.
  • the deviation includes a position deviation in which the center of gravity of the bottom surface of the article 10 is deviated, and a rotation deviation in which a rotation angle with respect to an axis perpendicular to the bottom surface from the center of gravity of the bottom of the article 10 is deviated. Therefore, the tolerance is set for misalignment and rotational misalignment, for example, about 5% of the size of the bottom surface of the article 10 in the three-dimensional data of the loading position for misalignment, and 5 degrees for rotational misalignment Set as degree. The magnitude of the tolerance may be set appropriately. Although the bottom of the article 10 is used to determine the loading position here, the top may be used, or three-dimensional data itself may be used.
  • the computer 2 is configured to control each component of the stowage support system 1 and to calculate and determine the stowing position.
  • a dedicated electronic circuit may be designed and used so that processing and processing can be performed.
  • the first three-dimensional measuring means 3 has a projector 3a, two cameras 3b, and a sensor 3c, and is provided in the vicinity of the conveyor 17 to perform three-dimensional measurement of the articles 10 flowing on the conveyor 17. ing.
  • the projector 3 a projects a pattern image necessary for performing three-dimensional measurement on the article 10 flowing on the conveyor 17.
  • the two cameras 3b perform shooting at the same position, but are provided at different positions, and simultaneously shoot the article 10 on which the pattern image is projected by the projector 3a.
  • the image data taken by the two cameras 3 b is transmitted to the computer 2 and processed by the image processing program 222.
  • the sensor 3 c is provided upstream of the position in which the projector 3 a and the two cameras 3 b are provided in the flow direction of the conveyor 17, and detects that the article 10 has flowed on the conveyor 17.
  • it is a photoelectric sensor or the like.
  • the positional information of the projector 3a, the two cameras 3b and the sensor 3c, and the flow speed of the conveyor 17 are input in advance to the storage unit 22 of the computer 2, from which the articles 10 flowing on the conveyor 17 are detected by the sensor 3c. It is possible to calculate the time from when it reaches the position of the projector 3a and the two cameras 3b.
  • two first cameras 3b are provided by the first three-dimensional measurement means 3.
  • two or more cameras 3b may be provided, and three or more cameras 3b may be provided.
  • the projector 3a and the camera 3b are configured to perform three-dimensional measurement by projecting a pattern image, other three-dimensional measurement means such as light cutting using a line laser, time of flight, etc. are used. It is also good.
  • the first three-dimensional measurement means 3 is provided on the conveyor 17 to perform three-dimensional measurement of the articles 10 flowing thereon, a dedicated booth for performing three-dimensional measurement is provided, the conveyor 17 The article 10 that has flowed may be moved to the booth and three-dimensional measurement may be performed at the booth.
  • goods 10 may be acquired by performing three-dimensional measurement by the 1st three-dimensional measurement means 3, for example, the warehouse management system etc. which manages the whole warehouse beforehand.
  • the warehouse management system etc. which manages the whole warehouse beforehand.
  • a bar code reader or the like for reading a bar code attached to the article 10 is provided on the conveyor 17, and the size of the article 10 from the warehouse management system Data may be acquired.
  • the second three-dimensional measurement means 4 has a projector 4 a and two cameras 4 b, and is provided at the installation place of the basket car 12.
  • the projector 4 a projects a pattern image necessary for three-dimensional measurement on the basket 12.
  • the two cameras 4b are provided at positions where they can shoot the car 12 from different positions respectively, and simultaneously shoots the car 12 on which the pattern image is projected by the projector 4a.
  • the image data taken by the two cameras 4 b is transmitted to the computer 2 and processed by the image processing program 222.
  • the positional information of the projector 4a, the two cameras 4b, and the projector 5 is input in advance to the storage unit 22 of the computer 2, and by the photographing of the basket car 12, the basket car 12, the projector 4a and the two cameras 4b, and the projector Calibration of the positional relationship with 5 can be performed.
  • two cameras 4b of the second three-dimensional measuring means 4 are used, when the number of the articles 10 loaded on the basket car 12 increases, an article to be stacked and measured If there are two cameras 4b at 10, it is possible to hide and prevent sufficient measurement, so three or more cameras 4b may be used.
  • the projector (loading position presentation means) 5 projects an image specifying the dimensions of the bottom of the article 10 on the loading position of the article 10 calculated by the loading position calculation program 225.
  • the image specifying the dimensions of the bottom surface of the article 10 may be any image as long as two adjacent sides of the bottom surface of the article 10 can be identified.
  • it may be a substantially L-shaped image in which line segments are shown at the positions of two adjacent sides of the bottom surface of the article 10, or an image showing points at the positions of three vertices on the bottom surface.
  • this image is an image for showing the position where the article 10 is to be loaded to the worker 15, it is preferable that the outer periphery of the bottom is indicated by a line segment so that the worker 15 can easily see and understand.
  • characters, symbols, figures, etc. may be displayed on the inner side, or the image data when the article 10 is photographed by the first three-dimensional measuring means 3 may be displayed. Good. Also, the color, density, etc. of the image may be changed.
  • This image is projected to the loading position so as to have the same dimensions as the dimensions of the bottom of the actual article 10. This is possible because the calibration of the positional relationship between the projector 5 and the basket car 12 is performed.
  • it may be confirmed by the camera 4b whether the image of the correct size is projected to the correct position.
  • an arrow may be projected on the side surface of the already loaded article 10 adjacent to the position to indicate the position to the worker 15.
  • the projector 5 is used as the loading position presenting unit, but the projector 4a is used to project a pattern image for three-dimensional measurement to the basket 12 by the second three-dimensional measuring unit 4. Therefore, the projector 4a may be used as a loading position presentation unit to project an image indicating the loading position.
  • a projector that can perform projection with a strong output is used for projecting a pattern image for three-dimensional measurement and for projecting an image indicating a loading position.
  • an image display device capable of displaying an image on a screen or the like instead of directly projecting an image to a loading position by a projector is used as a loading position presentation unit to indicate the loading position on the image display device. An image may be displayed.
  • the image display device is, for example, a screen of a liquid crystal display connected to the computer 2 or a screen of a mobile terminal such as a tablet connected to the computer 2 wirelessly.
  • the display of the image showing the loading position on the image display device may be shown three-dimensionally three-dimensionally as it is from the three-dimensional data of the loading position calculated by the loading position calculation program 225. It may be shown two-dimensionally by the like. At this time, the color of the item 10 to be loaded may be changed or the like so that the operator 15 can easily view and display it.
  • the light curtain 6 includes a light projector 6a and a light receiver 6b.
  • the light projector 6a projects light to the light receiver 6b, and the light receiver 6b receives and detects the light thus projected.
  • the light curtain 6 is provided in the car 12 so that the light between the light projector 6a and the light receiver 6b is blocked by the goods 10 and the worker 15 when the worker 15 loads the goods 10 onto the car 12. It is provided in the vicinity of the loading / unloading port which takes in and out the goods 10.
  • the light detected by the light receiver 6b decreases, so that it is possible to detect the end of the work of loading the article 10 onto the basket 12 by the worker 15 .
  • the light curtain 6 is used as a detection means for the end of the loading operation, but any means capable of detecting the end of the loading operation may be used.
  • a photoelectric sensor may be used, and when the loading operation is completed using a foot switch, a button switch or the like, the operator 15 may be configured to detect the end of the loading operation by pressing the foot switch or the like. It is also good.
  • the speaker (warning means) 7 is a device capable of making various sounds, and when the loading of the article 10 on the car 12 is improper or when the car 12 is full, the warning sound is given. It is used to warn the worker 15. Depending on the content of the warning, the pitch, size, and length of the sound may be changed, or a song having not only a single tone but also a chord or a melody may be played.
  • the speaker 7 is used as the warning means in the present embodiment, any means that allows the worker 15 to recognize the warning may be used. For example, since the projector 5 is used as the loading position presentation means, the projector 5 changes the color of the image projected to the loading position, or projects characters, marks, symbols, photographs, etc. that indicate a warning.
  • the image to be projected may blink as a warning.
  • a warning-dedicated projector or the like may be used, or an image indicating a warning may be displayed on an image display device such as a display.
  • it may be configured such that the worker 15 can perceive a warning both visually and aurally by combining a speaker and a projector.
  • the articles 10 sorted and arranged in order are conveyed one by one by the conveyor 17 to the loading place of the car (article loading unit) 12.
  • the article 10a that has been conveyed first will be described.
  • the sensor 3c detects that the article 10a has flowed (S1).
  • a detection signal of the article 10a by the sensor 3c is input to the computer 2 through the input / output unit 23, the processing unit 21 of the computer 2 calls the control / processing program 221 stored in the storage unit 22 as a trigger. It executes and executes a series of control and processing following S2 of the flow chart of FIG.
  • the second three-dimensional measurement means 4 (S2).
  • the computer 2 executes the image processing program 222 to acquire three-dimensional data of the basket car 12. Every time image data is transmitted from the second three-dimensional measuring means 4 to the computer 2 and the three-dimensional data of the basket car 12 is acquired, the storage unit 22 stores the three-dimensional data as three-dimensional data of the latest basket car 12 Save to At this time, the three-dimensional data of the old basket car 12 may be deleted or stored separately.
  • the computer 2 performs the article by the first three-dimensional measuring means 3 similar to S3.
  • the three-dimensional measurement 10 b is performed to obtain three-dimensional data of the article 10 b and add it to the end of the list of three-dimensional data of the article 10 in the storage unit 22.
  • the computer 2 executes a loading position calculation program 225.
  • the loading position calculation program 225 calculates the three-dimensional data of the latest car 12 stored in the storage unit 22 and the three-dimensional data of the top of the three-dimensional data list of the article 10 (here, the three-dimensional data of the article 10a And calculates the loading position of the article 10a on the basket 12 (S4).
  • the loading position calculated in S4 is stored in the storage unit 22 as three-dimensional data of the loading position.
  • the loading position calculation program 225 When the loading position is calculated by the loading position calculation program 225 in S4, the top three-dimensional data of the list of the three-dimensional data of the latest basket car 12 and the three-dimensional data of the article 10 used at that time are used Completed flag is given.
  • the loading position calculation program 225 is executed when the top of the list of the latest three-dimensional data of the basket car 12 or the three-dimensional data of the article 10 is updated, only when neither of the used flags is given. Be done.
  • the item 10a is the first item 10 that has been transported, but when the loading of the item 10 onto the basket 12 proceeds, when the loading position calculation program 225 is executed in S4, the item 10 at that time.
  • the computer 2 emits a warning sound from the speaker 7 to notify that the car 12 is full (S6).
  • the worker 15 receives the warning at S6, the worker 15 replaces the full load car 12 with a new car 12.
  • the operator 15 notifies the computer 2 that the basket car 12 has been replaced by a sensor such as a foot switch (not shown) (S7).
  • the computer 2 receives the detection signal of replacement of the basket car 12 at S7, the second three-dimensional measuring means 4 performs three-dimensional measurement of the basket car 12 and acquires three-dimensional data of the basket car 12 (S8).
  • the three-dimensional data of the latest basket car 12 of the storage unit 22 is updated to the three-dimensional data acquired at S8, and thereafter, the processing returns to S4 and the loading position is similarly calculated.
  • the computer 2 When the detection signal of the work end by the light curtain 6 is input to the computer 2, the computer 2 ends the projection of the image to the loading position by the projector 5, and the second three-dimensional measuring unit 4 Three-dimensional measurement is performed (S11).
  • the computer 2 executes the image processing program 222 to acquire three-dimensional data of the basket car 12, and the three-dimensional data is used as the tertiary car of the latest basket car 12. It is stored in the storage unit 22 as original data.
  • the computer 2 executes the loading determination program 226, and the loading position three-dimensional data stored in the storage unit 22 And using the latest three-dimensional data of the basket car 12, it is determined whether the loading of the article 10a on the basket car 12 is correct (S12). If it is determined in S12 that the loading is incorrect (YES in S12), the computer 2 again projects an image indicating the loading position of the article 10a from the three-dimensional data of the loading position by the projector 5, and A warning sound is issued by 7 to indicate that the loading is improper, and the worker 15 is warned (S13). The worker 15 corrects the loading when the loading error is warned by the speaker 7 in S13.
  • the first three-dimensional data (here, the three-dimensional data of the article 10a) is deleted from the three-dimensional data list of the article 10, and the second of the list
  • the three-dimensional data of (the article 10b) is moved to the top of the list
  • the third three-dimensional data is moved to the second, and so on.
  • three-dimensional data of the loading position is also deleted from the storage unit 22. Although the deletion is made here, it may be stored by giving a used flag to another place.
  • the process returns to S4, and the three-dimensional data at the top of the list of three-dimensional data of the article 10 Calculation of the loading position from the latest three-dimensional data of the basket car 12 (here, the three-dimensional data of the basket car 12 at S11 used when the loading is determined to be correct in S12) The same processing is performed thereafter.
  • the process waits for the article 10 to be newly transported.
  • loading support system 2 computer 225 loading position calculation program (loading position calculation means) 226 Loading determination program (determination means) 3 first three-dimensional measuring means 4 second three-dimensional measuring means 5 projector (loading position presenting means) 7 Speaker (warning means) 10 articles 12 basket cars (article placement department)

Abstract

[Problem] To provide a stacking assistance system that calculates a stacking position on an article carrying unit for an article to be aligned and transported and indicates that position to a worker, and that can perform article inspection simultaneously with stacking work. [Solution] A stacking assistance system comprises: a first three-dimensional measuring means 3 for performing three-dimensional measurement of an article 10 to be aligned and transported; a stacking position calculating means 2 for calculating a stacking position for the article 10 on an article carrying unit 12 using the measurement results of the first three-dimensional measuring means 3; a stacking position indicating means 5 for visually indicating the article stacking position calculated by the stacking position calculating means 2; a second three-dimensional measuring means 4 for performing three-dimensional measurement of the stacked article 10 on the article carrying unit 12; a determining means 2 for determining whether the article 10 is properly stacked by comparing the measurement results by the second three-dimensional measuring means 4 and the stacking position calculated by the stacking position calculating means 2; and a warning means 7 for issuing a warning when the article stacking is determined to be improper by the determining means 2.

Description

積み付け支援システムStowage support system
 本発明は、整列されて搬送されてきた物品を運搬機器等の物品載置部へ積み付けるための積み付け支援システムに関する。 BACKGROUND OF THE INVENTION Field of the Invention The present invention relates to a stowing support system for stowing an article which has been aligned and transported onto an article placing portion such as a transport device.
 一般的に、物流業界における物品の出荷工程は、物流倉庫から必要な物品が取り出され、地域や店舗等の配送先に応じて仕分けが行われた後、その仕分けされた物品は対応する搬出口へと搬送される。各搬出口に搬送されてきた物品はカゴ車、パレット、カートラック等の運搬機器に積み付けられ、そこで物品の検品作業が行われた後、運搬機器ごとトラック等に載せられて出荷先へと配送される。 Generally, in the shipping process of goods in the distribution industry, after the necessary goods are taken out from the distribution warehouse and sorted according to the delivery destination such as a region or a store, the sorted goods are taken out from the corresponding outlet. It is transported to The articles transported to each outlet are stacked on a carrier such as a basket car, pallet, car truck, etc., and after the inspection work of the article is performed there, the carrier is put on a truck etc. and sent to the shipping destination. Will be delivered.
 近年、電子商取引市場の拡大等によって物流量はますます増大しているため、物流の効率化が求められている。上記のような物流倉庫等における物品の出荷工程に関しても、機械化や自動化が進められている。例えば、倉庫からの物品の取り出しの際に倉庫の棚等に取り付けられたデジタル表示器の指示に従って物品をピッキングするデジタルピッキングシステムや、物品の仕分けの際に自動で配送先別に物品を仕分けするようなソーターシステム等がある。また、スタッカクレーンによって棚から自動で物品の出庫を行い、物品の取り出しから仕分けまでが自動化されているような自動倉庫もある。特許文献1には、複数の自動倉庫から順序立てて出庫された物品を順番通りに複数の搬送先へ搬送するような搬送設備が開示されている。 In recent years, with the expansion of the e-commerce market and the like, the physical flow has been increasing, and therefore, it is required to improve the efficiency of distribution. Mechanization and automation are also in progress regarding the shipping process of goods in the above-mentioned distribution warehouses and the like. For example, a digital picking system that picks up items according to the instruction of a digital indicator attached to a shelf or the like of the warehouse when taking out the items from the warehouse, or automatically sorts the items by delivery destination when sorting the items Sorter system etc. In addition, there are also automatic warehouses in which goods are automatically delivered from a rack by a stacker crane, and from picking up to sorting is automated. Patent Document 1 discloses a transport facility that transports the articles delivered in order from a plurality of automatic warehouses to a plurality of transport destinations in order.
特開2015-098397号公報Unexamined-Japanese-Patent No. 2015-098397
 上記のような自動倉庫や搬送設備等によって機械化や自動化がされている倉庫の場合でも、それらによって整列されて搬送されてきた物品を運搬機器へ積み込む工程は、人手によって行われているのが現状である。現場の作業者が搬送されてきた物品を見て、その場で運搬機器への積み付け位置を検討して積み付けている。この積み付けには作業者が検討する時間を要するため、この工程における作業効率は悪い。また、運搬機器へ物品を積み付けた後で検品作業を行うために、物品は略ロ字形になるように積み付ける必要があった。この検品作業は、物品に貼付されているバーコードを読み取ることによって行われるため、積み付けた後に内部に物品が隠れてしまうことなく、積み付けた物品の周りを作業者が回ってバーコードを読みやすくするために略ロ字形に積み付けている。しかし、この略ロ字形の積み付けは、内部が空きスペースになるため積載効率が悪い。 Even in the case of warehouses that are mechanized or automated by the above-mentioned automatic warehouses or transport facilities, etc., the process of loading the articles aligned and transported by them into the transport equipment is currently performed manually. It is. A worker at the site sees the transported items, and on the spot, examines and places the loading position on the transport equipment. The work efficiency in this process is not good because this loading requires time for the operator to consider. In addition, in order to carry out the inspection work after loading the articles onto the transport equipment, the articles had to be loaded so as to be substantially V-shaped. Since this inspection work is performed by reading the barcode attached to the item, the worker turns the barcode around the loaded item without hiding the item inside after being loaded. It is stacked in a roughly V shape for readability. However, this substantially V-shaped loading is not efficient because the inside space is empty.
 本発明は上記事情に鑑みてなされたものであって、整列されて搬送されてきた物品を運搬機器等の物品載置部へ積み付ける工程において、搬送されてきた物品の積み付け位置を計算し、その計算した位置を作業者に提示することによって、作業者が積み付けを検討する時間を無くして作業効率を高め、さらに、積み付け作業の際に物品の検品作業も併せて行うことによって、物品を略ロ字形に積み付ける必要を無くして物品の積載効率を高めることができる積み付け支援システムを提供することを目的とする。 The present invention has been made in view of the above circumstances, and in the step of stacking the aligned and transported articles on an article placing portion such as a transport device, the stacking position of the transported articles is calculated By showing the calculated position to the worker, the worker can eliminate the time for considering the loading and improve the working efficiency, and additionally, by carrying out the inspection work of the goods at the time of the loading work, It is an object of the present invention to provide a stowing support system capable of enhancing the loading efficiency of articles without the need to stow the articles in a substantially V-shape.
 上記課題を解決するために本発明に係る積み付け支援システムは、整列されて搬送されてくる物品の三次元計測を行う第1三次元計測手段と、第1三次元計測手段による測定結果を用いて物品の物品載置部への積み付け位置を計算する積み付け位置計算手段と、積み付け位置計算手段によって算出された物品の積み付け位置を視覚的に提示する積み付け位置提示手段と、物品載置部へ積み付けた物品の三次元計測を行う第2三次元計測手段と、第2三次元計測手段による測定結果と積み付け位置計算手段によって算出された積み付け位置とを比較して物品の積み付けの正否を判定する判定手段と、判定手段によって物品の積み付けが不正であると判定された場合に警告を発する警告手段と、を備える。 In order to solve the above-mentioned problems, a loading assistance system according to the present invention uses a first three-dimensional measuring means for performing three-dimensional measurement of articles conveyed in alignment and transported, and a measurement result by the first three-dimensional measuring means. Loading position calculating means for calculating the loading position of the article on the loading portion, loading position indicating means for visually presenting the loading position of the article calculated by the loading position calculating means, the article The second three-dimensional measurement means for performing three-dimensional measurement of the articles stacked on the mounting portion, and the measurement result by the second three-dimensional measurement means and the loading position calculated by the loading position calculation means And determining means for determining whether or not the loading of the article is correct, and a warning means for issuing a warning when the determination means determines that the loading of the article is incorrect.
 さらに、積み付け位置提示手段が、物品の積み付け位置に、物品の底面の隣り合う2辺を特定する画像を投影することを特徴とする。 Furthermore, the loading position presenting means is characterized by projecting an image specifying two adjacent sides of the bottom surface of the item to the loading position of the item.
 または、積み付け位置提示手段が、画像表示装置に積み付け位置を示す画像を表示することを特徴とする。 Alternatively, the loading position presenting means displays an image indicating the loading position on the image display device.
 本発明に係る積み付け支援システムによると、整列されて搬送されてきた物品は、第1三次元計測手段によって三次元計測が行われ、その測定結果から積み付け位置計算手段によって物品載置部への積み付け位置が計算される。そして、その算出された積み付け位置が積み付け位置提示手段によって視覚的に提示されるので、作業者は提示された積み付け位置に搬送されてきた物品を積み付けるだけでよく、作業者が積み付け位置を検討する時間を無くすことできるため、作業効率を高めることができる。さらに、作業者が物品を積み付けた際に、第2三次元計測手段によって三次元計測が行われ、その測定結果と積み付け位置計算手段で算出された積み付け位置とを比較して積み付けが正しいかどうかの判定が判定手段によって行われ、判定手段によって積み付けが不正であると判定された場合には警告手段によって警告される。これによって、搬送されてきた物品が積載漏れなくきちんと積み付けられたことが分かり、積み付け作業と同時に検品作業も行っていることになるため、従来の積み付け作業を全て終えた後のバーコード等による物品の検品作業が不要となり、検品作業の時間も短縮できる。さらに、検品作業を想定した略ロ字形の積み付けも不要となるため、積み付け位置計算手段による積み付け位置の計算も、略ロ字形のような制限なしに積載効率が良くなるような計算を行えるため、積載効率を高めることが出来る。 According to the loading support system according to the present invention, the articles which have been aligned and transported are subjected to three-dimensional measurement by the first three-dimensional measurement means, and from the measurement results to the article placement portion by the loading position calculation means The loading position of is calculated. Then, since the calculated loading position is visually presented by the loading position presentation means, the worker only has to load the articles transported to the presented loading position, and the worker can load it. The work efficiency can be improved because time for examining the placement position can be eliminated. Furthermore, when the worker loads the goods, the second three-dimensional measurement means performs three-dimensional measurement, and the measurement results are compared with the storage positions calculated by the storage position calculation means for storage. It is determined by the determination means whether the load is correct or not, and when the determination means determines that the loading is incorrect, the warning means warns. As a result, it can be understood that the transported items have been properly loaded without any load leakage, and the inspection operation is also performed at the same time as the loading operation, so the bar code after all the conventional loading operations have been completed This eliminates the need for the inspection work of the articles by the like, and the time for the inspection work can be shortened. Furthermore, since it is not necessary to use a substantially V-shaped loading assuming inspection work, calculation of the loading position by the loading position calculation means can also be performed to improve the loading efficiency without any limitations such as the substantially V-shape. As it can be done, the loading efficiency can be improved.
 そして、本発明に係る積み付け支援システムの積み付け位置提示手段は、物品の積み付け位置に物品の底面の隣り合う2辺を特定する画像を投影するため、作業者はその画像の位置に物品を積み付ければよく、一目見て積み付ける物品をどの位置にどのような向きで積み付ければよいのかが分かるので、積み付けの間違いが起こりにくく作業効率も上がる。 Then, the loading position presentation means of the loading assistance system according to the present invention projects an image identifying two adjacent sides of the bottom surface of the article to the loading position of the article. Since it is possible to know at a glance how to load the goods to be loaded at what position and in what direction, it is less likely that mistakes in loading will occur, and work efficiency will also increase.
 または、本発明に係る積み付け支援システムの積み付け位置提示手段は、画像表示装置に積み付け位置を示す画像を表示するため、作業者はその画像表示装置に表示された積み付け位置を示す画像に従って積み付け作業を行えばよいので、間違いが起こりにくく作業効率も上がる。 Alternatively, since the loading position presentation means of the loading assistance system according to the present invention displays an image indicating the loading position on the image display device, the operator can display the image indicating the loading position displayed on the image display device. Since it is sufficient to carry out the loading work in accordance with, errors are less likely to occur and work efficiency is also improved.
本発明の一実施形態に係る積み付け支援システムの一例を示す模式平面図である。It is a model top view showing an example of the stowage support system concerning one embodiment of the present invention. 本発明の一実施形態に係る積み付け支援システムで用いるコンピュータの構成の一例を示すブロック図である。It is a block diagram showing an example of composition of a computer used with a storage assistance system concerning one embodiment of the present invention. 本発明の一実施形態に係る積み付け支援システムの一連の処理の流れの一例を示すフローチャートである。It is a flowchart which shows an example of the flow of a series of processes of the storage assistance system which concerns on one Embodiment of this invention.
 本発明に係る積み付け支援システムの一実施形態について、以下、図面を参照しつつ説明する。図1に示すように、仕分けされて順番に整列された物品10がコンベヤ17によってカゴ車12の載置場所へと1つずつ搬送されてくる。この搬送されてきた物品10は、作業者15によってカゴ車12へと積み付けられる。本実施形態に係る積み付け支援システム1は、この搬送されてきた物品10を作業者15がカゴ車12へ積み付ける工程で用いられる。 An embodiment of a stowing support system according to the present invention will be described below with reference to the drawings. As shown in FIG. 1, the sorted and sequentially arranged articles 10 are conveyed one by one to the mounting place of the car 12 by the conveyor 17. The transported articles 10 are loaded by the worker 15 onto the basket car 12. The loading assistance system 1 according to the present embodiment is used in a process in which the worker 15 loads the transported item 10 onto the basket 12.
 本実施形態では、物品10は、内部に商品等が梱包された略直方体形の箱やケース、例えば段ボール等である。また、カゴ車12は、物品10が積み付けられる物品載置部であり、底面である物品10が載置される略矩形の載置面と、載置面の下面に設けられたカゴ車12を移動させるためのキャスターと、載置面の外周の3辺から略垂直上方に立ち上がってカゴ車12の側面の3面を囲む柵と、物品10の積み込み及び積み下ろしをするためのカゴ車12の側面の残りの1面の開口面である出し入れ口とを有するロールボックスパレットとも呼ばれる運搬機器である。本実施形態では物品10を積み付ける物品載置部としてカゴ車12を用いているが、カゴ車12だけでなく、パレットやカートラックのようなその他の運搬機器等、物品10を積載できるものであればよい。 In the present embodiment, the article 10 is a substantially rectangular box or case in which a product or the like is packaged inside, such as a cardboard or the like. In addition, the basket car 12 is an article placing portion on which the articles 10 are stacked, and the basket 12 provided on the lower surface of the substantially rectangular placing face on which the article 10 which is the bottom face is placed. Caster for moving the object, fences standing up substantially vertically upward from three sides of the outer periphery of the mounting surface and surrounding three sides of the side of the basket 12, and the basket 12 for loading and unloading the articles 10. It is a conveying apparatus also called a roll box pallet which has an inlet / outlet which is an opening surface of the remaining one surface of a side. In this embodiment, although the basket car 12 is used as the article placing portion for loading the articles 10, not only the basket car 12 but also other conveyance devices such as a pallet and a car track can load the articles 10 I hope there is.
 本実施形態に係る積み付け支援システム1は、図1に示すように、コンピュータ2と、第1三次元計測手段3と、第2三次元計測手段4と、プロジェクタ(積み付け位置提示手段)5と、ライトカーテン(検出手段)6と、スピーカー(警告手段)7と、を有する。 The loading assistance system 1 according to the present embodiment is, as shown in FIG. 1, a computer 2, a first three-dimensional measuring unit 3, a second three-dimensional measuring unit 4, and a projector (loading position presenting unit) 5. And a light curtain (detection means) 6 and a speaker (warning means) 7.
 コンピュータ2は、図2に示すように、処理部21と、記憶部22と、入出力部23とを有し、それぞれがシステムバス27に接続されており、システムバス27を介して互いにデータの送受信が可能となっている。処理部21は、種々のプログラムを実行することによってデータの処理やコンピュータ2に接続されている外部機器の制御等を行う。例えば、CPU及びRAM等である。記憶部22は、種々のデータを自在に記憶及び消去することが可能であり、処理部21で実行される種々のプログラムが予め格納されており、処理部21で処理されたデータや、コンピュータ2に入力された外部機器からのデータ等を保存することができる。例えば、ハードディスクやフラッシュメモリ等である。入出力部23は、種々の外部機器が接続される部分であり、入出力部23を介してコンピュータ2と外部機器とで互いにデータの送受信が可能となっている。例えば、LANポートやUSBポート等である。入出力部23と外部機器との接続は有線でも無線でもよい。積み付け支援システム1の構成要素である第1三次元計測手段3、第2三次元計測手段4、プロジェクタ5、ライトカーテン6、スピーカー7は全て入出力部23に接続されており、コンピュータ2と互いにデータの送受信が可能となっている。また、入出力部23にキーボードやマウス等の入力手段やディスプレイ等の出力手段を接続して、作業者15等が入力手段によってコンピュータ2を操作できるようにしたり、コンピュータ2の処理の内容を出力手段で表示するようにしてもよい。 As shown in FIG. 2, the computer 2 has a processing unit 21, a storage unit 22, and an input / output unit 23, each of which is connected to a system bus 27. Transmission and reception are possible. The processing unit 21 executes various programs to perform data processing, control of external devices connected to the computer 2, and the like. For example, CPU and RAM. The storage unit 22 can freely store and delete various data, and various programs to be executed by the processing unit 21 are stored in advance, and the data processed by the processing unit 21 and the computer 2 can be stored. The data etc. from the external device input into can be stored. For example, a hard disk or a flash memory. The input / output unit 23 is a part to which various external devices are connected, and the computer 2 and the external device can transmit / receive data to / from each other through the input / output unit 23. For example, it is a LAN port or a USB port. The connection between the input / output unit 23 and the external device may be wired or wireless. The first three-dimensional measuring means 3, the second three-dimensional measuring means 4, the projector 5, the light curtain 6 and the speakers 7 which are components of the stowing support system 1 are all connected to the input / output unit 23. Data can be transmitted and received mutually. Also, input means such as a keyboard and a mouse, and output means such as a display are connected to the input / output unit 23 so that the operator 15 or the like can operate the computer 2 by the input means, or the contents of processing of the computer 2 are output It may be displayed by means.
 記憶部22には、制御・処理プログラム221、画像処理プログラム222、積み付け位置計算プログラム225、及び積み付け判定プログラム226が予め格納されている。各プログラムは処理部21によって実行される。 In the storage unit 22, a control / processing program 221, an image processing program 222, a loading position calculation program 225, and a loading determination program 226 are stored in advance. Each program is executed by the processing unit 21.
 制御・処理プログラム221は、図3に示す積み付け支援システム1の一連の処理の流れを行うプログラムであり、積み付け支援システム1の各構成要素から受信した信号やデータの処理や、その処理に基づいて各構成要素の制御等を行う。 The control and processing program 221 is a program for performing a series of processes of the stowing support system 1 shown in FIG. 3 and processes signals and data received from each component of the stowing support system 1 and processes thereof. Control of each component is performed based on it.
 画像処理プログラム222は、第1三次元計測手段3または第2三次元計測手段4によって撮影された画像データを処理することによって、撮影対象の三次元の幾何情報を解析するプログラムである。第1三次元計測手段3からの画像データを処理することによって物品10の三次元データが得られる。この物品10の三次元データから物品10の寸法や形状等が分かる。第2三次元計測手段4からの画像データを処理することによってカゴ車12の三次元データが得られる。このカゴ車12の三次元データから、例えば、カゴ車12の載置面と側面の柵及び出し入れ口に囲まれた物品10の積載が可能な略直方体の積載空間の寸法や、撮影時点でカゴ車12に積載されている物品10の寸法やその物品10がどの位置にどのような状態で積み付けられているか等が分かる。 The image processing program 222 is a program for analyzing three-dimensional geometric information of an object to be photographed by processing image data photographed by the first three-dimensional measurement means 3 or the second three-dimensional measurement means 4. By processing the image data from the first three-dimensional measuring means 3, three-dimensional data of the article 10 can be obtained. From the three-dimensional data of the article 10, the size, shape, etc. of the article 10 can be known. By processing the image data from the second three-dimensional measuring means 4, three-dimensional data of the basket car 12 can be obtained. From the three-dimensional data of the cart 12, for example, the dimensions of the loading space of the substantially rectangular parallelepiped capable of loading the article 10 surrounded by the fence and the entry / exit of the loading surface and side of the cart 12 It is possible to know the size of the article 10 loaded in the car 12 and in what position and in what state the article 10 is loaded.
 積み付け位置計算プログラム(積み付け位置計算手段)225は、第1三次元計測手段3で撮影された画像データを画像処理プログラム222によって処理することで得られた物品10の三次元データを用いて、物品10のカゴ車12への積み付け位置を計算するプログラムである。本実施形態においては、物品10の三次元データと、第2三次元計測手段4で撮影された画像データを画像処理プログラム222によって処理することで得られたカゴ車12の三次元データとを用いて計算する。積み付け位置計算プログラム225による計算結果は、カゴ車12の三次元データの算出された積み付け位置に物品10の三次元データを加えた、積み付け位置の三次元データとして得られる。 The loading position calculation program (loading position calculation means) 225 uses three-dimensional data of the article 10 obtained by processing the image data taken by the first three-dimensional measuring means 3 by the image processing program 222. , A program for calculating the loading position of the article 10 on the basket 12. In the present embodiment, three-dimensional data of the article 10 and three-dimensional data of the basket 12 obtained by processing the image data captured by the second three-dimensional measuring means 4 by the image processing program 222 are used. Calculate. The calculation result by the loading position calculation program 225 is obtained as three-dimensional data of the loading position, which is obtained by adding the three-dimensional data of the article 10 to the calculated loading position of the three-dimensional data of the cart 12.
 この積み付け位置の計算は、例えば、一例であるが、図1の物品10bの積み付け位置を計算する時、カゴ車12の積載空間の空いている空間で、まず物品10bが最も下方に載置されるように計算し、そして、物品10bの側面の少なくとも2面が、カゴ車12に既に積載されている物品10aの側面及びカゴ車12の積載空間の出し入れ口側を除く3つの側面のいずれかに接するように計算する。この時、既に積載されている物品10aの側面に接する方が優先される。また、物品10bの側面の横幅が、物品10aの側面の横幅よりも長い場合、物品10aから物品10bがはみ出る長さが短くなる方の側面で接するようにする。このように、略ロ字形ではなく、できる限り空き空間が無くなるように積み付け位置の計算が行われるため、略ロ字形の積み付けより積載効率が上がる。なお、本実施形態における上記の積み付け位置の計算は、あくまで一例であって、その他の公知の計算方法やシミュレーションによって積み付け位置を算出するようにしてもよい。物品10の重量の取得手段を新たに備え、物品10の重量も用いて重心位置等積み付け後の重さのバランス等を考慮にいれて積み付け位置を計算するようにしてもよい。また、本実施形態においては、カゴ車12の三次元データから解析したカゴ車12の積載空間の寸法やカゴ車12に積載されている物品10の状態等を用いているが、用いる物品載置部が1種類だけで同じ寸法であり、物品載置部の設置場所が正確に決められている場合、事前にその物品載置部の寸法を記憶部22に入力しておき、それを用いるようにしてもよい。その場合、画像処理プログラム222によって取得する物品載置部の三次元データは、物品載置部に積み付けられた物品10の寸法や位置等だけでよい。 The calculation of the loading position is, for example, one example, but when calculating the loading position of the article 10b of FIG. 1, the article 10b is first mounted at the lowermost position in the empty space of the loading space of the cart 12 Calculated to be placed, and at least two sides of the side of the article 10b are three sides except the side of the article 10a already loaded on the car 12 and the loading / unloading side of the loading space of the car 12 Calculate to touch either. At this time, it is preferred to contact the side surface of the already loaded article 10a. Also, when the lateral width of the side of the article 10b is longer than the lateral width of the side of the article 10a, contact is made at the side where the length of the article 10b protrudes from the article 10a is shorter. As described above, the loading position is calculated so as to eliminate empty space as much as possible instead of being substantially V-shaped, and therefore the loading efficiency is higher than that of substantially V-shaped loading. The calculation of the loading position in the present embodiment is merely an example, and the loading position may be calculated by another known calculation method or simulation. A means for obtaining the weight of the article 10 may be newly provided, and the weight of the article 10 may also be used to calculate the loading position taking into consideration the balance of weight after loading, such as the center of gravity position. Further, in the present embodiment, the dimensions of the loading space of the cart 12 analyzed from the three-dimensional data of the cart 12, the state of the article 10 loaded on the cart 12, etc. are used. If only one type of part has the same size and the installation location of the article placement part is accurately determined, the dimensions of the article placement part may be input in advance to the storage part 22 and used. You may In that case, the three-dimensional data of the article placement unit acquired by the image processing program 222 may be only the dimensions, positions, etc. of the articles 10 stacked on the article placement unit.
 積み付け判定プログラム(判定手段)226は、カゴ車12に積み付けられた物品10が、積み付けるべき正しい物品10であるかどうか、そして積み付け位置計算プログラム225によって算出された積み付け位置に、正しく積み付けられたかどうかを判定するプログラムである。この判定は、積み付け位置計算プログラム225によって算出された物品10の積み付け位置の三次元データと、第2三次元計測手段4によって取得した物品10が積み付けられた後のカゴ車12の三次元データとを比較することによって行われ、物品10の寸法及び積み付け位置が正しい場合に積み付けが正しいと判定し、どちらか一方でも異なる場合には不正であると判定する。 The loading determination program (determination means) 226 determines whether the item 10 loaded on the car 12 is the correct item 10 to be loaded and at the loading position calculated by the loading position calculation program 225, It is a program to determine if it has been loaded properly. This determination is made by the three-dimensional data of the loading position of the item 10 calculated by the loading position calculation program 225 and the third order of the basket 12 after the item 10 obtained by the second three-dimensional measuring means 4 is loaded. This is performed by comparing with the original data, and it is determined that the loading is correct if the size and the loading position of the article 10 are correct, and it is determined that the loading is incorrect if either one is different.
 物品10の寸法が正しいかどうかの判定は、積み付け位置計算プログラム225による積み付け位置の三次元データからの物品10の寸法、つまり、物品10が搬送されてきた時の第1三次元計測手段3による物品10の三次元データからの物品10の寸法と、第2三次元計測手段4によるカゴ車12の三次元データからの作業者15が実際に積み付けた物品10の寸法と、が一致した場合に正しいと判定し、不一致の場合は不正と判定する。寸法としては、高さ、幅、奥行きの3つのパラメータを用いてもよいし、三次元データ自体を用いてもよい。作業者15による積み付け作業の際に多少物品10が変形したり、第1三次元計測手段3や第2三次元計測手段4の計測誤差等も考えられるため、許容誤差を設定してその範囲内であれば一致していると判定するようにしてもよい。寸法の誤差はあまり大きくならないと考えられるため、この許容誤差はなるべく小さく設定することが好ましいが、小さく設定しすぎると正しい物品10なのに不正と判定されたり、逆に大きく設定しすぎると、異なる物品を積み付けた場合でも正しい物品10であると判定されるので、許容誤差は適宜設定する。例えば、あくまで一例であるが、第1三次元計測手段3によって取得された物品10の寸法の1%程度とすればよい。 The determination of whether or not the dimensions of the article 10 are correct depends on the dimensions of the article 10 from the three-dimensional data of the loading position by the loading position calculation program 225, that is, the first three-dimensional measuring means when the article 10 is transported. The dimensions of the article 10 from the three-dimensional data of the article 10 according to 3 and the dimensions of the article 10 actually loaded by the operator 15 from the three-dimensional data of the basket 12 by the second three-dimensional measuring means 4 coincide If it does not match, it is determined that it is correct. If it does not match, it is determined that it is incorrect. As dimensions, three parameters of height, width, depth may be used, or three-dimensional data itself may be used. Since the article 10 may be slightly deformed during the loading work by the worker 15, or the measurement error of the first three-dimensional measurement means 3 or the second three-dimensional measurement means 4 may be considered, the tolerance is set and the range If it is inside, it may be determined that they match. It is preferable to set this tolerance as small as possible, because it is considered that the dimensional error does not increase too much, but if it is set too small, it may be determined to be incorrect for the correct article 10 or vice versa. Since it is determined that the product 10 is the correct one even when the container is loaded, the tolerance is set appropriately. For example, although this is merely an example, it may be about 1% of the size of the article 10 acquired by the first three-dimensional measurement means 3.
 物品10の積み付け位置が正しいかどうかの判定は、積み付け位置計算プログラム225による積み付け位置の三次元データにおける物品10の底面と、第2三次元計測手段4によるカゴ車12の三次元データにおける物品10の底面と、を比較して一致するかどうかによって判定を行う。この積み付け位置の判定については、積み付け作業は人である作業者15によって行われ、算出された積み付け位置に完全に正確に積み付けることは難しいため、ずれは生じるものとして、そのずれの許容誤差を設定しておき、その許容誤差の範囲内であれば積み付け位置が正しいと判定するようにする。ずれとしては、物品10の底面の重心位置がずれる位置ずれと、物品10の底面の重心位置から底面に垂直な軸に対しての回転角度がずれる回転ずれがある。従って、許容誤差は、位置ずれ及び回転ずれに対して設定し、例えば、位置ずれに対して積み付け位置の三次元データにおける物品10の底面の寸法の5%程度、回転ずれに対して5度程度のように設定する。許容誤差の大きさは適宜設定すればよい。ここでは積み付け位置の判定に物品10の底面を用いているが、天面を用いてもよいし、三次元データ自体を用いてもよい。 The determination of whether the loading position of the article 10 is correct depends on the bottom surface of the article 10 in the three-dimensional data of the loading position by the loading position calculation program 225 and the three-dimensional data of the cart 12 by the second three-dimensional measuring means 4 Are compared with the bottom of the article 10 at the point of. As for the determination of the loading position, the loading operation is carried out by the worker 15 who is a person, and it is difficult to load the calculated loading position completely completely, so that a shift is generated as it occurs. A tolerance is set, and if it is within the tolerance, it is determined that the loading position is correct. The deviation includes a position deviation in which the center of gravity of the bottom surface of the article 10 is deviated, and a rotation deviation in which a rotation angle with respect to an axis perpendicular to the bottom surface from the center of gravity of the bottom of the article 10 is deviated. Therefore, the tolerance is set for misalignment and rotational misalignment, for example, about 5% of the size of the bottom surface of the article 10 in the three-dimensional data of the loading position for misalignment, and 5 degrees for rotational misalignment Set as degree. The magnitude of the tolerance may be set appropriately. Although the bottom of the article 10 is used to determine the loading position here, the top may be used, or three-dimensional data itself may be used.
 なお、本実施形態においては、コンピュータ2によって積み付け支援システム1の各構成要素を制御したり、積み付け位置の計算や判定を行うように構成したが、コンピュータ2を用いずに、それらの制御や処理を行えるように専用の電子回路を設計して用いてもよい。 In the present embodiment, the computer 2 is configured to control each component of the stowage support system 1 and to calculate and determine the stowing position. A dedicated electronic circuit may be designed and used so that processing and processing can be performed.
 第1三次元計測手段3は、プロジェクタ3aと、2つのカメラ3bと、センサ3cと、を有し、コンベヤ17上を流れてくる物品10の三次元計測を行うため、コンベヤ17近傍に設けられている。プロジェクタ3aは、三次元計測を行うために必要なパターン画像をコンベヤ17上に流れてくる物品10に投影する。2つのカメラ3bは、同じ位置の撮影を行うが、それぞれ異なる位置に設けられており、プロジェクタ3aによってパターン画像が投影された物品10を同時に撮影する。その2つのカメラ3bによって撮影された画像データはそれぞれコンピュータ2へと送信され、画像処理プログラム222によって処理される。センサ3cは、プロジェクタ3a及び2つのカメラ3bが設けられている位置よりもコンベヤ17の流れる方向の上流に設けられており、コンベヤ17上に物品10が流れてきたことを検出する。例えば、光電センサ等である。プロジェクタ3a及び2つのカメラ3b及びセンサ3cの位置情報、そしてコンベヤ17の流れる速度は、予めコンピュータ2の記憶部22に入力されており、それらからコンベヤ17上を流れる物品10をセンサ3cで検出してからプロジェクタ3a及び2つのカメラ3bの位置に到達するまでの時間を計算できるようになっている。 The first three-dimensional measuring means 3 has a projector 3a, two cameras 3b, and a sensor 3c, and is provided in the vicinity of the conveyor 17 to perform three-dimensional measurement of the articles 10 flowing on the conveyor 17. ing. The projector 3 a projects a pattern image necessary for performing three-dimensional measurement on the article 10 flowing on the conveyor 17. The two cameras 3b perform shooting at the same position, but are provided at different positions, and simultaneously shoot the article 10 on which the pattern image is projected by the projector 3a. The image data taken by the two cameras 3 b is transmitted to the computer 2 and processed by the image processing program 222. The sensor 3 c is provided upstream of the position in which the projector 3 a and the two cameras 3 b are provided in the flow direction of the conveyor 17, and detects that the article 10 has flowed on the conveyor 17. For example, it is a photoelectric sensor or the like. The positional information of the projector 3a, the two cameras 3b and the sensor 3c, and the flow speed of the conveyor 17 are input in advance to the storage unit 22 of the computer 2, from which the articles 10 flowing on the conveyor 17 are detected by the sensor 3c. It is possible to calculate the time from when it reaches the position of the projector 3a and the two cameras 3b.
 なお、本実施形態においては、第1三次元計測手段3でカメラ3bを2つ設けるように構成したが、カメラ3bは2つ以上であればよく、3つ以上設けるようにしてもよい。また、プロジェクタ3aとカメラ3bとを用いてパターン画像の投影による三次元計測を行うように構成したが、ラインレーザを用いた光切断や、タイムオブフライト等、その他の三次元計測手段を用いてもよい。また、第1三次元計測手段3をコンベヤ17上に設けて、その上を流れる物品10の三次元計測を行うように構成したが、三次元計測を行うための専用のブースを設け、コンベヤ17を流れてきた物品10をそのブースに移動させてそのブースで三次元計測を行うようにしてもよい。また、第1三次元計測手段3で三次元計測を行うことによって物品10の三次元データを取得するように構成しているが、例えば、予め倉庫全体の管理をしている倉庫管理システム等に物品10の寸法や形状等のデータが存在する場合等は、物品10に貼付されているバーコードを読み取るバーコードリーダ等をコンベヤ17上に設けて、倉庫管理システムからその物品10の寸法等のデータを取得するようにしてもよい。 In the present embodiment, two first cameras 3b are provided by the first three-dimensional measurement means 3. However, two or more cameras 3b may be provided, and three or more cameras 3b may be provided. In addition, although the projector 3a and the camera 3b are configured to perform three-dimensional measurement by projecting a pattern image, other three-dimensional measurement means such as light cutting using a line laser, time of flight, etc. are used. It is also good. Also, although the first three-dimensional measurement means 3 is provided on the conveyor 17 to perform three-dimensional measurement of the articles 10 flowing thereon, a dedicated booth for performing three-dimensional measurement is provided, the conveyor 17 The article 10 that has flowed may be moved to the booth and three-dimensional measurement may be performed at the booth. Moreover, although it is comprised so that three-dimensional data of the articles | goods 10 may be acquired by performing three-dimensional measurement by the 1st three-dimensional measurement means 3, for example, the warehouse management system etc. which manages the whole warehouse beforehand. When data such as the size and shape of the article 10 is present, a bar code reader or the like for reading a bar code attached to the article 10 is provided on the conveyor 17, and the size of the article 10 from the warehouse management system Data may be acquired.
 第2三次元計測手段4は、プロジェクタ4aと、2つのカメラ4bと、を有し、カゴ車12の設置場所に設けられている。プロジェクタ4aは、三次元計測に必要なパターン画像をカゴ車12上に投影する。2つのカメラ4bは、カゴ車12をそれぞれ異なる位置から撮影できるような位置に設けられており、プロジェクタ4aによってパターン画像が投影されたカゴ車12を同時に撮影する。その2つのカメラ4bによって撮影された画像データはそれぞれコンピュータ2へと送信され、画像処理プログラム222によって処理される。プロジェクタ4a及び2つのカメラ4b、並びにプロジェクタ5の位置情報は予めコンピュータ2の記憶部22に入力されており、カゴ車12の撮影によって、カゴ車12と、プロジェクタ4a及び2つのカメラ4bと、プロジェクタ5との位置関係のキャリブレーションが行えるようになっている。なお、本実施形態においては、第2三次元計測手段4のカメラ4bは2つ用いているが、カゴ車12に積載された物品10の数が多くなってくると、積み付けて計測したい物品10がカメラ4bが2つだと隠れてしまって十分な計測ができないということも考えられるので、3つ以上のカメラ4bを用いるようにしてもよい。 The second three-dimensional measurement means 4 has a projector 4 a and two cameras 4 b, and is provided at the installation place of the basket car 12. The projector 4 a projects a pattern image necessary for three-dimensional measurement on the basket 12. The two cameras 4b are provided at positions where they can shoot the car 12 from different positions respectively, and simultaneously shoots the car 12 on which the pattern image is projected by the projector 4a. The image data taken by the two cameras 4 b is transmitted to the computer 2 and processed by the image processing program 222. The positional information of the projector 4a, the two cameras 4b, and the projector 5 is input in advance to the storage unit 22 of the computer 2, and by the photographing of the basket car 12, the basket car 12, the projector 4a and the two cameras 4b, and the projector Calibration of the positional relationship with 5 can be performed. In the present embodiment, although two cameras 4b of the second three-dimensional measuring means 4 are used, when the number of the articles 10 loaded on the basket car 12 increases, an article to be stacked and measured If there are two cameras 4b at 10, it is possible to hide and prevent sufficient measurement, so three or more cameras 4b may be used.
 プロジェクタ(積み付け位置提示手段)5は、積み付け位置計算プログラム225によって算出された物品10の積み付け位置に、物品10の底面の寸法を特定する画像を投影する。物品10の底面の寸法を特定する画像というのは、物品10の底面の隣り合う2辺が特定できるものであればよい。例えば、物品10の底面の隣り合う2辺の位置に線分を示した略L字形の画像でもよいし、底面の3つの頂点の位置にそれぞれ点を示した画像でもよい。ただ、この画像は作業者15に対してどの位置に物品10を積み付けるかを示すための画像なので、作業者15が見て分かりやすいように、底面の外周が線分で示されているような画像の方が好ましい。さらに、分かりやすくするためにその内側に文字、記号、図形等を表示したり、第1三次元計測手段3で物品10の撮影をしたときの画像データを用いてそれを表示するようにしてもよい。また、画像の色や濃淡等を変更するようにしてもよい。 The projector (loading position presentation means) 5 projects an image specifying the dimensions of the bottom of the article 10 on the loading position of the article 10 calculated by the loading position calculation program 225. The image specifying the dimensions of the bottom surface of the article 10 may be any image as long as two adjacent sides of the bottom surface of the article 10 can be identified. For example, it may be a substantially L-shaped image in which line segments are shown at the positions of two adjacent sides of the bottom surface of the article 10, or an image showing points at the positions of three vertices on the bottom surface. However, since this image is an image for showing the position where the article 10 is to be loaded to the worker 15, it is preferable that the outer periphery of the bottom is indicated by a line segment so that the worker 15 can easily see and understand. Images are preferable. Furthermore, in order to make it easy to understand, characters, symbols, figures, etc. may be displayed on the inner side, or the image data when the article 10 is photographed by the first three-dimensional measuring means 3 may be displayed. Good. Also, the color, density, etc. of the image may be changed.
 この画像は、実際の物品10の底面の寸法と同じ寸法となるように積み付け位置に投影される。プロジェクタ5とカゴ車12の位置関係のキャリブレーションが行われているので可能である。また、積み付け位置に画像を投影した後にカメラ4bによって正しい位置に正しい寸法の画像が投影されているか確認するようにしてもよい。カゴ車12への物品10の積み付けが進んで次に画像を投影する積み付け位置が高くなって作業者15から見えにくい場合等は、積み付け位置への画像の投影に加えて、積み付け位置の隣接する既に積載されている物品10の側面に、例えば矢印等を投影して作業者15に位置を示すようにしてもよい。 This image is projected to the loading position so as to have the same dimensions as the dimensions of the bottom of the actual article 10. This is possible because the calibration of the positional relationship between the projector 5 and the basket car 12 is performed. Alternatively, after projecting the image to the loading position, it may be confirmed by the camera 4b whether the image of the correct size is projected to the correct position. In addition to the projection of the image to the loading position, when the loading position of the goods 10 on the car 12 is advanced and the loading position for projecting the image is high next and it is difficult for the operator 15 to view, etc. For example, an arrow may be projected on the side surface of the already loaded article 10 adjacent to the position to indicate the position to the worker 15.
 なお、本実施形態においては、積み付け位置提示手段としてプロジェクタ5を用いたが、第2三次元計測手段4で三次元計測のためのパターン画像をカゴ車12に投影するためにプロジェクタ4aを用いているので、このプロジェクタ4aを積み付け位置提示手段として兼用して積み付け位置を示す画像を投影するようにしてもよい。この場合、三次元計測のためのパターン画像の投影には弱い出力で、積み付け位置を示す画像の投影には強い出力で投影を行うことができるプロジェクタを用いるようにする。また、プロジェクタによって画像を積み付け位置に直接投影するのではなく、画面等に画像を表示することができる画像表示装置を積み付け位置提示手段として用いて、その画像表示装置に積み付け位置を示す画像を表示するようにしてもよい。画像表示装置は、例えば、コンピュータ2に接続される液晶ディスプレイや、無線によってコンピュータ2に接続されるタブレット等のモバイル端末の画面である。画像表示装置への積み付け位置を示す画像の表示は、積み付け位置計算プログラム225によって算出された積み付け位置の三次元データから、そのまま立体的に三次元的に示してもよいし、平面図等で二次元的に示してもよい。その際、積み付ける対象の物品10だけ色を変える等によって作業者15が見て分かりやすく表示するようにすればよい。 In the present embodiment, the projector 5 is used as the loading position presenting unit, but the projector 4a is used to project a pattern image for three-dimensional measurement to the basket 12 by the second three-dimensional measuring unit 4. Therefore, the projector 4a may be used as a loading position presentation unit to project an image indicating the loading position. In this case, a projector that can perform projection with a strong output is used for projecting a pattern image for three-dimensional measurement and for projecting an image indicating a loading position. In addition, an image display device capable of displaying an image on a screen or the like instead of directly projecting an image to a loading position by a projector is used as a loading position presentation unit to indicate the loading position on the image display device. An image may be displayed. The image display device is, for example, a screen of a liquid crystal display connected to the computer 2 or a screen of a mobile terminal such as a tablet connected to the computer 2 wirelessly. The display of the image showing the loading position on the image display device may be shown three-dimensionally three-dimensionally as it is from the three-dimensional data of the loading position calculated by the loading position calculation program 225. It may be shown two-dimensionally by the like. At this time, the color of the item 10 to be loaded may be changed or the like so that the operator 15 can easily view and display it.
 ライトカーテン6は、投光器6aと受光器6bを有し、投光器6aは受光器6bへと光を投光し、受光器6bはその投光された光を受光して検出する。ライトカーテン6は、作業者15がカゴ車12へ物品10の積み付け作業を行う際、物品10や作業者15によって投光器6aと受光器6bの間の光が遮られるように、カゴ車12の物品10を出し入れする出し入れ口近傍に設けられている。投光器6aと受光器6bの間の光が遮られると、受光器6bが検出する光が減少するため、作業者15によるカゴ車12への物品10の積み付け作業の終了を検出することができる。例えば、光が減少し始めた時が積み付け作業の開始、光の減少中が積み付け作業中、光が元に戻った時が積み付け作業の終了と位置付けることができる。意図せず瞬間的にライトカーテン6の光を遮ってしまうようなことも考えられるため、光の減少が一定時間以上、例えば2秒程度、継続した場合にのみ、その後光が元に戻った時を積み付け作業の終了と判定するようにしてもよい。なお、本実施形態においてはライトカーテン6を積み付け作業の終了の検出手段として用いたが、積み付け作業の終了を検出できる手段であれば何でもよい。例えば、光電センサでもよいし、フットスイッチやボタンスイッチ等を用いて積み付け作業が終了した時に作業者15自身がそのフットスイッチ等を押すことで積み付け作業の終了を検出するように構成してもよい。 The light curtain 6 includes a light projector 6a and a light receiver 6b. The light projector 6a projects light to the light receiver 6b, and the light receiver 6b receives and detects the light thus projected. The light curtain 6 is provided in the car 12 so that the light between the light projector 6a and the light receiver 6b is blocked by the goods 10 and the worker 15 when the worker 15 loads the goods 10 onto the car 12. It is provided in the vicinity of the loading / unloading port which takes in and out the goods 10. When the light between the light projector 6a and the light receiver 6b is interrupted, the light detected by the light receiver 6b decreases, so that it is possible to detect the end of the work of loading the article 10 onto the basket 12 by the worker 15 . For example, when the light starts to decrease can be positioned as the start of the loading operation, during the light reduction as the loading operation, when the light returns to the end as the end of the loading operation. Since it is conceivable that the light of the light curtain 6 is interrupted unintentionally and momentarily, the reduction of the light is continued only for a predetermined time or more, for example, for about 2 seconds, when the light returns thereafter. May be determined to be the end of the loading operation. In the present embodiment, the light curtain 6 is used as a detection means for the end of the loading operation, but any means capable of detecting the end of the loading operation may be used. For example, a photoelectric sensor may be used, and when the loading operation is completed using a foot switch, a button switch or the like, the operator 15 may be configured to detect the end of the loading operation by pressing the foot switch or the like. It is also good.
 スピーカー(警告手段)7は、種々の音を鳴らすことが可能な装置で、カゴ車12への物品10の積み付けが不正である場合や、カゴ車12が満載になった場合に警告音を発し、作業者15に警告するために用いられる。警告の内容に応じて、鳴らす音の高さ、大きさ、長さを変化させたり、単音だけではなく和音やメロディ等を付けた曲を鳴らすようにしてもよい。本実施形態においては警告手段としてスピーカー7を用いたが、作業者15が警告を認識できるような手段であれば何でもよい。例えば、積み付け位置提示手段としてプロジェクタ5を用いているので、プロジェクタ5で積み付け位置に投影している画像の色を変更したり、警告を示すような文字、マーク、記号や写真等を投影したり、投影する画像が点滅したりするようにして警告としてもよい。プロジェクタ5を用いずに、警告専用のプロジェクタ等を用いてもよいし、ディスプレイ等の画像表示装置に警告を示す画像を表示するようにしてもよい。また、スピーカーとプロジェクタとを組み合わせる等して作業者15が視覚と聴覚の両方で警告を知覚できるように構成してもよい。 The speaker (warning means) 7 is a device capable of making various sounds, and when the loading of the article 10 on the car 12 is improper or when the car 12 is full, the warning sound is given. It is used to warn the worker 15. Depending on the content of the warning, the pitch, size, and length of the sound may be changed, or a song having not only a single tone but also a chord or a melody may be played. Although the speaker 7 is used as the warning means in the present embodiment, any means that allows the worker 15 to recognize the warning may be used. For example, since the projector 5 is used as the loading position presentation means, the projector 5 changes the color of the image projected to the loading position, or projects characters, marks, symbols, photographs, etc. that indicate a warning. Or the image to be projected may blink as a warning. Instead of using the projector 5, a warning-dedicated projector or the like may be used, or an image indicating a warning may be displayed on an image display device such as a display. In addition, it may be configured such that the worker 15 can perceive a warning both visually and aurally by combining a speaker and a projector.
 以下、本実施形態に係る積み付け支援システム1による一連の処理の流れについて図3のフローチャートを参照しながら説明する。 Hereinafter, the flow of a series of processes by the stowing support system 1 according to the present embodiment will be described with reference to the flowchart of FIG. 3.
 仕分けされて順番に整列された物品10がコンベヤ17によってカゴ車(物品載置部)12の載置場所へと1つずつ搬送されてくる。ここでは、物品10のうち最初に搬送されてきた物品10aについて説明する。コンベヤ17上を流れる物品10aがセンサ3cの地点に到達すると、センサ3cは物品10aが流れてきたことを検出する(S1)。センサ3cによる物品10aの検出信号が入出力部23を介してコンピュータ2に入力されると、それをきっかけとしてコンピュータ2の処理部21は記憶部22に格納されている制御・処理プログラム221を呼び出して実行し、図3のフローチャートのS2以下の一連の制御・処理を行う。まず、第2三次元計測手段4によってカゴ車12の三次元計測を行う(S2)。S2で撮影された画像データがコンピュータ2に入力されると、コンピュータ2は画像処理プログラム222を実行してカゴ車12の三次元データを取得する。コンピュータ2は、第2三次元計測手段4から画像データが送信されてきてカゴ車12の三次元データを取得する度に、その三次元データを最新のカゴ車12の三次元データとして記憶部22に保存する。この時、古いカゴ車12の三次元データは削除しても別に保存するようにしてもどちらでもよい。 The articles 10 sorted and arranged in order are conveyed one by one by the conveyor 17 to the loading place of the car (article loading unit) 12. Here, among the articles 10, the article 10a that has been conveyed first will be described. When the article 10a flowing on the conveyor 17 reaches the point of the sensor 3c, the sensor 3c detects that the article 10a has flowed (S1). When a detection signal of the article 10a by the sensor 3c is input to the computer 2 through the input / output unit 23, the processing unit 21 of the computer 2 calls the control / processing program 221 stored in the storage unit 22 as a trigger. It executes and executes a series of control and processing following S2 of the flow chart of FIG. First, three-dimensional measurement of the basket car 12 is performed by the second three-dimensional measurement means 4 (S2). When the image data captured in S2 is input to the computer 2, the computer 2 executes the image processing program 222 to acquire three-dimensional data of the basket car 12. Every time image data is transmitted from the second three-dimensional measuring means 4 to the computer 2 and the three-dimensional data of the basket car 12 is acquired, the storage unit 22 stores the three-dimensional data as three-dimensional data of the latest basket car 12 Save to At this time, the three-dimensional data of the old basket car 12 may be deleted or stored separately.
 物品10aがコンベヤ17上を流れて第1三次元計測手段3のプロジェクタ3a及び2つのカメラ3bの設置位置まで到達すると、それらによって物品10aの三次元計測を行う(S3)。S3で撮影された画像データがコンピュータ2に入力されると、コンピュータ2は画像処理プログラム222を実行して物品10aの三次元データを取得する。コンピュータ2は、記憶部22に物品10の三次元データのリストを作成し、第1三次元計測手段3から画像データが送信されてきて物品10の三次元データを取得する度に、その三次元データをリストの末尾に追加する。図3のフローチャートには示していないが、コンベヤ17によって物品10aの次の物品10bが搬送されてきたことをセンサ3cが検出すると、コンピュータ2はS3と同様の第1三次元計測手段3による物品10bの三次元計測を行い、物品10bの三次元データを取得し、記憶部22の物品10の三次元データのリストの末尾に追加する。物品10bの次の物品10c以降も同様である。これらは図3のフローチャートの処理とは別に並行して行われる。 When the article 10a flows on the conveyor 17 and reaches the installation position of the projector 3a and the two cameras 3b of the first three-dimensional measuring means 3, three-dimensional measurement of the article 10a is performed by them (S3). When the image data captured in S3 is input to the computer 2, the computer 2 executes the image processing program 222 to acquire three-dimensional data of the article 10a. The computer 2 creates a list of three-dimensional data of the article 10 in the storage unit 22, and whenever image data is transmitted from the first three-dimensional measuring means 3 and three-dimensional data of the article 10 is acquired, the three-dimensional Add data to the end of the list. Although not shown in the flowchart of FIG. 3, when the sensor 3c detects that the article 10b next to the article 10a has been conveyed by the conveyor 17, the computer 2 performs the article by the first three-dimensional measuring means 3 similar to S3. The three-dimensional measurement 10 b is performed to obtain three-dimensional data of the article 10 b and add it to the end of the list of three-dimensional data of the article 10 in the storage unit 22. The same applies to the next item 10c of the item 10b and the subsequent items. These are performed in parallel separately from the processing of the flowchart of FIG.
 コンピュータ2は、カゴ車12の三次元データ及び物品10aの三次元データを取得すると、積み付け位置計算プログラム225を実行する。積み付け位置計算プログラム225は、記憶部22に保存されている最新のカゴ車12の三次元データと、物品10の三次元データのリストの先頭の三次元データ(ここでは物品10aの三次元データ)とを用いて、物品10aのカゴ車12への積み付け位置を計算する(S4)。S4で算出された積み付け位置は、積み付け位置の三次元データとして記憶部22に保存される。S4で積み付け位置計算プログラム225によって積み付け位置が算出されると、その時に用いた最新のカゴ車12の三次元データ及び物品10の三次元データのリストの先頭の三次元データには、使用済フラグが付与される。積み付け位置計算プログラム225は、最新のカゴ車12の三次元データまたは物品10の三次元データのリストの先頭が更新された時、どちらにも使用済フラグが付与されていない場合にのみ、実行される。 When the computer 2 acquires the three-dimensional data of the basket car 12 and the three-dimensional data of the article 10a, the computer 2 executes a loading position calculation program 225. The loading position calculation program 225 calculates the three-dimensional data of the latest car 12 stored in the storage unit 22 and the three-dimensional data of the top of the three-dimensional data list of the article 10 (here, the three-dimensional data of the article 10a And calculates the loading position of the article 10a on the basket 12 (S4). The loading position calculated in S4 is stored in the storage unit 22 as three-dimensional data of the loading position. When the loading position is calculated by the loading position calculation program 225 in S4, the top three-dimensional data of the list of the three-dimensional data of the latest basket car 12 and the three-dimensional data of the article 10 used at that time are used Completed flag is given. The loading position calculation program 225 is executed when the top of the list of the latest three-dimensional data of the basket car 12 or the three-dimensional data of the article 10 is updated, only when neither of the used flags is given. Be done.
 物品10aは搬送されてきた最初の物品10なので問題ないが、カゴ車12への物品10の積み付けが進んでいくと、S4で積み付け位置計算プログラム225が実行されたとき、その時の物品10を積み付けようとするとカゴ車12が満載でカゴ車12の積載空間の範囲を超えてしまい、積み付け位置が計算できない時が来る(S5のYES)。この時、コンピュータ2は、スピーカー7によってカゴ車12が満載になったことを知らせる警告音を発する(S6)。作業者15はS6で警告を受けると、満載になったカゴ車12を新しいカゴ車12へと入れ替える。カゴ車12の入れ替え作業を終えると、作業者15は不図示のフットスイッチ等のセンサによってコンピュータ2にカゴ車12を入れ替えたことを知らせる(S7)。コンピュータ2は、S7でカゴ車12の入れ替えの検出信号を受けると、第2三次元計測手段4によってカゴ車12の三次元計測を行い、カゴ車12の三次元データを取得する(S8)。記憶部22の最新のカゴ車12の三次元データはS8で取得した三次元データに更新され、その後は、S4に戻って同様に積み付け位置が計算される。 There is no problem because the item 10a is the first item 10 that has been transported, but when the loading of the item 10 onto the basket 12 proceeds, when the loading position calculation program 225 is executed in S4, the item 10 at that time. When it is tried to load the cargo car 12 is full and the loading space of the car 12 is out of range, and the time when the loading position can not be calculated comes (YES in S5). At this time, the computer 2 emits a warning sound from the speaker 7 to notify that the car 12 is full (S6). When the worker 15 receives the warning at S6, the worker 15 replaces the full load car 12 with a new car 12. When the work of replacing the basket car 12 is finished, the operator 15 notifies the computer 2 that the basket car 12 has been replaced by a sensor such as a foot switch (not shown) (S7). When the computer 2 receives the detection signal of replacement of the basket car 12 at S7, the second three-dimensional measuring means 4 performs three-dimensional measurement of the basket car 12 and acquires three-dimensional data of the basket car 12 (S8). The three-dimensional data of the latest basket car 12 of the storage unit 22 is updated to the three-dimensional data acquired at S8, and thereafter, the processing returns to S4 and the loading position is similarly calculated.
 S4で物品10aの積み付け位置が算出されると(S5のNO)、その算出された積み付け位置の三次元データに基づいて、プロジェクタ5によって積み付ける物品10aの底面の寸法を特定する画像を積み付け位置に投影して、作業者15に物品10aの積み付け位置を提示する(S9)。コンベヤ17によって物品10aがカゴ車12の載置場所まで搬送されてくると、作業者15はS9で提示されている積み付け位置に物品10aの積み付け作業を行う。作業者15が物品10aの積み付け作業を終えると、ライトカーテン6によって作業が終了したことが検出される(S10)。ライトカーテン6による作業終了の検出信号がコンピュータ2に入力されると、コンピュータ2は、プロジェクタ5による積み付け位置への画像の投影を終了すると共に、第2三次元計測手段4によってカゴ車12の三次元計測を行う(S11)。S11で撮影された画像データがコンピュータ2に入力されると、コンピュータ2は画像処理プログラム222を実行してカゴ車12の三次元データを取得し、その三次元データを最新のカゴ車12の三次元データとして記憶部22に保存する。 When the loading position of the article 10a is calculated in S4 (NO in S5), an image specifying the dimensions of the bottom of the article 10a to be loaded by the projector 5 is determined based on the calculated three-dimensional data of the loading position. Projecting to the loading position, the loading position of the article 10a is presented to the worker 15 (S9). When the article 10a is conveyed by the conveyor 17 to the loading place of the car 12, the worker 15 carries out the loading operation of the article 10a at the loading position presented in S9. When the worker 15 finishes the work of stacking the articles 10a, it is detected by the light curtain 6 that the work is finished (S10). When the detection signal of the work end by the light curtain 6 is input to the computer 2, the computer 2 ends the projection of the image to the loading position by the projector 5, and the second three-dimensional measuring unit 4 Three-dimensional measurement is performed (S11). When the image data captured in S11 is input to the computer 2, the computer 2 executes the image processing program 222 to acquire three-dimensional data of the basket car 12, and the three-dimensional data is used as the tertiary car of the latest basket car 12. It is stored in the storage unit 22 as original data.
 S10後に、S11で最新のカゴ車12の三次元データが更新されたことをきっかけに、コンピュータ2は積み付け判定プログラム226を実行し、記憶部22に保存されている積み付け位置の三次元データ及び最新のカゴ車12の三次元データを用いて、カゴ車12への物品10aの積み付けが正しいかどうかを判定する(S12)。S12で積み付けが不正であると判定されると(S12のYES)、コンピュータ2は、プロジェクタ5によって再び積み付け位置の三次元データから物品10aの積み付け位置を示す画像を投影すると共に、スピーカー7によって積み付けの不正を知らせる警告音を発して作業者15に警告する(S13)。作業者15は、S13でスピーカー7によって積み付けの不正を警告されると、積み付けの修正を行う。作業者15が物品10aの積み付けの修正作業を終えると、S10と同様にライトカーテン6によってその修正作業の終了を検出する(S14)。S14での積み付け作業終了の検出信号がコンピュータ2に入力されると、S11に戻ってカゴ車12の三次元データを取得し、S12で積み付けの判定が行われる。S12で積み付けの判定が正しいと判定されるまでS11からS14は繰り返される。 After S10, in response to the update of the three-dimensional data of the latest car 12 at S11, the computer 2 executes the loading determination program 226, and the loading position three-dimensional data stored in the storage unit 22 And using the latest three-dimensional data of the basket car 12, it is determined whether the loading of the article 10a on the basket car 12 is correct (S12). If it is determined in S12 that the loading is incorrect (YES in S12), the computer 2 again projects an image indicating the loading position of the article 10a from the three-dimensional data of the loading position by the projector 5, and A warning sound is issued by 7 to indicate that the loading is improper, and the worker 15 is warned (S13). The worker 15 corrects the loading when the loading error is warned by the speaker 7 in S13. When the worker 15 finishes the correction work of the loading of the article 10a, the end of the correction work is detected by the light curtain 6 as in S10 (S14). When a detection signal indicating the end of the loading operation in S14 is input to the computer 2, the process returns to S11 to acquire three-dimensional data of the basket car 12, and the loading determination is performed in S12. S11 to S14 are repeated until it is determined in S12 that the determination of the loading is correct.
 S12で積み付けが正しいと判定されると(S12のNO)、物品10の三次元データのリストから先頭の三次元データ(ここでは物品10aの三次元データ)を削除して、リストの2番目(ここでは物品10b)の三次元データをリストの先頭に、3番目の三次元データを2番目に、というように以降も同様に一つずつ上に繰り上げる。また、積み付け位置の三次元データも記憶部22から削除する。なお、ここでは削除することにしているが、別の場所に使用済のフラグを付与する等して保存する等でもよい。この時、物品10の三次元データのリストが空でなく、三次元データが存在している場合(S15のYES)、S4に戻って、物品10の三次元データのリストの先頭の三次元データと、最新のカゴ車12の三次元データ(ここではS12で積み付けが正しいと判定されたときに用いられたS11でのカゴ車12の三次元データ)と、から積み付け位置の計算が行われ、以下同様の処理が行われる。物品10の三次元データのリストが空の場合(S15のNO)、新たに物品10が搬送されてくるのを待つ。予め設定した一定時間の間にセンサ3cが搬送されてきた物品10の検出を行うと(S16のYES)、S3に戻ってその物品10の三次元計測を行い、以下同様の処理を行う。一定時間の間にセンサ3cが物品10を検出しなかった場合(S16のNO)、コンピュータ2は制御・処理プログラム221を終了する。 If it is determined that the loading is correct in S12 (NO in S12), the first three-dimensional data (here, the three-dimensional data of the article 10a) is deleted from the three-dimensional data list of the article 10, and the second of the list The three-dimensional data of (the article 10b) is moved to the top of the list, the third three-dimensional data is moved to the second, and so on. In addition, three-dimensional data of the loading position is also deleted from the storage unit 22. Although the deletion is made here, it may be stored by giving a used flag to another place. At this time, if the list of three-dimensional data of the article 10 is not empty and three-dimensional data exists (YES in S15), the process returns to S4, and the three-dimensional data at the top of the list of three-dimensional data of the article 10 Calculation of the loading position from the latest three-dimensional data of the basket car 12 (here, the three-dimensional data of the basket car 12 at S11 used when the loading is determined to be correct in S12) The same processing is performed thereafter. When the list of three-dimensional data of the article 10 is empty (NO in S15), the process waits for the article 10 to be newly transported. When detection of the article 10 conveyed by the sensor 3c for a predetermined time set in advance (YES in S16), the process returns to S3, three-dimensional measurement of the article 10 is performed, and the same processing is performed. If the sensor 3c does not detect the article 10 during the predetermined time (NO in S16), the computer 2 ends the control and processing program 221.
 上記はあくまで本発明に係る積み付け支援システムの一実施形態を示したものであるため、本発明の思想を逸脱しない範囲で適宜変更可能である。 The above description is merely an embodiment of the stowing support system according to the present invention, and therefore, can be appropriately changed without departing from the concept of the present invention.
  1   積み付け支援システム
  2   コンピュータ
  225 積み付け位置計算プログラム(積み付け位置計算手段)
  226 積み付け判定プログラム(判定手段)
  3   第1三次元計測手段
  4   第2三次元計測手段
  5   プロジェクタ(積み付け位置提示手段)
  7   スピーカー(警告手段)
 10   物品
 12   カゴ車(物品載置部)

 
1 loading support system 2 computer 225 loading position calculation program (loading position calculation means)
226 Loading determination program (determination means)
3 first three-dimensional measuring means 4 second three-dimensional measuring means 5 projector (loading position presenting means)
7 Speaker (warning means)
10 articles 12 basket cars (article placement department)

Claims (3)

  1.  整列されて搬送されてくる物品の三次元計測を行う第1三次元計測手段と、
     前記第1三次元計測手段による測定結果を用いて前記物品の物品載置部への積み付け位置を計算する積み付け位置計算手段と、
     前記積み付け位置計算手段によって算出された前記物品の積み付け位置を視覚的に提示する積み付け位置提示手段と、
     前記物品載置部へ積み付けた前記物品の三次元計測を行う第2三次元計測手段と、
     前記第2三次元計測手段による測定結果と前記積み付け位置計算手段によって算出された前記積み付け位置とを比較して前記物品の積み付けの正否を判定する判定手段と、
     前記判定手段によって前記物品の積み付けが不正であると判定された場合に警告を発する警告手段と、
     を備える積み付け支援システム。
    First three-dimensional measuring means for performing three-dimensional measurement of articles conveyed in alignment and transported;
    Stowage position calculation means for calculating the stowage position of the article on the article placement portion using the measurement result by the first three-dimensional measurement means;
    Loading position presentation means for visually presenting the loading position of the article calculated by the loading position calculation means;
    Second three-dimensional measurement means for performing three-dimensional measurement of the articles stacked on the article placement unit;
    Determining means for comparing the measurement result by the second three-dimensional measuring means with the loading position calculated by the loading position calculating means to determine whether the loading of the article is correct or not;
    Warning means for giving a warning when it is determined by the determination means that the loading of the article is incorrect;
    Stowage support system with.
  2.  前記積み付け位置提示手段が、前記物品の前記積み付け位置に、前記物品の底面の隣り合う2辺を特定する画像を投影することを特徴とする請求項1に記載の積み付け支援システム。 The loading assistance system according to claim 1, wherein the loading position presentation means projects an image specifying two adjacent sides of the bottom surface of the article on the loading position of the article.
  3.  前記積み付け位置提示手段が、画像表示装置に前記積み付け位置を示す画像を表示することを特徴とする請求項1に記載の積み付け支援システム。

     
    The loading assistance system according to claim 1, wherein the loading position presenting means displays an image indicating the loading position on an image display device.

PCT/JP2017/045792 2017-12-20 2017-12-20 Stacking assistance system WO2019123578A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/JP2017/045792 WO2019123578A1 (en) 2017-12-20 2017-12-20 Stacking assistance system
JP2019559939A JPWO2019123578A1 (en) 2017-12-20 2017-12-20 Loading support system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2017/045792 WO2019123578A1 (en) 2017-12-20 2017-12-20 Stacking assistance system

Publications (1)

Publication Number Publication Date
WO2019123578A1 true WO2019123578A1 (en) 2019-06-27

Family

ID=66993305

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2017/045792 WO2019123578A1 (en) 2017-12-20 2017-12-20 Stacking assistance system

Country Status (2)

Country Link
JP (1) JPWO2019123578A1 (en)
WO (1) WO2019123578A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113554390A (en) * 2021-07-16 2021-10-26 携程旅游网络技术(上海)有限公司 Inventory management system, method, device and storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0753050A (en) * 1993-08-06 1995-02-28 Honda Motor Co Ltd Vanning layout system
WO2015145982A1 (en) * 2014-03-28 2015-10-01 日本電気株式会社 Information processing device, information processing system, distribution system, information processing method, and program storage medium
JP2017088388A (en) * 2015-11-16 2017-05-25 株式会社東芝 Delivery support system, delivery support device, and delivery support program

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0753050A (en) * 1993-08-06 1995-02-28 Honda Motor Co Ltd Vanning layout system
WO2015145982A1 (en) * 2014-03-28 2015-10-01 日本電気株式会社 Information processing device, information processing system, distribution system, information processing method, and program storage medium
JP2017088388A (en) * 2015-11-16 2017-05-25 株式会社東芝 Delivery support system, delivery support device, and delivery support program

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113554390A (en) * 2021-07-16 2021-10-26 携程旅游网络技术(上海)有限公司 Inventory management system, method, device and storage medium

Also Published As

Publication number Publication date
JPWO2019123578A1 (en) 2020-10-22

Similar Documents

Publication Publication Date Title
CN109635132B (en) Automatic warehouse management method, system and terminal equipment
US11383930B2 (en) Delivery system
WO2015145982A1 (en) Information processing device, information processing system, distribution system, information processing method, and program storage medium
US8463079B2 (en) Method and apparatus for geometrical measurement using an optical device such as a barcode and/or RFID scanner
KR20180075414A (en) Article loading facility
US20160176636A1 (en) Picking Display Device and Picking Display System
US20230092401A1 (en) Systems and methods for tracking items
JP2007153490A (en) Picking system
JP2006264914A (en) Incoming merchandise inspection system
JP2012137304A (en) Automatic measurement device for goods distribution system
WO2019123578A1 (en) Stacking assistance system
JP7360768B2 (en) Placement support system, placement support method, and program
CN110785363B (en) Cargo determination device, cargo sorting system, and cargo determination method
JPH05139506A (en) Storage facility
JP4855899B2 (en) Sorting system
US20230194331A1 (en) Weight-based item detection
KR102389786B1 (en) Method for Digital Picking
US20230030447A1 (en) System for monitoring loading and unloading or area transfer of goods
JP2007179301A (en) Cargo collapse detection method and device
JP3815544B2 (en) Gravity inspection storage system
CN113998359A (en) Data verification method, device and equipment, logistics system and storage medium
US20240127471A1 (en) Information processing apparatus, information processing system, information processing method, and recording medium
JP6515725B2 (en) Sorting facility and processing method of reversible recording medium in sorting facility
CN116783622A (en) Information processing apparatus, information processing system, information processing method, and recording medium
JP6564283B2 (en) Load detection system and load detection method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17935535

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2019559939

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17935535

Country of ref document: EP

Kind code of ref document: A1