JP7535720B2 - Shipping support device and shipping support system - Google Patents

Description

The present invention relates to a shipping support device and a shipping support system that support the shipping procedures of users who hand over packages to delivery companies.

In recent years, the use of peer-to-peer EC (Electronic Commerce) sites that mediate commercial transactions between individuals, such as flea markets and auctions, has expanded rapidly. In particular, companies that operate peer-to-peer EC sites have devised ways to make it easier to conduct commercial transactions between individuals by providing users with dedicated applications to be installed on user terminals (such as smartphones). For example, when shipping an item traded on a peer-to-peer EC site as a package, the sender (seller) can easily complete the shipping procedure by following the procedure in the dedicated application to enter delivery information (information on the sender, destination, etc.) and then visiting a nearby store (agency) such as a convenience store. If a device that supports the shipping procedure allows the user to easily complete the shipping procedure without having to interact with a store clerk, the convenience for the user can be further improved.

A known technology for supporting such package shipping procedures is one that uses a sensor such as a camera on a user terminal to measure the size of the package, presents the user with a delivery type that corresponds to the size of the package, and allows the user to post the package in a mailbox if the delivery type allows the package to be posted in a mailbox (see Patent Document 1).

There is also known a technology that uses a database to manage the dispatch, delivery and receipt of packages based on the identification information of a two-dimensional code printed on a label affixed to the package packaging, and allows users to register the package to be dispatched by reading the two-dimensional code on the package at a user terminal, and then place the package in a receiving box installed in a post box, convenience store, etc. (see Patent Document 2).

There is also known a technology in which a user inputs information (postal information) about the sender and destination and the delivery type into a user terminal, a shipping support device (unmanned reception machine) measures the size of the package, the user terminal calculates the delivery fee based on the package size obtained from the shipping support device and processes the payment of the delivery fee, and the shipping support device prints a label including the information inputted into the user terminal, and the user drops the package with the label affixed into the shipping support device (see Patent Document 3).

There is also known technology in which a shipping support device (parcel collection terminal device) allows a user to input parcel delivery information (information on the destination, etc.) and processes the payment of delivery fees based on that information, prints a label containing the delivery information, and allows the user to post the parcel with the label affixed into the shipping support device (see Patent Document 4).

In addition, a technology is known in which, when a user places a package in a shipping support device (automatic parcel collection device), the size of the package is measured, a determination is made as to whether the size of the package complies with a predetermined standard, and the result of the determination is presented to the user, and the package is stored or returned depending on the user's selection (see Patent Document 5). In particular, this technology can count and record the number of packages stored in the shipping support device.

There is also known a technology in which a shipping support device (delivery box device) measures the size of the package to be shipped, processes the payment of the delivery fee based on the size of the package, and completes the shipping procedure by having the user place the package in the shipping support device (see Patent Document 6). In particular, this technology allows shipping procedures to be carried out not only for packaged packages but also for unpackaged packages. That is, the size of an unpackaged package is measured, and appropriate packaging materials corresponding to the size of the package are presented to the user, who then packs the package in the presented packaging materials and places it in the shipping support device.

Patent No. 6490282 Patent No. 6664601 Patent No. 6524601 Japanese Patent Application Publication No. 10-91678 JP 2001-76262 A Patent No. 5891394

Now, after collecting a package, the delivery company usually measures the size of the package to confirm that there is no error in the size category declared by the requester during the shipping procedure. On the other hand, as in the conventional technology, if the size of the package is measured by a shipping support device and the measurement result is sufficiently accurate, it is possible to trust the measurement result of the shipping support device and omit measuring the size after collection by the delivery company. However, the delivery company cannot quickly confirm that the size of the package has been properly measured by the shipping support device and that there is no need to measure the size again. This poses the problem that the delivery company cannot immediately proceed with transporting the package after collecting it.

The main objective of the present invention is to provide a shipping support device and a shipping support system that allows delivery companies to quickly confirm that the size of a package has been properly measured by the shipping support device and that there is no need to measure the size again, and to immediately proceed with tasks such as transporting the package after collection.

The shipping assistance device of the present invention is a shipping assistance device that assists the shipping procedure of a user who hands over a package to a delivery company, and includes a placement section where the user places the package, one or more detection sections that detect the package placed on the placement section, a storage section that stores the package posted by the user, a display section that presents information to the user, and a processor that controls the shipping assistance, and is configured such that the processor measures the size of the package placed on the placement section based on the detection result of the detection section, determines whether the package can be posted based on the measurement result, displays information related to the determination result on the display section, and, if the determination result indicates that the package can be posted, grants approval information related to the size measurement result corresponding to the package.

The shipping support system of the present invention is a shipping support system that supports the shipping procedure of a user who delivers a package to a delivery company, and includes a shipping support device having a placement section where the user places the package, one or more detection sections that detect the package placed on the placement section, a storage section that stores the package posted by the user, and a display section that presents information to the user, and a server device connected to the shipping support device via a network, and the shipping support device transmits the detection result of the package placed on the placement section by the detection section to the server device, and the server device measures the size of the package placed on the placement section based on the detection result of the detection section received from the shipping support device, and determines whether the package can be posted based on the measurement result, and transmits information regarding the determination result to the shipping support device, and if the determination result indicates that the package can be posted, grants approval information regarding the size measurement result corresponding to the package, and the shipping support device displays the information regarding the determination result received from the server device on the display section.

According to the present invention, by presenting the approval information to the delivery company, the delivery company can quickly confirm that the package size was properly measured by the shipping support device and that there is no need to measure the package size again, and can immediately proceed with the transport of the package after collection.

Overall configuration diagram of a shipping support system according to a first embodiment Front view of the shipping support device 1 FIG. 1 is a perspective view showing a main part of a shipping support device 1. A cross-sectional view of the shipping support device 1, in which the placement table 21 is viewed from above. A cross-sectional view of the shipping support device 1, in which the placement table 21 is viewed from the side. FIG. 1 is an explanatory diagram illustrating a waybill printed by the shipping support device 1. A block diagram showing a schematic configuration of a shipping support device 1. FIG. 2 is an explanatory diagram showing an overview of processing performed by the shipping support device 1 for packed packages. FIG. 2 is an explanatory diagram showing an overview of processing for unpackaged packages performed by the shipping support device 1. FIG. 1 is a flow diagram showing a procedure for processing packed packages performed by the shipping support device 1. FIG. 1 is a flow diagram showing a procedure for processing packed packages performed by the shipping support device 1. FIG. 1 is a flow diagram showing a procedure for processing unpackaged packages performed by the shipping support device 1. FIG. 13 is an explanatory diagram showing a screen displayed on the shipping support device 1 during standby. FIG. 13 is an explanatory diagram showing a screen displayed in the automatic measurement mode in the shipping support device 1. FIG. 13 is an explanatory diagram showing a screen displayed in the automatic measurement mode in the shipping support device 1. FIG. 13 is an explanatory diagram showing a screen displayed in the automatic measurement mode in the shipping support device 1. FIG. 13 is an explanatory diagram showing a screen displayed in the automatic measurement mode in the shipping support device 1. FIG. 13 is an explanatory diagram showing a screen displayed in the self-posting mode in the shipping support device 1. FIG. 13 is an explanatory diagram showing a screen displayed in the self-posting mode in the shipping support device 1. FIG. 13 is an explanatory diagram showing a screen displayed in the self-posting mode in the shipping support device 1. FIG. 13 is an explanatory diagram showing a screen displayed in the self-posting mode in the shipping support device 1. FIG. 13 is an explanatory diagram showing a screen displayed in a packaging material purchase mode in the shipping support device 1. FIG. 13 is an explanatory diagram showing a screen displayed in a packaging material purchase mode in the shipping support device 1. FIG. 13 is an explanatory diagram showing a screen displayed in a packaging material purchase mode in the shipping support device 1. FIG. 11 is an explanatory diagram showing a screen displayed in a self-posting mode in a shipping support device 1 according to a first modified example of the first embodiment. FIG. 11 is a flow diagram showing a procedure for processing unpackaged packages according to a second modification of the first embodiment. FIG. 13 is an explanatory diagram showing a main part of a shipping support device 1 according to a third modified example of the first embodiment. FIG. 11 is a flowchart showing an operation procedure of the processor 63 of the shipping support device 1 according to the third modification of the first embodiment. FIG. 11 is a block diagram showing a schematic configuration of a shipping support device 1 and a server device 2 according to a second embodiment.

The first invention made to solve the above problem is a shipping assistance device that assists users in the shipping procedures of handing over packages to a delivery company, and includes a placement section where users place their packages, one or more detection sections that detect packages placed on the placement section, a storage section that stores packages posted by users, a display section that presents information to users, and a processor that controls the shipping assistance, and the processor measures the size of the package placed on the placement section based on the detection results of the detection section, determines whether the package can be posted based on the measurement results, displays information related to the determination results on the display section, and, if the determination result indicates that the package can be posted, provides approval information related to the size measurement results in association with the package.

By presenting the approval information to the delivery company, the delivery company can quickly confirm that the package size was properly measured by the shipping support device and that there is no need to measure the size again, and can immediately proceed with transporting the package after collecting it.

The second invention is configured such that the placement unit, the detection unit, the storage unit, and the display unit are integrally provided in the same housing.

This allows the device to take up less space, making it easy to install in stores such as convenience stores.

The third invention is configured so that the detection unit includes a first detection unit that detects luggage placed on the loading section from above, and a second detection unit that detects luggage placed on the loading section from the side.

This allows the size of luggage to be measured with high accuracy.

In addition, the fourth invention is configured such that, if the processor determines that the parcel placed on the placement section is unpackaged and can be posted, it displays at least one of information regarding the size of the parcel and information regarding the cost of shipping on the display section.

This allows users to check the size of the package and the cost of shipping.

In addition, the fifth invention is configured such that when the processor determines that an unpackaged package placed on the placement section can be dropped off, the processor displays information on the display section regarding packaging materials suitable for the package.

This allows users to immediately check what packaging materials they need to post.

In addition, in the sixth invention, when the processor determines that the parcel placed on the placement section is ready to be dropped off and that the parcel has already been packed, the processor displays on the display section that the parcel can be dropped off.

This allows users to immediately confirm that they can drop off their parcels and drop off the parcels in the device on the spot.

The seventh invention further includes a printing unit that prints a waybill, and when the processor determines that the package placed on the placement unit has already been packed and can be posted, it instructs the printing unit to print a waybill that includes the approval information corresponding to the package.

This allows users to immediately obtain the necessary waybill and post the package on the device on the spot. Furthermore, because approval information is visualized on the waybill, delivery companies can simply visually check the waybill affixed to the package to instantly confirm that the package's size was properly measured by the shipping support device and that there is no need to measure the size again.

The eighth invention is a shipping support system that supports the shipping procedure of a user who delivers a package to a delivery company, and includes a shipping support device having a placement section where the user places the package, one or more detection sections that detect the package placed on the placement section, a storage section that stores the package posted by the user, and a display section that presents information to the user, and a server device connected to the shipping support device via a network, in which the shipping support device transmits the detection result of the package placed on the placement section by the detection section to the server device, and the server device measures the size of the package placed on the placement section based on the detection result of the detection section received from the shipping support device, and determines whether the package can be posted based on the measurement result, and transmits information regarding the determination result to the shipping support device, and in the case of a determination result that the package can be posted, approval information regarding the size measurement result corresponding to the package is assigned, and the shipping support device displays the information regarding the determination result received from the server device on the display section.

As with the first invention, this allows the delivery company to quickly confirm that the package size has been properly measured by the shipping support device and that there is no need to measure the size again, and to immediately proceed with transporting the package after collection.

The following describes an embodiment of the present invention with reference to the drawings.

First Embodiment
FIG. 1 is a diagram showing the overall configuration of a shipping support system according to the first embodiment.

This shipping support system supports the shipping procedures of a user (requester) who hands over a package to a delivery company, and includes a shipping support device 1, a server device 2, and a smartphone 3 (user device). The shipping support device 1 and the server device 2 are connected via a network. The smartphone 3 and the server device 2 are also connected via a network. This shipping support system can also be used to ship goods traded on peer-to-peer e-commerce sites that mediate commercial transactions between individuals, such as flea markets and auctions.

The shipping support device 1 is installed in a store such as a convenience store. This shipping support device 1 has a function of measuring the size of luggage brought in by a user and presenting the user with the shipping fee for the luggage, etc. The shipping support device 1 also has a function as a postbox where luggage is dropped off. The shipping support device 1 also has a function as a self-checkout that sells packaging materials (packaging containers). The shipping support device 1 also has a function of printing a shipping label with specified information written on it based on information input in advance by the user using the smartphone 3. The user attaches the printed shipping label to the luggage and then drops it into the shipping support device 1.

The smartphone 3 is operated by a user who uses the shipping support device 1 to request a delivery company to deliver a package. A shipping application and a payment application are installed on this smartphone 3. In the shipping application, the user inputs shipping declaration information about the package to be shipped (information about the item name, sender, destination, handling instructions (fragile, precision equipment, refrigeration required), etc.). Note that the shipping declaration information may be input on a user terminal other than the smartphone 3, such as a PC or tablet terminal. The payment application is used to perform smartphone payment, i.e., payment services such as electronic money and credit cards, using the smartphone 3. The user can use this payment application to pay for the purchase of packaging materials using a specified payment service.

The server device 2 has a function of managing the shipment of packages. Specifically, it registers and manages information input by a user in advance using a smartphone 3 or the like when shipping a package as shipping declaration information for each user, and provides the shipping declaration information to the shipping support device 1 in response to a request from the shipping support device 1. The server device 2 also has a function related to payment. Specifically, it performs a payment process related to the payment of the cost of packaging materials purchased by the user in response to a request from the shipping support device 1. The server device 2 may be installed in a remote location separate from the store (such as a management center), or may be installed in an appropriate location within the store (such as a back yard or management room).

In this embodiment, the server device 2 has a function for managing package delivery and a function related to payment, but the function for managing package delivery and the function related to payment may be realized separately in different server devices.

Next, the schematic configuration of the shipping support device 1 will be described. Fig. 2 is a front view of the shipping support device 1. Fig. 3 is a perspective view showing the main parts of the shipping support device 1. Fig. 4 is a cross-sectional view of the shipping support device 1 when the mounting platform 21 is viewed from above. Fig. 5 is a cross-sectional view of the shipping support device 1 when the mounting platform 21 is viewed from the side. Fig. 6 is an explanatory diagram explaining the waybill printed by the shipping support device 1.

As shown in FIG. 2, the shipping support device 1 includes a main body 11 and a rack 12.

The rack 12 (stocker) stores packaging materials (standard packaging materials, compatible packaging materials) that can be dropped into this device. In this embodiment, two types of packaging materials are stored in the rack 12: standard packaging materials in the first category (type A standard boxes) and standard packaging materials in the second category (type B standard boxes). Users can purchase the packaging materials stored in the rack 12 using the shipping support device 1. The packaging materials are stored in the rack 12 in an unfolded or folded state, and are assembled by the user when packing.

As shown in FIG. 3, the main body 11 is equipped with a platform 21 (mounting section). Luggage brought in by a user is placed on this platform 21. In this embodiment, when a packaged or unpackaged package is placed on the platform 21, the size of the package is measured and the size category to which the package falls is determined. In addition, when packaging material removed from the rack 12 is placed on the platform 21, the type of packaging material is recognized.

The loading platform 21 is formed in a tray shape and has a rectangular loading surface 22 on which an object (packaged luggage, unpackaged luggage, packaging material to be purchased) is placed, and front, rear, left and right side wall surfaces 23 surrounding the loading surface 22. In this embodiment, the horizontal direction (left-right direction) of the rectangular loading surface 22 is the X direction, the vertical direction (front-rear direction) of the loading surface 22 is the Y direction, and the direction perpendicular to the loading surface 22 (height direction) is the Z direction.

An upper photographing unit 31 (first detection unit) is provided on the upper side of the mounting table 21 so as to face the mounting surface 22. This upper photographing unit 31 is equipped with a color camera 32 (two-dimensional camera) and a depth camera 33 (three-dimensional camera). The color camera 32 and the depth camera 33 photograph objects placed on the mounting surface 22 (packaged luggage, unpackaged luggage, packaging materials to be purchased) from above. The color camera 32 outputs a color image (detection result), and the depth camera 33 outputs a depth image (three-dimensional position information of the subject) (detection result). Note that a specific camera included in the depth camera 33, which is composed of multiple cameras, may be used as the color camera 32. In this case, the number of cameras can be reduced, thereby reducing the cost of the device.

The depth camera 33 is a three-dimensional camera that outputs three-dimensional position information of a subject, and may be a stereo camera or a TOF (Time of Flight) camera. The depth image is a distance image that includes information on the Z coordinate (distance from the depth camera 33) for each pixel defined by the X and Y coordinates.

A lateral photographing unit 35 (second detection unit) is provided on the side wall surface 23 on the side (right side) of the placement platform 21. This lateral photographing unit 35 is equipped with two color cameras 36 (two-dimensional cameras). The two color cameras 36 are arranged offset forward and backward (in the depth direction). The color cameras 36 photograph an object (packaged luggage) placed on the placement surface 22 from the side. The color cameras 36 output a color image (detection result). Note that three or more color cameras 36 may be provided in the lateral photographing unit 35.

As shown in FIG. 5, a reference marker 39 is provided on one (left) side wall surface 23 so as to face the color camera 36 of the lateral imaging unit 35 provided on the other (right) side wall surface 23. A predetermined pattern image (e.g., a checkered pattern) is drawn on this reference marker 39.

The color camera 36 of the lateral imaging unit 35 captures an image of a reference marker 39 located on the opposite side of the color camera 36 across the luggage placed on the platform 21. Therefore, in the color image captured by the color camera 36, depending on the height of the luggage, the image of the reference marker 39 may be partially blocked by the luggage. Therefore, it is possible to determine whether the height of the luggage exceeds the upper limit based on the blocking state of the image of the reference marker 39 in the color image.

In this embodiment, if the image of the reference marker 39 in the color image is partially missing, it is determined that the upper limit value for height has been exceeded. Specifically, the reference marker 39 is positioned so that the height of the lower side from the placement surface 22 coincides with the upper limit value Hmax for height. Therefore, if the height of the luggage placed on the placement surface 22 exceeds the upper limit value Hmax, the reference marker 39 is partially blocked by the luggage, and the image of the reference marker 39 in the color image is partially missing. This makes it possible to accurately determine whether the height of the luggage has exceeded the upper limit value Hmax. In addition, as shown in FIG. 4, the side photographing unit 35 has two color cameras 36 that are offset forward and backward, so that the height of the luggage placed on the placement surface 22 can be detected without omission.

As shown in FIG. 3, a front display 41 is provided above the platform 21 so as to face the user. This front display 41 mainly displays various guidance screens, for example, a screen that provides guidance on the procedures for the shipping support service.

A handheld display 42 is provided on the front side of the mounting base 21. This handheld display 42 is configured as a touch panel display. Various operation screens are displayed on this handheld display 42.

A reader 43 is provided to the side of the handheld display 42. This reader 43 reads the two-dimensional code displayed on the screen of the smartphone 3. In this embodiment, when purchasing packaging material, a two-dimensional code for payment is displayed on the screen by a payment application on the smartphone 3. In addition, when dropping off a package in the device, a two-dimensional code for shipping is displayed on the screen by a shipping application on the smartphone 3.

A printer 44 is provided on the front of the main body 11. This printer 44 prints a waybill 45 in a predetermined format based on the shipping declaration information (item name, sender, destination, handling instructions (fragile, precision equipment, refrigeration required), etc.) entered by the user using the smartphone 3 or the like (see FIG. 6). The user attaches this waybill 45 to the packaged item. From the perspective of protecting personal information, it is also possible to print a waybill in a confidential format in which the sender and destination information can be reproduced only by the delivery company. Furthermore, an ID (two-dimensional code) can be printed on the packaging material itself in a scannable position and the shipping declaration information can be linked to the ID, making the waybill printing function unnecessary (see Patent No. 6664601).

As shown in FIG. 6, in addition to the shipping declaration information (item name, sender, destination, etc.) regarding the target package, an approval mark 46 is drawn (printed) on the waybill 45 as approval information regarding the size measurement results of the target package. This approval mark 46 is used to approve that the size measurement of the package was performed properly by the shipping support device 1.

In this embodiment, in the case of a packaged item, if the measured size category of the item falls within the size category that allows posting, and no handling instructions that are not suitable for posting have been set, i.e., if the shipping declaration information does not include handling instructions, it is determined that posting is permitted. Then, if the determination result indicates that posting of the item is permitted, a waybill 45 including an approval mark 46 is printed by the shipping support device 1. Note that the approval mark 46 is not drawn (printed) on general waybills that are not printed by the shipping support device 1.

In the example shown in FIG. 6, the word "measured" is printed on the waybill 45 as the approval mark 46. A predetermined symbol or figure (icon) may also be drawn on the waybill 45 as the approval mark 46. Furthermore, letters indicating the size category of the package based on the measurement results may also be printed as the approval mark 46.

In this embodiment, a waybill is printed that includes an approval mark 46 indicating that the measurement results have been approved, but the presence or absence of approval of the measurement results may be expressed by the format of the waybill instead of the approval mark 46. In other words, the waybill that is printed after the size of the package is properly measured by the shipping support device 1 may be printed in a special format that differs from general waybills.

In addition, if handling instructions have been set for the target package (fragile, precision equipment, requires refrigeration, etc.), the handling instructions may be printed on the shipping label in addition to the sender and destination information and the approval mark (approval information).

In this embodiment, the visualized approval information allows the delivery company worker to simply visually check the waybill affixed to the package to instantly confirm that the package size was properly measured by the shipping support device 1 and that there is no need to measure the size again. Therefore, after the package is collected, the transport of the package and other operations can be carried out immediately.

In addition to such visualized approval information, electronic approval information can be used to show the delivery company that the size measurement of the package was performed properly in the shipping support device 1. In this case, a delivery company worker cannot confirm whether the size measurement of the package was performed properly just by visually inspecting the package. Therefore, in addition to information such as the sender and destination, approval information of the measurement results can be linked and managed to the package ID managed by the server device 2, and the approval information can be sent to the delivery company's terminal in response to an inquiry from the terminal. Note that the approval information only needs to be presented to the delivery company, so it does not need to be sent to the shipping support device 1.

In addition, to facilitate the inquiry of approval information from the delivery company's terminal, a two-dimensional code storing the parcel ID may be attached to the parcel, for example, by drawing the two-dimensional code on the parcel's waybill or printing the two-dimensional code on the parcel's packaging. In this case, the delivery company's terminal may inquire of the server device 2 about the approval information regarding the target parcel based on the parcel ID obtained by reading the two-dimensional code. The delivery company's terminal may allow the worker to check whether or not the measurement results have been approved by displaying the screen or outputting audio, etc.

Here, a possible fraudulent act is to switch the parcel at the time of measurement with the parcel at the time of posting, i.e., to measure the size of a smaller parcel, print a shipping label, and then post it on a different, larger parcel. To deal with this type of fraud, a check function may be installed that takes a photo of the parcel with the shipping label attached before posting, measures the size of the parcel again, obtains the size category indicated on the shipping label through image recognition of the image captured by the camera, and confirms that there is no difference between the size category indicated on the shipping label and the actual size category of the parcel.

As shown in FIG. 2, the main body 11 is provided with a mail slot 51 for dropping off parcels, and a storage section 52 for storing dropped parcels. The delivery company can collect parcels by removing the parcels stored in the storage section 52. In this embodiment, only parcels of a predetermined size category that have been properly measured by the shipping support device 1 can be dropped off, so the delivery company does not need to recheck the size category of the parcel after collection, and can omit the size measurement work that was previously necessary after collection.

The front side of the storage section 52 is covered with a door 53, which is provided with a handle 54 and a lock 55. The lock 55 can be unlocked by a worker in charge of collection of the delivery company's packages, and no one other than the worker can remove packages from the storage section 52.

In this embodiment, the mounting platform 21 (mounting section), upper photographing section 31 (detection section), side photographing section 35 (detection section), front display 41 (display section), handheld display 42 (display section, operation section), and storage section 52 are integrally provided in the same housing of the main body 11 of the shipping support device 1. This allows the shipping support device 1 to be space-saving, making it easy to install in stores such as convenience stores.

The mail slot 51 is formed in a shape and size that is suited to the size of parcels that can be mailed. In other words, the mail slot 51 is provided with an opening of a predetermined area (width, height) that is adjusted so that only small parcels that fall into a predetermined size category can be mailed.

In addition, in this embodiment, in order to measure the height of the luggage with high accuracy, a color camera 36 is provided in the side photographing unit 35, and the height of the luggage is measured based on the shading state of the reference marker 39 on the opposing surface. However, a sensor other than a camera, for example a sensor (e.g. a photoelectric sensor) that measures the height of an object based on the shading state of light between the light emitting unit and the light receiving unit, may be provided, and measurements may be made based on the detection results. Furthermore, a sensor other than a camera (e.g. a measuring device that uses a multi-laser to output three-dimensional information) may also be provided in the upper photographing unit 31, and measurements may be made based on the detection results.

In addition, in this embodiment, the mounting base 21, upper imaging section 31, side imaging section 35, front display 41, hand display 42, and storage section 52 are integrally provided on the main body 11, but the mounting base 21, upper imaging section 31, and side imaging section 35, which are related to photographing the object, may be configured separately from the storage section 52, and the front display 41 and hand display 42, which are related to guidance to the user and user operation, may be configured separately from the storage section 52. In particular, as long as the mounting base 21 is positioned between the front display 41 and hand display 42, it does not matter whether they are integrated or separate. And by arranging them in this way, it is possible to save space in the device and improve the operability of the device for the user.

Next, we will explain the general configuration of the shipping support device 1. Figure 7 is a block diagram showing the general configuration of the shipping support device 1.

As described above, the shipping support device 1 includes a color camera 32 and a depth camera 33 that constitute the upper photographing section 31, two color cameras 36 that constitute the side photographing section 35, a front display 41, a handheld display 42, a reader 43, and a printer 44.

The shipping support device 1 also includes a communication unit 61, a memory 62, and a processor 63.

The communication unit 61 communicates with the server device 2 via the network.

Memory 62 stores programs executed by processor 63, etc.

The processor 63 executes various processes related to shipping support by executing the programs stored in the memory 62. In this embodiment, the processor 63 performs target object detection processing, placement position determination processing, size measurement processing, size classification determination processing, packaging material selection processing, pre-declaration content inquiry processing, posting feasibility determination processing, waybill printing processing, packaging material recognition processing, payment instruction processing, and screen control processing. Here, the configuration of the communication unit 61, memory 62, and processor 63 is realized by adopting a general-purpose PC or tablet (information processing device).

In the object detection process, the processor 63 detects objects (unpackaged packages, packed packages, packaging materials to be purchased) placed on the platform 21 based on color images acquired from the color camera 32 of the upper imaging unit 31.

In the placement position determination process, the processor 63 determines whether or not the object is placed in the reference position based on the color image acquired from the color camera 32 of the upper image capture unit 31. In this embodiment, the left rear corner of the placement surface 22 is the reference point, and the state in which the left rear corner of the luggage is aligned with the reference point is the reference position of the luggage (see FIG. 4).

In the size measurement process, the processor 63 measures the size (length, width, and height) of the target luggage (packaged luggage, unpackaged luggage) placed on the platform 21 by the user based on the color image captured by the color camera 32 of the upper image capture unit 31, the depth image captured by the depth camera 33 of the upper image capture unit 31, and the color image captured by the color camera 36 of the lateral image capture unit 35. Note that the size measurement based on the color image captured by the color camera 36 of the lateral image capture unit 35 can be omitted depending on the accuracy of the size measurement based on the depth image captured by the depth camera 33 of the upper image capture unit 31.

In the size category determination process, the processor 63 determines the size category to which the target luggage placed on the platform 21 by the user falls, based on the measurement results of the size measurement process. Furthermore, in the size category determination process, the processor 63 determines, based on the measurement results of the size measurement process, whether or not the size category of the target luggage is likely to be changed from the size category of the determined result. This determination is made by comparing the dimensions of the luggage as the measurement result (length, width, and height) with the standard values of the determined size category and the standard values of less expensive size categories. At this time, it is determined whether or not the dimensions of the target luggage slightly exceed the standard values of the determined size category and the size category of the luggage is likely to be changed by the user changing the way the luggage is placed, for example by rearranging the luggage or moving it toward the reference point.

In the packaging material selection process, when the processor 63 is dealing with an unpackaged package, it selects the most recommended packaging material for packaging the package, i.e., the packaging material that corresponds to the size category of the package, based on the measurement results of the size measurement process.

In the advance declaration content inquiry process, the processor 63 inquires of the server device 2 regarding the target package and obtains shipping declaration information from the server device 2. This shipping declaration information is information that the user inputs (declares) in advance using the smartphone 3 or the like, and includes the item name, sender and destination information, handling specification information, and the like regarding the target package. The handling specification information is information regarding handling specifications that make the package unsuitable for posting, and is added to the shipping declaration information when handling specifications such as fragile items, precision equipment, and refrigeration are set. The shipping declaration information can be obtained from the server device 2 by accessing the server device 2 based on the user's registration information obtained by reading the two-dimensional shipping code displayed on the smartphone 3 screen with the reader 43.

In the process for determining whether or not the item can be posted, the processor 63 determines whether or not the item can be posted by this device based on the results of the size category determination process and the results of the pre-declaration content inquiry process. Specifically, in the case of an unpacked item, if the measured size category of the item matches the size category that allows posting, it is determined that the item can be posted. In the case of a packed item, if the measured size category of the item matches the size category that allows posting and no handling specifications that are not suitable for posting have been set, that is, if the shipping declaration information does not contain handling specification information, it is determined that the item can be posted. If it is determined that the item can be posted, the shipping procedure by posting continues, and if it is determined that the item cannot be posted, the shipping procedure by posting is interrupted.

In the waybill printing process, the processor 63 instructs the printer 44 to print a waybill to be affixed to the package based on the shipping declaration information (item name, sender, destination, etc.) obtained from the server device 2. In addition to the sender and destination information, this waybill contains approval information that acknowledges that the size of the package has been properly measured by the shipping support device 1.

In the packaging material recognition process, the processor 63 recognizes the type of packaging material that the user has placed on the placement table 21 for purchase by performing image recognition on the color image acquired from the color camera 32 of the upper photographing unit 31.

In the payment instruction process, the processor 63 accesses the server device 2 based on the user's payment information obtained by reading the two-dimensional payment code displayed on the screen of the smartphone 3 with the reader 43, and instructs the server device 2 to carry out the payment process for the payment of the packaging materials purchased by the user.

In the screen control process, the processor 63 displays guidance screens on the front display 41 and the handheld display 42 in response to the user's operation of the handheld display 42 to assist the user in the shipping procedure. In this embodiment, for example, a screen is displayed that presents the measurement results of the size measurement process to the user (measurement result presentation process). Specifically, the measurement results include the size of the package (length, width, and height) and the cost of shipping (delivery charges and packaging material prices). In addition, in this embodiment, when the target package is an unpackaged package, a screen is displayed that presents the user with packaging materials suitable for the package (packaging material presentation process).

Next, we will explain the processing performed by the shipping support device 1 for packaged packages. Figure 8 is an explanatory diagram showing an overview of the processing performed for packaged packages.

Only parcels that fall into a specified size category can be posted to the shipping support device 1. In this embodiment, only parcels that fall into the first and second size categories can be posted to the shipping support device 1.

In the first category, as shown in FIG. 8(A), only parcels packed in standard packaging materials of a specified size can be placed in the shipping support device 1. The standard packaging materials in the first category are, for example, cardboard boxes.

In the second category, as shown in FIG. 8(B), parcels packed in standard packaging materials of a specified size, and parcels packed in suitable packaging materials that fit the size of the second category, as shown in FIG. 8(C), can be dropped into the shipping support device 1. Note that standard packaging materials in the second category are, for example, cardboard boxes. Also, suitable packaging materials in the second category are packaging materials other than standard packaging materials, such as envelopes with cushioning material.

In the processing of packaged luggage (size measurement processing and size classification determination processing), the color image captured by the color camera 32 of the upper photographing unit 31, the depth image captured by the depth camera 33 of the upper photographing unit 31, and the color image captured by the color camera 36 of the side photographing unit 35 are used to distinguish between luggage packaged in standard packaging material of the first category shown in FIG. 8(A), luggage packaged in standard packaging material of the second category shown in FIG. 8(B), luggage packaged in suitable packaging material of the second category shown in FIG. 8(C), and luggage packaged in other packaging materials.

In particular, in the process of identifying standard packaging materials of the first category shown in FIG. 8(A) and the process of identifying standard packaging materials of the second category shown in FIG. 8(B), a color image captured by the color camera 32 of the upper photographing unit 31 and a depth image captured by the depth camera 33 of the upper photographing unit 31 are used. Specifically, three-dimensional size information (length, width, and height) of the object is obtained based on the depth image (three-dimensional position information of the subject) of the upper photographing unit 31, and a determination is made as to whether or not the object is a standard packaging material based on the three-dimensional size information. Furthermore, an image (service mark or unique pattern) printed on the surface of the standard packaging material is detected by image recognition of the color image of the upper photographing unit 31, and a determination is made as to whether or not the object is a standard packaging material.

On the other hand, in the process of identifying suitable packaging materials in the second category shown in FIG. 8(C), a color image captured by the color camera 32 of the upper photographing unit 31 and a color image captured by the color camera 36 of the side photographing unit 35 are used. Specifically, two-dimensional size information (vertical and horizontal dimensions) of the object is obtained based on the color image captured by the upper photographing unit 31, and a judgment is made as to whether the packaging material is suitable or not based on the two-dimensional size information. Furthermore, height information of the object is obtained based on the occlusion state of the reference marker 39 in the color image captured by the side photographing unit 35, and a judgment is made as to whether the packaging material is suitable or not based on the height information. Note that, in the process of identifying suitable packaging materials in the second category shown in FIG. 8(C), the color image captured by the color camera 32 of the upper photographing unit 31 and the depth image captured by the depth camera 33 of the upper photographing unit 31 may also be used for identification without changing the processing method.

When judging whether a standard packaging material is in the first category, a determination is made as to whether the measured length, width, and height match the size (length, width, and height) of the standard packaging material. When judging whether a standard packaging material is in the second category, a determination is made as to whether the measured length, width, and height match the size (length, width, and height) of the standard packaging material, similar to the determination of standard packaging material in the first category.

In addition, when determining whether a packaging material is suitable for the second category, the size (length, width, and height) of a standard packaging material in the second category is the maximum size, and an upper limit is set for each of the length, width, and height. A minimum size is also set in plan view. In other words, a lower limit is set for each of the length and width dimensions. Therefore, if the width is less than the upper limit and greater than the lower limit, the length is less than the upper limit and greater than the lower limit, and the height is less than the upper limit, the material is determined to be suitable for the second category.

In this manner, in this embodiment, in processing of packaged packages packed with standard packaging materials, the size classification of the package is determined by combining the three-dimensional size information (provisional size information) contained in the depth image captured by the depth camera 33 of the upper imaging unit 31 with the image recognition results of the color image captured by the color camera 32 of the upper imaging unit 31. As a result, even if there is an error in the height information contained in the depth image, standard packaging materials can be identified by image recognition, and by combining the two, the size classification of the package can be determined efficiently with sufficient accuracy.

On the other hand, in processing for packages packed with packaging materials other than standard packaging materials, the size classification of the package is determined by combining two-dimensional size information acquired from the color image captured by the color camera 32 of the upper image capture unit 31 with height information (corrected size information) based on the occlusion status of the reference marker 39 in the color image captured by the color camera 36 of the side image capture unit 35. As a result, in the case of packaging materials other than standard packaging materials, the packaging material cannot be identified by image recognition, and the size classification of the package cannot be determined with sufficient accuracy when determining only the image from the upper image capture unit 31, as there may be errors in the height information. However, detection of the reference marker 39 using the color image from the side image capture unit 35 provides highly accurate height information, so by combining the two, the size classification of the package can be determined efficiently with sufficient accuracy.

In this embodiment, only parcels that fall into the first and second size categories can be dropped into the shipping support device 1, but parcels that fall into three or more size categories may be dropped. In this case, the drop slot 51 may be made large, or drop slots 51 may be provided that correspond to the size categories of the parcels so that the corresponding parcels can be dropped.

In addition, in this embodiment, two types of packaging materials, namely, standard packaging materials in the first category (standard type A boxes) and standard packaging materials in the second category (standard type B boxes), are stored on rack 12 and sold to users. However, since packaging materials other than standard packaging materials are also permitted in the second category, other packaging materials that fit the second category, such as packaging materials such as cushioned envelopes, may also be stored on rack 12 and sold to users.

Next, we will explain the processing performed by the shipping support device 1 for unpackaged packages. Figure 9 is an explanatory diagram showing an overview of the processing performed for unpackaged packages.

The shipping support device 1 determines whether an unpackaged package falls into a size category (first category and second category) that can be dropped off in the device (size category determination process). At this time, based on a depth image (three-dimensional position information) acquired by the depth camera 33 of the upper imaging unit 31 capturing an image of the unpackaged package placed on the platform 21, the lengths (X-direction dimension, Y-direction dimension, and Z-direction dimension) of the three sides of a circumscribed rectangular solid that surrounds the foreground area in the depth image that corresponds to the target object (unpackaged package) are acquired, and based on the lengths of the three sides of the circumscribed rectangular solid, it is determined whether the target object falls into a size category (first category and second category) that can be dropped off in the device.

Specifically, the foreground region (object) is extracted from the color image acquired by the color camera 32 of the upper image capturing unit 31, and two-dimensional position information of the foreground region (object) is acquired. Next, a circumscribed rectangular parallelepiped that surrounds the foreground region (object) is set based on the depth image (three-dimensional position information) acquired by the depth camera 33 of the upper image capturing unit 31 and the two-dimensional position information of the foreground region (object). Next, the X-, Y-, and Z-dimensional dimensions of the circumscribed rectangular parallelepiped are calculated. Then, based on the X-, Y-, and Z-dimensional dimensions of the circumscribed rectangular parallelepiped, it is determined whether the object falls into a size category (first category and second category) that can be posted into this device.

The height of the foreground region (object) from the placement surface 22 is the dimension of the circumscribed rectangular parallelepiped in the Z direction. Therefore, the dimension of the circumscribed rectangular parallelepiped in the Z direction can be obtained by calculating the background difference in the Z coordinate of the foreground region, that is, the difference between the current depth image and a depth image (background image) captured by the depth camera 33 of the placement platform 21 in a state where no object is placed on it. Also, since the height from the placement surface 22 is not constant, the maximum value of the height from the placement surface 22 is the dimension of the circumscribed rectangular parallelepiped in the Z direction.

In this embodiment, the height of an object is measured based on the background difference of the depth image. However, if the height of the object is lower than the detection limit (e.g., 1 cm), such as in the case of a CD or DVD package, the background difference of the depth image cannot be properly acquired, and the height of the object cannot be properly measured. In this case, there is no particular problem in generating size information using the two-dimensional size information acquired from the color image and setting the height detection limit (e.g., 1 cm) as the height of the object.

In addition, the shipping support device 1 performs a packaging material recognition process for packaging materials purchased by the user. In this embodiment, the packaging materials (standard packaging materials of the first category and standard packaging materials of the second category) stored in the rack 12 can be purchased. At this time, the user selects a packaging material from the rack 12 and places it on the placement table 21. The shipping support device 1 determines whether the packaging material placed on the placement table 21 is either the standard packaging material of the first category or the standard packaging material of the second category by image recognition processing of the color image acquired by the color camera 32 of the upper photographing unit 31. The surfaces of the standard packaging materials of the first category and the standard packaging materials of the second category have unique images (such as service marks or unique patterns) printed on them. In the packaging material recognition process, the packaging material placed on the placement table 21 is detected from the color image acquired by the color camera 32 of the upper photographing unit 31, and the type of packaging material is recognized based on the shape and size of the packaging material and the image printed on the surface.

The packaging materials are stored in the rack 12 in a pre-assembled state (unfolded or folded), and the packaging materials can be identified based on the shape, size, and image printed on the surface of the packaging materials in the pre-assembled state.

In addition, in this embodiment, when an object (packaged luggage, unpackaged luggage, packaging materials to be purchased) is placed on the placement platform 21, a placement position determination process is performed. In this embodiment, as shown in FIG. 4, the left rear corner of the placement surface 22 is the reference point, and the state in which the left rear corner of the luggage is aligned with the reference point is the reference position of the luggage. The user places the object (packaged luggage, unpackaged luggage, packaging materials to be purchased) at the reference position.

The shipping support device 1 detects the position of the object by image recognition of the color image captured by the color camera 32 of the upper shooting unit 31, and determines whether the object is placed in the reference position. If the object is displaced from the reference position, the user is guided by the screen on the front display 41 and by voice to reposition the object in the reference position.

Next, we will explain the processing procedure for packaged packages performed by the shipping support device 1. Figures 10 and 11 are flow diagrams showing the processing procedure for packaged packages.

As shown in FIG. 10, in the shipping support device 1, the processor 63 first acquires a color image from the color camera 32 of the upper photographing unit 31 (ST101). Next, the processor 63 detects an object placed on the platform 21 by image recognition of the color image (object detection process) (ST102). The processor 63 then determines whether the object is placed at a reference position (placement position determination process) (ST103).

If the object is placed at the reference position (Yes in ST103), the processor 63 then acquires a depth image (three-dimensional position information of the subject) from the depth camera 33 of the upper shooting unit 31 (ST104). The processor 63 then detects the object from the depth image (ST105). The processor 63 then acquires size information (length, width, height) of the object based on the depth image (size measurement process) (ST106). The processor 63 then determines whether the size of the object matches the size of the standard packaging material of the first category (ST107).

If the size of the object matches the size of the standard packaging material of the first category (Yes in ST107), the processor 63 then performs image recognition on the color image (ST108). Then, based on the image recognition result, it is determined whether the object is a standard packaging material of the first category (size category determination process) (ST109).

Here, if the object is determined to be a standard packaging material of the first category (Yes in ST109), the object is determined to be a package packed in a standard packaging material of the first category (ST110).

On the other hand, if the size of the object does not match the size of the standard packaging material in the first category (No in ST107), the processor 63 then determines whether the size of the object matches the size of the standard packaging material in the second category (ST111).

Here, if the size of the object matches the size of the standard packaging material of the second category (Yes in ST111), the processor 63 then performs image recognition on the color image (ST112). Then, based on the image recognition result, it is determined whether the object is a standard packaging material of the second category (size category determination process) (ST113).

Here, if the object is determined to be a standard packaging material of the second category (Yes in ST113), the object is determined to be a package packed in a standard packaging material of the second category (ST114).

On the other hand, if it is determined that the object is not a standard packaging material of the first category (No in ST109), if the size of the object does not match the size of a standard box of the second category (No in ST111), or if it is determined that the object is not a standard box of the second category (No in ST113), the process proceeds to a process of determining whether the object is a conforming product other than a standard box of the second category (conformity determination for the second category).

As shown in FIG. 11, in determining whether a product conforms to the second category, first, the processor 63 extracts a foreground region from a color image captured by the color camera 32 of the upper photographing unit 31 (ST115). At this time, the processor 63 extracts the foreground region by determining the background difference of the color image, that is, the difference between the current color image and a color image (background image) captured by the color camera 32 of the mounting table 21 in a state where no object is placed on it in advance. Next, the processor 63 sets a circumscribing frame that surrounds the foreground region, and calculates the X-direction and Y-direction dimensions of the circumscribing frame (size measurement process) (ST116).

Next, the processor 63 determines whether the X-direction dimension of the circumscribing frame is equal to or less than the upper limit value for the width of the second section, and whether the Y-direction dimension is equal to or less than the upper limit value for the depth of the second section (ST117).

Here, if the X-direction dimension of the circumscribing frame is equal to or less than the upper limit value of the second section, and the Y-direction dimension is equal to or less than the upper limit value of the second section (Yes in ST117), the processor 63 then determines whether the X-direction dimension of the circumscribing frame is equal to or greater than the lower limit value for the width of the second section, and the Y-direction dimension is equal to or greater than the lower limit value for the depth of the second section (ST118).

Here, if the X-direction dimension of the circumscribing frame is equal to or greater than the lower limit of the second division, and the Y-direction dimension is equal to or greater than the lower limit of the second division (Yes in ST118), the processor 63 then acquires a color image from the color camera 36 of the lateral imaging unit 35 (ST119). Next, the processor 63 detects the reference marker 39 from the color image (ST120). Then, the processor 63 determines whether the height of the object is equal to or less than the upper limit of the height of the second division based on the occlusion state of the reference marker 39 in the color image (size division determination process) (ST121). Note that in the size measurement process (ST116), the size information (vertical dimension, horizontal dimension, height) of the object may be acquired based on the depth image to determine the height of the object. In this case, the configuration of the color camera 36 of the lateral imaging unit 35 can be omitted.

Here, if the height of the object is equal to or less than the upper limit value of the second category (Yes in ST121), the processor 63 then determines that the object is a package in the second category (package packed in packaging material other than standard packaging material) (ST122).

On the other hand, if the X-dimension of the circumscribing frame exceeds the upper limit of the second category or the Y-dimension exceeds the upper limit of the second category (No in ST117), if the X-dimension of the circumscribing frame is less than the lower limit of the second category or the Y-dimension is less than the lower limit of the second category (No in ST118), or if the height of the object exceeds the upper limit of the second category (No in ST121), the object is determined to be a package that cannot be posted (ST123).

Next, we will explain the procedure for processing unpackaged packages performed by the shipping support device 1. Figure 12 is a flow diagram showing the procedure for processing unpackaged packages.

In the shipping support device 1, the processor 63 first acquires a color image and a depth image (three-dimensional position information) from the color camera 32 and the depth camera 33 of the upper shooting unit 31 (ST201). At this time, if it is detected that an object has been placed on the mounting table 21 based on the background difference of the Z coordinate (height information) of the depth image, the process may proceed to the subsequent steps. If the height of the object is lower than the detection limit and the object is not detected, the two-dimensional size information acquired by extracting the foreground region from the color image may be used to generate size information with the height detection limit as the height of the object.

Next, the processor 63 extracts the foreground region (object) from the color image (ST202). Next, the processor 63 sets a circumscribed rectangular parallelepiped that surrounds the foreground region (object) based on the depth image (three-dimensional position information), and calculates the X-, Y-, and Z-dimensional dimensions of the circumscribed rectangular parallelepiped (size measurement process) (ST203).

Next, the processor 63 determines whether the Z-direction dimension of the circumscribed rectangular solid is less than or equal to the upper limit value of the first division (ST204).

If the Z-direction dimension of the circumscribed rectangular solid is equal to or less than the upper limit of the first section (Yes in ST204), the processor 63 then determines whether the X-direction dimension of the circumscribed rectangular solid is equal to or less than the upper limit of the width of the first section, and whether the Y-direction dimension is equal to or less than the upper limit of the depth of the first section (ST205).

Here, if the X-direction dimension of the circumscribed rectangular solid is equal to or less than the upper limit value of the first division, and the Y-direction dimension is equal to or less than the upper limit value of the first division (Yes in ST205), the processor 63 determines that the object is a piece of luggage in the first division (ST206).

On the other hand, if the X-direction dimension of the circumscribed rectangular solid exceeds the upper limit value of the first division, or if the Y-direction dimension exceeds the upper limit value of the first division (No in ST205), the processor 63 then determines whether the maximum height from the placement surface 22 is equal to or less than the upper limit value for the height of the second division (ST207).

Here, if the Z-direction dimension of the circumscribed rectangular solid is equal to or less than the upper limit value of the second section (Yes in ST207), the processor 63 then determines whether the X-direction dimension of the circumscribed rectangular solid is equal to or less than the upper limit value for the width of the second section, and whether the Y-direction dimension is equal to or less than the upper limit value for the depth of the second section (ST208).

Here, if the X-direction dimension of the circumscribed rectangular solid is equal to or less than the upper limit value of the second section, and the Y-direction dimension is equal to or less than the upper limit value of the second section (Yes in ST208), the processor 63 then determines whether the X-direction dimension of the circumscribed rectangular solid is equal to or greater than the lower limit value for the width of the second section, and the Y-direction dimension is equal to or greater than the lower limit value for the depth of the second section (ST209).

Here, if the X-direction dimension of the circumscribed rectangular solid is equal to or greater than the lower limit of the second division, and the Y-direction dimension is equal to or greater than the lower limit of the second division (Yes in ST209), the processor 63 determines that the object is a piece of luggage in the second division (ST210).

On the other hand, if the maximum height from the placement surface 22 exceeds the upper limit of the first category (No in ST204), if the maximum height from the placement surface 22 exceeds the upper limit of the second category (No in ST207), if the X-direction dimension of the circumscribed rectangular solid exceeds the upper limit of the second category or the Y-direction dimension exceeds the upper limit of the second category (No in ST208), or if the X-direction dimension of the circumscribed rectangular solid is less than the lower limit of the second category or the Y-direction dimension is less than the lower limit of the second category (No in ST209), the processor 63 determines that the object is a parcel that cannot be dropped (ST211).

Next, we will explain the screens displayed on the shipping support device 1 during standby. Figure 13 is an explanatory diagram showing the screens displayed on the shipping support device 1 during standby.

When the shipping support device 1 is on standby, the screen shown in FIG. 13(A) (standby screen) is displayed on the front display 41, and the screen shown in FIG. 13(B) (standby screen) is displayed on the handheld display 42.

The screen of the front display 41 shown in FIG. 13(A) displays text that guides the user through the menu of shipping support services, namely, text 101 that guides the user through the automatic measurement mode (first mode) titled "Automatic Size Check", text 102 that guides the user through the self-posting mode (second mode) titled "Self-Posting Post", and text 103 that guides the user through the packaging material purchase mode (third mode) titled "Purchase Packaging Material". This screen also displays text 104 that guides the user to select one of three operation modes, the automatic measurement mode, the self-posting mode, and the packaging material purchase mode, by operating the handheld display 42.

The screen of the handheld display 42 shown in FIG. 13(B) displays an automatic measurement mode selection section 105 titled "Automatic Size Check", a self-posting mode selection section 106 titled "Self-Posting Post", and a packaging material purchase mode selection section 107 titled "Purchase Packaging Material". The user can select one of the three operation modes by operating one of the selection sections 105, 106, or 107.

The automatic measurement mode, entitled "Automatic Size Check," is a mode in which, when a user brings in an unpackaged item, the appropriate packaging material for that item is presented to the user, allowing the user to purchase the packaging material using a self-checkout system.

The processing of this automatic measurement mode consists of a packaging material selection step and a packaging material purchase step. In the packaging material selection step, the processor 63 of the shipping support device 1 determines the size category of the unpackaged package placed on the loading platform 21 by the user, and determines whether the package can be posted by this device (posting feasibility determination process), and if the package can be posted by this device, selects a packaging material that corresponds to the size category of the package and presents it to the user (packaging material presentation process). In the packaging material purchase step, the processor 63 recognizes the type of packaging material that the user removed from the rack 12 and placed on the loading platform 21 based on the image captured by the color camera 32 of the upper shooting unit 31 (packaging material recognition process), and performs processing related to the payment (settlement) of the sales price of the packaging material (settlement process).

The self-posting mode, entitled "Self-Posting Post," allows a user to bring in a packaged item, print a waybill based on the shipping declaration information registered in advance for the shipment of the package, and then affix the waybill to the package, allowing the user to post it through the device's post slot 51.

In the self-posting mode, the processor 63 of the shipping support device 1 determines the size category of the packaged parcel placed on the loading platform 21 by the user (size category determination process), queries the server device 2 for handling designation information (contained in the shipping declaration information) regarding handling designation that is unsuitable for posting (e.g., fragile item, precision equipment, requires refrigeration) (pre-declaration content inquiry process), and determines that posting is permitted if the measured size category of the parcel matches a size category that permits posting and no handling designation has been set (posting permission determination process). If it is determined that posting is permitted, a waybill is printed based on the shipping declaration information registered in advance by the user (waybill printing process).

The packaging material purchase mode entitled "Purchase Packaging Material" allows the user to purchase packaging materials using a self-checkout system. In this packaging material purchase mode, the processor 63 of the shipping support device 1 recognizes the type of packaging material that the user has removed from the rack 12 and placed on the placement table 21 based on the color image captured by the color camera 32 of the upper photographing unit 31 (packaging material recognition processing), and performs processing related to the payment (settlement) of the purchase price of that packaging material (settlement instruction processing).

Next, we will explain the screens displayed in the automatic measurement mode on the shipping support device 1. Figures 14, 15, 16, and 17 are explanatory diagrams showing the screens displayed in the automatic measurement mode on the shipping support device 1.

In the shipping support device 1, when a user operates the automatic measurement mode selection section 105, which displays the title "Automatic size check" on the screen of the handheld display 42 shown in FIG. 13 (B), the front display 41 first transitions to the screen shown in FIG. 14 (A-1), and the handheld display 42 transitions to the screen shown in FIG. 14 (B-1).

The screen of the front display 41 shown in FIG. 14 (A-1) displays text 111 encouraging the user to place the luggage to be measured on the platform 21, and an image 112 showing how to place the luggage on the platform 21. Since the luggage needs to be placed at a reference position close to the rear left side of the platform 21, the image 112 displays a video of the luggage moving from the center of the platform 21 toward the rear left side.

The screen of the handheld display 42 shown in FIG. 14 (B-1) has text 115 prompting the user to place the package to be measured on the platform 21, and a button 116 for instructing the user to measure the size. When the user operates the button 116 for instructing the user to measure the size, the size measurement starts, and then a determination is made as to whether or not the package can be posted. Note that when the size measurement starts, the screen may transition to one that notifies the user that the size measurement is in progress.

Here, when the processor 63 of the shipping support device 1 detects the package placed on the platform 21, measures the size of the package, and determines that the package can be posted and that there is no possibility of changing the size category, the front display 41 transitions to the screen shown in FIG. 14 (A-2), and the handheld display 42 transitions to the screen shown in FIG. 14 (B-2).

The screen of the front display 41 shown in FIG. 14 (A-2) displays, as size information that is the result of the size measurement, characters 121 indicating the values of the three sides of the package, specifically the length, width and height of the circumscribing rectangle surrounding the package, and characters 122 indicating the cost of shipping the package, specifically the shipping fee and the price of packaging materials. This screen also displays characters 123 indicating that the size measurement can be redone by repackaging the package. Note that while the dimensions of the package itself are displayed as size information, it would also be possible to display the dimensions of the size category to which the package falls.

The screen of the handheld display 42 shown in FIG. 14 (B-2) displays characters 125 indicating the size of the package (length, width, and height), characters 126 indicating the delivery fee, and characters 127 informing the user of the most recommended packaging material for packaging the package. This screen also has a button 128 for instructing the user to remeasure the size, and a button 129 for proceeding to the step of purchasing packaging materials.

If the user operates button 128 to instruct the user to remeasure the size, the size is measured again. For example, if the user rearranges or arranges multiple items or clothing items in the luggage, which may result in a change in the size classification, the user can instruct the user to remeasure the size. Also, if the user operates button 129 to proceed to the packing material purchasing step, the front display 41 transitions to the screen shown in FIG. 15 (A-2), and the handheld display 42 transitions to the screen shown in FIG. 15 (B-2).

On the other hand, if the processor 63 determines that there is a possibility of changing the size category, the handheld display 42 transitions to the screen shown in FIG. 14 (B-3). On the screen of the handheld display 42 shown in FIG. 14 (B-3), instead of the characters 127 on the screen of FIG. 14 (B-2), characters 130 are displayed that show advice information on how to place unpacked packages.

The advice information encourages the user to remeasure the size of the package, because by adjusting the way the package is placed, for example by arranging the package or moving it closer to the reference point, the package's size classification may be changed and it may be possible to ship it using less expensive packaging materials. In the example shown in FIG. 14 (B-3), the advice information displayed is, "There is still room in the height." In addition to this, the advice information may be, for example, "Please move the package closer to the reference point."

By viewing such advice information, the user can easily confirm that the package can be shipped with a more appropriate (cheaper) delivery fee and packaging material. The user then manipulates how the package is placed, for example by arranging the package or moving it toward a reference point, and then operates button 128 to instruct the size to be measured again. At this time, in some cases, the size category of the package is changed to a more appropriate (cheaper) size category, and more appropriate (cheaper) packaging material is presented to the user. This allows the user to quickly confirm the most appropriate packaging material for the unpackaged package they have brought in.

The advice information may be displayed on the screen of the front display 41 shown in FIG. 13 (A-2). In addition to the screen display, the advice may be provided by audio output.

In this manner, in this embodiment, the size of the package can be repeatedly remeasured. When the package is unpacked, unlike when it is packed, the size measurement result (size category) may change if the user changes how the package is placed. For this reason, by allowing the user to repeatedly remeasure the size of the package until they are satisfied, the costs required for shipping the package (delivery charges and the price of packaging materials) can be kept low.

The screen of the handheld display 42 (such as FIG. 14 (B-1)) displays a button 119 for instructing the user to end the process. This button 119 allows the user to instruct the user to end the process at an appropriate time. Operating this button 119 transitions to a screen (not shown) for confirming the end of the process, and when the user confirms the end of the process on this screen, the automatic measurement mode ends and the system returns to the standby state.

In addition, since the payment (settlement) for the purchase price of the packaging materials is made using a designated payment service using the smartphone 3, before transitioning to the screen shown in FIG. 15 (A-2), a screen inquiring as to whether registration for the designated payment service has been completed or a screen urging the user to request information about the designated payment service from a store staff member may be displayed on the handheld display 42.

On the other hand, if the posting eligibility determination determines that the target parcel cannot be posted, the front display 41 transitions to the screen shown in FIG. 15 (A-1), and the handheld display 42 transitions to the screen shown in FIG. 15 (B-1).

The screen of the front display 41 shown in FIG. 15 (A-1) displays text 131 urging the user to complete the shipping procedure at a counter in the store because the package cannot be posted using this device, and an image 132 directing the user to the counter in the store.

The screen of the handheld display 42 shown in FIG. 15 (B-1) displays characters 135 indicating the size (length, width, and height) of the package, characters 136 informing the user that the package cannot be posted using this device, and characters 137 encouraging the user to complete the shipping procedure at a counter in the store. Note that if the package cannot be posted using this device, any numbers representing the length, width, and height of the package that exceed the size that can be posted may be highlighted.

The screen of the front display 41 shown in FIG. 15 (A-2) displays an image 141 that provides information about packaging materials that can be purchased with this device, and text 142 that prompts the user to select a packaging material from the rack 12 installed next to the main body 11. In this embodiment, standard packaging materials in the first category (standard type A boxes) and standard packaging materials in the second category (standard type B boxes) can be purchased with this device. In addition, in order to present the user with packaging materials that are suitable for the luggage, this screen highlights packaging materials that are suitable for the luggage. Note that packaging materials that are not suitable for the luggage may be displayed in gray.

The screen of the handheld display 42 shown in FIG. 15 (B-2) displays characters 145, 146 that prompt the user to select a packaging material suitable for the package. The packaging materials may be classified by type and stored on shelves of the rack 12, and an indicator (not shown) such as an LED lamp provided on the shelf may be lit in conjunction with the presentation of a packaging material suitable for the user's package, prompting the user to remove the presented packaging material.

When a predetermined time has elapsed since the screen of the front display 41 shown in FIG. 15 (A-2) and the screen of the handheld display 42 shown in FIG. 15 (B-2) have been transitioned to, the front display 41 transitions to the screen shown in FIG. 16 (A-1), and the handheld display 42 transitions to the screen shown in FIG. 16 (B-1).

The screen of the front display 41 shown in FIG. 16 (A-1) displays text 151 urging the user to place the selected packaging material on the placement table 21, text 152 informing the user that if multiple packaging materials are purchased, they should be placed one by one on the placement table 21, an image 153 informing the user how to place the packaging material on the placement table 21, and text 154 informing the user that a payment application on the smartphone 3 is required. Note that, because the packaging material needs to be placed at a reference position close to the rear left side of the placement table 21, image 153 displays a video of the packaging material moving from the center of the placement table 21 toward the rear left side.

The screen of the handheld display 42 shown in FIG. 16 (B-1) displays text 155 encouraging the user to place the selected packaging material on the placement table 21, and text 156 indicating the name and price of the packaging material suitable for the package.

Here, when the processor 63 of the shipping support device 1 detects the packaging material placed on the platform 21 and recognizes the type of packaging material, the handheld display 42 transitions to the screen shown in FIG. 16 (B-2).

The screen of the handheld display 42 shown in FIG. 16 (B-2) displays text 157 prompting the user to confirm the selected packaging material and give an instruction to purchase it, text 156 showing the name and price of the recognized packaging material, a button 158 for instructing the user to reselect the packaging material, and a button 159 for instructing the user to purchase the packaging material.

If the user presses button 158 to instruct the user to redo the packaging material selection, the screen shown in FIG. 16 (B-3) will be displayed. On the other hand, if the user presses button 159 to instruct the user to purchase packaging material, the front display 41 will transition to the screen shown in FIG. 17 (A-1), and the handheld display 42 will transition to the screen shown in FIG. 17 (B-1). Note that a user who does not wish to purchase packaging material but simply wants to be presented with the most suitable packaging material based on the measurement of the size of their package can simply instruct the user to end the process using button 119 on the handheld display 42 screen shown in FIG. 16 (B-2).

The screen of the handheld display 42 shown in FIG. 16 (B-3) displays text 161 prompting the user to select a packaging material, a packaging material selection section 162, and a cancel button 163. When the user operates the packaging material selection section 162, the front display 41 transitions to the screen shown in FIG. 17 (A-1), and the handheld display 42 transitions to the screen shown in FIG. 17 (B-1). When the user operates the cancel button 163, the automatic measurement mode ends and the device returns to the standby state.

The screen of the front display 41 shown in FIG. 17 (A-1) displays text 171 urging the user to display the code payment screen on the smartphone 3, an image 172 guiding the user through the procedure for displaying the code payment screen on the smartphone 3, an image 173 guiding the user to the location of the reader 43 of the shipping support device 1, and text 174 urging the user to hold the two-dimensional payment code displayed on the code payment screen over the reader 43.

The screen of the handheld display 42 shown in FIG. 17 (B-1) displays text 175 urging the customer to hold the two-dimensional payment code displayed on the code payment screen over the reader 43, and text 156 indicating the name and price of the packaging material to be purchased.

The processor 63 of the shipping support device 1 acquires read information from the reader 43 by having the reader 43 read the two-dimensional payment code displayed on the smartphone 3, and then transmits a payment instruction to the server device 2. The server device 2 executes a payment process for the purchase price related to the user. When the payment process is normally completed, the front display 41 transitions to the screen shown in FIG. 17 (A-2), and the handheld display 42 transitions to the screen shown in FIG. 17 (B-2).

The screen of the front display 41 shown in FIG. 17 (A-2) displays text 181 expressing gratitude for the purchase of packaging materials, and an image 182 guiding the customer through subsequent procedures. The image guiding the customer through subsequent procedures may, for example, display moving images that inform the customer that packaging work can be done in the store, inform the customer that the product can be sent (posted) using the self-posting mode of the device once packaging work is complete, or urge the customer to enter information about the product (such as size classification) in the shipping application on the smartphone 3.

The screen of the handheld display 42 shown in FIG. 17 (B-2) displays text 183 expressing gratitude for the purchase of the packaging material, and text 156 indicating the name and price of the packaging material for which payment has been completed.

If an error occurs during processing in the automatic measurement mode, an error screen (not shown) will be displayed on the front display 41 and the handheld display 42. This error screen may display text indicating that an error has occurred and processing cannot be performed normally, text urging the user to complete the shipping procedure at a counter in the store, an image showing the counter in the store (e.g., a store floor plan), text urging the user to call a store staff member, etc.

Next, we will explain the screens that are displayed in the self-posting mode on the shipping support device 1. Figures 18, 19, 20, and 21 are explanatory diagrams showing the screens that are displayed in the self-posting mode on the shipping support device 1.

In the shipping support device 1, when a user operates the self-posting mode selection section 106 entitled "Self-Posting Post" on the screen of the handheld display 42 shown in FIG. 13 (B), the front display 41 first transitions to the screen shown in FIG. 18 (A-1), and the handheld display 42 transitions to the screen shown in FIG. 18 (B-1).

The screen of the front display 41 shown in FIG. 18 (A-1) displays text 201 urging the user to place the packed package on the platform 21 and launch the shipping app on the smartphone 3, and an image 202 showing how to place the package on the platform 21. Since the package needs to be placed at a reference position close to the rear left side of the platform 21, the image 202 displays a video of the package moving from the center of the platform 21 toward the rear left side.

The screen of the handheld display 42 shown in FIG. 18 (B-1) displays text 205 urging the user to place the packed package on the platform 21 and launch the shipping app on the smartphone 3, as well as a button 206 for instructing the user to carry out the shipping procedure.

When the processor 63 detects that a packaged item has been placed on the platform 21, the handheld display 42 may transition to a screen indicating that the size of the item is being measured.

When the user operates the button 206 to instruct the shipping procedure, the front display 41 transitions to the screen shown in FIG. 18 (A-2), and the handheld display 42 transitions to the screen shown in FIG. 18 (B-2).

The screen of the front display 41 shown in FIG. 18 (A-2) displays text 211 in the payment application of the smartphone 3, encouraging the user to display a two-dimensional shipping code and hold it over the reader 43, and an image 212 indicating the location of the reader 43 of the device. Note that in the image, the location of the reader 43 is indicated by a frame image surrounding the reader 43.

The screen of the handheld display 42 shown in FIG. 18 (B-2) displays text 213 urging the user to hold the two-dimensional shipping code over the reader 43, and an image 214 indicating that the reader 43 is reading the code.

At this time, when the processor 63 obtains the results of reading the two-dimensional shipping code from the reader 43, it accesses the server device 2 and queries the handling specification information contained in the shipping declaration information related to the user, and checks whether any handling specifications that are not suitable for posting (e.g., fragile item, precision equipment, requires refrigeration) have been set.

If a failure occurs in the network or the like and connection to the server device 2 cannot be established, the screen may transition to one that notifies the user of this.

If the measured size category of the package falls within the specified size category and no handling instructions have been set that make it unsuitable for posting, i.e., the shipping declaration information does not contain handling instructions, and the package is determined to be suitable for posting, the front display 41 transitions to the screen shown in FIG. 19 (A-1), and the handheld display 42 transitions to the screen shown in FIG. 19 (B-1).

The screen of the front display 41 shown in FIG. 19 (A-1) displays text 221 informing users that the size of the package has been measured and that it can be posted, and an image 222 that alerts users who have not set a handling specification for fragile items to the risk of fragile items. As an alert to the risk of fragile items, a confirmation message may be displayed asking whether the package has been packaged with cushioning material that can withstand the impact of being posted.

The screen of the handheld display 42 shown in FIG. 19 (B-1) displays text 225 informing the user that the measurement of the package size and the determination of whether the package can be posted have been completed and that the package can be posted, as well as a button 226 for instructing the printing of a waybill.

On the other hand, if the measured size category of the parcel does not fall within the specified size category, or if handling instructions that are not suitable for posting (e.g., fragile, precision equipment, refrigerated) are set, i.e., if the parcel is determined to be unable to be posted because the shipping declaration information contains handling instructions, the front display 41 transitions to the screen shown in FIG. 19 (A-2). Also, if the measured size category of the parcel does not fall within the specified size category, and if the parcel is determined to be unable to be posted, the handheld display 42 transitions to the screen shown in FIG. 19 (B-2). On the other hand, if handling instructions that are not suitable for posting are set, i.e., if the shipping declaration information contains handling instructions, and if the parcel is determined to be unable to be posted, the handheld display 42 transitions to the screen shown in FIG. 19 (B-3).

If it is determined that a package cannot be dropped off, the customer will hand it over to a staff member at the store counter, who will then hand it over to the delivery company. This allows packages with handling instructions to be handed over safely to the delivery company without being damaged.

The screen of the front display 41 shown in FIG. 19 (A-2) displays text 231 urging the customer to complete the shipping procedure at a counter in the store, and an image 232 directing the customer to the counter in the store.

The screen of the handheld display 42 shown in FIG. 19 (B-2) displays text 235 informing the user that the package is too large to be dropped off, and text 236 encouraging the user to complete the shipping procedure at the counter in the store.

The screen of the handheld display 42 shown in FIG. 19 (B-3) displays text 237 informing the user that handling instructions have been set that are not suitable for posting, and text 236 urging the user to complete the shipping procedure at the counter in the store.

In addition, when the user operates the button 226 to instruct printing of a shipping label on the screen of the handheld display 42 shown in FIG. 19 (B-1), the front display 41 transitions to the screen shown in FIG. 20 (A-1), and the handheld display 42 transitions to the screen shown in FIG. 20 (B-1).

The screen of the front display 41 shown in FIG. 20 (A-1) displays text 241 informing the user that printing of the shipping label has started, and an image 242 indicating the location of the printer 44 of the device. Note that the image indicates the location of the printer 44 with a frame image surrounding the printer 44.

The screen of the handheld display 42 shown in FIG. 20 (B-1) displays text 245 notifying the user that printing of the shipping label has begun, and an image 246 indicating that the shipping label is currently being printed.

When printing of the shipping label is complete, the front display 41 transitions to the screen shown in FIG. 20 (A-2), and the handheld display 42 transitions to the screen shown in FIG. 20 (B-2).

The screen of the front display 41 shown in FIG. 20 (A-2) displays text 251 informing the user that printing of the waybill has been completed, text 252 prompting the user to affix the waybill to the packaged item, and an image 253 showing the status of affixing the waybill to the packaged item.

The screen of the handheld display 42 shown in FIG. 20 (B-2) displays text 255 informing the user that printing of the waybill has been completed, text 256 prompting the user to affix the waybill to the packaged item, and an OK button 258 to approve the affixing of the waybill.

Here, if the user wishes to affix the waybill to the package immediately, he/she operates the OK button 258. In this case, the front display 41 transitions to the screen shown in FIG. 21 (A-1), and the handheld display 42 transitions to the screen shown in FIG. 21 (B-1). On the other hand, if the user does not wish to affix the waybill to the package immediately, he/she operates the button 119 to instruct the user to end.

The screen of the front display 41 shown in FIG. 21 (A-1) displays text 261 encouraging the user to post a package and an image 262 indicating the location of the mail slot 51 of the device. Note that image 262 indicates the location of mail slot 51 with a frame image surrounding mail slot 51.

The screen of the handheld display 42 shown in FIG. 21 (B-1) displays text 265 encouraging the user to post the package and an OK button 268 to approve the posting of the package.

If the user wishes to post the package immediately, he or she operates the OK button 268. In this case, the front display 41 transitions to the screen shown in FIG. 21 (A-2), and the handheld display 42 transitions to the screen shown in FIG. 21 (B-2). On the other hand, if the user does not wish to post the package immediately, he or she operates the button 119 to instruct the user to end the process.

The screen of the front display 41 shown in FIG. 21 (A-2) displays text 271 indicating that the shipping procedure will be completed by dropping the package in the mailbox, text 272 prompting the user to input (shipping notification) that the shipping procedure has been completed in the shipping application on the smartphone 3, and an image 273 showing the status of the package being shipped.

The screen of the handheld display 42 shown in FIG. 21 (B-2) displays text 275 indicating that the shipping procedure has been completed, text 276 expressing gratitude for the use of the device, and text 277 prompting the user to input that the shipping procedure has been completed (shipping notification) in the shipping application of the smartphone 3. Here, in conjunction with the display on the screen of the handheld display 42 shown in FIG. 21 (B-2), an instruction to change the status information of the user's package from "waiting for shipping" to "shipping completed" may be automatically sent to the server device 2.

If an error occurs during processing in the automatic measurement mode, an error screen (not shown) will be displayed on the front display 41 and the handheld display 42. This error screen may display text indicating that an error has occurred and processing cannot be performed normally, text urging the user to complete the shipping procedure at a counter in the store, an image guiding the user to the counter in the store (e.g., a store floor plan), text urging the user to call a store staff member if the user has run out of paper to print on shipping labels, etc.

Next, we will explain the screens displayed in the packaging material purchase mode on the shipping support device 1. Figures 22, 23, and 24 are explanatory diagrams showing the screens displayed in the packaging material purchase mode on the shipping support device 1.

In the shipping support device 1, when a user operates the selection section 107 for the packing material purchase mode entitled "Purchase Packaging Material" on the screen of the handheld display 42 shown in FIG. 13 (B), the front display 41 first transitions to the screen shown in FIG. 22 (A), and the handheld display 42 transitions to the screen shown in FIG. 22 (B).

When the user operates the packing material purchase mode selection unit 107 on the screen of the handheld display 42 shown in FIG. 13(B), the handheld display 42 may transition to a screen (not shown) that inquires the user as to whether or not the user has completed registration for the specified payment service, and transition to the screen shown in FIGS. 22(A) and (B) only if the registration for the specified payment service has been completed. Also, if the registration for the specified payment service has not been completed, the screen may transition to a screen (not shown) that guides the user to purchase packing materials at a counter in the store.

The screen of the front display 41 shown in FIG. 22(A) displays an image 301 that guides the packaging materials stored in the rack 12 and text 302 that guides the rack 12 installed next to the main body 11.

The screen of the handheld display 42 shown in FIG. 22(B) displays text 305 prompting the user to select a packaging material stored in the rack 12, and text 306 indicating that packaging materials can only be purchased one at a time.

When a predetermined time has elapsed since the screen shown in Fig. 22 (A) or (B) was displayed, the front display 41 will transition to the screen shown in Fig. 23 (A-1), and the handheld display 42 will transition to the screen shown in Fig. 23 (B-1).

The rest of the process is the same as the packing material purchasing step in the automatic measurement mode. That is, the screens shown in Fig. 23(A-1), Fig. 24(A-1), and Fig. 24(A-2) are displayed in sequence on the front display 41, and these screens are the same as the screens shown in Fig. 16(A-1), Fig. 17(A-1), and Fig. 17(A-2) in the automatic measurement mode. Also, the screens shown in Fig. 23(B-1), Fig. 23(B-2), Fig. 23(B-3), Fig. 24(B-1), and Fig. 24(B-2) are displayed in sequence on the hand display 42, and these screens are the same as the screens shown in Fig. 16(B-1), Fig. 16(B-2), Fig. 16(B-3), Fig. 17(B-1), and Fig. 17(B-2) in the automatic measurement mode.

(First Modification of the First Embodiment)
Next, a first modification of the first embodiment will be described. Note that the points not mentioned here are the same as those of the above embodiment. Fig. 25 is an explanatory diagram showing a screen displayed in the self-posting mode in the shipping support device 1 according to the first modification of the first embodiment.

In the first embodiment, even if the measured size category of the package allows for posting, if the handling instructions set for the package make it unsuitable for posting, i.e., if the handling instructions are included in the shipping declaration information obtained from the server device 2, it is determined that the package cannot be posted, the screen shown in FIG. 19 (B-3) is displayed on the handheld display 42, the shipping procedure by this device is interrupted, and the shipping procedure is carried out at the store counter.

On the other hand, in this modified example, if the handling specifications set for the target package are not suitable for posting, guidance to continue the procedure by posting is displayed on the handheld display 42. At this time, the user is queried as to whether or not to continue the package shipping procedure by posting, and if the user agrees, the package shipping procedure by posting is continued and the process proceeds to the step of printing the waybill.

Specifically, if the handling instructions for the target package are set such that it is not suitable for posting, i.e., if the shipping declaration information obtained from the server device 2 includes handling instruction information, the front display 41 transitions to the screen shown in FIG. 25(A), and the handheld display 42 transitions to the screen shown in FIG. 25(B). These screens are generated based on the handling instruction information included in the advance declaration information.

The screen of the front display 41 shown in FIG. 25(A) displays text 281 informing the user that handling instructions have been set that make the item unsuitable for posting, text 282 indicating the handling instructions set by the user, and text 283 showing guidance for when posting is permitted on an exceptional basis. The example shown in FIG. 25(A) informs the user that even if the user has set handling instructions for fragile items, posting is possible if the item is sufficiently protected by cushioning material.

The screen of the handheld display 42 shown in FIG. 25(B) displays text 285 inquiring whether or not to continue the package shipping procedure by posting, and a button 286 for instructing the user to continue the package shipping procedure by posting. When the user operates this button 286 for instructing the user to continue, the screen transitions to one shown in FIG. 19(A-1) or FIG. 19(B-1), for example, and the waybill is printed.

If the handling instructions set for the target package require refrigeration, the system should interrupt the shipping procedure without asking the user whether or not to continue the shipping procedure, that is, without exception, and display a message indicating that the package cannot be shipped by posting.

(Second Modification of the First Embodiment)
Next, a second modified example of the first embodiment will be described. Note that points that are not particularly mentioned here are the same as those in the above embodiment. Fig. 26 is a flow diagram showing a procedure for processing unpackaged packages according to the second modified example of the first embodiment.

In the first embodiment, as shown in FIG. 11, in the case of a parcel packed with a packaging material other than a standard packaging material, the provisional size information based on the image captured by the upper photographing unit 31 is corrected with the corrected size information based on the image captured by the side photographing unit 35 to obtain the final size information. Also, as shown in FIG. 12, in the case of an unpackaged parcel, no correction is made with the corrected size information based on the image captured by the side photographing unit 35, and the provisional size information based on the image captured by the upper photographing unit 31 is used as the final size information as is.

In contrast, in this modified example, in the case of an unpacked package, as in the case of a packed package shown in FIG. 11, the provisional size information based on the image captured by the upper image capture unit 31 is corrected with the corrected size information based on the image captured by the side image capture unit 35 to obtain final size information. Specifically, instead of provisional height information based on the depth image captured by the upper image capture unit 31, the size category of the package is determined based on height information based on the occlusion status of the reference marker 39 in the color image captured by the side image capture unit 35.

Specifically, as shown in Fig. 26, after the processes of ST201 to ST203 similar to those of the first embodiment (see Fig. 12), the processor 63 acquires a color image from the color camera 36 of the lateral imaging unit 35 (ST221) and detects the reference marker 39 from the color image (ST222). Then, based on the occlusion state of the reference marker 39 in the color image, the processor 63 determines whether the height of the object is equal to or less than the upper limit value for the height of the first category (size category determination process) (ST223).

Here, if the height of the object is equal to or less than the upper limit of the first category (Yes in ST223), proceed to ST205. On the other hand, if the height of the object exceeds the upper limit of the first category (No in ST223), the processor 63 determines that the object is a package that cannot be dropped (ST211). Also, in ST205, if the XY dimensions of the circumscribed rectangular parallelepiped of the object are equal to or less than the upper limit of the first category (Yes in ST205), the processor 63 determines that the object is a package in the first category (ST206).

On the other hand, if the XY dimensions of the circumscribed rectangular solid of the object exceed the upper limit value of the first division (No in ST205), the processor 63 then determines whether the height of the object is equal to or less than the upper limit value for height of the second division based on the occlusion status of the reference marker 39 in the color image (size division determination process) (ST224).

If the height of the object is equal to or less than the upper limit of the second division (Yes in ST224), proceed to ST208. The processing from ST208 onwards is the same as in the first embodiment. On the other hand, if the height of the object exceeds the upper limit of the second division (No in ST224), proceed to ST211. The processing in ST211 is the same as in the first embodiment.

In this modified example, in order to accurately distinguish between two size categories with different upper height limits, two reference markers 39 may be provided, each corresponding to one of the two size categories.

(Third Modification of the First Embodiment)
Next, a third modified example of the first embodiment will be described. Note that points not mentioned here are the same as those in the above embodiment. Fig. 27 is an explanatory diagram showing a main part of the shipping support device 1 according to the third modified example of the first embodiment. Fig. 28 is a flow diagram showing the operation procedure of the processor 63 of the shipping support device 1.

As shown in FIG. 27, the main body 11 of the shipping support device 1 is provided with a storage section 52 for storing packages, and this storage section 52 is provided with a mail slot 51 that is adapted to the size of packages that can be mailed. Furthermore, the storage section 52 is provided with a lid 81 that covers the mail slot 51, and a locking mechanism 82 that restricts the opening and closing of this lid 81 to prevent the mail from being mailed. Note that the locking mechanism 82 may be configured, for example, such that a locking member (not shown) that restricts the opening and closing of the lid 81 is driven by a drive section (not shown) consisting of an actuator such as a solenoid.

The storage section 52 is also provided with a sensor 83 that detects the dropping of a package, i.e., a package passing through the drop slot 51. Detection of package dropping is a known technique (see, for example, JP 10-91678 A), and various configurations can be adopted. In addition to being configured as a passing sensor, the sensor 83 may also be configured as an opening/closing sensor that detects the opening and closing of the lid 81 that covers the drop slot 51. A reader may also be provided near the drop slot 51 to read a two-dimensional code printed on the shipping label, thereby detecting the dropping of a package and identifying the dropped package at the same time.

The processor 63 controls the locked state of the locking mechanism 82 so that unweighed packages or items other than packages (such as garbage) are not dropped through the drop slot 51. In this embodiment, the processor 63 temporarily releases the locked state of the locking mechanism based on a determination that dropping a package is permitted. Also, in this embodiment, the processor 63 temporarily releases the locked state of the locking mechanism 82 when printing of the shipping label by the printer 44 is completed. Also, in this embodiment, the processor 63 returns the locking mechanism 82 to the locked state when dropping a package is detected based on the detection result of the sensor 83.

The processor 63 also counts the number of parcels that have been determined to be eligible for posting and that have been posted in the storage unit 52. In this embodiment, the processor 63 counts the number of parcels that have been posted in the storage unit 52 based on the detection results of the sensor 83. That is, the number of parcels is counted up each time the sensor 83 detects that a parcel has been posted. Note that counting the number of parcels that are eligible for posting is also a publicly known technique (see, for example, JP 2001-76262 A), and various configurations can be adopted.

In this embodiment, the processor 63 compares the count of the dropped parcels with a threshold value (upper limit or a value a predetermined number less than the upper limit) for the number of parcels that can be stored in the storage unit 52, and issues an alert for a parcel collection request based on the comparison result. Specifically, when the count of the parcels exceeds the threshold value, an alert for a collection request is issued. In this case, for example, the notification of the collection request alert from the shipping support device 1 may be sent via the server device 2 and the delivery company's server device (not shown) to a terminal (not shown) held by the worker in charge of collection. Note that it is advisable to set a threshold value that allows the dropping of about 2 to 5 parcels so that the shipping support device 1 can continue to be used until the parcels are collected after the notification of the collection request alert.

In addition, in this embodiment, the processor 63 resets the parcel count value when collection of the parcels from the storage unit 52 is completed. In this case, for example, when a delivery company worker unlocks the lock 55 (see FIG. 2) of the storage unit 52 and finishes collection of the parcels, the worker performs an operation to complete collection, and the processor 63 resets the parcel count value in response to the operation. Also, the completion of collection of the parcels may be detected based on the opening and closing of the door 53 of the storage unit 52 and the unlocking and locking of the lock 55, and the parcel count value may be reset. Note that resetting the count value after collection of the parcels is also a publicly known technique (see, for example, Japanese Patent Publication No. 6-30738), and various configurations may be adopted.

In addition, in this embodiment, if the number of packages already deposited reaches the upper limit of the number of packages that can be stored in the storage unit 52 when the packages are collected, the threshold value for determining whether or not an alarm needs to be issued is updated. In this threshold value update, the threshold value is reset to a value that is a specified number smaller than the current setting value.

Specifically, as shown in FIG. 28, first, when sensor 83 detects the dropping of a parcel (Yes in ST301), processor 63 increments the number of dropped parcels (count of dropped parcels) by 1 (ST302). Next, processor 63 determines whether the number of dropped parcels has reached a predetermined threshold (determining whether an alert is required) (ST303). If the number of dropped parcels has reached the threshold (Yes in ST303), it determines whether a collection request alert has been issued (ST304). If a collection request alert has not been issued (No in ST304), a process is performed to issue a collection request alert (collection request alert issuance process) (ST305).

On the other hand, if a collection request alert has already been issued (Yes in ST304), processor 63 then determines whether or not it has detected the collection of parcels by a delivery company worker completing the collection operation (ST306). If it has detected the collection of parcels (Yes in ST306), processor 63 then determines whether or not the number of parcels that have been posted has reached a predetermined upper limit (S307). If the number of parcels that have been posted has reached the upper limit (Yes in ST307), the threshold for determining whether or not an alert needs to be issued is reset to a value that is a predetermined number less than the current setting (threshold update) (ST308).

Next, the processor 63 resets the number of parcels that have been posted (the count of parcels that have been posted) (ST309).

The threshold value for determining whether an alert needs to be issued is set to a value less than the upper limit of the amount of luggage that can be stored in the storage unit 52 (the number of luggage already deposited when the storage unit 52 is full). In other words, the threshold value for determining whether an alert needs to be issued is set to a value that is a predetermined margin (e.g., about 2 to 5 pieces) less than the upper limit. This allows a predetermined number of luggage to be deposited after the collection request alert is issued and before the luggage is collected. The margin can be set based on the time required from the issuance of the collection request alert to the collection of the luggage, the pace at which the luggage is deposited (the number of luggage deposited per unit time), etc.

In this way, in this modified example, an alert for a collection request is issued when there is still room in the storage unit 52, so that packages are collected before the storage unit 52 becomes full, reducing the occurrence of a situation in which packages cannot be posted because the storage unit 52 is full. Furthermore, by controlling the threshold value for determining whether an alert is required depending on the number of packages actually posted, it is possible to reliably avoid a situation in which the storage unit 52 is full and packages cannot be posted.

In this embodiment, as shown in Figures 2 and 27, one drop slot 51 is provided that is adjusted to match the size category (maximum) of parcels that can be dropped, but two or more drop slots 51 corresponding to the size categories of parcels that can be dropped may be provided, and the lock state of the lid of the drop slot 51 corresponding to the size category of the parcel may be released when the shipping support device 1 determines that the parcel can be dropped, or when the printer 44 prints the waybill. In this way, by controlling the lock state of the lid of the corresponding drop slot 51 according to the size category of the parcel, it is possible to reliably prevent fraud such as switching the parcel at the time of measurement with the parcel at the time of dropping.

Second Embodiment
Next, a second embodiment will be described. Note that the points not mentioned here are the same as those in the above embodiment. Fig. 29 is a block diagram showing a schematic configuration of a shipping support device 1 and a server device 2 according to the second embodiment.

In the first embodiment (see FIG. 7), the processor 63 of the shipping support device 1 performs processes related to shipping support, i.e., object detection process, photography position determination process, size measurement process, size classification determination process, packaging material selection process, advance declaration content inquiry process, posting permission determination process, waybill printing process, packaging material recognition process, payment process, and screen control process, but in this embodiment, the processor 73 of the server device 2 performs processes related to shipping support. In addition, the processor 73 of the server device 2 also performs processes related to management of shipping declaration information input in advance by the user and payment. The processor 73 of the server device 2 performs the necessary processes by executing programs stored in the memory 72.

In the shipping support device 1, the color image acquired by the color camera 32 of the upper image capture unit 31, the depth image acquired by the depth camera 33 of the upper image capture unit 31, and the color image acquired by the color camera 36 of the side image capture unit 35 are transmitted from the communication unit 61 to the server device 2. In the shipping support device 1, the communication unit 61 receives information transmitted from the communication unit 71 of the server device 2, and based on that information, the processor 63 controls the front display 41 and the handheld display 42 to display the required screen, controls the reader 43 to read the two-dimensional code, and controls the printer 44 to print the waybill.

In regard to the management of users when providing the shipping support service to them, information regarding the shipment of packages is input into the shipping application of the smartphone 3, the two-dimensional shipping code displayed by the shipping application of the smartphone 3 is read, and the two-dimensional payment code is read by the payment application of the smartphone 3. However, the user may be identified and payment processed by facial recognition. In this case, the user's registered face image (feature amount) may be registered in advance in the server device 2, and a facial matching process may be performed between the authentication face image acquired from the image captured by the user by the shipping support device 1 and the registered face image to perform payment processing by facial recognition.

As described above, the embodiments have been described as examples of the technology disclosed in this application. However, the technology in this disclosure is not limited to this, and can also be applied to embodiments in which modifications, substitutions, additions, omissions, etc. have been made. It is also possible to combine the components described in the above embodiments to create new embodiments.

The shipping support device and shipping support system according to the present invention have the effect of allowing the delivery company to quickly confirm that the size of the package has been properly measured by the shipping support device and that there is no need to measure the size again, and to immediately proceed with the transportation of the package after collection. They are useful as shipping support devices and shipping support systems that support the shipping procedures of users who hand over their packages to the delivery company.

1 Shipping support device 2 Server device 3 Smartphone 11 Main body 12 Rack 21 Placement table (placement section)
22 Placement surface 23 Side wall surface 31 Upper photographing section (detection section)
32 Color camera 33 Depth camera 35 Side photographing unit (detection unit)
36 Color camera 39 Reference marker 41 Front display (display unit)
42 Handheld display (display unit, operation unit)
43 Reader 44 Printer (printing unit)
51 Mail slot 52 Storage section 53 Door 54 Handle 55 Lock 61 Communication section 62 Memory 63 Processor 71 Communication section 72 Memory 73 Processor

Claims (8)

A shipping support device that supports a shipping procedure of a user who delivers a package to a delivery company,
A placement section where a user places their luggage;
One or more detection units for detecting luggage placed on the placement unit;
a storage section for storing parcels posted by users;
A display unit that presents information to a user;
A processor for controlling the dispatch support,
The processor,
measuring a size of the baggage placed on the placement section based on a detection result of the detection section;
Based on the measurement results, a decision is made as to whether or not the package can be posted.
Displaying information about the determination result on the display unit;
A shipping support device characterized in that, when a result of the determination is that the package can be dropped off, approval information relating to the size measurement result is added to the package. The shipping support device according to claim 1, characterized in that the placement unit, the detection unit, the storage unit, and the display unit are integrally provided in the same housing. The shipping support device according to claim 1, characterized in that the detection unit includes a first detection unit that detects luggage placed on the loading section from above, and a second detection unit that detects luggage placed on the loading section from the side. The processor,
The shipping support device described in claim 1, characterized in that if the package placed on the placement section is unpackaged and it is determined that the package can be dropped off, at least one of information regarding the size of the package and information regarding the cost of shipping is displayed on the display section. The processor,
The shipping support device according to claim 1, characterized in that when a package placed on the placement section is unpackaged and it is determined that the package can be dropped in a mailbox, information regarding packaging material suitable for the package to be dropped in the mailbox is displayed on the display section. The processor,
The shipping support device according to claim 1, characterized in that if a package placed on the placement section has already been packed and it is determined that the package can be dropped off, a message indicating that the package can be dropped off is displayed on the display section. Further, a printing unit for printing an invoice is provided,
The processor,
The shipping support device described in claim 1, characterized in that if a package placed on the placement section has already been packed and it is determined that the package can be posted, the device instructs the printing section to print a waybill including the approval information corresponding to the package. A shipping support system that supports a shipping procedure of a user who delivers a package to a delivery company,
A shipping support device having a placement section on which a user places a package, one or more detection sections for detecting the package placed on the placement section, a storage section for storing the package posted by the user, and a display section for presenting information to the user;
A server device connected to the shipping support device via a network,
The shipping assistance device includes:
a server device that detects the baggage placed on the placement section of the detection unit;
The server device includes:
measuring the size of the package placed on the placement unit based on the detection result of the detection unit received from the shipping support device;
Based on the measurement results, a decision is made as to whether or not the package can be posted.
Transmitting information regarding the determination result to the shipping support device;
If the result of the determination is that the package can be posted, approval information regarding the size measurement result is added to the package,
The shipping assistance device includes:
The shipping support system further comprises: displaying, on the display unit, information relating to the determination result received from the server device.

Images