JP2021076494A - System, device, and method for dimension measurement - Google Patents

Abstract

To allow for measuring external dimensions of an object without using a housing that forms a containment chamber.SOLUTION: A dimension measurement system is provided, comprising an image capturing unit configured to shoot an object to acquire an image of the object, and a measurement unit configured to measure external dimensions of the object using the image of the object. The measurement unit analyzes the image of the object to estimate a measurement direction perpendicular to a height direction of the object, and measures external dimensions of the object, including a dimension in the measurement direction of the object.SELECTED DRAWING: Figure 2

Description

The present invention relates to a dimension measuring system, a dimension measuring device and a dimension measuring method.

Conventionally, at a courier company's business store, convenience store, etc., parcel delivery is accepted by the following procedure. The client fills in the information about the client such as the name and address of the client and the information about the destination such as the name and address of the destination on the address label. Then, when a clerk at a convenience store or the like receives an address label with this information and the package to be sent from the client, the external dimensions and weight of the package are measured using a measure or scale, and the measurement result is obtained. The parcel delivery size and the parcel delivery fee are determined based on the delivery address and the delivery address, and the parcel delivery fee is settled to complete the parcel delivery reception.

However, in the delivery reception as described above, it takes time to measure the external dimensions and weight of the package, so in order to reduce the burden on the clerk, the client himself should measure the dimensions and weight of the package. It is preferable to do so. Furthermore, if the burden on the clerk can be reduced, it is possible to avoid having the customer wait for a long time at the cashier counter of the store, which leads to improvement of the service to the customer. Therefore, in recent years, a measuring device has been developed that automatically measures the size and weight of a package without bothering the clerk. Patent Document 1 discloses an example of such a measuring device.

JP-A-2018-000386

The above-mentioned measuring device has a housing forming a containment chamber, and measures a load placed in the containment chamber. In this case, since the width direction and the depth direction of the luggage are equal to the width direction and the depth direction of the accommodation chamber, the measuring device can be used for the length of the luggage in the width direction of the accommodation chamber and the luggage in the depth direction of the accommodation chamber. By measuring the length of the luggage, the external dimensions of the luggage can be specified. However, the housing forming the storage chamber requires an installation space according to the maximum size of the measurable luggage.

Therefore, the present invention has been made in view of the above problems, and an object of the present invention is a novel method capable of measuring the external dimensions of an object without using a housing forming a storage chamber. And to provide an improved dimensioning system, dimensioning apparatus and dimensioning method.

In order to solve the above problems, according to a certain viewpoint of the present invention, an imaging unit that images an object and acquires an image of the object, and a measuring unit that measures the external dimensions of the object based on the image of the object. By analyzing the image of the object, the measuring unit estimates the measuring direction orthogonal to the height direction of the object, and measures the external dimensions of the object including the dimensions in the measuring direction of the object. A dimensional measurement system is provided.

The dimension measurement system may further include a charge calculation unit that calculates a charge required for home delivery of the object based on the measurement result by the measurement unit.

The dimension measurement system displays a screen for inducing the rearrangement of an object on the display unit based on the angle difference between the display unit and the measurement direction and the reference direction estimated by the measurement unit exceeding the threshold value. A display control unit for displaying may be further provided.

The measuring unit further estimates the shape of the object, and the display control unit displays a screen for inducing the rearrangement of the object when the shape of the object estimated by the measuring unit is cylindrical. It is not necessary to display it on the part.

The measurement direction may be the direction of the side of the hexahedron when the hexahedron is arranged so that the volume of the hexahedron circumscribing the object is minimized.

When a person is detected in the image of the object, the measuring unit does not have to start measuring the external dimensions of the object.

When a person is detected in the image of the object, the measuring unit may measure the external dimensions of the object after masking the area where the person is detected.

The dimensional measurement system further includes a measuring instrument for measuring the weight of the object, and the charge calculation unit may use the charge calculation unit while the person is not detected in the person detection area including the measurement target area on which the object is placed. The delivery size of the object may be specified based on the weight of the object measured by the measuring instrument.

The dimension measurement system further includes a display unit and a display control unit that displays a measurement result screen showing a measurement result of the external dimensions of the object on the display unit, and the measurement unit is a case where the object has a hand-held portion. When the hand-held portion is detected, the display control unit detects the measurement result of the external dimensions including the hand-held portion on the measurement result screen, or the object in which the hand-held portion is ignored. An operation button for selecting which of the measurement results of the external dimensions of the above is to be displayed may be displayed on the display unit.

When the display control unit is selected to display the measurement result of the external dimensions of the object in which the hand-carrying portion is ignored, the hand-carrying portion can be deformed so that the height of the hand-carrying portion is reduced. A confirmation screen for confirming whether or not the object may be displayed on the display unit, and after the confirmation operation is performed on the confirmation screen, the display unit may display the measurement result of the external dimensions of the object in which the hand-held portion is ignored. ..

The measurement result screen includes an image of the object, and the display control unit may arrange an image of a predetermined object so as to be aligned with the image of the object or superimposed on the image of the object. ..

The measuring unit determines whether or not the object is a golf bag, and the charge calculating unit delivers the object to home according to a different charge system depending on the determination result of whether or not the object is a golf bag. You may calculate the charge required for.

The dimensional measurement system further includes an installation device that attaches the imaging unit to the installation surface, and the installation device may form a rotation axis along each of one direction or two or more different directions.

The installation device may have a drive unit that rotates the image pickup unit around the rotation axis.

The dimensioning system may further include a projector that forms an optical image in the area where the object should be placed.

The imaging unit may be provided on a mobile terminal that is gripped and used by the user.

Further, in order to solve the above-mentioned problems, according to another viewpoint of the present invention, by analyzing an image of an object, a measurement direction orthogonal to the height direction of the object is estimated, and the measurement direction of the object is set. Provided is a dimension measuring device including a measuring unit for measuring the external dimensions of the object including dimensions.

Further, in order to solve the above problems, according to another viewpoint of the present invention, by imaging an object to acquire an image of the object and analyzing the image of the object, the object is in the height direction. A dimensional measurement method is provided that includes estimating a measurement direction orthogonal to, and measuring the external dimensions of the object, including dimensions in the measurement direction of the object.
Equipment is provided.

According to the present invention described above, it is possible to measure the external dimensions of an object without using a housing forming a storage chamber.

It is an external view of the home delivery reception system 10 according to the 1st Embodiment of this invention. It is a functional block diagram of the home delivery reception system 10 according to the 1st Embodiment of this invention. It is a flowchart which shows the schematic operation of the home delivery reception system 10 by 1st Embodiment of this invention. It is explanatory drawing which shows the specific example of the measurement result screen 40. It is explanatory drawing which shows the adjustment method of the angle of view. It is explanatory drawing which shows the structure of the installation instrument 20. It is explanatory drawing which shows the specific example of the scale formed in the installation instrument 20. It is explanatory drawing which shows the specific example of calibration. It is explanatory drawing which shows the specific example of the area where a baggage should be placed. It is explanatory drawing which shows the person detection area G. It is explanatory drawing which shows the specific example of the measurement result screen 50. It is explanatory drawing which shows the specific example of the confirmation screen 60. It is explanatory drawing which shows the specific example of the measurement result screen 51 which includes the measurement result of the external dimension which ignored the hand-carrying part. It is explanatory drawing which shows the estimation example of the measurement direction of the baggage X. It is explanatory drawing which shows the specific example of the angle difference. It is explanatory drawing which shows the specific example of the screen 70 which guides the repositioning of a baggage. It is a flowchart which shows the operation about the direction detection of a baggage. It is explanatory drawing which shows the specific example of the measurement result screen 80. It is an external view of the home delivery reception system 12 according to the 2nd Embodiment. It is explanatory drawing which shows the structure of the tablet terminal 30. It is explanatory drawing which shows the specific example of the image which includes a person. It is explanatory drawing which shows the specific example of the guidance screen. It is explanatory drawing which shows the specific example of a mask processing. It is explanatory drawing which shows the structure of the home delivery reception system 13 according to 3rd Embodiment.

Embodiments of the present invention will be described in detail below with reference to the accompanying drawings. In the present specification and the drawings, components having substantially the same functional configuration are designated by the same reference numerals, so that duplicate description will be omitted.

Further, in the present specification and the drawings, a plurality of components having substantially the same functional configuration may be distinguished by adding different alphabets after the same reference numerals. However, when it is not necessary to particularly distinguish each of the plurality of components having substantially the same functional configuration, only the same reference numerals are given to each of the plurality of components.

The embodiment of the present invention described below can be applied to home delivery reception at a convenience store or the like. However, the embodiment of the present invention is not limited to being used in convenience stores and the like, and may be used in public facilities such as courier stores, retail stores, supermarkets, and transportation stations. It is not particularly limited.

Further, in the following explanation, the client means a person who brings a package for which a delivery is requested to a convenience store or the like, and in the following embodiments, a person who actually requests the delivery and a person who brings the package. Will be described as being the same. However, the person who actually requests the delivery and the person who brought the package do not have to be the same.

<< 1. First Embodiment >>
<1-1. Overview of home delivery reception system>
First, an outline of the home delivery reception system according to the embodiment of the present invention will be described. The home delivery reception system is an example of a dimension measurement system that measures the external dimensions of an object to be delivered to home, that is, a package brought in by the client. Any function included in the delivery reception system described below may be omitted depending on the installation location, the assumed client, the price, and the like. On the other hand, the home delivery reception system can also have functions not described below.

(Configuration of home delivery reception system)
FIG. 1 is an external view of a home delivery reception system 10 according to the first embodiment of the present invention. FIG. 2 is a functional configuration diagram of the home delivery reception system 10 according to the first embodiment of the present invention. As shown in FIGS. 1 and 2, the home delivery reception system 10 according to the first embodiment of the present invention includes an operation display unit 110, a speaker 120, a camera 130, a measuring instrument 140, a cash processing unit 150, and a code reader 160. It includes a label printer 170, a receipt printer 180, and a control unit 190.

The operation display unit 110 is a touch panel having functions as a display unit and an operation unit. The operation display unit 110 mainly displays a screen to the client and accepts an operation by the client. The operation display unit 110 appropriately displays texts, illustrations and moving images of operation guidance at each stage of the transaction, and displays a measurement result screen showing the measurement result of the package.

The speaker 120 is an audio output unit that outputs audio. The speaker 186 outputs, for example, voice guidance to the client.

The camera 130 is an example of an imaging unit that captures an image of a luggage and acquires an image of the luggage. The camera 130 has the functions of a visible light camera and a depth camera. The visible light camera acquires an RGB image of the luggage, and the depth camera acquires a distance image of the luggage. As shown in FIG. 1, the camera 130 is installed above the rear side of the mounting surface 16 on which the luggage is placed, for example.

The measuring instrument 140 measures the weight of the load. As shown in FIG. 1, the measuring instrument 140 has a neat appearance because it is embedded in, for example, a mounting surface 16 on which luggage is placed. However, the measuring instrument 140 may be placed on the counter, and the upper part of the measuring instrument 140 may be used as the mounting surface 16.

The cash processing unit 150 is configured to perform cash processing such as inserting cash and withdrawing change. The cash processing unit 150 has a function of a bill processing unit in which bills are inserted and withdraws bills as change, and a coin processing unit in which coins are inserted and coins are withdrawn as change.

The code reader 160 reads a code (for example, a two-dimensional code) displayed on an information processing terminal such as a smartphone used by the client. By reading the code displayed on the information processing terminal, the code reader 160 can obtain information such as baggage sending information, payment information, or the client's membership number input by the client to the information processing terminal. .. In FIG. 1, a fixed type reader is shown as the code reader 160, but a handy type reader may be used in place of the code reader 160 or in addition to the code reader 160.

The label printer 170 prints an address label for the client. The address label printed by the label printer 170 is a sticker with a release paper attached. The client removes the release paper from the address label and attaches the address label to the package. The home delivery reception system 10 can accept packages to which an address label is attached in advance, but it is also possible to create and print an address label based on the delivery information input during the transaction. Is. The method of inputting the sending information includes, for example, a method of inputting information such as the destination and the sending source from the operation screen displayed on the operation display unit 110, and a method of inputting information to an application of an information processing terminal such as a smartphone in advance. There are a method of reading the generated two-dimensional code with the code reader 160, and a method of receiving the information registered in the host as member information from the host and letting the client select it. The client attaches a printed address label to the package.

The receipt printer 180 prints a receipt to the client indicating receipt of the fee required for delivery of the package before the end of the transaction.

The control unit 190 controls the overall operation of the delivery reception system 10. The function of the control unit 190 can be realized by the cooperation of software and hardware such as a CPU and RAM. In particular, as shown in FIG. 2, the control unit 190 according to the present embodiment has the functions of the display control unit 192, the measurement unit 194, and the charge calculation unit 196, and is used as a dimension measurement device.

The display control unit 192 generates various display screens, and causes the operation display unit 110 to display the generated display screens. The measuring unit 194 measures the external dimensions of the luggage based on the image of the luggage obtained by the camera 130. As the external dimensions of the luggage, the total length of the three sides of the circumscribed hexahedron of the luggage can be used. The charge calculation unit 196 identifies the parcel delivery size based on the external dimensions of the parcel obtained by the measuring unit 194 and the weight of the parcel obtained by the measuring instrument 140, and the parcel delivery size, that is, the parcel delivery size. Calculate the parcel delivery fee corresponding to.

(Operation of home delivery reception system)
The configuration of the home delivery reception system 10 according to the first embodiment of the present invention has been described above. Subsequently, the schematic operation of the home delivery reception system 10 according to the first embodiment of the present invention will be described.

FIG. 3 is a flowchart showing a schematic operation of the home delivery reception system 10 according to the first embodiment of the present invention. First, when the client places the luggage on the mounting surface 16 (S204) and the start operation on the operation display unit 110 is performed (S208), the camera 130 images the luggage, and the image of the luggage obtained by the imaging is performed. The measuring unit 194 measures the external dimensions of the luggage based on the image (S212). Then, the measuring instrument 140 measures the weight of the luggage (S216).

Subsequently, the display control unit 192 generates a measurement result screen including the measurement result of the external dimensions and the measurement result of the weight, and causes the operation display unit 110 to display the measurement result screen (S220). FIG. 4 is an explanatory diagram showing a specific example of the measurement result screen 40. As shown in FIG. 4, the measurement result screen 40 includes an RGB image 42 of the luggage, a measurement result 44, a redo button 46, and a confirmation button 48. The measurement result 44 includes the display of the measurement result (size) of the external dimensions and the measurement result (weight) of the weight, as well as the display of the type of the package and the delivery size. The redo button 46 is a button for redoing the transaction from the beginning, and the confirmation button 48 is a button for proceeding with the transaction.

When the confirmation button 48 is selected on the measurement result screen, the charge calculation unit 196 calculates the charge (delivery charge) required for the delivery of the package (S224), as shown in FIG. After that, the display control unit 192 generates a payment screen including the delivery charge and the selection items of the payment method, and displays the payment screen on the operation display unit 110 (S228). Then, the control unit 190 performs the settlement process according to the settlement method selected by the client on the settlement screen (S232). After that, the label printer 170 prints the address label (S236), the receipt printer 180 prints the receipt (S240), and the series of processes is completed.

<1-2. Ingenuity in the delivery reception system>
The configuration and schematic operation of the home delivery reception system 10 according to the first embodiment of the present invention have been described above. Subsequently, various ingenuity and ingenuity in the home delivery reception system 10 according to the first embodiment of the present invention will be sequentially described in detail.

(Adjustment of angle of view)
In the home delivery reception system 10, a measurement target area of a predetermined size is set. The measurement target region may be, for example, a region having a width of 60 cm, a depth of 60 cm, and a height of 60 cm. The camera 130 is installed so that the angle of view of the camera 130 includes the measurement target area and the angle of view of the camera 130 includes three surfaces of the measurement target area. Further, from the viewpoint of measurement accuracy, it is desirable that the center of the angle of view of the camera 130 coincides with the center of the measurement target area. Hereinafter, a device for aligning the center of the angle of view of the camera 130 with the center of the measurement target area will be described.

FIG. 5 is an explanatory diagram showing a method of adjusting the angle of view. As shown in FIG. 5, the operator of the home delivery reception system 10 installs the mark member 15 at the center of the measurement target area F. Here, the camera 130 is attached to the installation surface via the installation device. The fixture forms a rotation axis along each of one direction, or two or more different directions. Hereinafter, a specific example of the installation device will be described with reference to FIG.

FIG. 6 is an explanatory diagram showing the configuration of the installation device 20. As shown in FIG. 6, the installation device 20 includes a first member 210, a second member 220, and a third member 230. The first member 210 includes a base surface 212 that abuts on the installation surface, and side surfaces 214 and 216 extending in parallel from the base surface 212, respectively. The base surface 212 includes the hole 212a, and the rotation shaft A1 is formed by attaching the base surface 212 to the installation surface through the hole 212a. The side surface 214 has a hole 214a, and the side surface 216 also has a hole (not shown) at a position facing the hole 214a.

The second member 220 is connected to the first member 210 through a hole 214a on the side surface 214 and a hole (not shown) on the side surface 216. The rotation shaft A2 is formed by the connection.

The third member 230 is a member that supports the camera 130 and has holes 230a that face each other. The rotation shaft A3 is formed by connecting the third member 230 to the second member 220 through the hole 230a.

In such an installation device 20, the first member 210 rotates in the P direction around the rotation axis A1, the second member 220 rotates in the Q direction around the rotation axis A2, and the third member 230 rotates. It is possible to rotate around the axis A3. Further, for example, a groove or a hole shown by a broken line is formed on the installation surface, and the first member 210 is attached to the installation surface through the groove or the hole, so that the first member 210 is in the extending direction of the groove or the hole ( For example, it is possible to move along the Z direction).

The operator of the home delivery reception system 10 can position the mark member 15 at the center of the image obtained by the camera 130 by manually adjusting such an installation device 20. Further, the control unit 190 can calculate the adjustment amount around each rotation axis based on the position of the mark member 15 in the image obtained by the camera 130, and the operator can adjust the installation device 20 according to the adjustment amount. Is. For this purpose, a scale may be formed around each rotation axis of the installation device 20.

FIG. 7 is an explanatory diagram showing a specific example of the scale formed on the installation device 20. In FIG. 7, a scale 222 is formed around the rotation axis A2. Scales are similarly formed around the other rotation axes. The control unit 190 calculates the number of scales as an adjustment amount, and the operation display unit 110 displays the number of scales, so that the operator can quickly and appropriately adjust the angle of view of the installation device 20. In addition, the operator can flexibly decide the place where the camera 130 is installed according to the environment of the store and the like.

Although the example in which the operator manually adjusts the installation device 20 has been described above, other aspects can also be applied to the first embodiment of the present invention. For example, the installation device 20 may have a drive unit that rotates the camera 130 (each member 210-230) around each rotation axis. The drive unit may include a motor, gears, and the like. The drive unit automatically rotates the camera 130 according to the adjustment amount calculated by the control unit 190, so that the installation time of the camera 130 can be further shortened.

(Calibration)
After the angle of view of the camera 130 is adjusted as described above, calibration for measurement is performed. The calibration includes detection of the mounting surface 16, detection of the origin of the measurement target area, and detection of the reference direction. The calibration is performed, for example, using a predetermined adjustment sheet. A specific example of calibration will be described below.

FIG. 8 is an explanatory diagram showing a specific example of calibration. As shown in FIG. 8, at the time of calibration, the operator lays the adjustment sheet 14 on the mounting surface 16. Any pattern, cord, or the like may be formed on the adjustment sheet 14. The camera 130 takes an image of the adjustment sheet 14 and obtains an image including the adjustment sheet 14.

The control unit 190 analyzes the image including the adjustment sheet 14, detects the plane on which the adjustment sheet 14 is laid (that is, the mounting surface 16), and detects the center of the adjustment sheet 14 (that is, the origin of the measurement target area). O) is detected. Further, the control unit 190 detects the reference direction L corresponding to the width direction of the measurement target region.

By using the calibration result obtained in this way, the measuring unit 194 can measure the external dimensions of the luggage with high accuracy.

(Induction of placement)
When the client places the load on the mounting surface 16, there is a concern that the client may be confused as to where and how the load should be placed on the mounting surface 16. In particular, as described with reference to FIG. 1, when the measuring instrument 140 is embedded in the mounting surface 16, it is difficult to know the area where the load should be placed.

Therefore, the home delivery reception system 10 according to the first embodiment of the present invention may have a configuration for indicating to the client an area in which the package should be placed. Hereinafter, a specific example will be described with reference to FIG.

FIG. 9 is an explanatory diagram showing a specific example of the area where the luggage should be placed. As shown in FIG. 9, the home delivery reception system 10 according to the first embodiment of the present invention may include a projector 134 that forms an optical image in an area where a package should be placed. The projector 134 can indicate an area on which the luggage should be placed by forming, for example, a message "Please put the luggage" on the mounting surface 16. The area where the luggage should be placed is the area where the adjustment sheet 14 was laid at the time of the calibration described with reference to FIG.

The control unit 190 may start the projection on the projector 134 based on the detection of the client, for example, and stop the projection on the projector 134 after the load is placed. The fact that the load is placed can be detected, for example, by measuring the weight with the measuring instrument 140 or analyzing the image obtained by the camera 130.

Further, the projector 134 may project grid lines including lines parallel to the reference direction L detected during the calibration described with reference to FIG. With such a configuration, the client can understand that the luggage should be placed so that the width direction and the depth direction of the luggage match the grid line.

(Setting of human detection area)
If the measurement is performed while a person is touching the luggage placed on the mounting surface 16, the measuring instrument 140 will obtain an inaccurate measurement result. For example, if the client puts his / her hand on the luggage, a weight larger than the weight of the luggage is obtained as a measurement result, and if the client is exerting force in the direction of lifting the luggage, the weight is smaller than the weight of the luggage. Is obtained as a measurement result.

Therefore, the home delivery reception system 10 according to the first embodiment of the present invention uses the weight of the package obtained by the measuring instrument 140 as the measurement result while no person is detected near the measurement target area, and uses the measurement result. Identify the parcel delivery size based on.

Specifically, as shown in FIG. 10, the control unit 190 sets the person detection region G including the measurement target region F. The size of the person detection area G is not particularly limited, and for example, the distance b between the outer circumference of the measurement target area F and the outer circumference of the person detection area G may be 100 mm. Then, the control unit 190 does not start measuring the weight and external dimensions when a person is detected in the person detection area G, and does not start measuring the weight and external dimensions when a person is not detected in the person detection area G. The measurement of may be started.

With such a configuration, it becomes possible to obtain a more accurate measurement result of the package. When a person is detected in the person detection area G, the control unit 190 may output a caution message such as "Please move away from the luggage" to the screen of the operation display unit 110 and / or the speaker 120. Good. Such a configuration allows the client to move away from the package and start measuring the package.

(Consideration of carrying part)
For an object whose luggage has a deformable carrying portion such as a carrying bag, it may be desirable to use the measurement result ignoring the carrying portion. Therefore, when the package has a hand-held portion, the home delivery reception system 10 according to the first embodiment of the present invention selectively selects the measurement result of the external dimensions including the hand-carried portion or the measurement result of the external dimensions in which the hand-carried portion is ignored. It can be used for. Hereinafter, this point will be specifically described.

The measuring unit 194 detects whether or not the luggage has a carrying portion. For example, the measuring unit 194 applies a predetermined algorithm to the image of the baggage, uses a determination device obtained by Deep Learning for the image of the baggage, or uses a combination thereof, and determines whether or not the baggage has a carrying portion. May be detected.

The above predetermined algorithm is not particularly limited. For example, a predetermined algorithm counts the number of data in each height range (for example, a range having a height of 5 mm) in the distance image of the luggage, and determines whether or not the change in the number of data exceeds the standard. However, if the change in the number of data has a height exceeding the standard, the algorithm may be used to detect from the upper end of the baggage to the height as a carrying portion.

When the hand-held portion is detected by the measuring unit 194, the display control unit 192 selects whether to display the measurement result of the external dimension including the hand-carried portion or the measurement result of the external dimension in which the hand-held portion is ignored. The measurement result screen including the operation button of is displayed on the operation display unit 110.

FIG. 11 is an explanatory diagram showing a specific example of the measurement result screen 50. As shown in FIG. 11, the measurement result screen 50 includes an RGB image 52 of the luggage, a measurement result 54, a redo button 56, a confirmation button 58, and a “change to carrying bag” button 59. As shown in the RGB image 52 of the luggage, the luggage is a carrying bag, but in the measurement result 54, "box" is displayed as the type.
As the size, the measurement result of the external dimensions of the entire carrying bag including the carrying part is displayed.

The "change to handbag" button 59 is an operation button selected to switch the measurement result 54 to the measurement result of the external dimension in which the handbag portion is ignored. When the "Change to handbag" button 59 is selected, the display control unit 192 causes the operation display unit 110 to display a confirmation screen for confirming whether the handbag portion can be deformed so that the height of the handbag portion is reduced. ..

FIG. 12 is an explanatory diagram showing a specific example of the confirmation screen 60. As shown in FIG. 12, the confirmation screen 60 includes a confirmation message 62 asking "Can the carrying portion be folded?", A "No" button 64, and a "Yes" button 66. When the “No” button 64 is selected, the display control unit 192 causes the operation display unit 110 to display the measurement result screen 50 described with reference to FIG. 11 again. On the other hand, when the "Yes" button 66 is selected, the display control unit 192 causes the operation display unit 110 to display a measurement result screen including the measurement result of the external dimensions in which the hand-held portion is ignored. The confirmation screen 60 shown in FIG. 12 is displayed before the screen of FIG. 11 or 13, and the screen of FIG. 11 or 13 is displayed after the "No" button 64 or the "Yes" button 66 is selected. May be done. Further, the confirmation screen 60 shown in FIG. 12 may be omitted.

FIG. 13 is an explanatory view showing a specific example of the measurement result screen 51 including the measurement result of the external dimensions in which the carrying portion is ignored. As shown in FIG. 13, the measurement result screen 51 includes an RGB image 53 of the luggage, a measurement result 55, a redo button 56, a confirmation button 58, and a “change to box” button 57. When the hand-held portion is detected, the measurement result screen 51 of FIG. 13 may be preferentially displayed instead of the measurement result screen 50 of FIG.

In the measurement result 55, "handbag" is displayed as the type, and the measurement result of the external dimensions in which the handbag portion is ignored is displayed as the size. The "change to box" button 57 is an operation button selected to switch the measurement result 55 to the measurement result of the external dimensions including the carrying portion (measurement result 54 described with reference to FIG. 11).

When the client selects the confirmation button 58 on the measurement result screen 51, the charge calculation unit 196 calculates the home delivery charge based on the measurement result of the external dimensions in which the hand-held portion is ignored, and the settlement process is performed according to the home delivery charge. Be told.

As described above, the home delivery reception system 10 according to the first embodiment of the present invention can automatically detect the hand-carried portion of the package and display the measurement result of the external dimensions in which the hand-carried portion is ignored. Further, even if there is a hand-carrying portion, it is possible to calculate the delivery charge based on an appropriate measurement result by confirming whether or not the hand-carrying portion is deformable.

The address label printed by the label printer 170 may indicate a box, a carrying bag, or the like as the type of luggage. According to such a configuration, the store staff can notice by looking at the address label that the luggage that should be treated as a box is treated as a carrying bag.

(Luggage direction detection)
The measuring unit 194 estimates the measurement direction of the load placed on the mounting surface 16 and measures the length of the load in the measurement direction. Specifically, the measuring unit 194 estimates as the measurement direction the direction of the side of the hexahedron when the hexahedron is arranged so that the volume of the hexahedron circumscribing the load is minimized. The measurement direction may coincide with the width direction, the depth direction, and the height direction of the cargo. Hereinafter, a more specific description will be given with reference to FIG.

FIG. 14 is an explanatory diagram showing an estimation example of the measurement direction of the luggage X. As shown in the left figure of FIG. 14, the measuring unit 194 has a length W in the reference direction L at the initial position of the luggage X, and a length in the direction orthogonal to the reference direction L and the height direction. Measure D, which is the dimension. Then, the measuring unit 194 rotates the image of the luggage X and specifies the rotation position of the luggage X that minimizes the total value of W and D.

For example, as shown in the right figure of FIG. 14, the measuring unit 194 specifies the rotation position of the load from which Wmin, which is the minimum value of W, and Dmin, which is the minimum value of D, are obtained. It is estimated that the width direction of the luggage X coincides with the reference direction L at the rotation position, and the depth direction of the luggage X coincides with the direction D. Therefore, the measuring unit 194 acquires Wmin as the length in the width direction of the luggage X and Dmin as the length in the depth direction of the luggage X.

However, if the camera 130 is installed and calibrated on the assumption that the actual width direction Dr of the luggage X matches the reference direction L, the actual width direction Dr and the reference direction L of the luggage X The larger the angle difference d of, the lower the measurement accuracy of the luggage X.

Therefore, the display control unit 192 causes the operation display unit 110 to display a screen for inducing the rearrangement of the luggage X based on the angle difference d exceeding the threshold value. For example, when the threshold value is 15 degrees and the angle difference d exceeds 15 degrees as shown in FIG. 15, the display control unit 192 may display a screen for guiding the rearrangement of the luggage X on the operation display unit 110. ..

FIG. 16 is an explanatory diagram showing a specific example of the screen 70 for inducing the rearrangement of the luggage. As shown in FIG. 16, the screen 70 includes a guidance message 71 saying "Please put the luggage straight back", an RGB image 72 of the luggage, and a confirmation button 74. Further, the speaker 120 may also output a voice guidance such as "Please put your luggage straight back." The client rearranges the luggage X according to the screen 70, voice guidance, and the like, and selects the confirmation button 74. As a result, the baggage is remeasured.

However, when the shape of the luggage is a cylindrical shape, the concept of the angle difference d described above is not familiar because the luggage does not have a linear side to be compared with the reference direction L. Therefore, when the shape of the luggage is cylindrical, the display control unit 192 does not have to display the screen for guiding the rearrangement of the luggage on the operation display unit 110.

The method by which the measuring unit 194 determines the shape of the cargo is not particularly limited. For example, the measuring unit 194 converts the image of the baggage obtained by the camera 130 into a plan view image of the baggage, detects the contour of the baggage in the plan view image, and applies a circular detection function within the range of the contour. Therefore, it may be determined whether or not the luggage has a cylindrical shape. According to such a configuration, when there is a cylindrical object in addition to the luggage, it is possible to prevent the luggage from being erroneously determined to have a cylindrical shape due to the existence of the cylindrical object.

The above-mentioned operation related to the direction detection of the load is organized as described below with reference to FIG.

FIG. 17 is a flowchart showing an operation related to the direction detection of the luggage. First, the measuring unit 194 estimates the angle difference between the actual width direction and the reference direction of the luggage by analyzing the image of the luggage obtained by the camera 130 (S304). Then, when the angle difference exceeds the threshold value (S308 / Yes), the measuring unit 194 determines the shape of the load (S312).

Then, when the shape of the luggage is not cylindrical (S316 / No), the display control unit 192 causes the operation display unit 110 to display a screen for guiding the rearrangement of the luggage (S320). On the other hand, when the shape of the luggage is a cylinder (S320 / Yes), the display control unit 192 does not display the screen for guiding the rearrangement of the luggage on the operation display unit 110.

Although the above shows an example in which the shape determination is performed after the angle difference is estimated, the angle difference may be estimated after the shape determination. For example, the measuring unit 194 estimates the angle difference when it is determined in the shape determination that the shape of the load is not a cylindrical shape, and when the angle difference exceeds the threshold value, the display control unit 192 places the load on the operation display unit 110. A screen for guiding the repair may be displayed. On the other hand, the measuring unit 194 does not have to estimate the angle difference when it is determined in the shape determination that the shape of the load is a cylindrical shape.

As described above, according to the home delivery reception system 10 according to the first embodiment of the present invention, the measurement direction of the package is estimated and the external dimensions of the package are measured without using the housing forming the storage chamber. Therefore, there is a high degree of freedom regarding the installation location of the home delivery reception system 10.

(Display of measurement result screen)
As described above, the display control unit 192 causes the operation display unit 110 to display the measurement result screen showing the measurement result of the baggage when the measurement of the baggage is completed. However, the package measurement result may differ from the client's expectation. Therefore, in order to make it easier for the client to be satisfied with the measurement result, the display control unit 192 is sized so as to be aligned with the image of the luggage or superimposed on the image of the luggage on the measurement result screen. An image of a predetermined object may be arranged as a comparison target.

FIG. 18 is an explanatory diagram showing a specific example of the measurement result screen 80. As shown in FIG. 18, the measurement result screen 80 includes an RGB image 82 of the luggage, a measurement result 84, a redo button 86, a confirmation button 88, and a PET bottle image 89. The PET bottle image 89 is an example of an image of a predetermined object, and is an image of a PET bottle corresponding to 500 ml. In FIG. 18, two PET bottle images 89 are arranged side by side in the height direction. As a result, the client can grasp that the height of the luggage is roughly equivalent to two PET bottles. Similarly, the display control unit 192 may arrange the PET bottle images 89 in the width direction or the depth direction.

With such a configuration, the client can intuitively grasp the size of the package and easily understand the measurement result. In the above, the PET bottle is illustrated as a predetermined object, but the predetermined object is not limited to the PET bottle. It is desirable that the predetermined object is an object whose size is generally recognized in common, and may be, for example, a tissue box.

<< 2. Second embodiment >>
The home delivery reception system 10 according to the first embodiment of the present invention has been described above. Subsequently, the home delivery reception system 12 according to the second embodiment of the present invention will be described. The home delivery reception system 10 according to the first embodiment of the present invention and the home delivery reception system 12 according to the second embodiment of the present invention mainly differ in the configuration for imaging a package.

FIG. 19 is an external view of the home delivery reception system 12 according to the second embodiment. As shown in FIG. 19, the home delivery reception system 12 according to the second embodiment includes a measuring instrument 140, a cash processing unit 150, a code reader 160, a label printer 170, a receipt printer 180, and a tablet terminal 30. The measuring instrument 140, the cash processing unit 150, the code reader 160, the label printer 170, and the receipt printer 180 are wirelessly connected to the tablet terminal 30 and operate according to a control signal from the tablet terminal 30. The specific functions of the measuring instrument 140, the cash processing unit 150, the code reader 160, the label printer 170, and the receipt printer 180 are as described in the first embodiment.

The tablet terminal 30 is an example of a mobile terminal that is gripped and used by a user, and has a function as a dimension measuring device for measuring the external dimensions of a package. Hereinafter, the functions of the tablet terminal 30 will be described more specifically with reference to FIG.

FIG. 20 is an explanatory diagram showing the configuration of the tablet terminal 30. As shown in FIG. 20, the tablet terminal 30 includes an operation display unit 310, a speaker 320, a camera 330, a communication unit 340, and a control unit 390. The functions of the operation display unit 310, the speaker 320, and the camera 330 are substantially the same as the functions of the operation display unit 110, the speaker 120, and the camera 130 described in the first embodiment.

The communication unit 340 communicates various information with the measuring instrument 140, the cash processing unit 150, the code reader 160, the label printer 170, the receipt printer 180, and the like. For example, the communication unit 340 transmits a measurement instruction to the measuring instrument 140 and receives the weight measurement result from the measuring instrument 140. The weight measurement result obtained by the measuring instrument 140 may be manually input to the operation display unit 310 by the client. Alternatively, when the weight measurement result obtained by the measuring instrument 140 is displayed, the camera 330 acquires an image including the display and recognizes the display portion of the measurement result in the image to acquire the weight measurement result. May be done. In addition, the communication unit 340 transmits a control signal including a delivery charge to the cash processing unit 150. Further, the communication unit 340 receives the information read from the code by the code reader 160. Further, the communication unit 340 transmits information for printing the mailing label to the label printer 170. Such a communication unit 340 may be connected by wire to each configuration such as a measuring instrument 140, a cash processing unit 150, a code reader 160, a label printer 170, and a receipt printer 180.

The control unit 390 controls the overall operation of the tablet terminal 30. In particular, the control unit 390 has the functions of the display control unit 392, the measurement unit 394, and the charge calculation unit 396, as shown in FIG. The functions of the display control unit 392, the measurement unit 394, and the charge calculation unit 396 are common to the functions of the display control unit 192, the measurement unit 194, and the charge calculation unit 196 described in the first embodiment. Then, the functions not described in the first embodiment will be mainly described.

The measuring unit 394 detects the mounting surface 16 from the image of the load obtained by the camera 330, estimates the measurement directions such as the width direction, the depth direction, and the height direction of the load, and the length of the load in each measurement direction. Measure the size.

Here, since the camera 330 is provided on the tablet terminal 30, the imaging range of the camera 330 changes according to the position and orientation of the tablet terminal 30 and the like. Therefore, as shown in FIG. 21, it is possible that the image obtained by the camera 330 includes an image of a person. Targeting an image containing a human image in this way as a measurement target may raise concerns from the viewpoint of protecting privacy.

Therefore, the measuring unit 394 does not start measuring the external dimensions of the luggage when a person is detected in the image obtained by the camera 330. At this time, when a person is detected in the image obtained by the camera 330, the display control unit 392 guides the guide screen 90 to prevent the person from entering the angle of view of the camera 330, for example, as shown in FIG. May be displayed on the operation display unit 310. With such a configuration, it is possible to enhance the protection of privacy.

Alternatively, when a person is detected in the image obtained by the camera 330, the measuring unit 394 masks the area M in which the person is detected, as shown in FIG. 23, and then determines the external dimensions of the luggage. May be measured. It is possible to enhance the protection of privacy even with such a configuration.

In addition, also in the second embodiment, consideration of the hand-held portion described in the first embodiment, display of the measurement result screen, and the like can be applied.

<< 3. Third Embodiment >>
The home delivery reception system 12 according to the second embodiment of the present invention has been described above. Subsequently, the home delivery reception system 13 according to the third embodiment of the present invention will be described. The home delivery reception system 13 according to the third embodiment is different from the first embodiment in that it mainly does not have a measuring instrument.

FIG. 24 is an explanatory diagram showing the configuration of the home delivery reception system 13 according to the third embodiment. As shown in FIG. 24, the home delivery reception system 13 according to the third embodiment includes an operation display unit 110, a speaker 120, a camera 130, a cash processing unit 150, a code reader 160, a label printer 170, a receipt printer 180, and a control unit. 191 is provided. The functions of the operation display unit 110, the speaker 120, the camera 130, the cash processing unit 150, the code reader 160, the label printer 170, and the receipt printer 180 are as described in the first embodiment.

The control unit 191 controls the overall operation of the delivery reception system 13. In particular, the control unit 191 has the functions of the display control unit 193, the measurement unit 195, and the charge calculation unit 197, as shown in FIG. 24. The functions of the display control unit 193, the measurement unit 195, and the charge calculation unit 197 are common to the functions of the display control unit 192, the measurement unit 194, and the charge calculation unit 196 described in the first embodiment. Then, the functions not described in the first embodiment will be mainly described.

If the luggage is a golf bag, the fee structure for the golf bag will be applied. The charge system for golf bags is different from the charge system for general luggage. Therefore, the home delivery reception system 13 determines whether or not the package is a golf bag. The method of the determination is not particularly limited. For example, the measuring unit 195 may specify the shape of the luggage based on the image of the luggage obtained by the camera 130, and may determine that the luggage is a golf bag when the shape of the luggage is the shape of a golf bag. .. Alternatively, the measuring unit 195 may determine that the luggage is a golf bag when the special cover specified by the golf equipment courier is used in the image of the luggage obtained by the camera 130. Alternatively, when the client inputs whether or not the luggage is a golf bag on the operation display unit 110, it is possible to determine whether or not the luggage is a golf bag based on the input. In addition, there may be a second charge system other than the above-mentioned golf bag charge system, and in the second charge system, the parcel delivered to the home may not be weighed like the above-mentioned golf bag charge system, or the first The delivery charge may be calculated after the parcel to be delivered is weighed by the measuring instrument 140 described in the first or second embodiment.

When it is determined that the luggage is a golf bag, the charge calculation unit 197 calculates the home delivery charge for the golf bag according to the charge system for the golf bag. Here, in the charge system for golf bags, the charge is defined according to the external dimensions of the golf bag regardless of the weight. Therefore, even if the home delivery reception system 13 does not have a measuring instrument, the charge calculation unit 197 can calculate the home delivery charge for the golf bag.

In addition, also in the third embodiment, the adjustment of the angle of view, the calibration, the guidance of the placement, the consideration of the carrying portion, the direction detection of the luggage, the display of the measurement result screen, and the like described in the first embodiment are applied. It is possible. Further, the technique described in the third embodiment can also be realized in a configuration using the tablet terminal 30 as in the second embodiment.

<< 4. Supplement >>
Although the preferred embodiments of the present invention have been described in detail with reference to the accompanying drawings, the present invention is not limited to such examples. It is clear that a person having ordinary knowledge in the field of technology to which the present invention belongs can come up with various modifications or modifications within the scope of the technical idea described in the claims. , These are also naturally understood to belong to the technical scope of the present invention.

For example, each step in the processing of the home delivery reception system 10 of the present specification does not necessarily have to be processed in chronological order in the order described as a flowchart. For example, each step in the processing of the home delivery reception system 10 may be processed in an order different from the order described in the flowchart, or may be processed in parallel.

Further, it is possible to create a computer program for causing the hardware such as the CPU, ROM, and RAM mounted on the home delivery reception system 10 to exhibit the same functions as each configuration of the home delivery reception system 10 described above. A storage medium for storing the computer program is also provided.

Further, in the first and second embodiments, the case where the measuring instrument 140 is configured has been described as an example, but the present invention is not limited to such an example, and the measuring instrument 140 may not be configured. In such a case, the delivery charge can be calculated, for example, by the client weighing in advance, providing a separate measuring instrument on the store side, or calculating the charge based on the size of the package.

Further, a part of each component of the first to third embodiments may be replaced with a part of each component of another embodiment.

10, 12, 13 Home delivery reception system 110 Operation display unit 120 Speaker 130 Camera 134 Projector 140 Weighing instrument 150 Cash processing unit 160 Code reader 170 Label printer 180 Receipt printer 186 Speaker 190, 191 Control unit 192, 193 Display control unit 194, 195 Measuring unit 196, 197 Charge calculation unit 14 Adjustment sheet 15 Marking member 16 Placement surface 20 Installation equipment 210 First member 212 Base surface 212a Hole 214 Side surface 214a Hole 216 Side surface 220 Second member 222 Scale 230 Third member 230a Hole 30 Tablet terminal 310 Operation display unit 320 Speaker 330 Camera 340 Communication unit 390 Control unit 392 Display control unit 394 Measurement unit 396 Charge calculation unit

Claims (18)

An imaging unit that captures an image of an object and acquires an image of the object,
A measuring unit that measures the external dimensions of the object based on the image of the object,
With
The measuring unit estimates the measuring direction orthogonal to the height direction of the object by analyzing the image of the object, and measures the external dimensions of the object including the dimensions in the measuring direction of the object. system. The dimension measurement system according to claim 1, further comprising a charge calculation unit that calculates a charge required for home delivery of the object based on the measurement result by the measurement unit. The dimensional measurement system
Display and
A display control unit that displays a screen that guides the repositioning of an object on the display unit based on the angle difference between the measurement direction and the reference direction estimated by the measurement unit that exceeds the threshold value.
2. The dimensional measurement system according to claim 2. The measuring unit further estimates the shape of the object and
The dimension measurement system according to claim 3, wherein the display control unit does not display a screen for inducing the rearrangement of the object on the display unit when the shape of the object estimated by the measurement unit is a cylindrical shape. .. The measurement direction according to any one of claims 1 to 4, wherein the measurement direction is the direction of the side of the hexahedron when the hexahedron is arranged so that the volume of the hexahedron circumscribing the object is minimized. Dimension measurement system. The dimension measurement system according to any one of claims 1 to 5, wherein the measuring unit does not start measuring the external dimensions of the object when a person is detected in the image of the object. According to claims 1 to 5, when a person is detected in the image of the object, the measuring unit measures the external dimensions of the object after masking the area where the person is detected. The dimensional measurement system according to any one item. The dimensional measurement system further comprises a measuring instrument for measuring the weight of the object.
The charge calculation unit determines the delivery size of the object based on the weight of the object measured by the measuring instrument while no person is detected in the person detection area including the measurement target area on which the object is placed. The dimensional measurement system according to any one of claims 1 to 5, which is specified. The dimensional measurement system
Display and
A display control unit for displaying a measurement result screen showing the measurement result of the external dimensions of the object on the display unit is further provided.
When the object has a hand-carrying portion, the measuring unit detects the hand-carrying portion and detects the hand-carrying portion.
When the hand-carrying portion is detected, the display control unit either measures the external dimension including the hand-carrying portion or the external dimension measurement result of the object in which the hand-carrying portion is ignored on the measurement result screen. The dimension measurement system according to claim 1 or 2, wherein an operation button for selecting whether to display is displayed on the display unit. When the display control unit is selected to display the measurement result of the external dimensions of the object in which the hand-carrying portion is ignored, the hand-carrying portion can be deformed so that the height of the hand-carrying portion is reduced. A claim for displaying a confirmation screen for confirming whether or not the object is displayed on the display unit, and after the confirmation operation is performed on the confirmation screen, the display unit displays the measurement result of the external dimensions of the object in which the carrying portion is ignored. The dimensional measurement system according to 4. The measurement result screen includes an image of the object.
The dimension measurement system according to claim 9, wherein the display control unit arranges an image of a predetermined object so as to be aligned with the image of the object or superimposed on the image of the object. The measuring unit determines whether or not the object is a golf bag, and determines whether or not the object is a golf bag.
The dimension measurement system according to claim 2, wherein the charge calculation unit calculates a charge required for home delivery of the object according to a different charge system depending on a determination result of whether or not the object is a golf bag. The dimensional measurement system further includes an installation instrument that attaches the imaging unit to the installation surface.
The dimensional measurement system according to any one of claims 1 to 12, wherein the installation device forms a rotation axis along one direction or two or more different directions. The dimensional measurement system according to claim 13, wherein the installation device has a drive unit that rotates the image pickup unit around the rotation axis. The dimension measurement system according to any one of claims 1 to 14, further comprising a projector that forms an optical image in a region where the object is to be placed. The dimensional measurement system according to any one of claims 1 to 15, wherein the imaging unit is provided on a mobile terminal that is gripped and used by a user. A dimension measuring device including a measuring unit that estimates a measuring direction orthogonal to the height direction of the object by analyzing an image of the object and measures the external dimensions of the object including the dimensions in the measuring direction of the object. To take an image of an object and acquire an image of the object,
By analyzing the image of the object, the measurement direction orthogonal to the height direction of the object can be estimated.
To measure the external dimensions of the object, including the dimensions in the measurement direction of the object,
Dimensional measurement methods, including.

Images