JP6048575B2 - Size measuring apparatus and size measuring method - Google Patents

Description

  The present invention relates to a technique for measuring the size of a measurement object using a target image in which the measurement object is reflected.

  In a parcel delivery service such as a parcel delivery service, a delivery fee is determined by the size and weight of the parcel. In general, the size and weight of such luggage are manually measured using a scale, a measure, or the like. Therefore, in the following Patent Document 1 and Patent Document 2, a method for reducing the labor for measuring the size of the luggage is proposed.

  In Patent Document 1 below, a marker having a known pattern is placed on the side surface of the measurement object, and the marker pattern is read by a CCD line sensor arranged on the other side surface of the measurement object. A method for measuring one side of a measurement object corresponding to the distance to the CCD line sensor is proposed. In this technique, the measurement is performed with respect to the height, width, and depth of the measurement object, whereby the dimension of the measurement object is measured.

  In Patent Document 2 below, a marker indicating a known length (indicated as a reference scale) is placed on the surface of the measurement object, and two or more surfaces of the measurement object including the marker are captured. In this way, a method for calculating the dimension of each side of the measurement object based on the image obtained by photographing is proposed.

JP 2002-286420 A JP 2010-8352 A

  However, in each of the proposed methods described above, it is necessary to prepare a marker for dimension measurement separately from the measurement object. Therefore, according to each of the proposed methods described above, at least labor for preparing the marker and arranging or printing the marker on the measurement object is required.

  This invention is made | formed in view of such a situation, and is providing the technique which reduces the measurement effort of the size of a measuring object.

  Each aspect of the present invention employs the following configurations in order to solve the above-described problems.

The first aspect relates to a size measuring device. The size measurement device according to the first aspect includes an image acquisition unit that acquires a target image in which a measurement object is captured, a reference point, three auxiliary points that are positioned on three axes that are orthogonal to each other at the reference point, and A virtual measurement marker including three reference lines having the same length in real space respectively arranged on three axes, and each length between the reference point and the three auxiliary points is measured in the target image. A first reference that connects the display processing unit that is displayed on the display unit so as to be superimposed on the target image, and the reference point and the first auxiliary point among the three auxiliary points so as to correspond to the lengths on the three axes of the object. A reference setting unit that acquires the length of the side in real space as the reference length of the virtual measurement marker, and calculates the length of the target image related to the virtual measurement marker superimposed on the target image on the image plane as the virtual length of the virtual measurement marker Acquired by the image information calculation unit and the reference setting unit From the relationship between the reference length of the virtual measurement marker and the virtual length of the virtual measurement marker calculated by the image information calculation unit, two second auxiliary points other than the first auxiliary point among the three auxiliary points and the reference point A real value calculation unit for calculating the length of two second reference sides in the real space, a reference length of the virtual measurement marker acquired by the reference setting unit, and two second values calculated by the real value calculation unit An output processing unit that outputs the length of the reference side in the real space as size information of the measurement object, and an operation of acquiring operation information of the virtual measurement marker corresponding to a user operation on the three reference lines included in the virtual measurement marker An information acquisition unit; and a marker adjustment unit that rotates three reference lines based on operation information of the virtual measurement marker . The image information calculation unit calculates the virtual length of the virtual measurement marker that has been rotated by the marker adjustment unit.

The second aspect relates to a sizing method performed by at least one computer. In the size measurement method according to the second aspect, a target image in which a measurement object is captured is obtained, a reference point, three auxiliary points positioned on three axes orthogonal to each other at the reference point, and the three axes. A virtual measurement marker including three reference lines having the same length in each real space arranged, and each length between the reference point and the three auxiliary points is 3 of the measurement object in the target image. The length in the real space of the first reference side connecting the reference point and the first auxiliary point among the three auxiliary points is displayed on the display unit so as to correspond to each length on the axis. Obtained as the reference length of the virtual measurement marker, calculates the length of the target image on the image plane related to the virtual measurement marker superimposed on the target image as the virtual length of the virtual measurement marker, and calculates the reference length of the virtual measurement marker and the virtual measurement marker The first complement of the three auxiliary points The length in the real space of the two second reference sides connecting the two second auxiliary points other than the point and the reference point is calculated, and the reference length of the virtual measurement marker and the length in the real space of the two second reference sides Output as size information of the measurement object. Furthermore, the size measurement method according to the second aspect acquires virtual measurement marker operation information corresponding to a user operation with respect to three reference lines included in the virtual measurement marker, and based on the virtual measurement marker operation information, 3 And rotating a reference line to calculate a virtual length of a virtual measurement marker on which the three reference lines have been rotated.

  Another aspect of the present invention may be a program that causes at least one computer to execute the method of the second aspect, or a computer-readable recording medium that records such a program. May be. This recording medium includes a non-transitory tangible medium.

  According to each said aspect, the technique which reduces the measurement effort of the size of a measurement object can be provided.

  The above-described object and other objects, features, and advantages will become more apparent from the preferred embodiments described below and the accompanying drawings.

It is a figure which shows notionally the structural example of the size measuring apparatus which concerns on 1st Embodiment. It is a figure which shows the example of the superimposition display of a virtual measurement marker and a target image. It is a figure which shows the other example of the superimposed display of a virtual measurement marker and a target image. It is a figure which shows notionally the structural example of the home delivery service system in 2nd Embodiment. It is a figure which shows notionally the process structural example of a portable information terminal in 2nd Embodiment. It is a figure which shows the example of calculation of the reference length of a virtual measurement marker. It is a figure which shows the example of calculation of the reference length of a virtual measurement marker. It is a sequence chart which shows the operation example of the portable information terminal in 1st Embodiment.

  Embodiments of the present invention will be described below. In addition, each embodiment given below is an illustration, respectively, and this invention is not limited to the structure of each following embodiment.

[First Embodiment]
FIG. 1 is a diagram conceptually illustrating a configuration example of a size measuring apparatus 100 according to the first embodiment. As shown in FIG. 1, the size measurement apparatus 100 includes an image acquisition unit 101 that acquires a target image in which a measurement target is captured, a display processing unit 102 that displays a virtual measurement marker on the display unit so as to overlap the target image. A reference setting unit 103 that acquires, as a reference length, the length of the first reference side in the real space of the virtual measurement marker, an image information calculation unit 104 that calculates a virtual length of the virtual measurement marker superimposed on the target image, From the relationship between the reference length of the virtual measurement marker acquired by the reference setting unit 103 and the virtual length of the virtual measurement marker calculated by the image information calculation unit 104, in the real space of the two second reference sides of the virtual measurement marker An actual value calculation unit 105 that calculates the length, a reference length of the virtual measurement marker acquired by the reference setting unit 103, and the two second reference sides calculated by the actual value calculation unit 105 A length in space, has an output processing section 106 to output as the size information of the measurement object, the.

  The size measuring apparatus 100 is a so-called computer, and may have a hardware configuration similar to that of the portable information terminal 10 in the second embodiment to be described later. Thereby, the above-described processing units are realized by processing the program in the same manner as the portable information terminal 10 described later. However, the size measuring apparatus 100 may not have the touch sensor 5, the communication module 6, the tilt sensor 7, and the camera module 8 that the portable information terminal 10 has. The size measuring apparatus 100 may acquire the target image from another computer.

  The size measuring method according to the first embodiment is executed by at least one computer such as the size measuring apparatus 100 described above. In this size measurement method, a target image in which a measurement object is captured is acquired, a virtual measurement marker is superimposed on the target image and displayed on the display unit, and the length of the first reference side of the virtual measurement marker in the real space is set as a reference length. And the virtual length of the virtual measurement marker superimposed on the target image is calculated. From the relationship between the reference length of the virtual measurement marker and the virtual length of the virtual measurement marker, two second reference sides of the virtual measurement marker are calculated. And calculating the reference length of the virtual measurement marker and the lengths of the two second reference sides in the real space as the size information of the measurement object. However, the steps included in this size measurement method may be executed sequentially in random order or may be executed simultaneously.

  Here, the virtual measurement marker does not actually exist as an object, but is an image that virtually exists only in the target image, and is located on three axes orthogonal to each other at the reference point and the reference point. Including two auxiliary points and three reference lines having the same length in the real space respectively arranged on the three axes. The first reference side of the virtual measurement marker is a side connecting the reference point and the first auxiliary point among the three auxiliary points, and the two second reference sides of the virtual measurement marker are the three auxiliary points. These are two sides connecting the two second auxiliary points other than the middle first auxiliary point and the reference point.

  The calculated virtual length of the virtual measurement marker is the length of the target image on the image plane regarding the virtual measurement marker superimposed on the target image. On the other hand, the length of the virtual measurement marker in the real space is the size of the measurement object actually existing in the real space (real world) and the size of the measurement object in the image plane of the target image. This is the size of the virtual measurement marker in the real space when it is assumed that the virtual measurement marker is present in the real space.

  [Operation and Effect in First Embodiment]

  In the first embodiment, an object image in which a measurement object existing in the real space (real world) is captured and a virtual measurement marker that does not exist in the real space are each of the lengths between the reference point and the three auxiliary points. The images are superimposed and displayed so as to correspond to the respective lengths on the three axes of the measurement object in the image. Thereby, the size of the measurement object can be acquired by calculating each length in the real space between the reference point and the three auxiliary points in the virtual measurement marker.

  As described above, the length (distance) handled in the first embodiment includes the length (distance) in the image plane of the target image on which the measurement target is reflected and the virtual measurement marker is superimposed, and the measurement target is actually Exist in the real world (real space). In the first embodiment, the length of the target image in the image plane is converted into the length in the real world. Note that a known method used in augmented reality (AR) or the like may be used for the superimposed display of the target image and the virtual measurement marker.

  FIG. 2 is a diagram illustrating an example of superimposed display of the virtual measurement marker and the target image. In the example of FIG. 2, the measurement object OB has a rectangular parallelepiped shape. In the case of the example of FIG. 2, in the first embodiment, the reference point MB, the first auxiliary point MS1, the second auxiliary point MS2, and MS3 are at the four vertices of the measurement object to indicate the size of the measurement object. Be placed. Thus, the side connecting the reference point MB and the first auxiliary point MS1 becomes the first reference side BS1, the side connecting the reference point MB and the second auxiliary point MS2 becomes the second reference side BS2, and the reference point MB and the first auxiliary point MS1 The side connecting the two auxiliary points MS3 is the second reference side BS3. In FIG. 2, since the first reference side and the two second reference sides coincide with the sides of the measurement object OB, BS1, BS2 and BS3 are indicated by broken lines of the curve from the viewpoint of visibility. . In FIG. 2, the three reference lines are denoted by BL1, BL2, and BL3.

  1st Embodiment does not restrict | limit the shape of the measuring object OB to a rectangular parallelepiped shape. When the measurement object OB is not a rectangular parallelepiped shape, the virtual measurement marker indicates that the lengths of the first reference side BS1, the second reference side BS2, and BS3 correspond to the lengths on the three axes of the measurement object OB in the target image. As long as they are arranged in a superimposed manner.

  FIG. 3 is a diagram illustrating another example of the superimposed display of the virtual measurement marker and the target image. In the example of FIG. 3, the shape of the measurement object OB is not a rectangular parallelepiped shape. Also in the example of FIG. 3, the reference point MB, the first auxiliary point MS1, and the first reference line BL1 are arranged so that the first reference side BS1 indicates the height of the measurement object OB, and the second reference side BS2 and The second auxiliary points MS2 and MS3 and the second reference lines BL2 and BL3 may be arranged so that BS3 indicates the other two sides (width and depth) of the measurement object OB.

  In the first embodiment, the length in the image plane of the target image related to the virtual measurement marker superimposed on the target image is calculated as the virtual length. The virtual length of the virtual measurement marker indicates, for example, the length in the image plane of the target image of the first reference side, the two second reference sides, and the three reference lines. The virtual length of the virtual measurement marker can be calculated based on the number of pixels and the resolution of the target image. For example, the length of the first reference side in the image plane can be calculated based on the number of pixels indicating the length of the first reference side in the image plane and the size per pixel obtained from the resolution.

  On the other hand, the length in the real space of the first reference side of the virtual measurement marker is acquired as the reference length. Since the target image and the virtual measurement marker are superimposed so that the lengths between the reference point and the three auxiliary points correspond to the lengths on the three axes of the measurement target in the target image, The reference side is associated with one side of the measurement object. Therefore, the length of one side of the measurement object may be measured, and the measured side length may be acquired as the length of the first reference side in real space. Here, one side of the measurement object is a side of the measurement object itself when the measurement object has a rectangular parallelepiped shape, and when the measurement object does not have a rectangular parallelepiped shape, the size of the measurement object is A virtual edge that is drawn to measure.

  It is desirable that the length of one side of the measurement object in the real space is automatically measured in order to reduce the measurement effort. Various methods are conceivable for such an automatic measurement method. For example, the length of one side of the measurement object in real space can be calculated from the height and angle of the camera when the measurement object is photographed. In addition, an actual measurement marker that is arranged on the surface of the measurement object or that appears in the object image together with the measurement object and that indicates a known length in the real world is used to measure the actuality of one side of the measurement object. The length in space can also be calculated. However, the length of one side of the measurement object in the real space may be directly input by the user by being measured by the user using a measure or the like.

  In the first embodiment, from the relationship between the acquired reference length of the virtual measurement marker and the calculated virtual length of the virtual measurement marker, two second references other than the first reference side indicating the reference length of the virtual measurement marker. The length of the edge in real space is calculated. Then, the length in the real space of the first reference side indicating the reference length of the virtual measurement marker and the calculated length in the real space of the two second reference sides are output as size information of the measurement object. The size information may be displayed and output on the display unit, may be printed and output by a printing apparatus, may be output as a file, and may be transmitted to another apparatus. The first embodiment does not limit the output form of size information.

  As described above, according to the first embodiment, the size of the measurement object can be measured using only the virtual measurement marker without using the actual measurement marker. Thereby, in 1st Embodiment, the effort which prepares a real measurement marker and arranges or prints the real measurement marker on a measurement object does not start. Therefore, according to 1st Embodiment, the measurement effort of the size of a measuring object can be reduced. However, the first embodiment does not exclude the use of the actual measurement marker in order to measure the reference length of the virtual measurement marker, that is, the length of one side of the measurement object in the real space. .

  Furthermore, according to the first embodiment, since the size of the measurement object is measured by the length between the reference point and the three auxiliary points in the virtual measurement marker superimposed on the target image, measurement of all shapes is possible. The size of the object can be measured. However, the measurement object having a rectangular parallelepiped (including a cube) shape can measure the size more accurately than the measurement object having other shapes. This is because a virtual measurement marker having a form in which three auxiliary points are orthogonal to each other at the reference point is used.

[Second Embodiment]
Hereinafter, a specific example when the configuration of the size measuring apparatus 100 and the size measuring method in the first embodiment described above are applied to a home delivery service system will be described as a second embodiment. Of course, the above-described embodiment is not limited to application to the size measurement of a package in a home delivery service, and can be applied to any form for measuring the size of an object existing in the real world.

〔System configuration〕
FIG. 4 is a diagram conceptually illustrating a configuration example of the home delivery service system 1 in the second embodiment. The home delivery service system 1 according to the second embodiment includes a portable information terminal 10, a home delivery server 50, and the like. The portable information terminal 10 and the home delivery server 50 are communicably connected via the communication network 9. From the portability of the portable information terminal 10, it is desirable that the communication network 9 includes a wireless communication network. However, the communication network 9 may include other communication forms such as a public network such as the Internet, a wide area network (WAN), and a local area network (LAN). In 2nd Embodiment, the communication form between the portable information terminal 10 and the delivery server 50 is not limited.

  The portable information terminal 10 is a so-called computer, for example, a CPU (Central Processing Unit) 2, a memory 3, a display module 4, a touch sensor 5, a communication module 6, a tilt sensor 7, and a camera that are connected to each other via a bus or the like. Module 8 etc. are provided. The portable information terminal 10 corresponds to the size measuring apparatus 100 in the first embodiment described above, and is used, for example, by a user such as a service person or a person in charge of transportation who receives a package delivery request from a customer.

  The memory 3 is a RAM (Random Access Memory), a ROM (Read Only Memory), or an auxiliary storage device (such as a hard disk). The display module 4 includes a monitor such as an LCD (Liquid Crystal Display) or a CRT (Cathode Ray Tube) display, and performs display processing. The touch sensor 5 receives an input from the user by sensing an external contact. The display module 4 and the touch sensor 5 can be realized as a touch panel unit. However, the portable information terminal 10 may have an input / output interface (not shown) connected to an input device such as a mouse or a keyboard together with the touch sensor 5 or instead of the touch sensor 5.

  The communication module 6 performs wireless communication or wired communication, and exchanges information with the home delivery server 50 via the communication network 9. The tilt sensor 7 is a device that detects the tilt of the portable information terminal 10, and is realized by, for example, an acceleration sensor, a geomagnetic sensor, or the like. The camera module 8 captures a captured image by capturing a package as a measurement object and a delivery slip attached to the package.

The home delivery server 50 is a so-called server computer and manages package information, delivery information, and the like sent from a plurality of portable information terminals 10.
However, the second embodiment does not limit the hardware configuration of the portable information terminal 10 and the home delivery server 50.

[Processing configuration]
FIG. 5 is a diagram conceptually illustrating a processing configuration example of the portable information terminal 10 in the second embodiment. In the second embodiment, the portable information terminal 10 includes an image acquisition unit 11, an image holding unit 12, a display processing unit 13, an operation information acquisition unit 14, a marker adjustment unit 15, a reference setting unit 16, an image information calculation unit 17, an actual value. A calculation unit 18, an output processing unit 19, an identification information acquisition unit 21, a transmission unit 22, and the like are included. Each of these processing units is realized, for example, by executing a program stored in the memory 3 by the CPU 2. In addition, the program may be installed from a portable recording medium such as a CD (Compact Disc) or a memory card or another computer on the network and stored in the memory 3.

  The image acquisition unit 11 acquires from the camera module 8 a target image in which a package as a measurement target is shown. The user directs the imaging lens of the camera module 8 to the luggage, thereby causing the camera module 8 to capture a target image in which the luggage is captured. The image acquisition unit 11 causes the image holding unit 12 to hold the acquired image data of the target image. For example, the retention timing of the image data is when a user's predetermined operation is detected.

  The image holding unit 12 holds image data of a target image in which a package is shown. The image data is held as a file in a format such as GIF (Graphics Interchange Format), JPEG (Joint Photographic Experts Group), or PNG (Portable Network Graphics).

  Similar to the first embodiment, the display processing unit 13 causes the virtual measurement marker to be superimposed on the target image acquired by the image acquisition unit 11 and displayed on the monitor of the display module 4. Various methods can be adopted as a method for superimposing the virtual measurement marker and the target image by the display processing unit 13.

  For example, the display processing unit 13 causes the reference point of the virtual measurement marker to be fixedly displayed at a predetermined position (preferably the center) of the display frame for displaying the captured image obtained from the camera module 8, and allows the user to display the reference point and the reference point. You may make it perform operation which shows alignment with the one vertex of the package | bag shown in a captured image (target image), and completion of alignment. In this case, the image acquisition unit 11 holds the image data of the target image in the image holding unit 12 at a timing according to the user operation indicating completion of the alignment, and the display processing unit 13 is held in the image holding unit 12. By performing image recognition on the image data, the superimposed position of the virtual measurement marker on the target image is determined.

  Specifically, the display processing unit 13 recognizes three vertices other than the vertices aligned with the reference point of the virtual measurement marker in the luggage shown in the target image, and the virtual measurement marker 3 is displayed on the three vertices. One auxiliary point is arranged, and three reference lines are arranged based on the three auxiliary points arranged and the reference point. However, the display processing unit 13 may recognize one or two vertices by image recognition, and may arrange at least one auxiliary point of the virtual measurement marker at the recognized at least one vertex. The image recognition of each vertex can be clearly realized by various well-known methods such as recognizing the boundary between each side of the luggage extending from the vertex matched with the reference point and the background. Since the three reference lines are orthogonal to each other and have the same length in real space, the display processing unit 13 performs image data corresponding to the rotation angles of the three reference lines in the image plane of the target image ( Data indicating the direction and length of each reference line) can also be stored in advance. In this case, the display processing unit 13 may determine the rotation angles of the three reference lines so that each reference line is arranged on a straight line connecting the reference point and each auxiliary point.

  As another method, the display processing unit 13 sets a reference point and a first auxiliary point at a location that forms the height or width of the luggage shown in the target image, which is calculated by the reference setting unit 16 described later. You may make it arrange | position the 1st reference | standard edge of the virtual measurement marker to connect, and one of three reference lines. In this case, the display processing unit 13 may arrange two auxiliary points other than the first auxiliary point by image recognition. However, the display processing unit 13 may arrange three auxiliary points at the positions indicated by the operation information of the virtual measurement marker acquired by the operation information acquisition unit 14 described later.

  The operation information acquisition unit 14 acquires operation information of the virtual measurement marker corresponding to the user operation on the virtual measurement marker acquired from the touch sensor 5 or the input device. The virtual measurement marker operation information indicates the positions of the three auxiliary points when the position of the three auxiliary points is designated by the user. Further, the operation information of the virtual measurement marker indicates the position of the changed auxiliary point when the position of at least one auxiliary point is changed by the user. Further, the operation information of the virtual measurement marker indicates the rotation angle of the reference line when the user performs the rotation operation of the three reference lines.

  The marker adjustment unit 15 changes the position of at least one auxiliary point in the target image based on the operation information of the virtual measurement marker acquired by the operation information acquisition unit 14. In addition, the marker adjustment unit 15 rotates the three reference lines in the target image based on the operation information of the virtual measurement marker. Thereby, the virtual measurement marker whose position or rotation angle is adjusted by the marker adjusting unit 15 is displayed.

  The reference setting unit 16 calculates the height or width of the package based on the target image acquired by the image acquisition unit 11, and sets the calculated height or width of the package as the reference length of the virtual measurement marker. There may be various methods for calculating the height or width of the luggage using the captured image.

6A and 6B are diagrams illustrating an example of calculating the reference length of the virtual measurement marker. In the example of FIGS. 6A and 6B, the reference setting unit 16 calculates the height of the load (distance between the code OH and the code OB). The reference setting unit 16 displays a fixed point at a predetermined position (preferably the center) of the display frame for displaying the captured image obtained from the camera module 8 and allows the user to view the fixed point and the captured image (target image). And the operation indicating the completion of the alignment. At this time, the reference setting unit 16 holds the height h of the imaging lens of the portable information terminal 10 in advance, and further determines the inclination θ ₁ of the portable information terminal 10 at the time of detecting the operation indicating the completion of alignment as an inclination sensor. Get from 7. Thereby, the distance between the top OB of the luggage and the position LB of the imaging lens of the portable information terminal 10 is calculated as h · tan θ1. Next, the reference setting unit 16 causes the user to perform an operation indicating the alignment between the fixed point and the apex OH of the luggage shown in the captured image, and the completion of the alignment. As described above, the reference setting unit 16 acquires, from the tilt sensor 7, the tilt θ ₂ of the portable information terminal 10 at the time of detecting an operation indicating completion of alignment. Thereby, the reference setting unit 16 can calculate the height of the luggage (distance between OB and OH) as follows.
Baggage height = h−h ′ = h−h · (tan θ ₁ / tan θ ₂ )
The reference setting unit 16 can also calculate the width of the package by a similar method. Further, the reference setting unit 16 calculates the height of the luggage without holding the value of the height h by capturing the luggage from a predetermined distance (distance between LB and OB). Can do.

  In addition, the reference setting unit 16 may cause the user to take an image of an actual marker having a known length so that it appears in the target image together with the package of the measurement target. In this case, the reference setting unit 16 can calculate the length in the real space of any one side of the package from the known length of the real marker in the target image.

  Similar to the first embodiment, the image information calculation unit 17 calculates the virtual length of the virtual measurement marker based on the target image. When a user operation is performed on the virtual measurement marker, the image information calculation unit 17 calculates the virtual length of the virtual measurement marker that has been subjected to position change or rotation by the marker adjustment unit 15.

  For example, the image information calculation unit 17 determines, based on the virtual measurement marker superimposed on the target image, the first reference line and the three auxiliary points included in the first reference edge among the three reference lines. Two second reference sides that connect two second auxiliary points other than the first auxiliary point and the reference point, and two second reference points included in the three reference lines included in the two second reference sides The length of the target image in the image plane for each of the reference lines is calculated as a virtual length. According to the example of FIG. 2, the image information calculation unit 17 calculates the length in the image plane regarding the first reference side BS1, the second reference sides BS2 and BS3, the first reference line BL1, and the second reference lines BL2 and BL3. Calculate as virtual length.

  The real value calculation unit 18 calculates the length in real space of the two second reference sides of the virtual measurement marker, as in the first embodiment. Specifically, the actual value calculation unit 18 calculates the three reference lines based on the relationship between the reference length of the virtual measurement marker, the length of the first reference side on the image plane, and the length of the first reference line on the image plane. The length in the real space is calculated, and the length in the real space of the two second reference sides is calculated from the relationship between the calculated length and the lengths of the two second reference lines and the two second reference sides in the image plane. Is calculated.

According to the example of FIG. 2, the length in the real space of the first reference side BS1 (denoted as (BS1; RL)) is calculated by the reference setting unit 16, and the first reference side BS1 and the first reference line are calculated. The length of BL1 on the image plane (denoted as (BS1; PL), (BL1; PL)) is calculated by the image information calculation unit 17. Thereby, the actual value calculation unit 18 can calculate the length of the first reference line BL1 in the real world (denoted as (BL1; RL)) as follows. The calculated (BL1; RL) is equal to the length of the second reference lines BL2 and BL3 in the real space.
(BL1; RL) = {(BS1; RL) × (BL1; PL)} / (BS1; PL)
(BL1; RL) = (BL2; RL) = (BL3; RL)

At this time, the lengths ((BL2; PL), (BL3; PL), (BS2; PL), (BS3;) in the image plane of the second reference lines BL2 and BL3 and the second reference sides BS2 and BS3 are further increased. PL) is calculated by the image information calculation unit 17. Thereby, the actual value calculation unit 18 can calculate the lengths of the second reference sides BS2 and BS3 in the real space (denoted as (BS2; RL), (BS3; RL)) as follows.
(BS2; RL) = {(BL2; RL) × (BS2; PL)} / (BL2; PL)
(BS3; RL) = {(BL3; RL) × (BS3; PL)} / (BL3; PL)
Note that the above-described calculation method is merely an example, and the real value calculation unit 18 may calculate the lengths of the two second reference sides in the real space by another method.

  The output processing unit 19 includes the reference length of the virtual measurement marker acquired by the reference setting unit 16 (the length of the first reference side in real space) and the two second reference sides calculated by the real value calculation unit 18. The length in the real space is output as the size information of the package that is the measurement object. The output processing unit 19 may display the size information of the package on the monitor of the display module 4 or print it on a printing device (not shown) connected via an input / output interface (not shown). Good.

  A package ID (target identification information) for identifying a package in the target image acquired by the identification information acquisition unit 21 and the image acquisition unit 11 is acquired. The package ID may be acquired by a user input using the touch sensor 5 or an input device, or the package ID read by a scanner device (not shown) connected via an input / output interface (not shown). It may be extracted from the identification label of the home delivery slip. The identification label of the home delivery slip is a barcode, a QR code (registered trademark) or the like. The package ID may be acquired from an RFID (Radio Frequency Identification) tag attached to the package.

  The transmission unit 22 sends the package size information output by the output processing unit 19 together with the package ID acquired by the identification information acquisition unit 21 and the image data of the target image held by the image holding unit 12 to the home delivery server. Send to 50.

  The home delivery server 50 receives the package ID, the image data of the target image showing the package, and the size information of the package transmitted from the portable information terminal 10, and stores them in the home delivery database. Thereby, the home delivery server 50 can manage the customer's package information received by the user of the portable information terminal 10 based on the information stored in the home delivery database.

[Operation example]
Hereinafter, a size measurement method according to the second embodiment will be described with reference to FIG. FIG. 7 is a sequence chart showing an operation example of the portable information terminal 10 in the first embodiment. In the following description, the portable information terminal 10 becomes the execution subject of each process, but the above-described processing units included in the portable information terminal 10 or at least one other computer may be the execution subject.

  The portable information terminal 10 acquires the package ID of the package whose size is to be measured (S70). The package ID is information for uniquely identifying the package, and is acquired by user input or analysis of a two-dimensional code that appears in an image of a delivery slip captured by the portable information terminal 10.

  The portable information terminal 10 acquires a target image in which the package identified by the package ID is shown (S71). In FIG. 7, for convenience of explanation, it is illustrated that one target image is acquired in (S <b> 71). However, the target image is sequentially captured by the camera module 8 and displayed on the monitor of the portable information terminal 10. The

  The portable information terminal 10 determines the positions of the reference point, the first auxiliary point, and the first reference line of the virtual measurement marker based on the acquired target image (S72). In other words, the portable information terminal 10 sets one side of the luggage shown in the target image as the first reference side of the virtual measurement marker. For example, the portable information terminal 10 causes the reference point of the virtual measurement marker to be fixedly displayed at a predetermined position of the display frame of the target image, and allows the user to align the reference point with one vertex of the luggage, and Then, an operation indicating completion of alignment is performed. Furthermore, the portable information terminal 10 automatically sets the first auxiliary point by image recognition based on the position of the reference point. Further, the portable information terminal 10 may cause the user to manually specify the first auxiliary point. When the positions of the reference point and the first auxiliary point are determined, the portable information terminal 10 arranges the first reference line on a straight line connecting the reference point and the first auxiliary point.

  When the position of the first reference side of the virtual measurement marker is set, the portable information terminal 10 holds the image data of the target image at that time (S73).

  The portable information terminal 10 further calculates the length in the real space of the first reference side of the virtual measurement marker set in (S72) as the reference length of the virtual measurement marker (S74). The portable information terminal 10 can calculate the reference length of the virtual measurement marker from the height and angle of the portable information terminal 10 when photographing the luggage. In addition, the portable information terminal 10 can also calculate the reference length of the virtual measurement marker using a real measurement marker that appears in the target image together with the package and indicates the known length of the real space.

  Subsequently, the portable information terminal 10 arranges two second auxiliary points and two second reference lines based on the position of the reference point determined in (S72) (S75). The second auxiliary point and the second reference line may be automatically arranged by image recognition, or may be manually arranged by user input.

  The portable information terminal 10 allows the user to fine-tune the virtual measurement marker arranged as described above. The user corrects the position of the reference point and each auxiliary point of the virtual measurement marker or the direction of the reference line of the virtual measurement marker by a touch operation on the portable information terminal 10 or a specifying operation using a pointing device such as a mouse. Can do. The portable information terminal 10 determines whether or not the operation information of the virtual measurement marker indicating the content of such user operation is acquired (S76). When the operation information of the virtual measurement marker is acquired (S76; YES), the portable information terminal 10 determines the reference point of the virtual measurement marker and the position of each auxiliary point or the reference of the virtual measurement marker based on the operation information. The direction of the line is adjusted (S77). When the operation information is not acquired (S76; NO), the portable information terminal 10 performs the following process without executing (S77). The portable information terminal 10 may determine that there is no virtual measurement marker operation information when a virtual measurement marker confirmation operation performed by the user is acquired.

  Based on the image data of the target image, the portable information terminal 10 determines the lengths of the first reference side, the second reference side, the first reference line, and the second reference line of the virtual measurement marker in the image plane of the target image. The virtual length of the virtual measurement marker is calculated (S78). The virtual length of the virtual measurement marker can be calculated based on the number of pixels and the resolution of the target image.

  Based on the reference length of the virtual measurement marker calculated in (S74) and the virtual length of the virtual measurement marker calculated in (S78), the portable information terminal 10 determines the two second reference sides of the virtual measurement marker. Each length in the real space is calculated (S79).

  The portable information terminal 10 uses the length of the virtual reference marker calculated in (S74) in the real space of the first reference side and the length of the virtual reference marker calculated in (S79) in the real space of the second reference side. Is output as size information of the package, and together with the size information of the package, the package ID acquired in (S70) and the image data of the target image held in (S73) are transmitted to the delivery server 50 ( S80).

  The size measurement method in the second embodiment is not limited to the order of the plurality of steps shown in FIG. The order of the steps shown in FIG. 7 can be changed within a range that does not hinder the contents. For example, (S74) may be executed before (S72) depending on a method for calculating the length of the first reference side in the real space. Further, after the position of only the reference point is determined in (S72), (S73) may be executed, and then the positions of the first auxiliary point and the first reference line may be determined.

[Operation and Effect of Second Embodiment]
As described above, in the second embodiment, the portable information terminal 10 uses the target image obtained by capturing the baggage and the virtual measurement marker displayed superimposed on the target image, and the size of the baggage. Information is acquired. Specifically, using such a target image, the length of one side of the baggage is measured, the length is set as the reference length of the virtual measurement marker, and the side of the baggage is One reference side is set. Subsequently, the positions of the two second auxiliary points and the directions of the two second reference lines are determined based on the positions of the reference points included in the first reference side. The virtual length of the virtual measurement marker is calculated based on the arrangement of the virtual measurement marker in the target image determined in this way, and the actual values of the two second reference sides are calculated based on the virtual length and the reference length of the virtual measurement marker. The length in space is calculated. Then, together with the size information of the virtual measurement marker indicating the length of the calculated first reference side and two second reference sides in the real space, the package ID of the package and the image data of the target image are It is sent from the portable information terminal 10 to the home delivery server 50.

  As described above, according to the second embodiment, it is possible to measure the size of the package using only the virtual measurement marker without using the actual measurement marker. Further, according to the second embodiment, the positions of the three auxiliary points and the directions of the three reference lines can be automatically set by image recognition on the target image. Therefore, according to the second embodiment, it is possible to reduce the labor for measuring the size of the baggage in the service person who has checked the baggage for delivery from the customer. Furthermore, according to the second embodiment, since the position and orientation of the virtual measurement marker can be automatically determined, the complexity of the usage method due to the use of the virtual measurement marker can be reduced.

  Furthermore, according to the second embodiment, since the size of the package automatically measured in this way is managed by the delivery server 50 together with the package ID and the image data showing the package, the company providing the delivery service can Luggage can be managed easily and reliably.

  On the other hand, in the method of measuring the size of a package only by image recognition using an actual measurement marker, the measurement marker of the package or the actual object in the target image is determined depending on the pattern printed on the surface of the package or the shooting environment of the package. It may not be recognized correctly. For example, when shooting a baggage on asphalt, shooting a baggage in the dark, shooting a baggage at a low angle, or when a uniform pattern is applied to the surface of the baggage, Such misrecognition may occur.

  Therefore, in the second embodiment, the position and orientation of the virtual measurement marker are adjusted based on the operation information of the virtual measurement marker indicating the user operation on the virtual measurement marker. Further, the position of the auxiliary point and the direction of the reference line can be determined by user designation without being automatically determined. Therefore, according to the second embodiment, the virtual measurement marker can be finely adjusted by the user even in a situation where there is a high possibility of causing the erroneous recognition of the package as described above. That is, according to the second embodiment, it is possible to always accurately measure the size of the luggage without being affected by the condition of the luggage or the shooting environment.

  Further, the portable information terminal 10 in the second embodiment may be a general portable information terminal called a smartphone, a tablet terminal, or a portable PC (Personal Computer) having a camera module 8 for picking up a baggage, an inclination sensor 7 and the like. That's fine. Thereby, according to 2nd Embodiment, the above effects can be acquired using a general spread apparatus (general purpose apparatus), without using a dedicated apparatus, and cost effectiveness can be improved.

[Supplement of the second embodiment]
In the above description, an example in which a load having a rectangular parallelepiped shape (including a cube shape) as shown in FIG. 2 is used as a measurement object is used, but in the second embodiment, the shape of the load is only a rectangular parallelepiped shape. Not limited to. When the measurement object OB shown in the example of FIG. 3 is a luggage, the portable information terminal 10 may cause the user to specify the reference point MB, the first auxiliary point MS1, the second auxiliary point MS2, and MS3. .

  For example, the reference point MB of the virtual measurement marker is fixedly displayed at a predetermined position of the display frame of the target image, and the user aligns the reference point MB with the position corresponding to the highest point of the package OB. Make it. Furthermore, the portable information terminal 10 causes the user to designate the location corresponding to the lowest point of the package OB as the first auxiliary point MS1, and further causes the user to designate the second auxiliary points MS2 and MS3. In this case, the reference point MB, the first auxiliary point MS1, the second auxiliary point MS2, and MS3 do not necessarily have to exist on the surface of the luggage OB. According to the second embodiment, by allowing the user to specify the position and orientation of the virtual measurement marker at a position that indicates the size of the package OB that does not have a rectangular parallelepiped shape, the size information of the package OB can be acquired. it can.

[Modification]
The identification information acquisition unit 21 described above may acquire the package ID from the image data held in the image holding unit 12 in order to acquire the size information of the package. In this case, the identification information acquisition unit 21 may recognize the identification label on the surface of the package shown in the target image of the image data held in the image holding unit 12 and extract the package ID from the recognized identification label. At this time, the orientation of the identification label such as a two-dimensional code in the target image is arbitrary. Therefore, the identification information acquisition unit 21 detects the identification label from the target image, and further recognizes the orientation of the identification label. The identification information acquisition unit 21 can decode the package ID encoded in the identification label by correcting the direction of the identification label. According to such a form, since the package ID can be acquired together with the size of the package, it is possible to further reduce the labor of a service person who has deposited the package for delivery from the customer.

  Each above-mentioned embodiment and modification can be combined in the range in which the contents do not conflict.

  A part or all of each of the above embodiments and modifications may be specified as in the following supplementary notes. However, each embodiment and each modification are not limited to the following description.

(Appendix 1)
In a program for causing a computer having a display unit to execute a size measurement method,
The size measuring method is:
Obtain the target image that shows the measurement object,
A reference point, three auxiliary points located on three axes orthogonal to each other at the reference point, and three reference lines having the same length in real space respectively arranged on the three axes A virtual measurement marker is overlaid on the target image such that each length between the reference point and the three auxiliary points corresponds to each length on the three axes of the measurement object in the target image. Display on the display unit,
Obtaining the length in the real space of the first reference side connecting the reference point and the first auxiliary point among the three auxiliary points as the reference length of the virtual measurement marker;
Calculating the length in the image plane of the target image related to the virtual measurement marker superimposed on the target image as the virtual length of the virtual measurement marker;
From the relationship between the reference length of the virtual measurement marker and the virtual length of the virtual measurement marker, two second auxiliary points other than the first auxiliary point in the three auxiliary points and the reference point Calculate the length in real space of the two second reference edges to be connected,
Outputting the reference length of the virtual measurement marker and the length of the two second reference sides in real space as size information of the measurement object;
A program that includes that.
(Appendix 2)
The size measuring method is:
Obtaining operation information of the virtual measurement marker corresponding to a user operation on at least one auxiliary point included in the virtual measurement marker;
Determining the position of the at least one auxiliary point in the target image based on the operation information of the virtual measurement marker;
Calculating the virtual length of the virtual measurement marker from which the position of the auxiliary point is determined;
The program according to appendix 1, further including:
(Appendix 3)
The size measuring method is:
Obtaining operation information of the virtual measurement marker corresponding to a user operation with respect to the three reference lines included in the virtual measurement marker;
Based on the operation information of the virtual measurement marker, rotate the three reference lines,
Calculating the virtual length of the virtual measurement marker subjected to rotation of the three reference lines;
The program according to appendix 1 or 2, further comprising:
(Appendix 4)
The measurement object has a rectangular parallelepiped shape,
The size measuring method is:
Recognizing at least one vertex of the measurement object in the target image;
Placing at least one auxiliary point of the virtual measurement marker at the recognized at least one vertex;
Based on the three auxiliary points and the reference point, the three reference lines are arranged.
The program according to any one of appendices 1 to 3, further including:
(Appendix 5)
The size measuring method is:
Based on the acquired target image, the height or width of the measurement object is calculated,
Set the calculated height or width of the measurement object to the reference length of the virtual measurement marker,
One of the reference point, the first auxiliary point, and the three reference lines of the virtual measurement marker at a location where the calculated height or width of the measurement object shown in the target image is formed. To place,
The program according to any one of appendices 1 to 4, further including:
(Appendix 6)
The calculation of the virtual length of the virtual measurement marker is based on the virtual measurement marker superimposed on the target image, and is included in the first reference side and the first reference side among the three reference lines. Included in one reference line, two second reference sides connecting the two second auxiliary points other than the first auxiliary point in the three auxiliary points and the reference point, and the two second reference sides Calculating the length of the target image in the image plane for each of the two second reference lines of the three reference lines as the virtual length,
The calculation of the length of the two second reference sides in the real space includes the reference length of the virtual measurement marker, the length of the first reference side in the image plane, and the first reference line in the image plane. The length in the real space of the three reference lines is calculated from the relationship with the length, and the calculated length and the lengths of the two second reference lines and the two second reference sides in the image plane are calculated. From the relationship, the length of the two second reference sides in real space is calculated.
The program according to any one of appendices 1 to 5.
(Appendix 7)
The size measuring method is:
Holding image data of the acquired target image;
Obtaining object identification information for identifying the measurement object;
The size information of the measurement object is transmitted to a predetermined server device together with the held image data and the acquired object identification information.
The program according to any one of appendices 1 to 6, further including:
(Appendix 8)
The acquisition of the target identification information is performed by recognizing an identification label on the surface of the measurement object in the target image, and extracting the target identification information from the recognized identification label.
The program according to appendix 7.

(Appendix 9)
An image acquisition unit for acquiring a target image in which a measurement object is shown;
A reference point, three auxiliary points located on three axes orthogonal to each other at the reference point, and three reference lines having the same length in real space respectively arranged on the three axes A virtual measurement marker is overlaid on the target image such that each length between the reference point and the three auxiliary points corresponds to each length on the three axes of the measurement object in the target image. A display processing unit to be displayed on the display unit,
A reference setting unit for acquiring a length in real space of a first reference side connecting the reference point and a first auxiliary point among the three auxiliary points as a reference length of the virtual measurement marker;
An image information calculation unit that calculates the length of the target image in the image plane related to the virtual measurement marker superimposed on the target image as the virtual length of the virtual measurement marker;
From the relationship between the reference length of the virtual measurement marker acquired by the reference setting unit and the virtual length of the virtual measurement marker calculated by the image information calculation unit, the third of the three auxiliary points. A real value calculation unit for calculating the length in real space of two second reference sides connecting the two second auxiliary points other than one auxiliary point and the reference point;
The reference length of the virtual measurement marker acquired by the reference setting unit and the length in real space of the two second reference sides calculated by the real value calculation unit are used as size information of the measurement object. An output processing unit for outputting;
A size measuring device comprising:
(Appendix 10)
An operation information acquisition unit that acquires operation information of the virtual measurement marker corresponding to a user operation on at least one auxiliary point included in the virtual measurement marker;
A marker adjustment unit that determines a position of the at least one auxiliary point in the target image based on operation information of the virtual measurement marker;
Further comprising
The image information calculation unit calculates the virtual length of the virtual measurement marker in which the position of the auxiliary point is determined by the marker adjustment unit;
The size measuring device according to appendix 9.
(Appendix 11)
An operation information acquisition unit for acquiring operation information of the virtual measurement marker corresponding to a user operation on the three reference lines included in the virtual measurement marker;
A marker adjustment unit that rotates the three reference lines based on the operation information of the virtual measurement marker;
Further comprising
The image information calculation unit calculates the virtual length of the virtual measurement marker subjected to the rotation by the marker adjustment unit.
The size measuring device according to appendix 9 or 10.
(Appendix 12)
The measurement object has a rectangular parallelepiped shape,
The display processing unit recognizes at least one vertex of the measurement object in the target image, arranges at least one auxiliary point of the virtual measurement marker at the at least one vertex, and the three auxiliary points. And arranging the three reference lines based on the reference point and
The size measuring device according to any one of appendices 9 to 11.
(Appendix 13)
The reference setting unit calculates a height or a width of the measurement target based on the target image acquired by the image acquisition unit, and calculates the calculated height or width of the measurement target as the virtual Set to the reference length of the measurement marker,
The display processing unit includes the reference point of the virtual measurement marker, the first auxiliary point, and the position of the measurement object that appears in the target image at a position that forms the height or width calculated by the reference setting unit. Placing one of the three reference lines;
The size measuring device according to any one of appendices 9 to 12.
(Appendix 14)
The image information calculation unit, based on the virtual measurement marker superimposed on the target image, the first reference side, a first reference line included in the first reference side among the three reference lines, Two second reference sides that connect the two second auxiliary points other than the first auxiliary point among the three auxiliary points and the reference point, and the three references included in the two second reference sides Calculating the length in the image plane of the target image for each of the two second reference lines in the line as the virtual length,
The real value calculation unit is configured to calculate the three reference values based on the relationship between the reference length of the virtual measurement marker, the length of the first reference side in the image plane, and the length of the first reference line in the image plane. The length of the line in real space is calculated, and the two second references are calculated from the relationship between the calculated length and the lengths of the two second reference lines and the two second reference sides in the image plane. Calculate the length of the edge in real space,
The size measuring device according to any one of appendices 9 to 13.
(Appendix 15)
An image holding unit for holding image data of the target image acquired by the image acquisition unit;
An identification information acquisition unit for acquiring object identification information for identifying the measurement object;
The size information of the measurement object output by the output processing unit is transmitted to a predetermined server device together with the image data held by the image holding unit and the target identification information acquired by the identification information acquisition unit. A transmitter to
The size measuring device according to any one of appendices 9 to 14, further comprising:
(Appendix 16)
The identification information acquisition unit recognizes an identification label on the surface of the measurement object in the target image, and extracts the target identification information from the recognized identification label;
The size measuring device according to appendix 15.

(Appendix 17)
A sizing method performed by at least one computer,
The size measurement method, wherein the program according to any one of appendices 1 to 8 is executed by the at least one computer.

(Appendix 18)
A storage medium for storing the program according to any one of appendices 1 to 8 in a computer-readable manner.

  This application claims the priority on the basis of Japanese application Japanese Patent Application No. 2013-071217 for which it applied on March 29, 2013, and takes in those the indications of all here.

Claims (15)

An image acquisition unit for acquiring a target image in which a measurement object is shown;
A reference point, three auxiliary points located on three axes orthogonal to each other at the reference point, and three reference lines having the same length in real space respectively arranged on the three axes A virtual measurement marker is overlaid on the target image such that each length between the reference point and the three auxiliary points corresponds to each length on the three axes of the measurement object in the target image. A display processing unit to be displayed on the display unit,
A reference setting unit for acquiring a length in real space of a first reference side connecting the reference point and a first auxiliary point among the three auxiliary points as a reference length of the virtual measurement marker;
An image information calculation unit that calculates the length of the target image in the image plane related to the virtual measurement marker superimposed on the target image as the virtual length of the virtual measurement marker;
From the relationship between the reference length of the virtual measurement marker acquired by the reference setting unit and the virtual length of the virtual measurement marker calculated by the image information calculation unit, the third of the three auxiliary points. A real value calculation unit for calculating the length in real space of two second reference sides connecting the two second auxiliary points other than one auxiliary point and the reference point;
The reference length of the virtual measurement marker acquired by the reference setting unit and the length in real space of the two second reference sides calculated by the real value calculation unit are used as size information of the measurement object. An output processing unit for outputting;
An operation information acquisition unit for acquiring operation information of the virtual measurement marker corresponding to a user operation on the three reference lines included in the virtual measurement marker;
A marker adjustment unit that rotates the three reference lines based on the operation information of the virtual measurement marker;
Equipped with a,
The image information calculation unit is a size measurement device that calculates the virtual length of the virtual measurement marker that has been rotated by the marker adjustment unit . An operation information acquisition unit that acquires operation information of the virtual measurement marker corresponding to a user operation on at least one auxiliary point included in the virtual measurement marker;
A marker adjustment unit that determines a position of the at least one auxiliary point in the target image based on operation information of the virtual measurement marker;
Further comprising
The image information calculation unit calculates the virtual length of the virtual measurement marker in which the position of the auxiliary point is determined by the marker adjustment unit;
The size measuring device according to claim 1. The measurement object has a rectangular parallelepiped shape,
The display processing unit recognizes at least one vertex of the measurement object in the target image, arranges at least one auxiliary point of the virtual measurement marker at the at least one vertex, and the three auxiliary points. And arranging the three reference lines based on the reference point and
The size measuring device according to claim 1 or 2 . The reference setting unit calculates the height or width of the measurement object based on the distance between the ground and the size measurement apparatus and the inclination of the size measurement apparatus, and the calculated measurement object Set the height or width to the reference length of the virtual measurement marker,
The display processing unit includes the reference point of the virtual measurement marker, the first auxiliary point, and the position of the measurement object that appears in the target image at a position that forms the height or width calculated by the reference setting unit. Placing one of the three reference lines;
The size measuring device according to any one of claims 1 to 3 . The image information calculation unit, based on the virtual measurement marker superimposed on the target image, the first reference side, a first reference line included in the first reference side among the three reference lines, Two second reference sides that connect the two second auxiliary points other than the first auxiliary point among the three auxiliary points and the reference point, and the three references included in the two second reference sides Calculating the length in the image plane of the target image for each of the two second reference lines in the line as the virtual length,
The real value calculation unit is configured to calculate the three reference values based on the relationship between the reference length of the virtual measurement marker, the length of the first reference side in the image plane, and the length of the first reference line in the image plane. The length of the line in real space is calculated, and the two second references are calculated from the relationship between the calculated length and the lengths of the two second reference lines and the two second reference sides in the image plane. Calculate the length of the edge in real space,
The size measuring device according to any one of claims 1 to 4 . An image holding unit for holding image data of the target image acquired by the image acquisition unit;
An identification information acquisition unit for acquiring object identification information for identifying the measurement object;
The size information of the measurement object output by the output processing unit is transmitted to a predetermined server device together with the image data held by the image holding unit and the target identification information acquired by the identification information acquisition unit. A transmitter to
The size measuring device according to any one of claims 1 to 5 , further comprising: The identification information acquisition unit recognizes an identification label on the surface of the measurement object in the target image, and extracts the target identification information from the recognized identification label;
The size measuring device according to claim 6 . In a sizing method performed by at least one computer,
Obtain the target image that shows the measurement object,
A reference point, three auxiliary points located on three axes orthogonal to each other at the reference point, and three reference lines having the same length in real space respectively arranged on the three axes A virtual measurement marker is overlaid on the target image such that each length between the reference point and the three auxiliary points corresponds to each length on the three axes of the measurement object in the target image. Displayed on the display,
Obtaining the length in the real space of the first reference side connecting the reference point and the first auxiliary point among the three auxiliary points as the reference length of the virtual measurement marker;
Calculating the length in the image plane of the target image related to the virtual measurement marker superimposed on the target image as the virtual length of the virtual measurement marker;
From the relationship between the reference length of the virtual measurement marker and the virtual length of the virtual measurement marker, two second auxiliary points other than the first auxiliary point in the three auxiliary points and the reference point Calculate the length in real space of the two second reference edges to be connected,
Outputting the reference length of the virtual measurement marker and the length of the two second reference sides in real space as size information of the measurement object;
In addition,
Obtaining operation information of the virtual measurement marker corresponding to a user operation with respect to the three reference lines included in the virtual measurement marker;
Based on the operation information of the virtual measurement marker, rotate the three reference lines,
Calculating the virtual length of the virtual measurement marker subjected to rotation of the three reference lines;
A size measurement method including that. Obtaining operation information of the virtual measurement marker corresponding to a user operation on at least one auxiliary point included in the virtual measurement marker;
Determining the position of the at least one auxiliary point in the target image based on the operation information of the virtual measurement marker;
Calculating the virtual length of the virtual measurement marker from which the position of the auxiliary point is determined;
The size measuring method according to claim 8 , further comprising: Recognizing at least one vertex of the measurement object having a rectangular parallelepiped shape in the target image;
Placing at least one auxiliary point of the virtual measurement marker at the recognized at least one vertex;
Based on the three auxiliary points and the reference point, the three reference lines are arranged.
The size measurement method according to claim 8 , further comprising: Based on the distance between the ground and the size measuring device and the inclination of the size measuring device, the height or width of the measurement object is calculated,
Set the calculated height or width of the measurement object to the reference length of the virtual measurement marker,
One of the reference point, the first auxiliary point, and the three reference lines of the virtual measurement marker at a location where the calculated height or width of the measurement object shown in the target image is formed. To place,
Further size measuring method according to claims 8 to any one of 10, including the. The calculation of the virtual length of the virtual measurement marker is based on the virtual measurement marker superimposed on the target image, and is included in the first reference side and the first reference side among the three reference lines. Included in one reference line, two second reference sides connecting the two second auxiliary points other than the first auxiliary point in the three auxiliary points and the reference point, and the two second reference sides Calculating the length of the target image in the image plane for each of the two second reference lines of the three reference lines as the virtual length,
The calculation of the length of the two second reference sides in the real space includes the reference length of the virtual measurement marker, the length of the first reference side in the image plane, and the first reference line in the image plane. The length in the real space of the three reference lines is calculated from the relationship with the length, and the calculated length and the lengths of the two second reference lines and the two second reference sides in the image plane are calculated. From the relationship, the length of the two second reference sides in real space is calculated.
The size measuring method according to any one of claims 8 to 11 . Holding image data of the acquired target image;
Obtaining object identification information for identifying the measurement object;
The size information of the measurement object is transmitted to a predetermined server device together with the held image data and the acquired object identification information.
The size measuring method according to any one of claims 8 to 12 , further comprising: The acquisition of the target identification information is performed by recognizing an identification label on the surface of the measurement object in the target image, and extracting the target identification information from the recognized identification label.
The size measuring method according to claim 13 . A program for causing at least one computer to execute the size measuring method according to any one of claims 8 to 14 .

Images