JP7098554B2 - Information processing equipment - Google Patents

Description

The present invention relates to a technique for measuring the size of an object.

The delivery fee for packages delivered by the delivery company varies depending on the size. For this reason, when a delivery company accepts a package, the size of the package is measured to determine the delivery fee. For example, Patent Document 1 discloses that the size of an imaged baggage is measured by image analysis.

JP-A-2018-194963

When the size of a baggage is automatically measured only by image analysis of a captured image, an error may occur in the measurement depending on various conditions such as the imaging direction and the imaging range. Therefore, accurate measurement can be expected if there is some explicit operation by the operator to measure the size of the luggage. However, it is desirable that the operation be as simple as possible.

Therefore, an object of the present invention is to simplify the operation of the operator when calculating the size of the object in the captured image by the operation of the operator.

In order to solve the above problems, the present invention has a recognition unit that recognizes a reference plane in contact with the object in an image captured in a space including an object having a plurality of vertices, and each of the objects possessed by the object in the image. When the vertices are designated by the operator in a predetermined order with the vertices in contact with the reference plane as the first rank, each of the designated vertices in the space is based on the result of recognizing the reference plane. Provided is an information processing apparatus including a detection unit for detecting coordinates and a calculation unit for calculating the size of the object based on the coordinates detected for each of the vertices.

In the predetermined order, the vertices in contact with the reference plane are given the first rank, and thereafter, the vertices connected to the vertices of the next higher rank via one side of the object are given the next rank. You may.

A condition storage unit that stores a condition that should be satisfied with respect to the distance between the image pickup device that images the space including the object and the reference plane, or the image pickup direction by the image pickup device, and the case where the condition is satisfied or the condition. May be provided with a first notification unit that performs notification when the above conditions are not satisfied.

For each of the vertices, a range storage unit that stores a range in which the image pickup device for imaging the vertex should exist, and a notification when the image pickup device exists in the range or when the image pickup device does not exist in the range. A second notification unit may be provided.

The operator may be provided with a guide unit that performs a process for guiding an operation for designating the apex in the captured image.

The guide unit may guide the vertex to be next designated by the operator or the vertex already designated by the operator.

The guide unit may guide the operator in a range in which the apex can be specified in the captured image.

The guide unit may display the position designated by the operator for the apex and the captured image in a predetermined range from the designated position in an superimposed manner.

An information output unit that outputs information regarding the size and weight of the object or the charge required for delivery of the object may be provided.

A limiting storage unit that stores a limitation on the moving speed of an imaging device that images a space containing an object, or a limitation on brightness when the imaging device performs imaging, and the limitation within or outside the limitation depending on the imaging device. It may be provided with a third notification unit that notifies when an image is taken.

According to the present invention, it is possible to simplify the operation of the operator when calculating the size of the object in the captured image by the operation of the operator.

It is a block diagram which shows an example of the hardware composition of the information processing apparatus which concerns on one Embodiment of this invention. It is a block diagram which shows an example of the functional structure of the information processing apparatus. It is a flowchart which illustrates the operation of the information processing apparatus. It is a figure exemplifying the display contents by the information processing apparatus. It is a figure which illustrates the display content by the information processing apparatus, and the operation content of an operator with respect to the display content. It is a figure which illustrates the display content by the information processing apparatus, and the operation content of an operator with respect to the display content. It is a figure which illustrates the distance between the image pickup device and the reference plane of the information processing apparatus, and the image pickup direction by the image pickup device. It is a figure which illustrates the distance between the image pickup device and the reference plane of the information processing apparatus, and the image pickup direction by the image pickup device. It is a figure exemplifying the display contents by the information processing apparatus.

[Constitution]
FIG. 1 is a diagram showing a hardware configuration of an information processing apparatus 10 according to an embodiment of the present invention. The information processing device 10 is, for example, a computer device such as a smart phone, a tablet, or a camera. The information processing device 10 physically includes a processor 1001, a memory 1002, a storage 1003, a communication device 1004, an input device 1005, an output device 1006, a bus connecting them, and the like. In the following description, the word "device" can be read as a circuit, a device, a unit, or the like, and vice versa. The hardware configuration of the information processing device 10 may be configured to include one or more of the devices shown in the figure, or may be configured not to include some of the devices. Further, the hardware configuration of the information processing device 10 may be a configuration in which all the devices are integrated, or a configuration in which a plurality of devices are connected by wire or wirelessly.

For each function in the information processing apparatus 10, the processor 1001 performs an operation by loading predetermined software (program) on the hardware such as the processor 1001 and the memory 1002, and controls the communication by the communication apparatus 1004 or the memory. It is realized by controlling at least one of reading and writing of data in 1002 and storage 1003.

Processor 1001 operates, for example, an operating system to control the entire computer. The processor 1001 may be configured by a central processing unit (CPU: Central Processing Unit) including an interface with peripheral devices, a control device, an arithmetic unit, a register, and the like.

The processor 1001 reads a program (program code), a software module, data, and the like from at least one of the storage 1003 and the communication device 1004 into the memory 1002, and executes various processes according to these. As the program, a program that causes a computer to execute at least a part of the operation described later is used. The functional block of the information processing apparatus 10 may be stored in the memory 1002 and realized by a control program operating in the processor 1001. Various processes may be executed by one processor 1001, but may be executed simultaneously or sequentially by two or more processors 1001. Processor 1001 may be mounted by one or more chips. The program may be transmitted from the network to the information processing apparatus 10 via a telecommunication line.

The memory 1002 is a computer-readable storage medium, for example, a ROM (Read Only Memory), an EPROM (Erasable Program ROM), an EPROM (Electrically Erasable Program ROM), a RAM (Random Memory), a RAM (Random Memory), or the like. May be done. The memory 1002 may be referred to as a register, a cache, a main memory (main storage device), or the like. The memory 1002 can store a program (program code), a software module, or the like that can be executed to carry out the method according to the present embodiment.

The storage 1003 is a computer-readable storage medium, for example, an optical disk such as a CD-ROM (Compact Disk ROM), a hard disk drive, a flexible disk, an optical magnetic disk (for example, a compact disk, a digital versatile disk, a Blu-ray). It may consist of at least one (registered trademark) disk), smart card, flash memory (eg, card, stick, key drive), floppy (registered trademark) disk, magnetic strip, and the like. The storage 1003 may be referred to as an auxiliary storage device.

The communication device 1004 is hardware (transmission / reception device) for communicating between computers via at least one of a wired network and a wireless network, and is also referred to as, for example, a network device, a network controller, a network card, a communication module, or the like. The communication device 1004 has a high frequency switch, a duplexer, and a filter in order to realize at least one of a configuration suitable for wireless communication, for example, Frequency Division Duplex (FDD) and Time Division Duplex (TDD). , Frequency synthesizer and the like may be included. For example, the transmission / reception antenna, the amplifier unit, the transmission / reception unit, the transmission line interface, and the like may be realized by the communication device 1004. The transmission / reception unit may be physically or logically separated from each other in the transmission unit and the reception unit. Further, for example, a baseband signal processing unit, a call processing unit, or the like may be realized by the communication device 1004.

The input device 1005 is an input device that receives an input from the outside. The input device 1005 includes at least an image pickup device 1005a as an image pickup device and a touch sensor 1005b as an operation device, but also includes, for example, an acceleration sensor, a gyro sensor, a distance sensor, a keyboard, a mouse, a switch, or a microphone. May be good.

The output device 1006 is an output device that performs output to the outside. The output device 1006 includes a display 1006a as a display device, but may also include, for example, a speaker, an LED (Light Emitting Diode) light emitting device, or the like. The touch sensor 1005b of the input device 1005 and the display 1006a of the output device 1006 constitute a touch screen that accepts a user's operation and displays an image.

The information processing apparatus 10 includes a microprocessor, a digital signal processor (DSP: Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), a PLD (Progrumable Digital Device), a PLD (Progrumable Logic Device), a hardware such as an FPGA, and an FPGA (File). The hardware may implement some or all of each functional block. For example, processor 1001 may be implemented using at least one of these hardware. Further, the bus connecting each device may be configured by using a single bus, or may be configured by using a different bus for each device.

FIG. 2 is a block diagram showing an example of the functional configuration of the information processing apparatus 10. The image pickup unit 11 captures an object. The object referred to here is, for example, a box in which a package to be delivered is packed, but the object is not necessarily limited to this example. This object is a polyhedron such as a cube or a rectangular cuboid, that is, a shape having a plurality of vertices. In an object, these vertices are connected by edges and surrounded by these plurality of edges to form a surface.

The recognition unit 12 three-dimensionally recognizes the captured space. Specifically, the recognition unit 12 recognizes a reference plane in contact with the object in the captured image of the space including the object, and the imaging position when the information processing apparatus 10 is moved with the reference plane as a reference. The space including the object is recognized three-dimensionally by using the difference (parallax) of (viewpoint). This reference plane is, for example, a horizontal floor on which an object is placed.

The detection unit 13 detects the coordinates of each vertex of the object in space. The space referred to here is a three-dimensional space defined by the XYZ coordinate axes, and the coordinates of each vertex are composed of the X coordinate, the Y coordinate, and the Z coordinate coordinate values. Of the vertices of each object, the minimum required vertices for measuring the size of the object are designated by the operator on the display 1006a that displays an image of the space including the object. At this time, the order in which the operator specifies these vertices is predetermined. Specifically, the vertices in contact with the above-mentioned reference plane are set as the first rank, and thereafter, the vertices connected to the vertices of the next rank via one side of the object are set as the next rank. This order will be described in detail later. When the vertices of the object are designated by the operator in such an order, the detection unit 13 detects the coordinates of the designated vertices based on the recognition result of the reference plane.

The calculation unit 14 calculates the size of the object based on the coordinates detected for each vertex.

The guide unit 15 performs a process for guiding the operator to an operation of designating the apex of the object in the captured image. Specifically, the guide unit 15 guides the vertex to be designated next by the operator when designating the vertex of the object. Further, the guide unit 15 guides the range in which the operator can specify the apex in the captured image. This guidance will be described in detail later.

[motion]
Next, the operation of this embodiment will be described with reference to FIGS. 3 to 6. First, the operator performs an operation to start the software of the information processing apparatus 10. In response to this operation, the processor 1001 executes software and activates the image pickup device 1005a. The operator performs imaging while moving the imaging device 1005a. The operator may be an employee of a delivery company that delivers the object, which is a package, or may be a requester who requests the delivery of the object, which is the object.

In FIG. 3, the image pickup unit 11 of the information processing apparatus 10 takes an image of the space and displays the imaged result as an image on the display 1006a (step S11). At the same time as imaging the space, the recognition unit 12 starts the recognition process for the space (step S12).

FIG. 4A shows an captured image displayed on the display 1006a of the information processing apparatus 10. In FIG. 4A, 101 is an image meaning a reference surface (here, a horizontal floor surface) recognized by the recognition unit 12. In FIG. 4A, in order to make it easy to understand that the reference plane recognized by the recognition unit 12 exists in the captured image, the reference plane 101 represented by the grid-like image is shown, but the display 1006a is shown. The image actually displayed in the image may not include such a grid-like image.

Next, the operator places an object whose size is to be measured on a reference plane. Here, it is assumed that this object is a box of a rectangular cuboid.

FIG. 4B shows an captured image displayed on the display 1006a of the information processing apparatus 10 at this time. The recognition unit 12 recognizes the reference surface 101 in contact with the object 102 in the captured image of the space including the object 102, and the image pickup device 1005a when the information processing apparatus 10 is moved with the reference surface 101 as a reference. The space is recognized three-dimensionally by using the difference (parallax) of the imaging position (viewpoint) of. A well-known space recognition technique can be used. For example, the distance from the information processing device 10 (imaging device 1005a) to the reference plane, the posture and orientation of the information processing device 10 (imaging device 1005a), and information processing. It is a technique of sterically recognizing a space based on the relationship with the parallax when the device 10 (imaging device 1005a) is moved.

At this time, the guide unit 15 guides the vertex to be designated first by the operator. More specifically, the guide unit 15 corresponds to an object in a predetermined display area of the display 1006a of the information processing apparatus 10 (here, in the upper right corner of the entire rectangular display area of the display 1006a when viewed from the operator). An image 103 that imitates a box is displayed. Further, in the image 103, the guide unit 15 is the apex of the object placed on the reference plane, which is in contact with the reference plane (that is, the apex of the bottom of the object), and is located on the information processing apparatus 10 (that is, the imaging position). The guide image 104 marked with a red circle is superimposed and displayed on the vertex corresponding to the vertex at the nearest position. At this time, the image 103 imitating a box corresponding to an object and the object actually placed on the reference plane do not have to have exactly the same shape and posture. That is, it is sufficient for the operator to see the image 103 and the guide image 104 and understand which vertex position of the object actually placed on the reference plane should be specified.

Further, the guide unit 15 "selects the same place as the red part in the figure" in the predetermined display area of the display 1006a of the information processing apparatus 10 (here, the upper end of the entire rectangular display area of the display 1006a). . (1/4) ”is displayed. "(1/4)" in this message means that there are a total of four vertex designation operations by the operator, and the operation of the first rank among them is guided. With this guidance, the operator can understand which of the vertices of the object should be specified and how far the specified operation has progressed in all the operation procedures. ..

The operator touches (designates) the vertices of the object 102 corresponding to the vertices guided by the guide image 104 on the display 1006a by his / her own hand 105. In response to this operation, the guide unit 15 displays an image 106a, which means that a vertex has been designated, at the touched position, as shown in FIG. 5 (A). Here, the reason why the operation of designating the apex near the information processing device 10 (that is, the imaging position) is set to the first order is that the vicinity of the apex is displayed large on the display 1006a, so that the apex by the operator is displayed. This is because the designation of is easy and accurate.

Next, the guide unit 15 guides the vertex to be designated next by the operator and guides the range in which the operator can specify the vertex next. Specifically, as shown in FIG. 5B, in the image 103 that imitates a box corresponding to an object, the guide unit 15 is a vertex that is continuous with respect to the first-ranked vertex via one side of the object. Moreover, the guide image 104 such as a red circle is superimposed and displayed on the apex closest to the information processing device 10 (that is, the imaging position).

Further, the guide unit 15 displays a chain line image 107 such as a chain line extending vertically upward with respect to the reference plane 101 from the image 106a, which means that the apex is designated. Here, as described above, it is assumed that the rectangular cuboid object 102 is placed on a horizontal floor surface which is a reference surface 101. Therefore, the vertices that are continuous with respect to the first-ranked vertices via one side of the object and are located closest to the information processing apparatus 10 are in the vertical direction from the image 106a with respect to the reference plane 101. It will be on a straight line extending upward. That is, the chain line image 107 means a range in which the operator can specify the vertices next.

Further, the guide unit 15 displays a message such as "Please select the same place as the red part in the figure. (2/4)" on the upper end of the display 1006a of the information processing apparatus 10. "(2/4)" in this message means that there are a total of four vertices designation operations by the operator, and the operation of the second rank among them is guided.

The operator performs an operation of touching (designating) the vertices corresponding to the vertices guided by the guide image 104 on the display 1006a by his / her own hand 105. In response to this operation, the guide unit 15 displays an image 106b, which means that a vertex has been designated, at the touched position, as shown in FIG. 5 (B). Here, the reason why the operation of designating the apex near the information processing device 10 (that is, the imaging position) is set to the second order is that the vicinity of the apex is displayed large on the display 1006a, so that the apex by the operator is displayed. This is because the designation of is easy and accurate.

Further, the guide unit 15 guides the vertex to be designated next by the operator and guides the range in which the operator can specify the vertex next. Specifically, as shown in FIG. 6A, in the image 103 imitating a box corresponding to an object, the guide unit 15 is connected to the second-ranked vertices via one side of the object. A guide image 104 such as a red circle is superimposed and displayed on any of the vertices. Further, the guide portion 15 has a chain line extending from the image 106b, which means that the apex is designated, in the horizontal direction with respect to the reference plane 101 and in the direction in which the next apex to be designated will exist. The chain line image 107 such as is displayed. Further, the guide unit 15 displays a message such as "Please select the same place as the red part in the figure. (3/4)" on the upper end of the display 1006a of the information processing apparatus 10.

The operator performs an operation of touching (designating) the vertices corresponding to the vertices guided by the guide image 104 on the display 1006a by his / her own hand 105. In response to this operation, the guide unit 15 displays an image 106c, which means that a vertex is designated at the touched position, as shown in FIG. 6A.

Then, the guide unit 15 guides the vertex to be designated next by the operator and guides the range in which the operator can specify the vertex next. Specifically, as shown in FIG. 6B, the guide unit 15 is an image 103 that imitates a box corresponding to an object, and is a vertex that is continuous with respect to a vertex of the third rank via one side of the object. Therefore, the guidance image 104 such as a red circle is superimposed and displayed on the apex required to measure the last one of the three sides of the object which is a rectangular cuboid. Further, the guide portion 15 has a chain line extending from the image 106b, which means that the apex is designated, in the horizontal direction with respect to the reference plane 101 and in the direction in which the next apex to be designated will exist. The chain line image 107 of is displayed. Further, the guide unit 15 displays a message such as "Please select the same place as the red part in the figure. (4/4)" on the upper end of the display 1006a of the information processing apparatus 10.

The operator performs an operation of touching (designating) the vertices corresponding to the vertices guided by the guide image 104 on the display 1006a by his / her own hand 105. In response to this operation, the guide unit 15 displays an image 106d, which means that a vertex has been designated, at the touched position, as shown in FIG. 6 (B).

When the operation of designating the vertices by the operator is completed, the detection unit 13 detects the three-dimensional coordinates of each of the designated vertices (FIG. 3: step S13). At this time, the detection unit 13 detects the coordinates of each vertex, for example, with the reference plane as the XY plane and the position of the first designated vertex as the origin of the XYZ coordinate space.

Finally, the calculation unit 14 calculates the distance between two adjacent vertices via one side of the three vertices based on the coordinates detected for the three vertices specified by the operator. , The size of the object (here, the total length of the three sides of the object) is calculated (step S14).

According to the embodiment described above, the operation performed by the operator is only the designation of the three vertices necessary for measuring the size of the object. Therefore, for example, in a display displaying an image of an object, the operation of the operator is simpler than that of a method of designating the positions of three sides of the object by a drag operation or the like.

[Modification example]
The present invention is not limited to the embodiments described above. The above-described embodiment may be modified as follows. Further, the following two or more modified examples may be combined and carried out.

[Modification 1]
In the embodiment, the guide unit 15 guides the vertex to be designated next by the operator, but instead of or in addition to this, the guide unit 15 may guide the vertex already designated by the operator. good. For example, the guide unit 15 has the same display method as when the guide image 104 with a red circle is superimposed on the vertex to be designated next in the image 103, and the guide image is displayed on the vertex already designated in the image 103. A guide image that can be identified with (for example, a guide image with a blue circle) may be superimposed and displayed.

[Modification 2]
In order for the detection unit 13 to more accurately detect the coordinates of the apex of the object, there is a condition that must be satisfied for at least one of the distance between the image pickup device 1005a and the reference plane or the image pickup direction by the image pickup device 1005a. .. This condition will be described with reference to FIGS. 7 and 8. FIG. 7 is a diagram illustrating the distance between the image pickup device 1005a and the reference plane 101 and the image pickup direction by the image pickup device 1005a. As for the distance between the image pickup device 1005a and the reference plane, as can be seen by comparing FIGS. 7 (A) and 7 (B), the smaller the distance L, that is, the closer the information processing device 10 and the reference plane 101 are. The closer to the apex P of the object 102, is displayed on the display 1006a, so that the operator can easily and accurately specify the apex P, and the coordinate detection accuracy by the detection unit 13 is also high. It gets higher. Therefore, as a condition of the distance between the image pickup device 1005a and the reference plane, a certain upper limit is set for the value of the distance. The imaging range of the imaging device 1005a is a range sandwiched by the two chain wires S.

Regarding the image pickup direction by the image pickup device 1005a, the more the image pickup direction by the image pickup device 1005a is perpendicular to the reference plane, the easier and more accurate the operator can specify the apex, and the coordinates by the detection unit 13. The detection accuracy of is also high. For example, in FIG. 7A, the image pickup direction by the image pickup device 1005a is closer to perpendicular to the reference plane than in FIG. Since the Z coordinate of the vertex P is "0", it is the X and Y coordinates that should be specified, but it is easier to specify the X and Y coordinates more accurately when viewed from the direction perpendicular to the reference plane. Therefore, the condition that the image pickup direction of the image pickup device 1005a is within a certain range with respect to the reference plane is determined.

In this case, the information processing apparatus 10 stores a condition storage unit that stores a condition to be satisfied with respect to the distance between the image pickup device that images the space including the object and the reference plane, or the image pickup direction by the image pickup device, and the condition. It is provided with a first notification unit that notifies when the condition is satisfied or the condition is not satisfied. The operator may perform imaging by changing the position and imaging direction of the imaging device in response to this notification. Note that the notification (for example, the notification of "being X") is not limited to the explicit notification, and may be implicit (for example, the notification is not performed) (the same shall apply hereinafter).

[Modification 3]
In other words, it can be said that there is an appropriate range for the imaging position for each vertex of the object. In this case, the information processing apparatus 10 has, for each vertex, a range storage unit that stores a range in which the image pickup device for imaging the vertex should exist, and when the image pickup device exists in the range or the image pickup device in the range. It is provided with a second notification unit that notifies when it does not exist. The operator may change the position of the imaging device to perform imaging in response to this notification.

[Modification 4]
The information processing apparatus 10 may superimpose the position designated by the operator on the object and the image near the apex targeted for the designation and display it in an enlarged manner. Specifically, as shown in FIG. 9, the information processing apparatus 10 has a circular shape in a predetermined display area of the display 1006a (here, in the upper right corner of the entire rectangular display area of the display 1006a when viewed from the operator). Enlarged display area is provided. The information processing apparatus 10 superimposes and displays an image 109, which means a position designated by the operator on an object, and an image 108 near the apex, which is the target of the designation, on the enlarged display area. In this case, in the information processing apparatus 10, the guide unit 15 superimposes and displays the position designated by the operator for the apex and the captured image in a predetermined range from the designated position.

[Modification 5]
The information processing apparatus 10 may output (for example, display) additional information about an object whose size is to be measured. This additional information is, for example, information about the measured baggage size, the range of the baggage weight estimated from the size, or the shipping fee required to deliver the baggage of that size or weight. .. In this case, the information processing apparatus 10 includes an information output unit that outputs information regarding the size and weight of the object or the charge required for delivery of the object.

[Modification 6]
A limit on the moving speed of the image pickup device 1005a or a limit on the brightness at the time of imaging may be set so as to notify when the limit is out of the range. That is, if the moving speed of the image pickup device 1005a is too fast, the space may not be recognized normally, and if it is too dark or too bright at the time of imaging, the space may not be recognized normally. Notify in such cases. In this case, the information processing apparatus 10 limits the moving speed of the image pickup device that images the space including the object, or limits the brightness when the image pickup device performs image pickup. It is provided with a third notification unit that notifies when the limit is within or outside the limit. The operator may perform imaging by changing the moving speed of the imaging device and the lighting method in response to this notification.

[Modification 7]
In the above embodiment, the information processing device 10 that performs imaging calculates the size of an object by itself. For example, the device that performs imaging transmits the imaging data to the server device via the network, and the server device recognizes the image. It may function as an information processing device that realizes the unit 12, the detection unit 13, the calculation unit 14, and the guide unit 15.

When designating vertices, the order of designation is not limited to the order exemplified in the embodiment.

Further, in the present invention, the computer has a recognition unit that recognizes a reference plane in contact with the object in an image captured in a space including an object having a plurality of vertices, and each vertex of the object in the captured image. , When the operator designates the vertices in contact with the reference plane in a predetermined order with the vertices in contact with the reference plane as the first order, the coordinates of each of the designated vertices in the space are determined based on the result of recognizing the reference plane. It may be a program for functioning as a detection unit for detecting and a calculation unit for calculating the size of the object based on the coordinates detected for each of the vertices.

[Other variants]
The block diagram used in the description of the above embodiment shows a block of functional units. These functional blocks (components) are realized by any combination of hardware and / or software. Further, the means for realizing each functional block is not particularly limited. That is, each functional block may be realized by one physically and / or logically coupled device, or directly and / or indirectly by two or more physically and / or logically separated devices. (For example, wired and / or wireless) may be connected and realized by these plurality of devices.

The processing procedures, sequences, flowcharts, and the like of each aspect / embodiment described in the present specification may be rearranged in order as long as there is no contradiction. For example, the methods described herein present elements of various steps in an exemplary order and are not limited to the particular order presented.
Each aspect / embodiment described in the present specification may be used alone, in combination, or may be switched and used according to the execution.

The information or parameters described herein may be represented by absolute values, relative values from a given value, or other corresponding information. The names used for the parameters mentioned above are not limited in any way. Further, mathematical formulas and the like using these parameters may differ from those expressly disclosed herein.

The present invention may be provided as an information processing method including steps of processing performed in the information processing apparatus 10. Further, the present invention may be provided as a program executed by the information processing apparatus 10. Such a program may be provided in a form stored in a storage medium such as an optical disk, or may be provided in a form such as being downloaded to a computer via a network such as the Internet and being installed and made available. It is possible.

Software, instructions, etc. may be transmitted and received via a transmission medium. For example, the software may be a website, server, or other using wired technology such as coaxial cable, fiber optic cable, twist pair and digital subscriber line (DSL) and / or wireless technology such as infrared, wireless and microwave. When transmitted from a remote source, these wired and / or wireless technologies are included within the definition of transmission medium.

The information, signals, etc. described herein may be represented using any of a variety of different techniques. For example, data, instructions, commands, information, signals, bits, symbols, chips, etc. that may be referred to throughout the above description are voltages, currents, electromagnetic waves, magnetic fields or magnetic particles, light fields or photons, or any of these. It may be represented by a combination of.

The terms described herein and / or the terms necessary for understanding the present specification may be replaced with terms having the same or similar meanings.

As long as "inclusion", "comprising", and variations thereof are used herein or within the scope of the claims, these terms are as comprehensive as the term "comprising". Intended to be targeted. Moreover, the term "or" as used herein or in the claims is intended to be non-exclusive.

Throughout this disclosure, if articles are added by translation, for example, a, an, and the in English, these articles are not explicitly indicated by the context to be otherwise. It shall include more than one.

Although the present invention has been described in detail above, it is clear to those skilled in the art that the present invention is not limited to the embodiments described in the present specification. The present invention can be implemented as an amendment and a determination mode without departing from the spirit and scope of the present invention as determined by the description of the scope of claims. Therefore, the description of the present specification is for the purpose of exemplifying explanation and does not have any limiting meaning to the present invention.

10 ... Information processing device, 11 ... Imaging unit, 12 ... Recognition unit, 13 ... Detection unit, 14 ... Calculation unit, 15 ... Guide unit, 1001 ... Processor, 1002 ... Memory, 1003 ... Storage, 1004 ... Communication device, 1005 ... Input device, 1005a ... Imaging device, 1005b ... Touch sensor, 1006 ... Output device, 1006a ... Display.

Claims (10)

A recognition unit that recognizes a reference plane in contact with an object in a captured image of a space including an object having a plurality of vertices.
In the captured image, when each vertex of the object is designated by the operator in a predetermined order with the vertices in contact with the reference plane as the first order, the designation is based on the result of recognizing the reference plane. A detector that detects the coordinates of each of the vertices in the space,
An information processing apparatus including a calculation unit that calculates the size of the object based on the coordinates detected for each of the vertices. The predetermined order is
The apex in contact with the reference plane is set as the first rank.
The information processing apparatus according to claim 1, wherein the following is an order in which the vertices connected to the vertices of the next higher rank via one side of the object are in the next rank. A condition storage unit that stores conditions that should be satisfied with respect to the distance between the image pickup device that images the space including the object and the reference plane, or the image pickup direction by the image pickup device.
The information processing apparatus according to claim 1 or 2, further comprising a first notification unit that performs notification when the conditions are satisfied or when the conditions are not satisfied. For each of the vertices, a range storage unit that stores a range in which an imaging device that images the vertex should exist, and a range storage unit.
The information according to any one of claims 1 to 3, further comprising a second notification unit that performs notification when the image pickup device is present in the range or when the image pickup device is not present in the range. Processing equipment. The information processing apparatus according to any one of claims 1 to 4, wherein the operator includes a guide unit that performs a process for guiding an operation for designating the apex in the captured image. The information processing apparatus according to claim 5, wherein the guide unit guides the vertex to be designated next by the operator or the vertex already designated by the operator. The information processing apparatus according to claim 5, wherein the guide unit guides a range in which the operator can specify the apex in the captured image. Any of claims 5 to 7, wherein the guide unit superimposes and displays a position designated by the operator for the apex and the captured image in a predetermined range from the designated position. The information processing apparatus according to item 1. The information processing apparatus according to any one of claims 1 to 8, further comprising an information output unit that outputs information regarding the size, weight, or charge required for delivery of the object. A limiting storage unit that stores a limitation on the moving speed of an imaging device that images a space containing an object, or a limitation on the brightness when the imaging device performs imaging.
The information according to any one of claims 1 to 9, further comprising a third notification unit that notifies when an image pickup within or outside the limit is performed by the image pickup device. Processing equipment.

Images