JP2022017919A - Delivery completion information collection system and delivery completion information collection method - Google Patents

Abstract

To specify coordinates of an element which a user wants to extract on a receipt image by correctly capturing and transmitting the receipt image.SOLUTION: A delivery completion information collection system comprises: a storage unit; a coordinate information acquisition unit; a two-dimensional code coordinate specification unit; and an imaging range estimation unit. The storage unit holds coordinate information on a sheet surface of components of a receipt. The coordinate information on the sheet surface of components of the receipt includes coordinate information on the sheet surface of plural points of a two-dimensional code and a coordinate value on the sheet surface in a collection range of the image of the receipt. The coordinate information acquisition unit acquires the coordinate value on the sheet surface in the collection range of the image of the receipt. The two-dimensional code coordinate specification unit specifies the coordinate value on a screen of the plural points of the two-dimensional code in the captured image of the receipt. The imaging range estimation unit estimates the coordinate value on the screen in the collection range of the image of the receipt on the basis of a relation between a distance between the coordinate values on the sheet surface of the plural points of the two-dimensional code and a distance between the coordinate values on the screen of the plural points of the two-dimensional code and the coordinate information on the sheet surface of the components of the receipt.SELECTED DRAWING: Figure 2

Description

The present invention relates to a delivery completion information collecting technique in a physical distribution business.

In the logistics industry, in order to improve work efficiency, it is required to grasp the work status of the delivery person and the delivery status of the product in real time as much as possible. As an example, it is required to acquire the delivery completion information of the delivery person. For example, a delivery person may send a receipt image, and by acquiring the image, delivery completion information may be acquired, and it is required to record this.

As a problem of concern, it is conceivable that the delivery person sends a false receipt image due to falsification or malfunction, and accurate delivery completion information cannot be obtained. For example, the delivery person may mistakenly send a receipt image that does not show the correct shooting range, or may intentionally or mistakenly send an image of a receipt that is different from the completed delivery. be.

Patent Document 1 discloses a receipt storage system and a receipt storage program that can store and retrieve highly reliable receipts without burden. This includes a mobile terminal that includes the consignee's imprint information and inputs receipt image information that proves that the delivery package has been received, and stores customer information including the customer imprint information in advance, and delivers delivery package identification information and receipt image information. It is provided with a storage unit that connects and stores the information, and a control unit that determines whether or not the consignee imprint information and the customer imprint information of the addressee himself / herself match.

Further, Patent Document 2 provides an imaging technique capable of image correction and high document reproducibility without being affected by the placement of the document or the position of the camera, and even if the color of the paper or the corners are crushed. Disclose. This is a mobile phone with a camera such as a digital camera or smartphone. When shooting a document, a positioning symbol is printed on the document paper, and image processing is performed based on this positioning symbol to perform image processing on the color and corners of the paper. Even if the part is crushed, image correction (trapezoidal correction) is possible, and image processing with high document reproducibility becomes possible.

Japanese Unexamined Patent Publication No. 2002-31244 Japanese Unexamined Patent Publication No. 2012-151900

In Patent Document 1, the delivery person reads the surface of the receipt stamped with the consignee's judgment with an image scanner, or obtains the receipt image using a digital camera, thereby delivering the receipt image information and delivery. The slip identification information is transmitted from the mobile terminal to the host computer. Therefore, although the delivery completion information is transmitted, no effort is made to confirm and adjust whether the received receipt image to be transmitted correctly includes the shooting range of the receipt.

On the other hand, Patent Document 2 provides a technique for shooting a shooting range surrounded by a positioning symbol in a correct and highly reproducible state without being affected by the placement of the document to be shot and the position of the camera. There is. However, the coordinates of each element included in the shooting range cannot be specified, and the image of each element to be extracted cannot be partially acquired.

Therefore, it is an object of the present invention to be able to correctly capture and transmit a receipt image, to specify the coordinates of a plurality of elements to be extracted on the receipt image, and to partially extract the image of each element. And.

The delivery completion information collection system, which is one aspect of the invention disclosed in the present application, has a storage unit, a coordinate information acquisition unit, a two-dimensional code coordinate identification unit, and a shooting range estimation unit, and the storage unit includes a storage unit. For each format of the receipt certifying that the shipping destination has received the package, the coordinate information on the paper of the component of the receipt is retained, and the coordinate information on the paper of the component of the receipt is the above. The coordinates include, on paper, coordinate information of a plurality of points of the two-dimensional code including the identification information of the receipt printed on the receipt, and coordinate values on the paper of the collection range of the image of the receipt. The information acquisition unit acquires the coordinate values on the paper of the collection range of the image of the receipt corresponding to the format of the receipt specified based on the identification information of the receipt from the storage unit, and obtains the coordinate values on the paper. The dimensional code coordinate specifying unit identifies the coordinate values on the screen of the terminal device at a plurality of points of the two-dimensional code in the image obtained by displaying the receipt taken by the terminal device on the screen of the terminal device. The photographing range estimation unit sets the distance between the coordinate values of the plurality of points of the two-dimensional code on the paper and the distance between the coordinate values of the plurality of points of the two-dimensional code on the screen of the terminal device. It is characterized in that the coordinate value on the screen of the terminal device in the collection range of the image of the receipt is estimated based on the relationship and the coordinate information on the paper of the component of the receipt.

According to a typical embodiment of the present invention, it is possible to obtain a receipt image that correctly captures the shooting range of the receipt. Issues, configurations and effects other than those described above will be clarified by the description of the following examples.

It is a block diagram which shows the hardware configuration example of the delivery completion information collection system of Example 1 of this invention. It is a block diagram which shows the functional configuration example of the delivery completion information collection system of Example 1 of this invention. It is a flowchart which shows the example of the notification processing procedure by the delivery completion information collection system of Embodiment 1 of this invention. It is a flowchart which shows the example of the notification processing procedure by the delivery completion information collection system of Embodiment 1 of this invention. It is explanatory drawing which shows an example of the receipt used in Example 1 of this invention. It is explanatory drawing which shows an example of the 1st input data to the server of the delivery completion information collection system of Embodiment 1 of this invention. It is explanatory drawing which shows an example of the table of the receipt information management database stored in the storage device of Example 1 of this invention. It is explanatory drawing which shows an example of the table of the receipt information management database stored in the storage device of Example 1 of this invention. It is explanatory drawing which shows an example of the 2nd input data to the mobile terminal of the delivery completion information collection system of Embodiment 1 of this invention. It is explanatory drawing which shows an example of the output data to the mobile terminal of the delivery completion information collection system of Example 1 of this invention. It is a flowchart which shows the example of the coordinate estimation processing procedure on the screen of each element of a receipt by the delivery completion information collection system of Embodiment 1 of this invention. It is explanatory drawing which shows an example of the shooting screen of the mobile terminal by the delivery completion information collection system of Embodiment 1 of this invention. It is explanatory drawing which shows an example of the receipt image transmission screen of a mobile terminal by the delivery completion information collection system of Embodiment 1 of this invention. It is explanatory drawing which shows an example of the transmission completion screen of the receipt image of a mobile terminal by the delivery completion information collection system of Embodiment 1 of this invention. It is explanatory drawing which shows an example of the pasting type receipt used in Example 2 of this invention.

Hereinafter, the present invention will be described in detail according to examples with reference to the accompanying drawings. The configuration shown in the following examples is only an example, and the present invention is not limited to the illustrated configuration. Also, in many cases, the user refers to the delivery person.

In the first embodiment, after the user delivers the product to the shipping destination, the person in charge at the shipping destination sends an image of the receipt with the receipt sign on the receipt to the server to notify the delivery completion information. Is shown.

A receipt is a document that the shipper gives to the shipper as proof that the package has been received. The receipt is issued by the shipper or the carrier, and the person in charge at the shipper fills in the receipt sign to provide a certificate that the shipper has received the package. Receipts are often returned to the carrier or shipper. The delivery completion information is proof information that the shipping destination has received the package, for example, an image of a receipt with a receipt sign written by the person in charge of the shipping destination after the shipping destination receives the package. Applicable.

Here, the person in charge of the shipping destination is a person in charge of the business of receiving the delivered package at the shipping destination (that is, the delivery destination). For example, if the shipping destination is a company, the person in charge of the shipping destination may be the person in charge of receiving the package under the company, and if the shipping destination is an individual, the person in charge of the shipping destination is the individual himself / herself. It may be.

In the first embodiment, an example of transmitting a receipt image showing the correct shooting range by estimating the coordinates of the shooting range on the display and displaying a frame indicating the shooting range on the display will be described. As an example of the portable delivery completion information notification device having a camera function, the receipt image will be described below by taking a mobile terminal with a camera as an example. So-called tablet PCs and smartphones are typical examples of mobile terminals that can take pictures and perform data communication in any place by equipping them with wireless communication functions. Hereinafter, the configuration and processing flow of the delivery completion information collection system will be described.

<Example of Embodiment of delivery completion information collection system>
FIG. 1 is a block diagram showing a hardware configuration example of the delivery completion information collection system according to the first embodiment of the present invention.

The delivery completion information collection system 100 includes a server 110 and a mobile terminal 120.

The server 110 includes a processor 111, a storage device 112, and a communication unit 113. The processor 111, the storage device 112, and the communication unit 113 are connected by a bus 114. The processor 111 controls the server 110. Further, the processor 111 rewrites the contents of the receipt information management database 115 stored in the storage device 112, writes a receipt image, etc., searches the receipt information management database 115, and describes each element on the paper of the receipt. Read out coordinate information.

The storage device 112 stores information necessary for processing of the processor 111 such as a program, a receipt information management database 115, and the like. The receipt information management database 115 will be described later with reference to FIGS. 6A and 6B.

The communication unit 113 connects to a network 130 such as the Internet, receives information transmitted from the mobile terminal 120, and transmits the information to the mobile terminal 120.

The mobile terminal 120 is carried by a user such as a delivery person at the time of delivery, transmits a receipt image to the server 110, and receives a reception completion notification from the server 110. The mobile terminal 120 includes an input device 121, a display 122, a two-dimensional code reader 123, a storage device 124, a processor 125, and a communication unit 126.

The processor 125 is connected to an input device 121, a display 122, a two-dimensional code reader 123, a storage device 124, and a communication unit 126, and controls the overall operation of the mobile terminal 120.

The input device 121 is an input device for the user to select to send or re-shoot the receipt image. The input device 121 includes, for example, a touch panel on the display 122. The input device 121 may further include a camera that captures a receipt image or the like.

The two-dimensional code reader 123 acquires the receipt identification ID and the coordinate information of the two-dimensional code on the screen by reading the two-dimensional code of the receipt at the time of delivery. The receipt identification ID is an ID for identifying the receipt. As the receipt identification ID, the delivery ID of the ID that identifies the delivery may be used.

The storage device 124 stores coordinate information on the screen of the mobile terminal required for processing of the processor 125. The coordinate information on the screen is information indicating where each element described in the receipt is located on the shooting screen of the mobile terminal.

The communication unit 126 transmits a receipt image or the like to the server 110 through the network 130.

<Example of functional configuration of delivery completion information collection system>
FIG. 2 is a block diagram showing a functional configuration example of the delivery completion information collection system 100 according to the first embodiment of the present invention.

The coordinate information 231 on the paper and the document format ID information 237 of the receipt are stored in the storage device 112 of the server 110. The coordinate information 231 on the paper is information indicating where each element described in the receipt is located on the paper of the receipt. Further, the receipt identification ID acquired by reading the two-dimensional code 232 printed on the receipt, the coordinate information of the two-dimensional code on the screen, and the receipt image 235 are stored in the storage device 124 of the mobile terminal 120. ing. The frame 234, the receipt image 235, and the transmission completion information 236 are displayed on the display 122 of the mobile terminal 120.

The server 110 of the delivery completion information collection system 100 has a coordinate information acquisition unit 211 and an output result storage unit 212. Specifically, these are functions realized by, for example, causing the processor 111 to execute a program stored in the storage device 112 shown in FIG.

The mobile terminal 120 of the delivery completion information collection system 100 transmits the receipt identification ID input unit 221, the two-dimensional code coordinate identification unit 222, the shooting range estimation unit 223, the shooting range display unit 224, and the shooting unit 225. It has a completion notification unit 226 and. Specifically, these are functions realized by, for example, causing the processor 125 to execute a program stored in the storage device 124 shown in FIG.

In FIG. 2, it is assumed that the receipt identification ID input unit 221, the two-dimensional code coordinate identification unit 222, and the shooting range estimation unit 223 are arranged on the mobile terminal 120, but in the form of a web application. , It is also possible to realize those functions by the processing of the server 110. In that case, the receipt identification ID input unit 221, the two-dimensional code coordinate identification unit 222, and the shooting range estimation unit 223 may, for example, cause the processor 111 to execute the program stored in the storage device 112 shown in FIG. It is a function to be realized.

<Example of notification processing procedure by delivery completion information collection system>
3A and 3B are flowcharts showing an example of a notification processing procedure by the delivery completion information collecting system 100 according to the first embodiment of the present invention.

Before starting the delivery completion information collection process, the coordinate information acquisition unit 211 of the server 110 takes in the receipt identification ID and the coordinate information 231 on the paper associated with the document format ID corresponding to the receipt identification ID. , Registered in the receipt information management database 115 stored in the storage device 112 (step S301). Elements that you want to extract from the receipt include, for example, a two-dimensional code, delivery information such as shipping address and goods to be delivered, receipt sign, delivery person information, and shooting range. The details of the coordinate information 231 on the paper acquired by the server 110 will be described later with reference to FIG.

The receipt 400 is a certificate certifying that the shipping destination has received the delivery by having the person in charge of the shipping destination fill in the receipt sign after delivery. An example of the format of the receipt 400 will be described later with reference to FIG. In addition, instead of writing the receipt sign on the receipt, stamping the receipt stamp may be used as proof of delivery completion.

Next, the delivery completion information collecting system 100 determines whether or not there is an instruction to end the notification process by the user (step S302). When there is an end instruction (step S302: Yes), the delivery completion information collecting system 100 ends the notification process. If there is no end instruction (step S302: No), the delivery completion information collecting system 100 starts the notification process after step S303.

Next, the receipt identification ID input unit 221 of the mobile terminal 120 reads the two-dimensional code 232 on the receipt using the two-dimensional code reader 123 (step S303).

Next, the receipt identification ID input unit 221 of the mobile terminal 120 accesses the URL of the server 110 corresponding to the two-dimensional code, and the receipt identification ID read from the two-dimensional code 232 is used as the coordinate information acquisition unit 211 of the server 110. (Step S304).

Next, the coordinate information acquisition unit 211 of the server 110 searches for the document format ID information 237 corresponding to the receipt identification ID, and the coordinates of each element on the paper including the shooting range corresponding to the document format ID information 237. The information 231 is transmitted to the shooting range estimation unit 223 of the mobile terminal 120 (step S305).

Next, the shooting range display unit 224 of the mobile terminal 120 displays the frame 234 on the screen (step S306).

Next, the two-dimensional code coordinate specifying unit 222 of the mobile terminal 120 reads the coordinate information of the two-dimensional code on the screen from the two-dimensional code 232 on the receipt and transmits it to the shooting range estimation unit 223 (step S307). .. The details of the coordinate information of the two-dimensional code on the screen will be described later with reference to FIG. 7.

Next, the shooting range estimation unit 223 of the mobile terminal 120 estimates the coordinates of the element to be extracted including the shooting range, transmits the coordinate information of each element on the screen to the output result storage unit 212, and shoots the shooting range on the screen. (Step S308), the coordinate information of the above is transmitted to the shooting range display unit 224.

The output result storage unit 212 stores the coordinate information of each element on the screen in the receipt information management database 115 stored in the storage device 112. The details of the coordinate information of the shooting range on the screen will be described later with reference to FIG. The details of the shooting range estimation processing procedure on the screen will be described later with reference to FIG.

Next, in the mobile terminal 120, when the receipt is copied on the screen by the camera function, the shooting unit 225 determines the shooting timing (step S309). Whether or not the shooting range 233 on the paper of the receipt is within the frame 234 is a criterion. For example, when the shooting range 233 on the paper of the receipt is within the frame 234, it is determined that the shooting timing has arrived. When it is determined that the shooting timing has arrived (step S309: YES), the shooting unit 225 automatically shoots (step S310). If it is determined that the shooting timing has not arrived (step S309: NO), the process returns to step S307.

Next, the mobile terminal 120 displays the receipt image 235, the transmission button, and the re-shooting button taken by the shooting unit 225 on the screen (step S311). In the mobile terminal 120, the transmission button or the re-shooting button is pressed on the screen by the user (step S312). When the send button is pressed, the photographing unit 225 of the mobile terminal 120 transmits the receipt identification ID read from the two-dimensional code 232 and the receipt image 235 to the output result storage unit 212 of the server 110 (step S313). ). When the re-shooting button is pressed, the process returns to step S306. Examples of display screens in steps S306 to S313 will be described later with reference to FIGS. 10 to 12.

In reality, the camera included in the input device 121 of the mobile terminal 120 may continuously capture the receipt image, and the display 122 may display the image. In that case, the automatic shooting in step S310 may be a process in which the shooting unit 225 holds the image taken by the camera when the shooting timing arrives as an image to be transmitted to the server 110. The image held there is transmitted to the output result storage unit 212 of the server 110 in step S313.

Next, the output result storage unit 212 of the server 110 stores the receipt image 235 in the receipt information management database 115 stored in the storage device 112 (step S314). If the receipt image 235 is already stored in the receipt information management database 115, the output result storage unit 212 notifies the transmission completion notification unit 226 of the mobile terminal 120 that the delivery completion information has already been collected. You may.

Next, the output result storage unit 212 of the server 110 transmits a reception completion notification to the transmission completion notification unit 226 of the mobile terminal 120 (step S315).

Next, the transmission completion notification unit 226 of the mobile terminal 120 displays the transmission completion information 236 on the screen (step S313).

Next, returning to step S302, the delivery completion information collection system 100 ends the notification process if the user gives an instruction to end the notification process (step S302: Yes).

<Example of the format of the receipt used in Example 1>
FIG. 4 is an explanatory diagram showing an example of the receipt 400 used in the first embodiment of the present invention.

The receipt 400 includes a shipping source name address 401, a delivery ID 402, a receipt date 403, a delivery person information 404, a shipping destination name address 405, a delivery detail information 406, a two-dimensional code 232, a receipt sign entry field 407, and a remarks field. 408 and the like are printed. The detailed delivery information 406 is printed with the product name / standard, quantity, unit, remarks, and the like. The receipt sign entry field 407 is a field for the person in charge of the shipping source to fill in the receipt sign. Various items such as cautionary notes are printed in the remarks column 408. The two-dimensional code 232 stores the URL for accessing the server 110 and the receipt identification ID information. The format of the receipt in FIG. 4 is merely an example, and is not limited to this.

<Example of first input data>
FIG. 5 is an explanatory diagram showing an example of first input data to the server 110 of the delivery completion information collection system 100 according to the first embodiment of the present invention.

The first input data is the receipt identification ID, the document format ID information 237 corresponding to the receipt identification ID, and the coordinate information 231 on the paper of each element of the receipt corresponding to the document format ID. As the coordinate information on the paper of each element of the receipt, the shipping source name address 401, the delivery ID 402, the receipt date 403, the delivery person information 404, the shipping destination name address 405, the delivery details information 406, the two-dimensional code 232, the receipt sign. It has coordinate information on paper such as an entry field 407, a remarks field 408, and a shooting range 233 on paper of the receipt.

The coordinate information of the two-dimensional code 232 on the paper and the coordinate information of the shooting range 233 on the paper must be captured in order to perform the coordinate estimation processing of the shooting range on the screen. The coordinate information on the paper of the element to be acquired is the coordinate information of the four corners of the rectangle as small as possible that can surround each element of the receipt. However, as the coordinate information of the two-dimensional code on the paper, the center coordinates of the three black squares at the corners of the two-dimensional code are acquired.

Here, as an example, consider a coordinate system in which the lower left corner of the receipt is the origin, the x-axis extends to the right, and the y-axis extends upward, but the numerical values of the coordinates are merely examples and are not limited. As the coordinate information on the paper of the receipt, the coordinate information of the four corners of (0,0), (x501, y501), (x502, y502), and (x503, y503) in FIG. 5 is acquired. Based on the coordinate information on the paper of the receipt, the coordinate information of the two-dimensional code on the paper is (x511, y511), (x512, y512), (x513, y513), and (x514, y514) of FIG. To get. Further, based on the coordinate information on the paper of the receipt, as the coordinate information of the shooting range on the paper, (x521, y521), (x522, y522), (x523, y523), (x524, y524) of FIG. Get the coordinate information of the four corners of.

<Example of receipt information management database table>
6A and 6B are explanatory views showing an example of a table of the receipt information management database 115 stored in the storage device 112 of the first embodiment of the present invention.

The receipt information management database 115 is a screen acquired from the table 610 (FIG. 6A) having the coordinate information 231 on the paper corresponding to the document format ID, the document format ID information 237 corresponding to the receipt identification ID, and the mobile terminal 120. It has a table 620 (FIG. 6B) with the above coordinate information.

The table 610 shown in FIG. 6A has coordinate information 231 on paper of each element of the receipt associated with each document format ID 611. Elements for acquiring coordinate information on paper include, for example, a two-dimensional code 612, a shooting range 613, and a receipt sign entry field 614, and the coordinate information of the four corners of a rectangle as small as possible that can enclose each element. To store.

The table 620 shown in FIG. 6B has the document format ID information 237 associated with the receipt identification ID 621 and the coordinate information on the screen of each element of the receipt. Elements for acquiring coordinate information on the screen include, for example, a two-dimensional code 622, a shooting range 623, and a receipt sign entry field 624, and the coordinate information of the four corners of a rectangle as small as possible that can enclose each element. To store. As for the coordinate information on the screen, empty data is stored before the delivery completion information collection process is started, and the coordinate information is written by being transmitted by the shooting range estimation unit in step S308.

<Example of second input data>
FIG. 7 is an explanatory diagram showing an example of second input data to the mobile terminal 120 of the delivery completion information collection system 100 according to the first embodiment of the present invention.

The second input data 700 is the receipt identification ID and the coordinate information of the two-dimensional code on the screen. The three black squares at the corners of the two-dimensional code are called position detection patterns. The two-dimensional code coordinate specifying unit 222 acquires the coordinates of the centers I, J, and L of these position detection patterns by identifying the position detection pattern.

Here, as an example, consider a coordinate system in which the lower left corner of the screen of the mobile terminal 120 is the origin, the x-axis extends to the right, and the y-axis extends upward. However, the numerical values of the coordinates shown here are merely examples and are not limited to these. The center coordinates of the three black squares at the corners of the two-dimensional code obtained by identifying the position detection pattern are shown in FIGS. 7 (x711, y711), (x712, y712), and (x714, y714). be. Further, the coordinates (x713, y713) of the lower right point K of the two-dimensional code can be defined as (x712, y714) from the coordinates of I, J, and L.

<Example of output data>
FIG. 8 is an explanatory diagram showing an example of output data to the mobile terminal 120 of the delivery completion information collection system 100 according to the first embodiment of the present invention.

The output data 800 is coordinate information on the screen of each element of the receipt estimated by the shooting range estimation unit 223. The shooting range estimation unit 223 outputs the coordinate information on the screen for the coordinate information of each element on the paper surface acquired from the coordinate information acquisition unit 211. For example, as the coordinate information of the shooting range on the screen, the coordinate information of the four corners of (x821, y821), (x822, y822), (x823, y823), and (x824, y824) in FIG. 8 is output.

<Example of coordinate estimation processing procedure on the screen of each element of the receipt>
FIG. 9 is a flowchart showing an example of a coordinate estimation processing procedure on the screen of each element of the receipt by the delivery completion information collecting system 100 of the first embodiment of the present invention.

Specifically, with reference to FIG. 9, the coordinate estimation process performed in step 307 of FIG. 3A will be described in detail.

The shooting range estimation unit 223 of the delivery completion information collection system 100 calculates the inter-coordinate distance from the coordinate information of each element on the paper acquired from the coordinate information acquisition unit 211 (step S901). The distance between the coordinates of the two-dimensional code refers to the distance between the centers of the three black squares at the corners of the two-dimensional code. In the example of FIG. 5, if the central points of the three black squares at the corners of the two-dimensional code are defined as A, B, and D, the distance l1 between AD and the distance m1 between AB are defined by the following equation (1). , (2).

l1 = | y511-y514 | ... (1)
m1 = | x512-x511 | ... (2)

The inter-coordinate distance of each element of the receipt other than the two-dimensional code refers to the vertical and horizontal lengths of the smallest possible rectangle that can enclose each element. Here, as an example, an example of calculating the inter-coordinate distance on the paper of the shooting range, which is one of the elements to be extracted from the receipt, will be described. In the example of FIG. 5, if the vertices of the rectangle are defined as E, F, G, H, the distance between EH is defined as the vertical length l2 of the rectangle, and the distance between EF is defined as the horizontal length m2 of the rectangle. Calculated according to 3) and (4).

l2 = | y521-y524 | ... (3)
m2 = | x523-x524 | ... (4)

The calculation formulas (3) and (4) are merely examples, and the calculation method is not limited to this. The distance between the coordinates of each element on the receipt other than the shooting range can also be calculated using the equations (3) and (4) from the coordinates of the vertices of the rectangle as small as possible that can surround each element.

Next, the shooting range estimation unit 223 of the delivery completion information collection system 100 calculates the inter-coordinate distance from the coordinate information of the two-dimensional code on the screen acquired from the two-dimensional code coordinate identification unit 222 (step S902). In the example of FIG. 7, if the central points of the three black squares at the corners of the two-dimensional code are defined as I, J, and L, the distance p1 between IL and the distance q1 between IJ are defined by the following equation (5). , (6).

p1 = | y711-y714 | ... (5)
q1 = | x712-x711 | ... (6)

Next, the shooting range estimation unit 223 of the delivery completion information collection system 100 uses the coordinate-to-coordinate distance obtained in steps S901 and S902 to obtain the coordinate-to-coordinate distance on the paper and the coordinate-to-coordinate distance on the screen of the two-dimensional code. Calculate the ratio with. The shooting range estimation unit 223 estimates the coordinates on the screen of each element of the receipt other than the two-dimensional code by using the ratio calculated here (step S903). The ratio ry of the vertical length on the paper and the vertical length on the screen of the two-dimensional code and the ratio rx of the horizontal length on the paper and the horizontal length on the screen of the two-dimensional code are expressed in the equation (7). Calculated according to (8).

ry = p1 / l1 ... (7)
rx = q1 / m1 ... (8)

Here, as an example, an example of estimating the coordinates on the screen of the shooting range, which is one of the elements to be extracted from the receipt, will be described. In the example of FIG. 8, if the vertices of the rectangle surrounding the shooting range on the screen are defined as M, N, O, and P, the distance between MPs is defined as the vertical length p2 of the rectangle, and MN is defined as the horizontal length q2 of the rectangle. The distance is calculated by the following equations (9) and (10).

p2 = l2 × ry ... (9)
q2 = m2 × rx ... (10)

Here, the coordinates (x8211, y821), (x822, y822), (x823, y823), (x824, y824) of the vertices M, N, O, and P of the rectangle surrounding the shooting range on the screen are expressed by the following equations (x824, y824). It is calculated by 11) to (18).

x821 = x711 + (x521-x511) x rx ... (11)
y821 = y711 + (y521-y511) × ry ... (12)
x822 = x821 + q2 ... (13)
y822 = y821 ... (14)
x823 = x821 + q2 ... (15)
y823 = y821-p2 ... (16)
x824 = x821 ... (17)
y824 = y821-p2 ... (18)

For the coordinates on the screen of each element on the receipt other than the shooting range, the coordinates of each vertex of the rectangle surrounding the shooting range can be changed to the coordinates of each vertex of the rectangle surrounding the element to be extracted. It can be calculated using (1) to (18).

Next, the shooting range estimation unit 223 of the delivery completion information collection system 100 transmits the coordinate information of each element on the screen obtained in step S903 to the output result storage unit 212, and the coordinate information of the shooting range on the screen is transmitted. It is transmitted to the shooting range display unit 224 (step S904).

<Example of shooting screen of mobile terminal>
FIG. 10 is an explanatory diagram showing an example of a shooting screen of the mobile terminal 120 by the delivery completion information collecting system 100 according to the first embodiment of the present invention.

In step S308, the shooting range display unit 224 includes the shooting range of the receipt copied on the screen in the frame 234 based on the coordinate information of the shooting range on the screen transmitted from the shooting range estimation unit 223. A message 1002 prompting the movement of the mobile terminal 120 is displayed. For example, when the user moves the mobile terminal 120 (specifically, for example, the direction of the camera is changed) so that the shooting range of the receipt projected on the screen is included in the frame according to this message 1002, the shooting unit 225 moves. Perform automatic shooting.

<Example of receipt image transmission screen of mobile terminal>
FIG. 11 is an explanatory diagram showing an example of a receipt image transmission screen of the mobile terminal 120 by the delivery completion information collecting system 100 of the first embodiment of the present invention.

After the shooting unit 225 performs automatic shooting, in step S311, a transmission button 1101 and a reshooting button 1102 are displayed on the screen in order to prompt the user to select whether to send the receipt image 235 or to reshoot. ing.

<Example of transmission completion screen of mobile terminal>
FIG. 12 is an explanatory diagram showing an example of a transmission completion screen of the receipt image of the mobile terminal 120 by the delivery completion information collection system 100 of the first embodiment of the present invention.

In step S316, a message corresponding to the transmission completion information 236 for the transmission completion notification unit to convey to the user that the receipt image has been transmitted to the server 110 is displayed on the screen.

According to the first embodiment, when the delivery completion information collection system 100 is used to notify the delivery completion information and to acquire the notification, the user reads the two-dimensional code of the receipt with the mobile terminal 120 and displays it on the screen. By following the displayed instructions, it is possible to send a receipt image that includes the correct shooting range of the receipt. In addition, by registering the coordinate information on the paper of the partial element to be extracted within the shooting range in the server 110, the coordinates on the screen of each element, that is, the coordinates on the receipt image can be specified and shot. It is possible to extract the image of each element within the range. Furthermore, when the shipper or the delivery company wants to update the format of the receipt, the coordinate information on the paper of the receipt in the new format is registered in the server 110 as a table and transmitted to the shooting range estimation unit 223. It is possible to easily change the format of the receipt.

Here, according to this embodiment, since the image of each element can be extracted, an image in which information that is not desired to be displayed on the receipt image is hidden is created, or only a part of the receipt is extracted and extracted. It is also possible. For example, when sending a receipt image to the shipper, if you want to hide the delivery person information 404 such as the delivery person's name and employee number, you want to send it based on the coordinate information on the screen registered in the server 110. , It is possible to create an image in which the part where the delivery person information 404 of the receipt is described is blackened and send it. Further, when identifying whether the receipt sign entry field 407 on the receipt is blank by image processing, only the receipt sign entry field of the receipt image can be extracted.

Each element on the image can be specified by using a process such as feature amount extraction, but in order to perform feature amount extraction, it is necessary to save an image for comparing feature points in the mobile terminal 120. It is necessary and the amount of data to be stored is large. In addition, when the form to be photographed is tilted, it may not be possible to extract the feature amount. On the other hand, when the delivery completion information collection system 100 of this embodiment is used, only the coordinate information needs to be registered in the server 110, so that the data capacity to be saved is small, and the image is taken by a simpler method using similarity. The range can be specified. It is also possible to deal with the case where the form to be photographed is tilted.

Here, when the receipt identification ID is transmitted from the receipt identification ID input unit 221 to the coordinate information acquisition unit 211, the receipt corresponding to the receipt identification ID is stored in the receipt information management database 115 stored in the storage device 112. Suppose the image has already been saved. In this case, the coordinate information acquisition unit 211 may transmit the delivery completion information acquisition information to the receipt identification ID input unit 221 and display a message indicating the delivery completion on the display 122. This makes it possible to prevent the user from transmitting the receipt image twice for the delivery in which the receipt image has already been transmitted to the server 110 in the past.

Next, Example 2 of the present invention will be described. As the second embodiment, the delivery completion information collection process to be performed when the person in charge of the shipping destination does not have a habit of writing a receipt sign on the receipt due to the fact that the goods are often delivered to the shipping destination on a daily basis will be described. Here, as proof information of the delivery completion information of the delivery person, the delivery statement attached to the delivered product is used instead of the receipt sign of the shipping destination.

In this case, the delivery company issues a delivery statement pasting mount, and the delivery person photographs the delivery statement pasting mount 1310 received from the delivery company with the delivery statement 1320 superimposed. Here, the delivery company is a business operator (for example, a logistics company) that receives the cargo from the shipping source and delivers it to the shipping destination, and the delivery person is the shipping destination that actually transports the cargo according to the instructions of the delivery company. A person (for example, a truck driver belonging to a logistics company or its subcontractor) who carries out the business of handing over to.

In the second embodiment, the user (for example, the delivery person) does not use the receipt 400, and the delivery statement 1320 is superimposed on the delivery statement pasting mount 1310 (this is referred to as the pasting type receipt 1300). Use. An example of the format of the paste-type receipt 1300 used in the second embodiment will be described later with reference to FIG.

Except for the differences described below, each part of the delivery completion information collection system 100 of the second embodiment has the same function as each part of the same reference numeral of the first embodiment shown in FIGS. 1 to 12. Therefore, those explanations will be omitted.

Only the steps that are changed from the first embodiment will be described. Further, in the second embodiment, the stick-on receipt 1300 is used instead of the receipt 400 in step S301 of FIG. 3A to step S316 of FIG. 3B.

In the second embodiment, after step S302, the delivery statement 1320 is superimposed on the delivery statement pasting mount 1310 by the user. At this time, the user or the person in charge of the shipping destination visually confirms that the delivery information of the delivery statement pasting mount 1310 and the delivery information of the delivery statement 1320 match.

<Example of the format of the receipt used in Example 2>
FIG. 13 is an explanatory diagram showing an example of the pasted type receipt 1300 used in the second embodiment of the present invention.

The pasting type receipt 1300 refers to a delivery statement pasting mount 1310 on which the delivery statement 1320 is superimposed. The pasting type receipt 1300 is a certificate certifying that the shipping destination has received the delivery by superimposing the delivery statement 1320 on the delivery statement pasting mount 1310. The delivery statement 1320 is often issued by the shipping source and delivered to the shipping destination. On the other hand, it is assumed that the delivery statement pasting mount 1310 is issued by the delivery company and returned to the delivery company after the delivery by the delivery person is completed.

The delivery date 1311, the shipping source 1312, the delivery ID 1313, the shipping destination 1314, the two-dimensional code 232, and the like are printed on the delivery statement pasting mount 1310. On the delivery statement 1320, the shipping source 1321, the detailed delivery information 1322, the remarks column 1323, and the like are printed. The format of the paste-type receipt 1300 in FIG. 13 is merely an example, and is not limited thereto.

According to the second embodiment, when the person in charge of the shipping destination cannot enter the receipt sign on the receipt 400, the delivery company delivers the product on the delivery statement pasting mount 1310 on which the two-dimensional code is printed. By transmitting the image of the pasted-type receipt 1300 on which the specification 1320 is superimposed, it is possible to notify the delivery completion information.

Further, when there are a plurality of delivery statements 1320, for example, when a plurality of packages are delivered to the same shipping destination at one time, a button for allowing the user to select whether to end or continue the delivery completion information collection process is stepped. It may be displayed on the screen of the mobile terminal 120 in S302, the pasted receipt 1300 may be photographed a plurality of times for the number of delivery statements, and the image may be transmitted to the server 110. This makes it possible to perform the delivery completion information collection process even when there are a plurality of delivery statements.

Further, in the second embodiment, instead of the pasted receipt 1300, the delivery statement to which the delivery date 1311, the shipping source 1312, the delivery ID 1313, the shipping destination 1314, the two-dimensional code 232, and the like are printed is attached. 1320 may be used. In this case, a sticker sticking column may be printed on the delivery statement 1320, and a message urging the user to stick the sticker on the sticker sticking column may be displayed on the screen of the mobile terminal after step S302. As a result, it is not necessary to superimpose the delivery statement pasting mount 1310 on the delivery statement 1320 and photograph the receipt image, which makes it easier for the user to photograph the receipt image.

Further, in the second embodiment, the shipping destination or the user visually confirms that the delivery information of the delivery statement pasting mount 1310 and the delivery statement 1320 match, but in the future, the mobile terminal 120 or the like will be used. May read the delivery information and the delivery date / time information on paper by character recognition or the like. This eliminates the need for the user to visually confirm.

Next, Example 3 will be described. In the first embodiment, the case where the receipt sign of the shipping destination is used as the proof information of the delivery completion information by the delivery person has been described. In the second embodiment, the case of using the delivery statement attached to the delivered product has been described. In the third embodiment, the case where the date and time information and the location information at the time of the delivery completion information notification by the user's mobile terminal 120 are used as the evidence information for further firmly supporting the delivery completion information will be described.

In Example 3, the mobile terminal 120 has a GPS receiver and an antenna in addition to FIG. When the GPS receiving unit receives radio waves from GPS satellites via the antenna, it becomes possible to acquire the current position information of the mobile terminal 120. Except for the differences described below, each part of the delivery completion information collection system 100 of Example 3 is the same as each part of Example 1 or Example 2 shown in FIGS. 1 to 13 with the same reference numerals. Since they have the functions of, their description will be omitted.

Only the steps that have changed from Example 1 are shown below.

Step S313: The photographing unit 225 of the mobile terminal 120 includes the receipt identification ID read from the two-dimensional code 232, the receipt image 235, the current position information of the mobile terminal 120, and the current date and time information of the mobile terminal 120. To the output result storage unit 212 of the server 110.

<Example of the table of the receipt information management database used in Example 3>
In the third embodiment, the table 620 of FIG. 6B corresponds to the receipt identification ID 621 and corresponds to the position information of the mobile terminal 120 and the position information of the mobile terminal 120 at the time of transmitting the delivery completion information such as the receipt image 235 by the photographing unit 225. It has date and time information and additional information.

According to the third embodiment, the server 110 acquires the date and time information and the location information of the user's mobile terminal 120 at the time of executing the delivery completion information collection process, so that the evidence information for further firmly supporting the delivery completion information can be obtained. It becomes possible to acquire.

Here, delivery information such as the location information of the delivery destination and the delivery date / time information may be pre-registered in the storage device 112 of the server 110 in association with the receipt identification ID. As a result, if there is a large difference between the received location information and date and time information of the mobile terminal 120 and the information registered in the server 110 when the receipt image is transmitted to the server 110, a message is displayed on the screen. You can tell the user that they are inconsistent. As a result, it is possible to prevent mistakes in the receipt to be handled and to prevent the transmission of the receipt image whose delivery has not been completed intentionally.

The above embodiment is mainly intended for application in business-to-business (BtoB) delivery in the logistics field, but the present invention is for personal (BtoC) home delivery and receipt of registered mail in the postal service. It can also be applied to proofs. In addition to land transportation, it can also be applied to obtain evidence information of delivery of cargo in the trade field such as sea transportation or air transportation.

The system described in the above-described embodiment of the present invention may be configured as follows.

(1) A storage unit (for example, a receipt information management database 115), a coordinate information acquisition unit (for example, a coordinate information acquisition unit 211), a two-dimensional code coordinate identification unit (for example, a two-dimensional code coordinate identification unit 222), and a shooting range. A delivery completion information collection system (for example, delivery completion information collection system 100) having an estimation unit (for example, a shooting range estimation unit 223), and a storage unit is a receipt certifying that the shipping destination has received the package (for example, a receipt (for example, delivery completion information collection system 100). For example, for each format of the receipt 400), the coordinate information on the paper of the component of the receipt (for example, the coordinate information 231 of each element on the paper) is retained, and the coordinate information on the paper of the component of the receipt is obtained. Coordinate information on paper (for example, 2D code 612) of multiple points of the 2D code including the identification information of the receipt printed on the receipt, and the collection range of the image of the receipt (for example, the shooting range 233 on the paper). ) And the coordinate values on paper (eg, the shooting range 613), and the coordinate information acquisition unit is the collection range of the image of the receipt corresponding to the format of the receipt specified based on the identification information of the receipt. The coordinate values on the paper were acquired from the storage unit (for example, step S305), and the two-dimensional code coordinate identification unit displayed the receipt taken by the terminal device (for example, the mobile terminal 120) on the screen of the terminal device. The coordinate values on the screen of the terminal device of the plurality of points of the two-dimensional code in the image are specified (for example, step S307), and the shooting range estimation unit is the distance between the coordinate values of the plurality of points of the two-dimensional code on the paper surface. And the relationship between the distance between the coordinate values on the screen of the terminal device at multiple points of the two-dimensional code, and the coordinate information on the paper of the component of the receipt, the collection range of the image of the receipt. Estimate the coordinate values on the screen of the terminal device (for example, step S308).

This makes it possible to obtain a receipt image that correctly captures the shooting range of the receipt.

(2) The delivery completion information collecting system according to (1) above displays a shooting range display unit (for example, a frame 234 on the screen) indicating a shooting range of an image by the terminal device on the screen of the terminal device. According to the estimation results of the shooting range display unit 224) and the shooting range estimation unit, when the collection range of the image of the receipt is included in the shooting range indicated by the frame, the terminal device is made to shoot the image of the receipt and the image is taken. It further has a photographing unit (for example, an photographing unit 225) for transmitting the image of the received receipt, and a storage unit (for example, an output result storage unit 212) for storing the image of the receipt transmitted from the photographing unit in the storage unit. ..

This makes it possible to obtain a receipt image that correctly captures the shooting range of the receipt.

(3) In the above (2), the shooting range estimation unit uses the distance between the coordinate values of the plurality of points of the two-dimensional code on the paper and the coordinates of the plurality of points of the two-dimensional code on the screen of the terminal device. Based on the relationship with the distance between the values, the coordinate values on the screen of each element of the image of the receipt are estimated (for example, estimation using equations (1) to (18)), and the storage unit is the shooting range. The coordinate values on the screen of each element of the image of the receipt estimated by the estimation unit (for example, the coordinate information on the screen of the table 620) are stored in the storage unit.

As a result, since the image of each element can be extracted, it is possible to create an image in which information that is not desired to be displayed on the receipt image is hidden, or to extract and extract only a part of the receipt.

(4) In the above (3), the two-dimensional code includes the identification information of the receipt (for example, the receipt identification ID), and the collection range of the image of the receipt includes the range in which the two-dimensional code is printed and the shipping destination. Includes a range of confirmation information (eg, receipt sign or stamp of receipt) that is added to the receipt to confirm that the package has been received (eg, receipt sign entry field 407), and the photographing unit is responsible for one image. The photographed image is transmitted to the storage unit so that the two-dimensional code and the confirmation information are included in the storage unit (for example, steps S310 to S313).

This makes it possible to prove that the confirmation information (for example, the receipt sign) corresponds to the identification information of the receipt.

(5) In the above (4), the photographing unit transmits information indicating the date and time when the image of the receipt was taken and the position of the terminal device at the date and time to the storage unit.

As a result, it is possible to prevent mistakes in the receipt to be handled and to prevent the transmission of the receipt image whose delivery has not been completed intentionally.

(6) The delivery completion information collecting system according to (2) above has a server device (for example, server 110) connected to the terminal device via a network (for example, network 130), and the server device is connected to the network. A first communication unit (for example, communication unit 113), a first processor (for example, processor 111) connected to the first communication unit, and a first storage device (for example, storage device 112) connected to the first processor. The terminal device is connected to a second communication unit (for example, communication unit 126) connected to the network, a second processor (for example, processor 125) connected to the second communication unit, and a second processor. Second storage device (for example, storage device 124), input device (for example, input device 121) connected to the second processor, display device (for example, display 122) connected to the second processor, and the second processor. It has a two-dimensional code reader (for example, a two-dimensional code reader 123) to be connected, a storage unit is a storage area of a first storage device, an input device captures an image of a receipt, and a display device is a display device. The image taken by the input device is displayed, the two-dimensional code reader reads the two-dimensional code of the receipt, and the coordinate information acquisition unit and the storage unit execute the program stored in the first storage device by the first processor. The two-dimensional code coordinate identification unit, the imaging range estimation unit, the imaging range display unit, and the imaging unit are realized by the second processor executing the program stored in the second storage device. It is a function.

As a result, the function of the delivery completion information collection system can be realized in cooperation with the server device and the terminal device carried by the delivery person or the like.

(7) The delivery completion information collecting system according to (2) above has a server device (for example, server 110) connected to the terminal device via a network (for example, network 130), and the server device is connected to the network. A first communication unit (for example, communication unit 113), a first processor (for example, processor 111) connected to the first communication unit, and a first storage device (for example, storage device 112) connected to the first processor. The terminal device is connected to a second communication unit (for example, communication unit 126) connected to the network, a second processor (for example, processor 125) connected to the second communication unit, and a second processor. Second storage device (for example, storage device 124), input device (for example, input device 121) connected to the second processor, display device (for example, display 122) connected to the second processor, and the second processor. It has a two-dimensional code reader (for example, a two-dimensional code reader 123) to be connected, a storage unit is a storage area of a first storage device, an input device captures an image of a receipt, and a display device is a display device. The image taken by the input device is displayed, the two-dimensional code reader reads the two-dimensional code of the receipt, and the coordinate information acquisition unit, the storage unit, the two-dimensional code coordinate identification unit, and the imaging range estimation unit are first stored. This function is realized by the first processor executing the program stored in the device, and the shooting range display unit and the shooting unit are realized by the second processor executing the program stored in the second storage device. It is a function to be done.

As a result, the function of the delivery completion information collection system can be realized in cooperation with the server device and the terminal device carried by the delivery person or the like.

(8) In the above (1), the receipt is a mount (for example, a mount for attaching the delivery statement 1310) taken together with the delivery statement (for example, the delivery statement 1320) attached to the package and delivered to the shipping destination. ..

This makes it possible to notify the delivery completion information even when the person in charge at the shipping destination cannot fill in the receipt sign or the like on the receipt.

(9) In the above (1), the plurality of points of the two-dimensional code are at least three points (for example, A, B, and D in FIG. 5) out of the four corners of the range of the rectangular two-dimensional code.

The shooting range estimation unit is a ratio of the distance between the coordinate values of the plurality of points of the two-dimensional code on the paper and the distance between the coordinate values of the plurality of points of the two-dimensional code on the screen of the terminal device (for example, an equation (for example). By applying the ry of 7) and the rx of the formula (8) to the coordinate information on the paper of the components of the receipt (for example, formulas (9) to (18)), the collection range of the image of the receipt. Estimate the coordinate values on the screen of the terminal device.

This makes it possible to obtain a receipt image that correctly captures the shooting range of the receipt.

The present invention is not limited to the above-described embodiment, and includes various modifications. For example, the above-mentioned examples have been described in detail for a better understanding of the present invention, and are not necessarily limited to those having all the configurations of the description. Further, it is possible to replace a part of the configuration of one embodiment with the configuration of another embodiment, and it is possible to add the configuration of another embodiment to the configuration of one embodiment. Further, it is possible to add / delete / replace a part of the configuration of each embodiment with another configuration.

Further, each of the above configurations, functions, processing units, processing means and the like may be realized by hardware by designing a part or all of them by, for example, an integrated circuit. Further, each of the above configurations, functions, and the like may be realized by software by the processor interpreting and executing a program that realizes each function. Information such as programs, tables, and files that realize each function can be stored in non-volatile semiconductor memories, hard disk drives, storage devices such as SSDs (Solid State Drives), or computer-readable non-readable devices such as IC cards, SD cards, and DVDs. It can be stored in a temporary data storage medium.

In addition, the control lines and information lines indicate what is considered necessary for explanation, and do not necessarily indicate all the control lines and information lines in the product. In practice, it can be considered that almost all configurations are interconnected.

100 Delivery completion information collection system 110 Server 120 Mobile terminal 211 Coordinate information acquisition unit 212 Output result storage unit 221 Receipt identification ID input unit 222 Two-dimensional code coordinate identification unit 223 Shooting range estimation section 224 Shooting range display section 225 Shooting section 226 Transmission Completion notification unit 231 Coordinate information of each element on paper 232 Two-dimensional code on receipt 233 Shooting range on paper 234 Frame 235 Receipt image 236 Transmission completion information 237 Document format ID information 400 Receipt

Claims (10)

A delivery completion information collection system having a storage unit, a coordinate information acquisition unit, a two-dimensional code coordinate identification unit, and a shooting range estimation unit.
The storage unit holds the coordinate information on paper of the components of the receipt for each format of the receipt certifying that the shipping destination has received the package.
The coordinate information on the paper of the component of the receipt includes the coordinate information on the paper of a plurality of points of the two-dimensional code including the identification information of the receipt printed on the receipt, and the image of the receipt. Including the coordinate values on the paper of the collection range,
The coordinate information acquisition unit acquires the coordinate values on the paper of the collection range of the image of the receipt corresponding to the format of the receipt specified based on the identification information of the receipt from the storage unit.
The two-dimensional code coordinate specifying unit determines the coordinate values on the screen of the terminal device at a plurality of points of the two-dimensional code in the image obtained by displaying the receipt taken by the terminal device on the screen of the terminal device. Identify and
The shooting range estimation unit has a relationship between the distance between the coordinate values of the plurality of points of the two-dimensional code on the paper surface and the coordinate values of the plurality of points of the two-dimensional code on the screen of the terminal device. , And a delivery completion information collection system, which estimates the coordinate values on the screen of the terminal device in the collection range of the image of the receipt based on the coordinate information on the paper of the component of the receipt. .. The delivery completion information collection system according to claim 1.
A shooting range display unit that displays a frame indicating the shooting range of an image by the terminal device on the screen of the terminal device, and a shooting range display unit.
According to the estimation result of the shooting range estimation unit, when the collection range of the image of the receipt is included in the shooting range indicated by the frame, the terminal device is made to shoot the image of the receipt and the image is taken. The shooting department that sends the image of the receipt,
A delivery completion information collecting system further comprising a storage unit for storing an image of the receipt transmitted from the photographing unit in the storage unit. The delivery completion information collection system according to claim 2.
The shooting range estimation unit has a relationship between the distance between the coordinate values of the plurality of points of the two-dimensional code on the paper and the distance between the coordinate values of the plurality of points of the two-dimensional code on the screen of the terminal device. Based on, the on-screen coordinate values of each element of the image of the receipt are estimated.
The storage unit is a delivery completion information collecting system characterized in that the coordinate values on the screen of each element of the image of the receipt estimated by the photographing range estimation unit are stored in the storage unit. The delivery completion information collection system according to claim 3.
The two-dimensional code contains the identification information of the receipt.
The collection range of the image of the receipt includes the range in which the two-dimensional code is printed and the range in which the confirmation information is added to the receipt to confirm that the shipping destination has received the package. Including,
The delivery completion information collecting system is characterized in that the photographing unit transmits an image captured so that the two-dimensional code and the confirmation information are included in one image to the storage unit. The delivery completion information collection system according to claim 4.
The delivery completion information collecting system is characterized in that the photographing unit transmits information indicating the date and time when the image of the receipt was taken and the position of the terminal device at the date and time to the storage unit. The delivery completion information collection system according to claim 2.
It has a server device connected to the terminal device via a network, and has a server device.
The server device has a first communication unit connected to the network, a first processor connected to the first communication unit, and a first storage device connected to the first processor.
The terminal device includes a second communication unit connected to the network, a second processor connected to the second communication unit, a second storage device connected to the second processor, and the second processor. It has an input device to be connected, a display device to be connected to the second processor, and a two-dimensional code reader to be connected to the second processor.
The storage unit is a storage area of the first storage device.
The input device captures an image of the receipt and
The display device displays an image taken by the input device.
The two-dimensional code reader reads the two-dimensional code on the receipt and reads it.
The coordinate information acquisition unit and the storage unit are functions realized by the first processor.
A delivery completion information collecting system characterized in that the two-dimensional code coordinate specifying unit, the shooting range estimation unit, the shooting range display unit, and the shooting unit are functions realized by the second processor. The delivery completion information collection system according to claim 2.
It has a server device connected to the terminal device via a network, and has a server device.
The server device has a first communication unit connected to the network, a first processor connected to the first communication unit, and a first storage device connected to the first processor.
The terminal device includes a second communication unit connected to the network, a second processor connected to the second communication unit, a second storage device connected to the second processor, and the second processor. It has an input device to be connected, a display device to be connected to the second processor, and a two-dimensional code reader to be connected to the second processor.
The storage unit is a storage area of the first storage device.
The input device captures an image of the receipt and
The display device displays an image taken by the input device.
The two-dimensional code reader reads the two-dimensional code on the receipt and reads it.
The coordinate information acquisition unit, the storage unit, the two-dimensional code coordinate identification unit, and the shooting range estimation unit are functions realized by the first processor.
The delivery completion information collecting system, wherein the shooting range display unit and the shooting unit are functions realized by the second processor. The delivery completion information collection system according to claim 1.
The delivery completion information collection system, characterized in that the receipt includes a mount attached to the package and taken together with a delivery statement to be delivered to the shipping destination. The delivery completion information collection system according to claim 1.
The plurality of points of the two-dimensional code include at least three points out of the four corners of the range of the two-dimensional code of the rectangle.
The shooting range estimation unit is a ratio of the distance between the coordinate values of the plurality of points of the two-dimensional code on the paper surface and the distance between the coordinate values of the plurality of points of the two-dimensional code on the screen of the terminal device. Is applied to the coordinate information on the paper of the component of the receipt to estimate the coordinate value on the screen of the terminal device in the collection range of the image of the receipt. system. It is a delivery completion information collection method executed by a delivery completion information collection system having a storage unit, a coordinate information acquisition unit, a two-dimensional code coordinate identification unit, and a shooting range estimation unit.
The storage unit holds the coordinate information on paper of the components of the receipt for each format of the receipt certifying that the shipping destination has received the package.
The coordinate information on the paper of the component of the receipt includes the coordinate information on the paper of a plurality of points of the two-dimensional code including the identification information of the receipt printed on the receipt, and the image of the receipt. Including the coordinate values on the paper of the collection range,
The delivery completion information collection method is
A procedure in which the coordinate information acquisition unit acquires the coordinate values on paper of the collection range of the image of the receipt corresponding to the format of the receipt specified based on the identification information of the receipt from the storage unit. When,
The two-dimensional code coordinate specifying unit determines the coordinate values on the screen of the terminal device at a plurality of points of the two-dimensional code in the image in which the receipt taken by the terminal device is displayed on the screen of the terminal device. The procedure to identify and
The relationship between the distance between the coordinate values on the paper surface of the plurality of points of the two-dimensional code and the distance between the coordinate values of the plurality of points of the two-dimensional code on the screen of the terminal device by the photographing range estimation unit. , And a procedure for estimating the coordinate values on the screen of the terminal device in the collection range of the image of the receipt based on the coordinate information on the paper of the component of the receipt. How to collect delivery completion information.

Images