KR20160038862A - Waybill for protection of consignee information, system for managing product delivery and method for supporting product delivery using the same - Google Patents

Abstract

Disclosed is a support method to increase the efficiency of delivery work for a deliverer and protecting personal information of a consignee about an item delivered through a distribution system. The distribution delivery support method using augmented reality includes: a step of optically recognizing an encrypted identification code placed on the surface of the delivered item; a step of obtaining distribution delivery support information related with the encrypted identification code; and a step of combining the distribution delivery support information with the delivered item through augmented reality to display the information.

Description

[0001] The present invention relates to a transportation system and a logistics distribution management system for protecting consignee information, and a method of supporting logistics delivery using the system,

The present invention relates to a method for protecting the personal information of a consignee displayed on a delivery shipped through a distribution system and supporting smooth distribution of goods.

Personal information such as the name, address, telephone number, e-mail address, etc. of the consignee is generally exposed in a state that can be seen by anyone in the shipment delivered through the logistics delivery system such as courier. Personal information leakage can be abused not only for privacy invasion but also for various kinds of crimes.

In the prior art, there is a case where a part where information related to the consignee is described is produced in a sticker form which is easy to remove. Although there is an advantage of facilitating the disposal of personal information once the delivery is completed, It does not help the risk of information leakage.

In another conventional technique, in order to hide personal information of the shipper and the consignee during the delivery process, a method of displaying the information only in the QR code has been proposed (Korean Patent Application Publication No. 10-2013-0119600). This approach can remove some of the risk of external exposure of personal information, but simply hiding personal information can cause significant inconveniences and confusion in the field where many deliveries must be processed quickly, There is a high possibility of inhibiting it.

The object of the present invention is to minimize the risk of exposing personal information in the delivery process without impeding the efficiency of the deliverymen during logistics delivery.

In addition, the present invention aims at effectively protecting the personal information of the consignee by using the augmented reality technique, and at the same time, enhancing the delivery efficiency of the deliverymen.

One embodiment of the present invention is a method for managing secret information in a logistics delivery management system, the method comprising: encrypting at least part of the logistics-related information by dividing the information into secret information; and generating an encryption identification code corresponding to the encrypted secret information The method comprising the steps of:

A method of managing consignee information of a physical distribution management server according to an embodiment of the present invention includes receiving at least part of consonant-related information as classified information or non-secret information (or inputting at least part of received consonant- Non-hidden information); Encrypting the secret information among the inputted consonant-related information, and generating an encryption identification code corresponding thereto.

The encryption identification code may be newly generated every time a delivery instance for the consignee occurs, and the delivery instance may be configured to correspond to a physical packaging unit (i.e., a package box unit) of the baggage.

The encryption identification code may include at least one of a bar code or a QR code (two-dimensional bar code). Among the receiver-related information, the object to which the secret information is to be hidden or not hidden is a name, address, And may include at least any one of them. Also, the address information of the consignee is divided into at least two levels, and at least a part of the address information may be concealed or not concealed.

According to another embodiment of the present invention, a logistics shipping mark that can be affixed to a surface of a delivered logistics includes a readable display unit for displaying at least a part of information on the consignee in human readable characters; And a non-readable (i.e., human-readable) display comprising an optically recognizable encrypted identification code associated with the un-displayed information of the information about the consignee, wherein the encrypted identification code is optically recognized, At least some of the concealed information about the user can be extracted.

At least a part of the information extracted through the optical recognition may be information on the storage location of the extended scan information.

The readable display unit displays information of a higher level among the address information of the consignee, and the information hidden in the non-ignorable display unit may include lower-level detailed information of the address information of the consignee.

According to another embodiment of the present invention, there is provided a method of displaying information on a consignment of a delivery log which displays high-level information of address information of a consignee as it is, while hiding detail information of a low level and displaying it with an optically recognizable cryptographic identification code, When the encryption identification code is optically recognized, the detailed address information about the consignee can be directly extracted or extracted from the extended scan information including the detailed address information.

According to another embodiment of the present invention, there is provided a delivery information acquiring method using an optically recognizable encrypted identification code located on a surface of a delivery log, comprising: optically recognizing the encryption identification code; Obtaining delivery information associated with the encryption identification code; And displaying the delivery information on the terminal of the user.

The acquisition of the delivery information can be extracted by accessing extended scan information associated with the encryption identification code.

The delivery information displayed on the user terminal may be displayed together with a function button capable of being further input through the touch screen of the user terminal.

According to another aspect of the present invention, there is provided a method of supporting logistics delivery using an augmented reality technique, comprising: optically recognizing an encryption identification code located on a surface of a delivery; Obtaining logistics delivery support information associated with the encryption identification code; And combining the logistics delivery support information with the delivery through an augmented reality technique.

Information on the storage location of the extended scan information may be extracted through optical recognition of the encryption identification code, and the extended scan information may include the distribution support information.

The distribution delivery support information may be displayed on a plane substantially coinciding with the surface of the delivery where the encryption identification code is located.

The logistics delivery support information obtained through the encryption identification code may include at least one of a detailed address information, a name, a telephone number, and an e-mail address of the consignee.

The delivery support information display step may display a virtual function button that allows additional input through the operation of the user.

The virtual function button can perform at least one of a phone call, a delivery completion confirmation, and a video transmission function to the receiver.

The virtual function button is used to input at least any one of a gaze by a user, a swiping, a tapping, or a movement of a user's head, It is possible to perform a function corresponding to the function button.

A smart glass (e.g., Google Glass) according to the present invention may be configured to switch the smart glass to a power saving mode if the image window is not stared for more than a few seconds.

The delivery support information display step may provide a virtual map image.

According to another exemplary embodiment of the present invention, there is provided a method of operating a security management server for supporting logistics delivery, the method comprising: receiving logistics information including a secret portion and a non-secret portion; Generating a security key and a secured QR code related to the logistics information; Transmitting the invoice information including the non-hidden portion of the logistics information and the secured QR code to the logistics processing server or the third party logistics processing server of the sender; And transmitting the security key to a terminal of a final deliverymen or a server managing the terminal.

According to another embodiment of the present invention, there is provided a security management server for supporting logistics delivery, comprising: a receiving unit for receiving logistics information classified into a hidden portion and a non-hidden portion; A security processing unit for generating a security key and a secured QR code related to the logistics information; And a DB for storing the logistics information, the security key, and the secured QR code, wherein the security management server transmits the invoice information including the non-hidden portion and the secured QR code of the logistics information to the logistics processing server To the third party logistics processing server, or transmits the security key to the terminal of the final deliverymen or the server managing the terminal.

According to another embodiment of the present invention, there is provided a method of operating a security management server for supporting logistics delivery, comprising: receiving secret logistics information; Generating a security key and a secured QR code related to the logistics information; Transmitting the invoice information including the secured QR code related to the logistics information to the logistics processing server or the third party logistics processing server of the sender; And transmitting the security key to a terminal of a final deliverymen or a server managing the terminal.

According to another aspect of the present invention, there is provided a security management server for supporting logistics delivery, comprising: a reception unit for receiving secret logistics information; A security processing unit for generating a security key and a secured QR code related to the logistics information; And a DB for storing the logistics information, the security key, and the secured QR code, and the security management server transmits the invoice information including the secured QR code related to the logistics information to the logistics processing server or the third party logistics server To the processing server, or transmits the security key to the terminal of the final delivery source or the server that manages the terminal.

According to another embodiment of the present invention, there is provided a security management server for supporting logistics delivery, comprising: a security processing unit for encrypting at least part of logistics-related information into secret information and generating a security key and an encryption identification code associated with the secret information; ; And a DB for storing the logistics information, the security key, and the encryption identification code, and the security management server transmits the invoice information including the non-hidden portion of the logistics information and the encryption identification code to the logistics processing server or the third party logistics server To the processing server, or transmits the security key to the terminal of the final delivery source or the server that manages the terminal.

According to another embodiment of the present invention, there is provided a method of operating a security management server for supporting logistics delivery, the method comprising: encrypting at least a portion of logistics-related information in a secret information; Generating a security key and an encryption identification code associated with the encrypted secret information; Transmitting the invoice information including the unenclosed portion of the logistics information and the encryption identification code to the logistics processing server or the third party logistics processing server of the sender; And transmitting the security key to a terminal of a final deliverymen or a server managing the terminal.

The present invention provides a consignee information management and logistics delivery support method that can protect the personal information of the consignee and increase the delivery efficiency of the deliverymen.

1 is a view showing a conventional logistics delivery system.
2 is a view illustrating a distribution system according to an embodiment of the present invention.
3 is a view showing a flow of logistics delivery according to an embodiment of the present invention.
FIGS. 4A and 4B are views showing a consignee information display unit according to a related art, and a consonant information display unit (a conveyance unit) according to an embodiment of the present invention.
FIG. 5 is a view illustrating a method of confirming consent information using the AR technique according to an exemplary embodiment of the present invention, and augmented reality screen generated according to the method.
FIG. 6 is a flowchart illustrating a delivery execution procedure according to an embodiment of the present invention applied to a wearable device of a spectacle type.
FIG. 7 is a flowchart illustrating a procedure for coping with a QR code scan error in FIG.
Fig. 8 is a flowchart showing a process in the case where a problem that the delivery can not be completed occurs in Fig.
FIG. 9 illustrates a procedure in which the SOS mode is activated in order to solve a problem in a case where delivery is not completed normally in a delivery support method according to an embodiment of the present invention.
10 is a schematic diagram of a security management delivery system in accordance with an embodiment of the present invention.
11 is a diagram illustrating a procedure of a security barcode management server according to an embodiment of the present invention.
FIG. 12 is a diagram illustrating a transmission / reception relationship of information between servers according to an embodiment of the present invention.
FIG. 13 is a flowchart illustrating a process of processing a final delivery step using a secured QR code at a terminal of a courier having a valid security key according to an exemplary embodiment of the present invention.
FIGS. 14A to 16H are views for explaining a procedure of executing an augmented reality in a terminal according to an embodiment of the present invention, using an augmented reality image.
17 is a state transition diagram of the augmented reality mode and the glass view mode.
18 is a view schematically showing a configuration of a wearable device according to an embodiment of the present invention.
FIG. 19 is a diagram showing logistics information included in a waybill (delivery mark) according to the conventional system.
20 is a diagram illustrating extended scan information according to an embodiment of the present invention.
FIGS. 21A and 21B are views showing an arrangement of augmented reality markers according to an embodiment of the present invention.
22A and 22B are diagrams illustrating an arrangement of augmented reality markers according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily carry out the present invention. It will be apparent to those skilled in the art, however, that the scope of the present invention is not limited to the embodiments described herein, and that various modifications are possible without departing from the scope of the present invention.

The logistics delivery system according to the embodiment of the present invention is schematically shown in FIG. When the orderer completes the delivery order of a specific item through the open market on the web, the information about the orderer is encrypted and delivered to the seller of the item. This prevents personal information from being exposed to third parties in situations that can not be controlled by the purchaser. This is in contrast to the conventional method shown in FIG. 1 in which not only the personal information provided by the purchaser is directly delivered to the seller but also the personal information is displayed on the surface of the delivered product as it is in the delivery process.

Referring to FIG. 3, a shipping flow scenario to which the logistics delivery support method according to an embodiment of the present invention is applied will be described in detail. Here, the shipper 1 may be a general consumer shopping through the Internet. When the shipper 1 completes the order through the open market (i.e., the Internet shopping mall), the order details are transmitted to the security barcode management server 301, and the security barcode management server 301 transmits the order details to the security barcode management server 301 A security barcode is created. The security barcode may be transmitted to the sender 1 and the consignee. The automatic classification of shipment and the shipment tracking (302) in the subsequent shipment process are all performed through the security barcode. When the security barcode is optically recognized through a terminal (preferably a glasses-type wearable device) 303 held by a delivery person (that is, a courier staff), information necessary for completing the final delivery through the security key stored in the delivery terminal in advance Is extracted and displayed on the terminal of the delivery source. The consignee can recognize the security barcode through his terminal and confirm whether the delivery is delivered to him / her. This confirmation by the consignee may be performed by a method of verifying whether the security barcode that is already received and matches the barcode displayed on the delivery is matched or the security barcode management server 301 separately transmits the security key previously transmitted to the consignee . In this case, the security key transmitted to the subscribing terminal may be different from the security key transmitted to the to-be-delivered terminal. Although the security keys of the carrier and the consignee do not necessarily have to be different from each other, in the case of generating a separate security key for the consignee, the logistics-related information that can be accessed through this secret key is limited to the information that the consignee needs to access There is an advantage that it can be configured. Such a security key for subscribers is generated and managed by a security barcode management server described later. However, the security key for the cryptographer is not necessary and may be configured to allow the consignee to access the logistics information that the consignee needs to know without a security key.

In another shipping scenario, the shipper (2) may deliver the shipment directly to the courier. In this case, the shipper 2 displays only the information of the sender and the consignee that does not need to be kept secure (for example, the address of the building at the destination and the destination), the name of the shipper or the consignee, Is not displayed. The courier staff issues a shipping request confirmation letter printed with the security barcode and the invoice number issued by the security barcode management server 301 to the sender 2 in the field and the shipper 2 sends the security barcode scan message You can enter the details of the consignee or access the website through the PC, enter the invoice number, enter the details of the consignee, and complete the delivery request.

It will be appreciated by those skilled in the art that the embodiments of the present invention described below are assumed to operate in the two delivery scenarios described above, but can be applied to various delivery scenarios without departing from the spirit of the present invention.

The information about the shipper or the consignee can be configured to determine whether or not to process the secret (or security) processing according to the choice of the purchaser. For example, in the case of shipments delivered directly to the home, it would be better to secure all personal information such as the name, address, phone number, and e-mail address of the consignee. However, If you are receiving shipments in an environment that is not directly communicated, the situation may be somewhat different. In other words, if the shipment to be delivered to the mailing house in the workplace can not be verified without the security bar code, it may cause inconvenience. Therefore, it is desirable that the security of the information of the sender is processed by the purchaser in accordance with the delivery situation. For example, an open market order creation server may allow an orderer to differentiate security for each item by name, address, phone number, e-mail address, and so on. In addition, the above information may include options of full concealment and partial concealment. For example, in the case of concealing a telephone number, the last four digits may be concealed, or the option of concealing only the second of the three letters of the name may be provided.

4A to 4B show an example in which the delivery-related information of the consignee is displayed. FIG. 4A shows a waybill indicating all the information of a consignee required for delivery according to a conventional method, and FIG. 4B shows a waybill concealing part of the consignee's personal information according to an embodiment of the present invention. It should be noted that in FIG. 4B, the address of the building at the delivery destination is described in human readable characters. This is to protect the personal information of the consignee sufficiently, but not to give too much inconvenience to the deliverymen. If extremely hiding all shipping related information, it may be inconvenient for the delivery personnel to continuously and repeatedly perform security barcode recognition even when they are trying to ascertain a higher level shipping address for the shipment. However, in an embodiment of the present invention, it is also possible to process all the delivery-related information as hidden information, and obtain all the information necessary for the delivery from the extended scan information acquired through the optical recognition of the security barcode.

The consignee information display portion of Fig. 4 (b) does not include personal information such as the detailed address in the building, the consignee's name, the telephone number or the e-mail address, but includes a mark such as " 2222 ★★ ". According to an embodiment of the present invention, a consignee can recognize a security barcode through his / her terminal and confirm whether the corresponding delivery is delivered to him / her. However, in addition to the security barcode, if the marking is known only to the consignee (hereinafter referred to as "consignee identification mark") on the waybill, the consignee may not recognize the security barcode before performing the security barcode recognition Even if it is not possible to do so), it can immediately know that the shipment is delivered to the user, thereby enhancing user convenience. If you are purchasing items from the open market through online shopping and delivering them to you, it is possible for the consignee to pre-designate the identification marking that is received at the time of ordering the goods. The identity of the consignee can be variously used in numbers, letters, symbols, shapes, characters, pictures, or combinations thereof. FIG. 4B shows an example in which the last four digits of the waybill are combined with two star symbols to form a consignee identification mark. Depending on the operational needs, a scratch-off removable film coating may be applied on the surface of the identification indicia.

In order to accomplish a similar purpose without using the identification markers described above, identification numbers irrelevant to personal information (for example, invoice numbers) may be displayed on the waybill as non-secret information, and the consignee may be notified of the number The sending method may be applied. However, in this case, when the invoice number can not be confirmed on the spot (for example, when the phone or the like is broken), it may become difficult to utilize it.

Fig. 5 shows a situation in which a wearable device of the glasses type is applied to an embodiment of the present invention. In this case, the augmented reality technique can be utilized to provide a convenient function to the deliveryman. As shown in FIG. 5, when a security barcode attached to the surface of a delivery is successfully recognized, AR text, an AR interactive button, a virtual map image, and the like are displayed in combination with the delivery . If the smartphone is a general smartphone other than a wearable device of the glasses type, the virtual text, the virtual button, the virtual map image and the like may be displayed on the image displayed in the display of the phone. In FIG. 5, address information including detailed information of an address is displayed as a virtual text. 20, the image acquisition unit 180 acquires an image including the security barcode, and when the security barcode is successfully recognized by the security processing unit 182, the security barcode is stored in the storage unit (not shown) Accesses the stored extended scan information and displays a part of the delivery-related information on the display 185 in accordance with the control signal of the glass view processing unit 181. If the device is not a wearable device but a normal smartphone, The glass view processing unit 181 may be replaced with a control processing unit and other components may be maintained to perform substantially the same function. If there is an input to the "CALL" virtual button, Accesses the extended scan information to acquire the telephone number of the consignee and transmits a control signal to the communication processor (not shown) so that telephone connection is automatically attempted with the consignee do. The communication unit may include a mobile communication function, and may be connected to another mobile communication terminal through a wired or wireless communication interface. Hereinafter, the term 'terminal of the deliverymen' refers to the wearable device when the wearable device includes a mobile communication function, and otherwise refers to a mobile communication terminal connected to the wearable device through a wired or wireless communication interface. When a smartphone is used instead of a wearable device, the smartphone itself is referred to as a delivery terminal. When a telephone connection with a consignee is attempted, a control signal is generated from the glass view processing unit and transmitted to the terminal, so that a record of the telephone number of the consignee is automatically deleted or prevented from being stored at first. The actual telephone number of the consignee can be prevented from being left in the terminal of the deliverer even when a method of making the telephone connection to the consignee via the temporary virtual number is used according to the embodiment. When the user input processing unit 1811 determines that there is an input for the "delivery completed" virtual button, the terminal of the deliverymen originates the delivery to the corresponding delivery according to the signals of the glass view processing unit 181 or the control processing unit And informs the security barcode management server or another management server that the delivery has been completed. The "image transfer" button is provided to perform the function of acquiring the signature or face photograph of the recipient (via the security management server or directly) to the consignee when the third party receives the shipment in its place.

FIG. 6 is a flowchart illustrating a delivery support procedure according to an embodiment of the present invention applied to a wearable device of a spectacle type. However, the same procedure can be applied to smartphones in the same way. Voice input can be replaced by touching the smartphone screen. FIG. 6 also shows an exemplary screen state of the wearable device (or smartphone) corresponding to each of steps S600 to S604. In the standby state (S600), transition is made to the delivery mode (S601) through the activation input. In the case of Google Glass, a voice of "OK Glass" is inputted to the user input sensor 186 and is successfully recognized in the user input processing unit 1811, the state goes to the delivery mode (S601). If there is an audio input or tap input of "OK Delivery" in the user input sensor 186 in the delivery mode (S601), the image acquisition unit 180 is activated to acquire an image of the security barcode, The security processing unit 182 performs optical recognition on the image (S602). If the security barcode fails to be recognized, the flow goes to the delivery list activation step (S605), which will be described in detail with reference to FIG. When the security bar code recognition is successfully performed, the glass view processing unit 181 or the control processing unit accesses the extended scan information storage unit (not shown) and stores information about the address text or the map image screen including the detailed address of the destination And displayed on the display 185, and these two screens can be configured to be alternately displayed through toggling (S603). If the return application is accepted for the delivery, this information is recorded as a part of the extended scan information, and after the optical recognition step (S602), the glass view processing unit 181 or the control processing unit Upon confirming the information corresponding to the receipt of the return application, a "Return" screen is displayed on the display 185 (S603). The completion confirmation step S604 may be activated if the voice input or tap input such as "OK Finish " is input to the user input sensor 186 and is successfully recognized in the user input processing unit 1811. [ In the completion confirmation step (S604), if there is an input ("Yes") for notifying the normal delivery completion, the bar code recognition value is initialized and the delivery mode (S601) is returned to support the next delivery. If there is an input ("No") indicating that the delivery has not been completed normally, activate the SOS function (S606) to try to solve the problem. The performance of the SOS function will be described later with reference to FIG. 8 and FIG.

If it is determined that an optical recognition error has occurred in the QR code scanning step S602 (S605), the procedure shown in Fig. 7 is executed. The procedure shown in FIG. 7 can be executed even when a delivery service is to be performed using a delivery list stored in advance in the delivery terminal due to temporary communication failure or the like, or when a corresponding mode is required for other operations. 7, the glass view processing unit 181 accesses the extended scan information by voice input such as "OK LIST " to display the list of invoices on the display 185 (S701). If the smartphone is a general smartphone, it can be configured to go to the invoice number display step S701 by touching the screen. Here, the invoice number list displayed on the screen may be interlocked with the position information so that only the invoice numbers corresponding to the current position of the delivery destination are displayed, so that it becomes more convenient for the delivery person to use. For example, the range corresponding to the current position may be a predetermined radius range from the current position, and the user may change the radius value to adjust the range corresponding to the current position. The range corresponding to the current position can be set based on the travel distance of the road on which passage is possible. If there are a plurality of invoice numbers belonging to the range corresponding to the current position, a search is performed in a sliding manner. Furthermore, by displaying the total number of processed objects and the number of processed objects on the screen in which the invoice number is displayed, user convenience can be further enhanced. The total number of processed objects and the number of processed objects can be limited to the range corresponding to the current position. When the user selects a specific invoice number, the glass view processing unit 181 extracts delivery information (address information) corresponding to the invoice number from the extended scan information and controls the display information to be displayed on the screen 185 S702). The address display screen may be configured to be alternately displayed through toggling with the map image display screen (S702).

FIG. 8 shows a temporal example of a procedure performed at the delivery terminal when normal delivery can not be performed according to the procedure according to FIG. That is, when "No" is selected in the delivery completion confirmation step (S604) in FIG. 6, the HELP mode is activated and waits for input of either "READY" or "SOS" (S800). The case where there is an audio input such as " OK SOS " is described in FIG. If there is an audio input such as "OK READY ", steps S801 to S804 are performed. Since this part corresponds to steps S601 to S604 already described in FIG. 6, further explanation will be omitted. However, in the step S800, the iterative loop of the subsequent procedure in which "OK READY" is input is limited to be performed only to a limited number of times (for example, three times). If the number of times is exceeded, It may be configured to attempt to establish a call connection.

FIG. 9 shows a procedure in which the SOS mode is immediately activated among the procedures operated to solve the problem when the delivery is not normally completed. When "No" is selected in the delivery completion confirmation steps (S604, S704, S804) in Figs. 6, 7, 8, etc., the mode is shifted to the HELP mode (S800, S900) The problem solving mode (S901, S902) is activated. In step S901, the management server performs tracking to solve the problem, and a character displayed as "Tracking" or a visual image indicative thereof is displayed on the screen displayed to the deliverymen. The management server can directly solve the problem, display the problem-solving method on the screen of the deliveryman's terminal, or generate a text or the like about the contents to be instructed through the telephone call or the like with the deliveryman.

10 schematically illustrates a security management delivery system according to an embodiment of the present invention. The third party logistics processing server 1002, the parcel delivery company management server 1003 and the security barcode management server (or security management server) 1004 are basically configured in accordance with the implementation scenario. The plurality of servers do not necessarily have to be physically separated and arranged independently. Although FIG. 10 does not show a user order server for the open market, it may be considered that the server exists in the cloud and is connected to the logistics processing server 1001 of the sender. The delivery terminal 1005 is connected to the courier service management server 1003 and the security barcode management server 1004. [

For convenience of explanation, a configuration in which an ordering server is mainly located in the cloud, and an entry point of the logistics delivery instance is the logistics processing server 1001 of the sender will be described below. But this is not the only implementation. For example, it is also possible that the ordering server is directly connected to the security barcode management server 1004 in Fig. In this case, the entry point of the logistics delivery instance may be the security barcode management server 1004, so that some procedures to be described below with reference to Figs. 11 and 12 may be appropriately modified to that effect Be apparent to those skilled in the art. In this case, for example, step S1101 is omitted.

11 is a flowchart illustrating an operation procedure of a security barcode management server according to an embodiment of the present invention. Referring to FIG. 12, the procedure can be more clearly confirmed through the correlation with other servers. First, the security barcode management server 1004 receives the logistics information necessary for delivering goods from the logistics processing server 1001 of the sender (S1101, S1201). Then, in the received logistics information, a secret portion and a non-secret portion are separated, a security key is generated, and a secured QR code invoice is generated based on the logistics information (S1102). In the case of an augmented reality-based delivery system, an augmented reality marker is displayed together with the secured QR code invoice. When generating the augmented reality marker, information such as the size of the article in the logistics information can be referred to. The security barcode management server 1004 also stores the secured QR code, the security key, and the log information in a DB form (S1103). The security barcode management server 1004 transmits the invoice information including the non-hidden portion of the logistics information and the secured QR code to the logistics processing server 1001 and / or the third party logistics company server 1002 S1104, S1202). At this time, secret information among the logistics information and the security key are not transmitted. In this case, in the case of setting the logistics delivery plan to the sender logistics processing server 1001 or the third-party logistics server 1002, the information for establishing the logistics delivery plan Should be provided. That is, the address information of the destination, excluding the detailed address information, can be configured to correspond to the non-hidden information. However, the criterion for distinguishing hidden information from non-hidden information does not necessarily have to match. For example, even if all the address information is not recorded as a secret information, it is possible to provide address information of a delivery destination excluding the detailed address information to the subject who sets up the delivery plan. Thereafter, the security barcode management server 1004 receives a notification from the logistics processing server 1001 or the third party logistics vendor server 1002 notifying the start of security tracking (S1105, S1203). The security tracking start notification notification is made to notify the security barcode management server 1004 that the information including the non-hidden portion of the logistics information and the invoice including the secured QR code are attached to the article and the delivery is started. After receiving the notification of the start of security tracking, the server 1001 or the third party logistics company server 1002 requests final courier company information (S1106, S1204). When the final courier company information is confirmed (S1205), the security barcode management server requests the courier server 1003 managing the final courier company for the device ID and the network information to use the security barcode (S1107, S1206). When the device ID list and the network information are received from the courier company management server 1003 (S1108, S1207), the security barcode management server 1004 transmits the secret information among the logistics information to the sender logistics processing server and the devices of the final courier company (S1109, S1208). The secure barcode management server 1004 transmits the secret information to the devices of the final delivery company and starts security tracking (S1110) after the security key transmission completion is confirmed (S1209) and verified. The concealment information may be transmitted in the form of extended scan information (see FIG. 20). A configuration in which the security key is transmitted to the sender logistics processing server 1001 and the Ack is received therefrom in steps S1208 and S1209 may be omitted.

In some implementations, the security barcode management server 1004 may set up a logistics delivery plan. In this case, it is not necessary to provide the information necessary for establishing the delivery plan to the sender logistics processing server 1001 or the third party logistics company server 1002, and information on the final courier company is also sent to the logistics processing server 1001 Or from the third party logistics company server 1002, the security barcode management server 1004 may generate the security barcode itself.

FIG. 13 is a flowchart illustrating a process in which a final delivery step is processed using a secure QR code at a terminal of a delivery source having a valid security key. First, the QR code is scanned (S1301), and it is determined whether or not the QR code has been successfully decoded (S1302). If the QR code is successfully decoded, the DB is downloaded from the security barcode management server, and the DB is searched for the matching extension scan information by using the invoice number or the management number as a key value (S1303). If the search is successful (that is, if there is extended scan information matching the DB), the address and name of the receiver are read from the extended scan information and displayed (S1305). If there is an input requesting a map display corresponding to the corresponding address, the map is displayed. When there is a delivery completion input of a specific delivery (S1306), the tag information of the corresponding extended scan information stored in the DB is corrected to "delivery completed" (S1307), and the flow returns to the QR code scanning step (S1301). If it is determined that normal delivery has not been performed (S1306), a tracking request message is transmitted to the management server (S1315). If the decoding of the QR code fails in step S1302, the current position of the delivery source is determined based on the GPS information (S1308), and the delivery destination of the delivery destination (S1309). Such a search can be simply performed by searching the item of latitude / longitude information (i.e., GPS coordinates) of the extended scan information and calculating a straight line distance from the current position, but the present invention is not limited thereto. As a result of the search, if there is a delivery list (order information) searched in the adjacent area at the current position of the carrier, it is displayed (S1311). In an environment such as Google Glass, for example, adjacent area order information may be set to display up to five at a time (S1311 to S1314). If there is an input indicating that the delivery can not be normally completed in step S1312, the management server transmits a tracking request message to the management server (S1315). If there is no data matching the search result in step S 1304 or S 1310, an error message is generated (S 1316).

In one embodiment of the present invention, the augmented reality markers (i.e., visual markers) function as part of the good features to track required for the augmented reality mode operation and at the same time intuitively inform the users of the display position of the virtual buttons The giver plays a role.

4B shows a waybill according to an embodiment of the present invention. The waybill includes a secured QR code, as well as an augmented reality marker combined with a security code. Square shapes surrounding the QR code in the waybill are utilized as part of the augmented reality marker. In the case of designing the waybill in the form as shown in FIG. 4B, not only space can be efficiently used when the augmented reality function is executed, but also there is an advantage that a virtual button can be naturally associated with a part of the augmented reality marker.

In another example, the augmented reality markers can be arranged as shown in Fig. 21A. FIG. 21A shows a delivery mark in a state in which the augmented reality mode is inactive, and FIG. 21A shows a state in which the augmented reality mode is activated and a virtual button is displayed on the augmented reality marker. The point that at least a part of the augmented reality marker substantially coincides with the position of the virtual button in the augmented reality operation is similar to the example of Figs. 4A to 4B, but the virtual buttons are arranged so as not to overlap with the QR code. As in FIGS. 4A and 4B, placing the virtual button on the visually prominent portion printed on the surface of the delivery path has the advantage of providing a visually more natural user interface.

It is preferable that the shape of the augmented reality marker is determined such that the correlation with the FIP (finder pattern) of the QR code is lowered. Otherwise, if the augmented reality marker is configured in the same or similar shape as the FIP of the QR code, the success rate of QR code recognition may be lowered. FIGS. 22A and 22B are diagrams showing an arrangement of augmented reality markers designed to lower the correlation with the FIP of a QR code according to an embodiment of the present invention. Compared with Figs. 21A and 21B, it can easily be confirmed that the correlation with the FIP of the QR code in the vertical direction becomes lower in the case of Figs. 22A and 22B.

FIGS. 14A to 16H are diagrams for explaining a procedure of executing an augmented reality in the aft terminal through an augmented reality image. Fig. 14A shows a waybill according to an embodiment of the present invention which can be seen visually when the augmented reality is in the OFF state. When the augmented reality mode is executed by scanning the QR code and confirming the augmented reality markers, the virtual buttons and the virtual display screen are displayed on the surface substantially coinciding with the waybill surface as shown in Fig. 14B. The detailed display address of the consignee who has been hidden among the logistics information is displayed on the virtual display screen. When the virtual button at the lower left is pressed, the screen showing the address details of the consignee is toggled to the map screen as shown in FIG. 14C. 14C, the map window is terminated and the function of the virtual button is changed as shown in FIG. 14D. You can call the consignee by pressing the upper left button. When the button at the lower left is pressed, delivery completion is input (Fig. 14E).

The procedure of the augmented reality mode described in Figs. 15A to 15O is an example corresponding substantially to the normal mode (or the glass view mode) described in Fig. That is, the GPS-based delivery support function is performed according to the screen procedure of the augmented reality mode described in Figs. 15A to 15O. FIG. 15A shows a transportation route when the augmented reality is OFF. 15b activates the delivery list by activating the QR code scan error and selects the "HELP" button at the upper right of the augmented reality screen displayed on the waybill, A desired delivery can be selected through the operation of FIG. 15C (FIG. 15C). 15D). When the upper left button is selected, the receiver and the call are connected (FIG. 15E). When the delivery is confirmed (FIG. 15F), the delivery list is activated again 15G), the same procedure can be repeated in Figs. 15H to 15O below.

16A to 16D show an example of a procedure for retrying a scan when a scan error occurs in the augmented reality mode. When the backward button at the lower left end in FIG. 16C is selected, the process returns to the scanning step (FIG. 16D).

16E to 16H show an example of a processing procedure in the augmented reality mode when a delivery accident or an emergency occurs. When the SOS button at the upper left in FIG. 16F is selected, the communication with the management server is executed, and then the process returns to the scan standby mode via FIG. 16G (FIG. 16H).

In the augmented reality mode delivery support method according to an exemplary embodiment of the present invention, an augmented reality mode (AR view mode) and a glass view mode (glass view mode) may be selected depending on the state of the terminal, Can be switched to each other. 17 is a state transition diagram of the augmented reality mode and the glass view mode. In the glass view mode, only the secure QR code is processed, and the rest can be implemented in such a manner that information is provided and received according to the basic user interface menu configuration method of the glass. On the other hand, in Evolved Reality mode, in addition to processing the secure QR code, you must also continuously display the virtual button on the delivery surface and verify the input of the virtual button. That is, power consumption increases due to pose estimation, pause tracking, virtual button management, and the like. Therefore, when the power of the smart glass device of the delivery source is insufficient, it is possible to automatically set the augmented reality mode to the glass view mode. In addition, even if the augmented reality mode is executed, the reference marker (or target marker) for augmented reality may be set to be automatically switched to the glass view mode even if it can not be captured within a predetermined time. Although not shown in FIG. 17, when the smart glass according to the present invention is not input for a predetermined time (for example, when the user does not stare the image window for more than a few seconds), the power saving mode You can add a state. That is, when the above conditions are satisfied in the augmented reality mode or the glass view mode, the state transits to the power saving mode. In the power saving mode, it is checked whether there is an input from the user according to a predetermined regular, irregular, or a combination time interval. If the user input is confirmed, the state returns to the state immediately before the user input (that is, the augmented reality mode or the glass view mode) . It is also possible to implement only two of the above three states according to the embodiment, or to implement more than four states by further subdividing the power saving mode.

18 schematically shows a configuration of a wearable device for carrying out an embodiment according to the present invention. It is obvious to those skilled in the art that the glass view processor 181, the security processor 182, the AR processor 183, and the like are not necessarily physically separated from each other and can be implemented by a single processor. The glass view processing unit 181 takes charge of processing relating to all operations to be processed in the normal glass view mode. The user input processing unit 1811 processes various user inputs inputted from the user input sensor 186 and outputs the result to the audio processing unit 187, the renderer 184, or the vibration output unit (not shown) have.

The user input sensor 186 may include an inertial sensor for sensing movement, a tactile sensor for sensing a touch input, a voice input device for sensing a voice input, a gaze sensor for sensing a gaze, An image input device for performing image processing, etc. may be used. In addition to the method using a dedicated sensor, the visual-gaze sensor may implement a sensing function by processing an image of an eye region input through a video input device. The virtual button area confirms whether the finger is at the position and presses the button when it remains for a predetermined time. To do so, the button region is extracted using the pose value of the currently calculated package box and the registered button region position that is already known, and inverse-transformation is performed, Only the button area is extracted as shown in the lower part of the mail.

The AR processing unit includes a pose estimating unit 1831, a pause tracking unit 1832, and a virtual button manager 1833. The pose estimation unit 1831 estimates a pose of a delivery object to which the augmented reality marker is attached (or displayed) from the image acquired through the image acquisition unit 180, and the pose of the delivery object is measured during the augmented reality mode, Lt; RTI ID = 0.0 > 1832 < / RTI > A plurality of augmented reality marker sets can be set to improve the performance of pose tracking. For example, in the case of FIG. 4B, if four color diagrams surrounding the QR code are set as the first marker set and another feature (for example, the entire box contour) of the shipment with the waybill is set as the second marker set, If the first marker set is not well recognized, the second marker set is recognized and pose tracking can be performed seamlessly. If two markers are used for tracking at the same time according to the implementation, if there is a problem in recognition of either one, a method of performing tracking through the marker set on the other side can be applied.

If it is intended to reduce the amount of computation required for tracking, it may be configured to perform tracking only on a particular region of interest (ROI). The ROI to which tracking should be performed may be, for example, an area in which a virtual button should be displayed. Tracking only the ROI portion can invert-transform only that portion, thereby reducing the amount of computation and ultimately reducing the power consumption of the portable device. In addition, the amount of computation and the power consumption can be reduced even when the area for tracking the finger movement is restricted to only the ROI (e.g., the virtual button position).

Similarly, a method may be utilized that limits the ROI to only the region performing the inverse transform, while tracking the entire shipping box (or the larger region containing the ROI). For example, if only the ROI region is extracted using the pose value of the current tracking box and the coordinate value of the corresponding ROI region, and inverse-transformation is performed only for the extracted region, It is possible to reduce power consumption.

The virtual button manager 1833 generates information necessary for rendering the virtual button in cooperation with the pause tracking unit 1832, determines whether or not the virtual button is input, and generates an execution command. Whether or not the virtual button is input may be a Ray Picking algorithm or a proximity-based method, but is not limited thereto. For more information on Ray Picking algorithms or proximity-based methods, see Jens Grubert's book, Augmented Reality for Android Application Development, for example. The virtual button can be determined by gazing by a user or by accessing a virtual button display position by a user or the like, as well as determining whether or not an input of a swallow for a wearable device (smart glass) Swiping, tapping, movement of the user's head, and the like, so as to determine whether or not the user has input.

20 is extended scan information according to an embodiment of the present invention. Extended scan information is introduced to manage more information associated with deliveries than information obtained directly via a one-dimensional bar code or two-dimensional bar code (QR code), and to enhance security for at least some of the extended scan information . That is, if the extended scan information is used, only the ID information of the delivery object is extracted through security barcode recognition, and other necessary information is obtained through valid security key authentication through the extended scan information corresponding to the delivery ID. The shipment ID may be a shipment number, a shipment number, or other security shipment number. For comparison, FIG. 19 shows the logistics information described in the conventional way. The extended scan information may include various information related to the delivery in addition to the information described in the conventional way. The extended scan information can be accessed from the terminal of the delivering party who has properly received the security key from the security barcode management server and holds it. The terminal of the deliverymen can download all the extended scan information necessary for a specific delivery date (or a specific delivery time) in advance and store it in the terminal. Alternatively, every time the security barcode is recognized, an extension scan Information may also be downloaded. It is more convenient to store the extended scan information in advance in the terminal in consideration of the possibility that the communication environment of the moving deliveree on the move may occasionally be disturbed.

In the embodiment of the present invention, the extended scan information is generated in S1102 of FIG. 11 by the security management server 1004, transmitted to the TA terminal after the security key is transmitted to the TA terminal (S1109) (S1110). However, the security key and extended scan information may be transmitted together, and the transmission order may be changed.

On the other hand, even a terminal having a valid security key does not necessarily have to be unlimitedly accessible to the extended scan information corresponding to the security key, but can be accessed only in a specific permitted manner Is more preferable in terms of personal information protection of the consignee. For example, the name or telephone number of the consignee may be configured such that the terminal of the dispatcher can not directly access the telephone. If the consignee needs to make a telephone call, the telephone number of the consignee or the telephone in the security mode In addition, it may be configured to determine whether to allow access to the detailed address with a valid security key based on current location information of the parcel provider terminal. In this case, (E.g., GPS receiver or cellular / Wi-Fi based triangulation arithmetic operation unit) not shown in FIG. 18 and receives a specific item Or not. Also, the security key manager 1822 manages access of the extended scan information only in a previously permitted manner (e.g., dialing in secure mode).

The extended scan information includes package information about the shipment, and the package information may further include an invoice number, an address, a name, a telephone number, tag information, GPS position information (latitude and longitude), a map image, and the like. Also, when the present invention is implemented through the augmented reality technique, the feature point information necessary for rendering the augmented reality is included as part of extended scan information, which is more advantageous in terms of processing speed. For example, when using Qualcomm's Vuforia as a virtual reality platform, you can configure an extended scan information package with two files, ".dat" and ".xml", where the ".dat" ), And the " .xml " file may be configured to include all logistics information. If you save such good features to track in a .dat file, you do not have to recompute the minutiae information from the original image separately, which is more advantageous when processing in real time.

It is also one of the examples which can be modified within the scope of the present invention to encrypt only some items of the extended scan information so as to be accessible through a security key and to design other items to be accessible without a security key.

Claims (18)

A method for managing secret information in a logistics delivery management system,
Encrypting at least a part of the logistics-related information as secret information; And
And generating an encryption identification code corresponding to the encrypted secret information. The method according to claim 1,
Wherein the encryption identification code includes at least one of a one-dimensional bar code or a two-dimensional bar code. The method according to claim 1,
Wherein the secret information includes personal information on the consignee. The method according to claim 1,
Wherein the secret information is included in extended scan information associated with the encryption identification code. In a logistics delivery label that can be attached to the surface of the delivered logistics,
A readable display unit for displaying at least a part of information on the consignee in human readable characters; And
And an optically recognizable encrypted identification code associated with the unmarked information of the information about the consignee,
Wherein the encryption identification code is optically acknowledged so that at least some of the concealed information about the consignee can be extracted. 6. The method of claim 5,
The readable display unit displays information of higher level among the address information of the consignee, and the information hidden in the non-read unit displays at least one of lower-level detailed information of the consignee's address information, the name of the consignee, And a control unit for controlling the delivery of the goods. A method of displaying information on a delivery logistics that displays information of a higher level among address information of a consignee as it is and displays detailed information of the lower level as an optically recognizable encrypted identification code,
And when the encryption identification code is optically recognized, detailed address information on the consignee can be extracted. A method for obtaining delivery information using an optically recognizable encrypted identification code located on a surface of a delivery log,
Optically recognizing the encryption identification code;
Accessing extended scan information associated with the encrypted identification code;
Obtaining delivery information from the extended scan information; And
And displaying the delivery information on a terminal of the user. 9. The method of claim 8,
And information about a storage location of the extended scan information is extracted through optical recognition of the encryption identification code. A method for supporting logistics delivery using an augmented reality technique,
Optically recognizing an encryption identification code located on the surface of the shipment;
Obtaining logistics delivery support information associated with the encryption identification code; And
And visually combining the logistics delivery support information with the delivery through an augmented reality technique to display the logistics delivery support information. 11. The method of claim 10,
Wherein the logistics delivery support information display step displays the logistics delivery support information on a substantially same plane as the surface of the delivery where the encryption identification code is located. 11. The method of claim 10,
Wherein the logistics delivery support information obtained through the encryption identification code includes at least one of a detailed address information, a name, a telephone number, and an e-mail address of the consignee. 11. The method of claim 10,
The step of obtaining the distribution delivery support information
Accessing extended scan information associated with the encrypted identification code;
Further comprising the step of acquiring the logistics distribution support information from the extended scan information.
11. The method of claim 10,
Further comprising the step of displaying a virtual button on a plane substantially coplanar with a surface of the shipment for which said encryption identification code is located,
Wherein the virtual button performs at least one of a telephone call to a consignee, a delivery completion confirmation, a video transmission function, and a problem solving request function. 11. The method of claim 10,
Displaying a virtual button on a plane substantially coplanar with a surface of the shipment where the encryption identification code is located; And
Further comprising tracking the virtual button to be located in substantially the same area as the visual marker located near the encryption identification code. 16. The method of claim 15,
Wherein the tracking step is performed only for a region of interest including an area requiring display of a virtual button. A security management server for supporting logistics delivery,
A security processing unit for encrypting at least part of the logistics-related information into secret information and generating a security key and an encryption identification code associated with the secret information; And
And a DB for storing the logistics information, the security key, and the encryption identification code,
The security management server transmits the invoice information including the non-hidden portion and the encryption identification code of the logistics information to the logistics processing server or the third party logistics processing server of the sender, or to the server of the final delivery source or the server that manages the terminal And transmits the security key. A method of operating a security management server for supporting logistics delivery,
Encrypting at least a part of the logistics-related information as secret information;
Generating a security key and an encryption identification code associated with the encrypted secret information;
Transmitting the invoice information including the unenclosed portion of the logistics information and the encryption identification code to the logistics processing server or the third party logistics processing server of the sender; And
And transmitting the security key to a terminal of a final deliverer or a server managing the terminal.

Images