TWI822132B - Courier assistance system and method of using the courier assistance system - Google Patents

Abstract

The present invention provides a courier assistance system and a method of using the courier assistance system, including courier assistance glasses and a control device, the courier assistance glasses can collect environmental image data and environmental depth data, and transmit them to the control device for analysis, and the courier assistance glasses can receive an order data, navigation map data and indoor navigation map data transmitted by the control device are displayed. The present invention can allow delivery personnel or couriers to concentrate on driving to the target location without worrying about getting lost in the indoor space.

Description

Express delivery auxiliary system and how to use the express delivery auxiliary system

The present invention relates to an auxiliary system and a method of using the auxiliary system, in particular to an express delivery auxiliary system and a method of using the express delivery auxiliary system.

As the delivery-related industry chain gradually develops, the attendance requirements of delivery personnel or couriers have further increased, so the demand for positioning and navigation systems has also further increased. However, currently, mobile phones or tablets are often used with global positioning systems for navigation, but While moving by bicycle, you need to repeatedly check your phone or tablet to confirm your current location and navigation route, which leads to distraction during the movement, thereby increasing the possibility of traffic accidents.

In addition, although the global positioning system can assist in positioning and navigation through satellite images, it can assist delivery personnel or couriers to pick up goods at a designated address and deliver them to the consumer's designated address to complete the delivery. However, when the address they want to go to is located in a building, Or in underground spaces, such as department stores, stations, underground streets, etc., the positioning and navigation function of the global positioning system cannot effectively function, which may cause delivery personnel or courier personnel to get lost in the indoor space.

An object of the present invention is to avoid the need for delivery personnel or courier personnel to repeatedly check the mobile phone or tablet computer to confirm the current location and navigation route when using a mobile phone or tablet computer for navigation, causing distraction while driving, and to avoid being trapped in a building. There is a problem of getting lost indoors.

Based on the purpose of the invention, the invention provides an express delivery auxiliary system, which includes express delivery auxiliary glasses and a control device. The express delivery auxiliary glasses include a motherboard, an image capture module, a depth capture module, a display module and a charging module. The motherboard is used to allocate input and output signals, and allocate input and output data; the image capture module is coupled to the motherboard and is used to capture the environment image of the user's front field of view to generate environmental image data; The depth acquisition module is coupled to the motherboard and is used to measure the distance between the user and various objects in the environment to generate environmental depth data; the display module is coupled to the motherboard and is used to receive various items transmitted by the motherboard. and display the data; the charging module is coupled to the motherboard, the image capture module, the depth capture module and the display module for power supply; the control device includes a second wireless transmission module, an application, and a logistics service Platform, positioning and navigation module and indoor positioning and navigation module, in which the application communicates with the express auxiliary glasses through the second wireless transmission module, receives environmental image data and environmental depth data, and communicates with the control device through the second wireless transmission module communicate with other platforms and modules on the express auxiliary glasses, and can share the data transmitted by the express auxiliary glasses to other platforms and modules for calculation and transmit the calculation results to the express auxiliary glasses. Other platforms and modules on the control device can also communicate through The application shares data. In addition, the control device transmits signals to the express auxiliary glasses through the application to operate the express auxiliary glasses. It can also transmit signals to the second wireless transmission module or other platforms and modules on the control device through the application. , to operate the second wireless transmission module or other platforms and modules on the control device; the logistics service platform communicates with the application to receive the consumer's order and generate order data, and the order data includes the first target address and the second target address; the positioning and navigation module communicates with the application to identify the user's current location and The application extracts the first destination address or the second destination address of the order data, and performs analysis to obtain a map of the user from the current location to the first destination address or the second destination address, and plans the user's journey from the current location to the second destination address. The navigation route of a target address or a second target address, as well as the navigation icons and direction instructions that guide the user to move along the navigation route, generate navigation map data; the indoor positioning navigation module communicates with the application to identify the user's current location. indoor location, and after extracting the first destination address or the second destination address of the order data through the application, an indoor navigation route for the user from the current location to the first destination address or the second destination address can be planned to generate indoor navigation. Route data, and obtain the environmental image data and environmental depth data collected by express auxiliary glasses through the application, and integrate the environmental image data and environmental depth data to generate integrated environmental image data. The indoor positioning and navigation module is based on the indoor navigation route The indoor navigation route provided by the data is further analyzed and integrated with the environmental image data to obtain indoor navigation data; the order data, navigation map data and indoor navigation data are transmitted to the express auxiliary glasses for display through the application.

The motherboard includes a processor, a data storage module and a first wireless transmission module; the data storage module is coupled to the processor and is used to store various data received by the processor, and is configured and stored by the processor in the data storage Various data of the module; among them, the first wireless transmission module is coupled to the processor.

The courier auxiliary glasses further include a vibration module, which is coupled to the processor and the charging module, and receives signals transmitted by the processor to vibrate.

The express auxiliary glasses further include a touch module. The touch module is coupled to the processor and the charging module, and is used to recognize the movement of the user's fingers to generate touch signals, and transmit the touch signals to the processor.

The order data further includes a communication method; the control device further includes a text message module, and the application communicates with the text message module through the second wireless transmission module of the control device. The text message module can preset a notification message for picking up the goods and send it The notification pickup message is sent to the communication device corresponding to the communication method.

The order information further includes a communication method; the control device further includes a call module, and the application communicates with the call module through the second wireless transmission module of the control device, and can make calls to the communication device corresponding to the communication method.

Based on the purpose of the present invention, the present invention provides a method of using the express delivery auxiliary system, a method of using the express delivery auxiliary system, which is applied between the express delivery auxiliary glasses and the mobile device, and includes navigation steps. The navigation steps include: Step S101: Control device Receive the order data and extract the first target address in the order data; Step S102: The control device identifies the user's current location, obtains a map from the user's current location to the first target address, and plans the user's journey from the current location to the first target address. The navigation route from the location to the first target address, and the navigation icons and direction instructions that guide the user to move according to the navigation route, generate navigation map data; Step S103: The control device transmits the order data and navigation map data to the express auxiliary glasses; Step S104: The express auxiliary glasses display order information and navigation map data; Step S105: When the control device recognizes that the user has arrived at the first destination address, the control device terminates transmitting the navigation map data to the express auxiliary glasses.

The method of using the express delivery assistance system as described in claim 7 further includes an indoor image display step, wherein the indoor image display step continues after step S105, and the indoor navigation step includes: Step S1051: The control device identifies whether the order data includes indoor image data. If it does not include indoor image data, proceed to step S202. If it includes indoor image data, proceed to step S1052. Step S1052: The control device displays a question message, and the question message is a query. Whether the user displays indoor image data. If the user chooses not to display indoor image data, then step S202 is continued. If the user chooses to display indoor image data, step S1053 is continued. Step S1053: The control device transmits the indoor image data to the courier. Auxiliary glasses; Step S1054: The express auxiliary glasses display indoor image data; Step S1055: The user sends a signal to the express auxiliary glasses through the control device to instruct the express auxiliary glasses to stop collecting environmental image data and environmental depth data, and continue with step S303.

The method of using the express delivery auxiliary system as described in claim 7, applying the express delivery auxiliary glasses and the mobile device, further includes an indoor navigation step, wherein the indoor navigation step continues after step S105, and the indoor navigation step includes: Step S201: Control The device identifies the user's current indoor location; Step S202: The control device extracts the first target address in the order data, and plans an indoor navigation route from the user's current location to the first target address to generate indoor navigation route data; Step S203: The control device sends a signal to instruct the express auxiliary glasses to collect environmental image data and environmental depth data; Step S204: The express auxiliary glasses collect environmental image data and environmental depth data and transmit them to the control device; Step S205: The control device collects the environmental image data and environmental depth data. Environmental depth data are integrated into integrated environmental image data; Step S206: The control device further analyzes and integrates the environmental image data based on the indoor navigation route data to generate indoor navigation data.

Step S207: The control device transmits the indoor navigation data to the express delivery auxiliary glasses; Step S208: The express delivery auxiliary glasses display the indoor navigation data.

It further includes a relocation step, wherein the relocation step continues after step S208, and the relocation step includes: Step S301: When the control device recognizes that the user has arrived at the first destination address, the control device terminates the transmission of indoor navigation data to the express auxiliary glasses. ; Step S302: The control device instructs the express auxiliary glasses to terminate the collection of environmental image data and environmental depth data; Step S303: The control device extracts the second target address in the order data, replacing the first target address; Step S304: Repeat once Steps S102-S105, Steps S201-S208 and Steps S301-S302; Step S305: The control device sends a signal to the express auxiliary glasses to instruct the express auxiliary glasses to stop collecting environmental image data and environmental depth data, and to stop displaying order information and indoor navigation data.

It further includes a step of notifying and picking up goods, wherein the step of notifying and picking up goods follows step S304, and the step of notifying and picking up goods includes the following steps: Step S3041: The control device extracts a communication method in the order data; Step S3042: The control device extracts a communication method according to the communication The method transmits a goods collection notification, and continues with step S305.

In summary, when delivery personnel or courier personnel use mobile phones or tablets for navigation, they need to repeatedly check the mobile phone or tablet to confirm the current location and navigation route. Distraction while driving and getting lost indoors in buildings.

1: Express assistance system

10: Express auxiliary glasses

101:First frame

102:Second frame

103:Connection part

104:First temple

105: Second temple

11: Motherboard

111: Processor

112: The first wireless transmission module

113:Data storage module

114: Communication interface

115:Vibration module driver

12:Image capture module

13: Depth capture module

14:Display module

141: First display unit

142: Second display unit

15:Charging module

16:Vibration module

161: First vibration unit

162: Second vibration unit

17:Touch module

20:Control device

21:Application

22: Second wireless transmission module

23:Logistics service platform

24: Positioning and navigation module

25: Indoor positioning and navigation module

26:SMS module

27: Call module

S101-S105: Steps

S201-S208: Steps

S301-S305: Steps

S3041-S3042: Steps

FIG. 1A is a schematic structural diagram of an embodiment of the express delivery assistance system of the present invention.

1B is a schematic structural diagram of an embodiment of express delivery auxiliary glasses of the present invention.

FIG. 2 is a schematic connection diagram of a motherboard according to an embodiment of the present invention.

Figure 3 is a schematic connection diagram of the control device of the present invention.

Figure 4 is a step diagram of the navigation steps of the present invention.

Figure 5 is a step diagram of the indoor navigation steps of the present invention.

Figure 6 is a step diagram of the repositioning step of the present invention.

FIG. 7 is a step diagram of the indoor image display steps of the present invention.

Figure 8 is a step diagram of the step of notifying the goods to be picked up according to the present invention.

In order to make it easy for those with ordinary knowledge in the technical field to understand the content of the present invention, the present invention will be further described below in conjunction with the embodiments and drawings. Each embodiment is only used to illustrate the technical features of the present invention. The mentioned content It does not limit the invention.

In the description of the present invention, it should be noted that the orientation or positional relationship indicated by the terms "upper", "lower", "left", "right", etc. are based on the orientation or positional relationship shown in the drawings and are only for the purpose of The description is for convenience and simplicity, and is not intended to indicate or imply that the device or element referred to must have a specific orientation, be constructed and operate in a specific orientation, and therefore should not be construed as a limitation of the invention. In addition, the terms "first", "second", "third" and "fourth" are used for descriptive purposes only and should not be understood as indicating or implying relative importance.

Please refer to Figure 1A. The present invention provides an express delivery auxiliary system 1, which includes express delivery auxiliary glasses 10 and a control device 20.

Please refer to Figure 1A. The express delivery auxiliary glasses 10 include a motherboard 11, an image capture module 12, a depth capture module 13, a display module 14, and a charging module 15. The charging module 15 is coupled to the motherboard 11, the image capture module 12, the depth capture module 13 and the display module 14 for power supply. The motherboard 11 is coupled to the image capture module 12, the depth capture module 13, and the display module 14, and is used for allocating input and output signals, and allocating input and output data. The image capture module 12 is used to capture the environmental image of the user's front field of view to generate environmental image data. The depth acquisition module 13 is used to measure the distance between the user and various objects in the environment to generate environmental depth data. The display module is used to receive various data transmitted by the motherboard 11 and display them.

Please refer to FIG. 2 . The motherboard 11 includes a processor 111 , a first wireless transmission module 112 , a data storage module 113 and a communication interface 114 . The processor 111 is coupled to the first wireless transmission module 112, the data storage module 113 and the communication interface 114. The processor 111 communicates with the control device 20 via the first wireless transmission module 112 . The motherboard 11 is coupled to the image capture module 12 , the depth capture module 13 and the display module 14 via the communication interface 114 . In another embodiment of the present invention, the motherboard 11 does not include a communication interface 114, but uses the first wireless transmission module 112 and the image capture module 12, the depth capture module 13, and the display module 14 to remotely communicate with each other. Wired. The processor 111 is used for allocating input and output data. The data storage module 113 is used to store various data received by the processor 111, and allows the processor 111 to deploy various data stored in the data storage module 113.

Referring to FIG. 1B , the express delivery auxiliary glasses 10 further include a vibration module 16 . The motherboard 11 further includes a vibration module driver 115 . The processor 111 is coupled to the vibration module 16 via the vibration module driver 115 . The vibration module 16 is used to receive the signal transmitted by the processor 111 and vibrate. The charging module 15 and the vibration module 16 are coupled to provide power. In another embodiment of the present invention, the processor 111 does not include a shock The mobile module driver 115 is provided, and the processor 111 is remotely connected via the first wireless transmission module 112 and the vibration module 16 .

Please refer to FIG. 1B , the express delivery auxiliary glasses 10 further include a touch module 17 , and the touch module 17 is coupled to the processor 111 through the communication interface 114 . The touch module 17 is used to recognize the movement of the user's fingers to generate touch signals, and transmit the touch signals to the processor 111 . The charging module 15 and the touch module 17 are coupled for power supply. In another embodiment of this case, the processor 111 is remotely connected to the touch module 17 through the first wireless transmission module 112 .

Please refer to FIG. 3 . The control device 20 includes an application program 21 , a logistics service platform 23 , a positioning and navigation module 24 , an indoor positioning and navigation module 25 , and a second wireless transmission module 22 . The control device 20 controls the third component of the device 20 through the application program 21 . The second wireless transmission module 22 communicates with the logistics service platform 23, the positioning and navigation module 24, the indoor positioning and navigation module 25 and the express delivery auxiliary glasses 10. The application 21 is used to receive the environmental image data and environmental depth data transmitted from the express auxiliary glasses 10. It can also connect with the logistics service platform 23, the positioning and navigation module 24, and the indoor positioning and navigation module 25, and can transmit the express auxiliary glasses 10 The data is shared to the logistics service platform 23, the positioning navigation module 24, and the indoor positioning and navigation module 25 for calculation and the calculation results are transmitted to the express auxiliary glasses 10. The logistics service platform 23, the positioning and navigation module 24, and the indoor positioning and navigation module 25 can also share data through the application 21. In addition, the control device 20 can also transmit signals to the express auxiliary glasses 10 through the application 21 to operate the express auxiliary glasses 10, or transmit signals to the logistics service platform 23, positioning and navigation. The module 24, the indoor positioning and navigation module 25, and the second wireless transmission module 22 are used to operate the logistics service platform 23, the positioning and navigation module 24, the indoor positioning and navigation module 25, and the second wireless transmission module 22. The logistics service platform 23 is used to receive orders from consumers and generate order information. The order information includes the first target address and the second target address. The positioning and navigation module 24 is used to identify the user's current location, extract the first target address or the second target address of the order data through the application 21, and perform analysis to obtain the user's current location to the first target address or the second target address. A map of the second destination address, and planning for the user to get from the current location to the first destination address or the second destination The navigation route of the address, as well as the navigation icons and direction instructions that guide the user to move according to the navigation route, generate navigation map data. The indoor positioning and navigation module 25 is used to identify the user's current indoor location, and after extracting the first target address or the second target address of the order data through the application 21, it can plan the user's journey from the current location to the first target address. or the indoor navigation route of the second target address to generate indoor navigation route data, and obtain the environmental image data and environmental depth data collected by the express auxiliary glasses 10 through the application 21, and integrate the environmental image data and environmental depth data to generate Integrating environmental image data, the indoor positioning and navigation module 25 further analyzes and integrates the environmental image data based on the indoor navigation route provided by the indoor navigation route data to obtain indoor navigation data.

In another embodiment of the present invention, the order information further includes a communication method.

Please refer to Figure 3. The control device further includes a SMS module 26. The application program 21 communicates with the SMS module 26 through the second wireless transmission module 22 of the control device 20. The SMS module 26 can notify the pickup message by default, and Send a pickup notification message to the communication device corresponding to the communication method.

Referring to Figure 3, the control device 20 further includes a call module 27. The application program 21 communicates with the call module 27 through the second wireless transmission module 22 of the control device 20, and can make calls to the communication device corresponding to the communication method.

In another embodiment of the present invention, the order data further includes indoor image data, where the indoor image data is various images such as photos, videos, 360° panoramic photos, etc. in the building at the first target address or the second target address. material.

Please refer to Figure 4. Based on the foregoing description, the present invention provides a method of using the express delivery assistance system 1, which includes navigation steps. The navigation steps include steps S101-S105: Step S101: The control device 20 receives the order data and extracts the order data. first target address; Step S102: The control device 20 identifies the user's current location, obtains a map of the user from the current location to the first target address, and plans the user's journey from the current location to the first target address to generate navigation map data; Step S103 : The control device 20 transmits the order information and navigation map data to the express delivery auxiliary glasses 10; Step S104: The express delivery auxiliary glasses 10 display the order information and navigation map data; Step S105: When the control device 20 recognizes that the user has arrived at the first destination address, The control device 20 terminates the transmission of navigation map data to the express delivery auxiliary glasses 10 .

Please refer to FIG. 4 , the navigation step is further described in detail; in step S101 , the control device 20 extracts the first target address in the order data from the logistics service platform 23 through the application 21 , and transmits the first target address to the positioning navigation. Module 24; In step S102, the positioning and navigation module 24 identifies the user's current location, obtains a map of the user from the current location to the first target address, and plans the user's journey from the current location to the first target address. The navigation route generates navigation map data; in step S103, the application 21 transmits the navigation map data to the processor 111. At the same time, the application 21 also transmits the order data to the processor 111. The processor 111 then transmits the order data and navigation The map data is transmitted to the data storage module 113 for data storage; in step S104, the processor 111 extracts the order data and navigation map data from the data storage module 113, and transmits them to the display module 14 for display; in step S105, When the positioning and navigation module 24 recognizes that the user has arrived at the first destination address and transmits a signal that the user has arrived at the first destination address to the application program 21, the application program 21 terminates transmitting the navigation map data to the processor 111 and sends a signal to indicate the termination. The navigation map data is transmitted to the display module 14, so that the display module 14 stops displaying the navigation map data.

Please refer to Figure 5. The present invention provides a method of using the express delivery assistance system 1, which further includes an indoor navigation step. The indoor navigation step follows step S105 and includes steps S201-S208: Step S201: The control device 20 identifies the user's current location. indoor location; Step S202: The control device 20 extracts the first target address in the order data, and plans an indoor navigation route from the user's current location to the first target address to generate indoor navigation route data; Step S203: The control device 20 sends a signal to instruct the express delivery auxiliary glasses 10 to collect environmental image data and environmental depth data; Step S204: The express delivery auxiliary glasses 10 collects environmental image data and environmental depth data and transmits them to the control device 20; Step S205: The control device 20 collects the environmental image data and environmental depth data. The environmental depth data is integrated into integrated environmental image data; Step S206: The control device 20 further analyzes and integrates the environmental image data based on the indoor navigation route data to generate indoor navigation data; Step S207: The control device 20 transmits the indoor navigation data to the express auxiliary glasses 10 ; Step S208: The express delivery auxiliary glasses 10 display indoor navigation information.

Please refer to Figure 5 , where the indoor navigation steps are further described in detail; in step S201, the control device 20 sends a signal through the application program 21 to instruct the indoor positioning and navigation module 25 to identify the user's current indoor location; in step S202, the application program 21 21 The logistics service platform 23 extracts the first target address of the order data and transmits the first target address to the indoor positioning and navigation module 25. The indoor positioning and navigation module 25 is based on the user's current location and the location of the first target address. and then planning from the user’s current The indoor navigation route from the location to the first target address generates indoor navigation route data; in step S203, the control device 20 sends a signal to the processor 111 through the application program 21 to instruct the image capture module 12 to collect environmental image data and transmit it to The processor 111 sends a signal to instruct the depth acquisition module 13 to collect environmental depth data and transmit it to the processor 111. The processor 111 then transmits the environmental image data and environmental depth data to the data storage module 113 for data storage; in step S204 , the processor 111 extracts the environmental image data and the environmental depth data from the data storage module 113, then transmits the environmental image data and the environmental depth data to the application program 21 of the control device 20, and transmits the environmental image data and environmental depth data through the application program 21. The depth data is transmitted to the indoor positioning and navigation module; in step S205, the indoor positioning and navigation module integrates the environmental image data and the environmental depth data into integrated environmental image data; in step S206, the indoor positioning and navigation module indoor positioning and navigation module 25 The positioning and navigation module 24 further analyzes and integrates the environmental image data based on the indoor navigation route data to generate indoor navigation data; in step S207, the indoor navigation data is transmitted to the processor 111 through the application 21, and the processor 111 then transmits the indoor navigation data to the processor 111. The data is transmitted to the data storage module 113 for data storage; in step S208, the processor 111 extracts the indoor navigation data from the data storage module 113 and transmits it to the display module 14 for display.

Please refer to Figure 6. The present invention provides a method of using the express delivery assistance system 1, which further includes a relocation step. The relocation step follows step S208 and includes steps S301-S305: Step S301: When the control device 20 recognizes the user When arriving at the first target address, the control device 20 stops transmitting indoor navigation data to the express auxiliary glasses 10; Step S302: The control device 20 instructs the express auxiliary glasses 10 to stop collecting environmental image data and environmental depth data; Step S303: The control device 20 extracts the second target address in the order data and replaces the first target address; Step S304: Repeat steps S102-S105, S201-S208 and S301-S302; Step S305: The control device 20 sends a signal to the express auxiliary glasses 10 to instruct the express auxiliary glasses 10 to stop collecting environmental image data and environmental depth data, and terminate Display order information and indoor navigation information.

Please refer to Figure 6 , which further details the relocation step; in step S301, when the indoor positioning and navigation module 25 recognizes that the user has arrived at the first destination address, and transmits a message that the user has arrived at the first destination address to the application 21 At this time, the application 21 stops transmitting indoor navigation data to the processor 111; in step S302, the application 21 sends a signal to the processor 111 to instruct the image capture module 12 to stop collecting environmental image data, and sends a signal to instruct the depth capture. The module 13 stops collecting environmental depth data and sends a signal to instruct the display module 14 to stop displaying indoor navigation data; in step S303, the application program 21 of the control device 20 retrieves the second target address of the order data from the logistics service platform 23, and Replace the first target address with the second target address; in step S304, the express delivery auxiliary system repeatedly executes steps S102-S105, steps S201-S208 and steps S301-S302, because the first target address is replaced with the second target address. , therefore in step S304, the user is directed to the second target address; in step S305, the control device 20 sends a signal to the processor 111 to instruct the image capture module 12 to terminate the collection and transmission of environmental image data, and sends a signal to indicate the depth. The acquisition module 13 stops collecting and transmitting the environment depth data, and sends a signal to instruct the display module 14 to stop displaying the order data and indoor navigation data.

Please refer to Figure 7. The method of using the express delivery assistance system 1 further includes an indoor image display step, where the indoor image display step continues after step S105 and includes steps S1051-S1055: Step S1051: The control device 20 identifies whether the order data includes indoor image data. If it does not include indoor image data, proceed to step S202. If it includes indoor image data, proceed to step S1052. Step S1052: The control device 20 displays a question message. The question message In order to ask the user whether to display the indoor image data, if the user chooses not to display the indoor image data, then step S202 is continued, and if the user chooses to display the indoor image data, then step S1053 is continued; Step S1053: The control device 20 converts the indoor image data to Transmitted to the express auxiliary glasses 10; Step S1054: The express auxiliary glasses 10 display indoor image data; Step S1055: The user sends a signal to the express auxiliary glasses 10 through the control device 20 to instruct the express auxiliary glasses 10 to stop collecting environmental image data and environmental depth data. And continue with step S303.

Please refer to Figure 7 , where the indoor image display steps are further described in detail; in step S1051, the control device 20 identifies through the application 21 whether the order data includes indoor image data. If the indoor image data is not included, step S202 is continued, and If indoor image data is included, then continue to step S1052; in step S1052, the control device 20 displays a question message through the application 21, and the question message asks the user whether to display indoor image data. If the user chooses not to display indoor image data, then continue. Step S202, if the user chooses to display indoor image data, then step S1053 is continued; in step S1053, the control device 20 transmits the indoor image data to the processor 111 through the application program 21, and the processor 111 transmits the indoor image data to the data processor 111. The storage module 113 performs data storage; in step S1054, the processor 111 extracts the indoor image data from the data storage module 113 and transmits it to the display module. The group 14 is displayed; in step S1055, the user sends a signal to the processor 111 through the application program to instruct the image capture module 12, and continues with step S303.

Please refer to Figure 8. The present invention provides a method of using the express delivery assistance system 1, which further includes a step of notifying to pick up the goods. The indoor navigation step follows step S304 and includes steps S3041-S3042: Step S3041: The control device 20 extracts order information. communication method; Step S3042: The control device 20 transmits the goods pickup notification according to the communication method, and continues with step S305.

Please refer to Figure 8 , where the step of notifying and picking up the goods is further described in detail; in step S3041, the control device 20 retrieves the communication method in the order data from the logistics service platform 23 through the application program 21; in step S3042, the control device 20 retrieves the communication method in the order data through the application program 21 21. Transmit the communication method to the call module 27 and make a call to the communication device corresponding to the communication method to notify the consumer to pick up the goods. In another embodiment of the present invention, in step S3042, the control device 20 transmits the communication method to the SMS module 26 through the application 21, and sends the preset notification pickup message in the SMS module 26 to the corresponding A communication device used to notify consumers to pick up goods.

Example 1:

Please refer to Figure 1A. In one embodiment of the present invention, the express delivery auxiliary glasses 10 include a first frame 101, a second frame 102, a connecting part 103, a first temple 104 and a second temple 105, wherein the first frame 101 and The second mirror frames 102 are connected by a connecting part 103. One end of the first mirror frame 104 is connected to the side of the first mirror frame 101 away from the connecting part 103. One end of the second mirror frame 105 is away from the connecting part 103 of the second mirror frame 102. side connection. The first temple leg 104 and the second temple leg 105 are used to hook the user's ears, so that the express delivery auxiliary glasses 10 can be hung on the user's head.

Please refer to FIG. 1A . In one embodiment of the present invention, the motherboard 11 is disposed in the second temple 105 . The image capture module 12 is provided on the connection portion 103 of the express delivery auxiliary glasses 10 . The image capture module 12 is a camera. The depth capture module 13 is disposed outside the first frame 101 and the second frame 102 of the express delivery auxiliary glasses 10 . The depth acquisition module 13 is a laser radar or an infrared range finder. The display module 14 includes a first display unit 141 and a second display unit 142. The first display unit 141 is embedded in the first frame 101, and the second display unit 142 is embedded in the second frame 102. The first display unit 141 and the second display unit 142 are both transparent display panels. The charging module 15 is disposed in the first temple 104 . The charging module 15 is a battery. The motherboard 11 is disposed in the second temple 105 .

Referring to Figure 2, the processor 111 is a microprocessor. The data storage module 113 can be an SD card, RAM or a combination thereof. The first wireless transmission module 112 may be WiFi, low-power Bluetooth, etc. The communication interface 114 may be a universal serial bus (USB) interface, an Inter-Integrated Circuit (I2C) interface, a Universal Synchronous Asynchronous Receiver Transmitter (UART) interface, General Purpose Input/Output (GPIO) interface, etc. The motherboard 11 is coupled to the image capture module 12 through a universal serial bus interface. The motherboard 11 is coupled to the depth acquisition module 13 through an integrated bus circuit interface. The motherboard 11 is coupled to the display module 14 through an asynchronous transceiver interface.

Please refer to Figure 3. The control device 20 can be a smart phone, a tablet computer, etc. The second wireless transmission module 22 can be WiFi, low-power Bluetooth, etc. The logistics service platform 23 may be a catering delivery service platform or an express delivery service platform. The positioning and navigation module 24 is a global positioning system, which can provide functions such as map display, navigation route planning and navigation route guidance, but is not limited to this and can also be other types of satellite positioning systems. The indoor positioning and navigation module 25 can be a Bluetooth indoor positioning system, a WiFi indoor positioning system, an infrared indoor positioning system, an RFID indoor positioning system, etc., but is not limited to this and can also be other types of indoor positioning systems. The indoor positioning and navigation module 25 integrates environmental image data and environmental depth data to generate integrated environmental image data to achieve two-dimensional and three-dimensional image recognition, thereby more accurately identifying various objects and text. room The internal positioning navigation module 25 identifies the user's current indoor location and obtains the first destination address or the second destination address through the application 21, and then plans a route from the user's current location to the first destination address or the second destination address. The route, that is, the indoor navigation route, generates indoor navigation route data. The indoor positioning and navigation module 25 further analyzes and integrates the environmental image data to obtain indoor navigation data based on the indoor navigation route provided by the indoor navigation route data. The indoor navigation data includes the following content. The indoor positioning and navigation module 25 starts from the bottom of the integrated environmental image data. Search upwards, identify the object closest to the user as the base object, and compare it with other recognized objects to instantly determine the object closest to the user and mark it. The marking method is usually to frame the object with a rectangular frame. And plan a safe walking area on the indoor navigation route to avoid these objects, and generate navigation icons and direction indicators in the user's forward field of view to guide the direction of travel. In addition, the indoor positioning navigation module 25 will also perform road recognition. First, Integrate the environmental image data for grayscale processing to remove color and reduce the amount of data required to be processed. Then perform Gaussian blur to eliminate noise in the integrated environmental image data. Then use edge detection to further eliminate noise and find the area of interest ( region of interest (ROI), that is, find the road line where the user is located and mark the road line. The road line is marked, for example, with red lines along the road line to guide the user to move along the indoor navigation route. . The SMS module 26 is a default SMS program for smart phones, tablet computers, etc. And the call module 27 is the default call program of smart phones, tablet computers, etc.

Example 2:

Please refer to FIG. 1B . In another embodiment of the present invention, the structure of the express delivery auxiliary glasses 10 is the same as that of Embodiment 1, and further includes a vibration module 16 and a touch module 17 . The vibration module 16 further includes a first vibration unit 161 and a second vibration unit 162 . The first vibration unit 161 is disposed inside the first temple 104 . The second vibration unit 162 is disposed inside the second temple 105 . The first vibration unit 161 and the second vibration unit 162 are both vibration motors. The touch module 17 is provided on the first temple 104 . The touch module 17 is a touch panel. The motherboard 11 is coupled to the touch control module 17 through an asynchronous transceiver interface.

Example 3:

The architecture of the express delivery assistance system 1 is the same as that of Embodiment 1, and is used to combine delivery services. The control device 20 and the logistics service platform 23 first send the order information through the catering delivery service platform. The order information includes the first destination address, the second destination address and the communication method. After the delivery personnel receive the order through the control device 20, the express delivery assistance system 1. Start executing the navigation step, and display the order information on the first display unit 141, and display the navigation map information on the second display unit 142 to guide the delivery person to the first target address. Then, when the control device 20 recognizes that the delivery person has arrived at the first destination address, the second display unit 142 stops displaying the navigation map, and the express delivery assistance system 1 continues to perform the indoor navigation steps and displays the indoor navigation information on the second display unit 142, thereby Further guide the delivery personnel to arrive at the first destination address to pick up the meal. When the user arrives at the first destination address and completes picking up the food, the express delivery assistance system 1 directs the delivery person to the second destination address. When the delivery person arrives at the second destination address, the control device 20 will send a preset notification to pick up the food. Send a message to the communication device corresponding to the communication method, in which the default pickup message is such as: "It has been delivered to the destination, please collect it as soon as possible." Or make a call to the communication device corresponding to the communication method, where the communication device can be a mobile phone , tablet or home phone, etc.

Example 4:

The architecture of the courier assistance system 1 is the same as that of Embodiment 2, and is used to combine delivery services. The control device 20 is a smart phone, tablet computer, etc. The logistics service platform 23 is a catering delivery service platform. The vibration module 16 can vibrate according to the signal transmitted by the processor 111. For example, when the express delivery assistance system 1 is executing the indoor navigation step, the indoor navigation data is transmitted to the processor 111 through the application program 21, and the processor 111 then transmits the indoor navigation data to the data storage module 113 for data storage, and then the processor 111 The data storage module 113 extracts the indoor navigation data, and transmits a signal to the vibration module 16 corresponding to the direction guidance according to the direction guidance of the indoor navigation data to vibrate to remind the user to perform turning actions, for example, when the indoor navigation data guidance is to be carried out When turning right, the vibration module 16 on the right side of the user will vibrate, which in this embodiment refers to the first vibration unit. The touch module 17 is used to recognize the movement of the user's fingers to generate touch signals, and transmit the touch signals to the processor 111. The processor 111 then transmits the touch signals to the processor 111. The signal is transmitted to the vibration module 16, the display module 14 or the application 21, thereby operating the vibration module 16, the display module, or the second wireless transmission module 22, the logistics service platform 23, and the positioning and navigation module through the application 21. Group 24, indoor positioning and navigation module 25, SMS module 26 and call module 27 operate. For example, when the vibration module 16 vibrates, the user inputs a click touch signal by clicking the touch module 17 , the single-click touch signal is transmitted to the vibration module 16 through the processor, and the vibration module 16 stops vibrating after receiving the single-touch signal, or when the user wants to adjust the vibration intensity of the vibration module 16, the user The user slides two fingers from back to front on the touch module 17 to increase the vibration intensity. In contrast, the user slides two fingers from front to back on the touch module 17 to weaken the vibration intensity.

To sum up, the present invention provides an express delivery auxiliary system and a method of using the express delivery auxiliary system, which can allow delivery personnel or express delivery personnel to concentrate on driving to the target location without worrying about getting lost in the indoor space, solving the problem of delivery personnel or courier personnel When using a mobile phone or tablet for navigation, you need to check the mobile phone or tablet repeatedly to confirm the current location and navigation route, which leads to distraction while driving and the problem of getting lost indoors in buildings.

Each embodiment is only used to illustrate the content of the present invention and is not intended to limit the implementation scope of the present invention. Therefore, equal changes and modifications made according to the patentable scope of the present invention should still fall within the scope of the present invention.

1: Express assistance system

10: Express auxiliary glasses

101:First frame

102:Second frame

103:Connection part

104:First temple

105: Second temple

11: Motherboard

12:Image capture module

13: Depth capture module

14:Display module

141: First display unit

142: Second display unit

15:Charging module

20:Control device

Claims (11)

A courier auxiliary system, including: a courier auxiliary glasses, the courier auxiliary glasses include: a motherboard, used to allocate input and output signals, and allocate input and output data; an image capture module, coupled to the host The board is used to capture the environment image of the user's front field of view to generate an environment image data; a depth acquisition module is coupled to the motherboard and is used to measure the distance between the user and various objects in the environment to generate an environment image data. Environmental depth data; a display module coupled to the motherboard for receiving and displaying various data transmitted by the motherboard; a charging module coupled to the motherboard, the image capture module, and the depth Capturing the module and the display module for power supply; a control device including: a second wireless transmission module; an application that communicates with the express delivery auxiliary glasses through the second wireless transmission module to receive the environmental image The data and the environment depth data are communicated with other platforms and modules on the control device through the second wireless transmission module, and the data transmitted by the express auxiliary glasses can be shared with the other platforms and modules for calculation and processing. The calculation results are transmitted to the courier auxiliary glasses, and other platforms and modules on the control device can also share data through the application. In addition, the control device transmits signals to the courier auxiliary glasses through the application to control the courier auxiliary glasses. The glasses can also be operated by transmitting signals to the second wireless transmission module or other platforms or modules on the control device through the application, thereby controlling the second wireless transmission module or other platforms or modules on the control device. The module operates; A logistics service platform communicates with the application and is used to receive orders from consumers and generate order data. The order data includes a first destination address and a second destination address; a positioning navigation module and the application Communication is used to identify the user's current location, extract the first destination address or the second destination address of the order data through the application, and perform analysis to obtain the user's current location to the first destination address. Or a map of the second target address, and planning of the user's navigation route from the current location to the first target address or the second target address, and navigation icons and direction instructions that guide the user to move along the navigation route. A navigation map data; an indoor positioning and navigation module that communicates with the application to identify the user's current indoor location and extracts the first destination address or the second destination address of the order data through the application. , can plan an indoor navigation route for the user from the current location to the first destination address or the second destination address to generate indoor navigation route data, and obtain the environmental image data collected by the express auxiliary glasses through the application and the environmental depth data, and integrates the environmental image data and the environmental depth data to generate integrated environmental image data. The indoor positioning and navigation module further analyzes the indoor navigation route based on the indoor navigation route data. The environmental image data is integrated to obtain indoor navigation data; the order data, the navigation map data and the indoor navigation data are transmitted to the express auxiliary glasses for display through the application. The express delivery auxiliary system as described in claim 1, wherein the motherboard includes: a processor; a data storage module coupled to the processor for storing various data received by the processor and providing the data to the processor Allocating various data stored in the data storage module; and a first wireless transmission module coupled to the processor. The express delivery auxiliary system of claim 2, wherein the express delivery auxiliary glasses further include: a vibration module coupled to the processor and the charging module, receiving signals transmitted by the processor and vibrating. The express delivery auxiliary system of claim 2, wherein the express delivery auxiliary glasses further include: a touch module coupled to the processor and the charging module, identifying the movement of the user's fingers to generate a touch signal, and transmit the touch signal to the processor. The express delivery assistance system as described in claim 1, wherein the order information further includes a communication method; wherein the control device further includes a SMS module, and the application uses the second wireless transmission module of the control device to communicate with the SMS Module communication, in which the SMS module can preset a pickup notification message and send the pickup notification message to the communication device corresponding to the communication method. As for the express delivery assistance system described in claim 1, the order information further includes a communication method; wherein the control device further includes a call module, and the application uses the second wireless transmission module of the control device to communicate with the call module. For group communication, you can make a call to the communication device corresponding to the communication method. A method of using an express delivery auxiliary system, which is applied between express delivery auxiliary glasses and a mobile device, and includes a navigation step. The navigation step includes: Step S101: A control device receives an order data and extracts a first item in the order data. A target address; Step S102: The control device identifies the user's current location, obtains a map of the user from the current location to the first target address, and plans the user's navigation from the current location to the first target address. Route, and navigation icons and direction instructions that guide the user to move along the navigation route, thereby generating a navigation map data; Step S103: The control device transmits the order information and the navigation map data to the express delivery auxiliary glasses; Step S104: The express delivery auxiliary glasses display the order information and the navigation map data; Step S105: When the control device recognizes that the user has arrived When the first target address is reached, the control device terminates transmitting the navigation map data to the express auxiliary glasses. The method of using the express delivery assistance system as described in claim 7 further includes an indoor image display step, wherein the indoor image display step continues after step S105, and the indoor navigation step includes: step S1051: the control device identifies the order Whether the data includes indoor image data. If the indoor image data is not included, step S202 is continued. If the indoor image data is included, step S1052 is continued. Step S1052: The control device displays a question message, and the question message is to inquire about use. The user determines whether to display the indoor image data. If the user chooses not to display the indoor image data, step S202 is continued. If the user chooses to display the indoor image data, step S1053 is continued. Step S1053: The control device displays the indoor image data. The data is transmitted to the express auxiliary glasses; Step S1054: The express auxiliary glasses display the indoor image data; Step S1055: The user sends a signal to the express auxiliary glasses through the control device to instruct the express auxiliary glasses to terminate collecting an environmental image data and an environment depth data, and continue with step S303. The method of using the express delivery auxiliary system as described in claim 7, applying the express delivery auxiliary glasses and the mobile device, further includes an indoor navigation step, wherein the indoor navigation step continues after step S105, and the indoor navigation step includes: S201: The control device identifies the user's current indoor location; Step S202: The control device extracts the first target address in the order data, and plans an indoor navigation route from the user's current location to the first target address to generate indoor navigation route data; Step S203: The control The device sends a signal to instruct the express auxiliary glasses to collect an environmental image data and an environmental depth data; Step S204: The express auxiliary glasses collect the environmental image data and the environmental depth data and transmit them to the control device; Step S205: The control device Integrate the environmental image data and the environmental depth data into integrated environmental image data; Step S206: The control device further analyzes the integrated environmental image data based on the indoor navigation route data to generate indoor navigation data; Step S207: The control The device transmits the indoor navigation data to the express delivery auxiliary glasses; step S208: the express delivery auxiliary glasses display the indoor navigation data. The method of using the express delivery assistance system as described in claim 9 further includes a relocation step, wherein the relocation step is continued after step S208, and the relocation step includes: step S301: when the control device recognizes that the user has arrived When the first target address is reached, the control device stops transmitting the indoor navigation data to the express auxiliary glasses; step S302: the control device instructs the express auxiliary glasses to stop collecting the environmental image data and the environmental depth data; Step S303: The control device extracts a second target address in the order data to replace the first target address; Step S304: Repeat steps S102-S105, steps S201-S208 and steps S301-S302; Step S305: The control device sends a signal to the express auxiliary glasses to instruct the express auxiliary glasses to stop collecting the environmental image data and the environmental depth data, and to stop displaying the order information and the indoor navigation data. The method of using the express delivery assistance system as described in claim 10 further includes a step of notifying and picking up goods, wherein the step of notifying and picking up goods follows step S304, and the step of notifying and picking up goods includes the following steps: Step S3041: The control device Extract a communication method in the order data; step S3042: the control device transmits a goods pickup notification according to the communication method, and continues with step S305.

Images