TWI838021B - Tallying image recognition system and tallying image recognition method using the same - Google Patents

Abstract

A tallying image recognition system includes a plurality of labels, at least one camera unit, an image analysis unit and a processing unit. The camera unit is configured for taking pictures of the labels to obtain a tally image. The image analysis unit is configured to analyze the tally image to determine whether any one of the labels is covered; and if any one of the labels is covered, to determine a label command represented by the covered label. The processing unit is configured for executing a label command indicated by the covered label.

Description

Cargo tally image recognition system and cargo tally image recognition method using the same

The present invention relates to a tally image recognition system and a tally image recognition method using the same.

At present, the development of intelligent warehousing in Taiwan focuses on the optimization of storage and picking operations, and generally introduces automatic warehousing, conveyor belts, computer-assisted picking systems (CAPS), autonomous mobile robots (AMR), etc. After the goods are picked out, the packaging and sorting operations are still mainly manual, supplemented by intelligence. In the current packaging and sorting operations, in addition to requiring operators to take a large number of goods, if complete sorting information needs to be recorded, it is necessary to use the help of multiple tools, such as handheld barcode guns, keyboards, mice, cameras, etc., to perform shipment registration and confirmation operations.

However, with this type of operation, the operator must select a suitable object from a variety of different objects and then perform the corresponding action, which reduces the efficiency of sorting and packaging.

Therefore, proposing a more efficient tallying technology is one of the goals of the industry in this field.

The purpose of the present invention is to provide a tally image recognition system and a tally image recognition method using the same, so that the operator can mask the label as a command input, replacing the complicated operation of learning to pick up a variety of different objects, thereby improving the efficiency of tally packaging.

An embodiment of the present invention proposes a tally image recognition system. The tally image recognition system includes a plurality of tags, at least one imaging unit, an image analysis unit, and a processing unit. The imaging unit is used to photograph these tags to obtain a tally image. The image analysis unit is used to: analyze the tally image to determine whether any of the tags is blocked; and, if any of the tags is blocked, determine a tag instruction represented by the blocked tag. The processing unit is used to: execute a tag instruction represented by the blocked tag.

Another embodiment of the present invention proposes a tally image recognition method. The tally image recognition method includes the following steps: photographing these tags to obtain a tally image; analyzing the tally image to determine whether these tags are blocked; if these tags are blocked, determining a tag instruction represented by the blocked tags; and executing a tag instruction represented by the blocked tags.

This invention can achieve the goal of reducing the number of human actions and time spent on packaging and sorting operations. Through the collaboration of cameras and image recognition technology, virtual keys are configured on the desktop, so that operators are no longer restricted by tools and can complete common actions within the monitoring range of the camera, effectively reducing the consumption of manpower and resources.

In order to better understand the above and other aspects of the present invention, the following is a specific example and a detailed description with the attached drawings as follows:

100: Cargo image recognition system

10: Carrier

10s1: First side

10s2: Side 2

110A: First camera unit

110B: Second camera unit

120: Image analysis unit

130: Processing unit

140: Display

150: Printer

CO1: Product barcode image

CO: Product image

OD: Order Image

OD1: Order barcode image

FS: delivery note

L1: Scanning label

L2: Unlabel

L3: Temporary tag

L4: Carton tracking label

L5: Sealing label

L6: Completed label

N1: Grid

S1: First marking line

S2: Second marking line

S101~S225: Steps

T11: Order scanning instructions

T12: Product scanning instructions

T2: Cancel the command

T3: Temporary instruction

T4: Chasing box instruction

T5: Sealing instructions

T6: Complete the instruction

Figure 1 shows a schematic diagram of a tally image recognition system according to an embodiment of the present invention.

Figure 2 shows a schematic diagram of the tally image recognition system in Figure 1.

Figures 3A to 3F show the flow chart of the tally image recognition method of the tally image recognition system in Figure 1.

Please refer to Figures 1 and 2. Figure 1 shows a schematic diagram of a tally image recognition system 100 according to an embodiment of the present invention, and Figure 2 shows a schematic diagram of the tally image recognition system 100 of Figure 1.

As shown in FIG. 1, the tally image recognition system 100 includes a plurality of labels L1 to L6, at least one imaging unit (e.g., a first imaging unit 110A and a second imaging unit 110B), an image analysis unit 120, a processing unit 130, a display 140, and a printer 150. The processing unit 130 is, for example, a physical circuit formed by a semiconductor process. The imaging unit is, for example, a camera or a camera. The display 140 is, for example, a display screen capable of displaying images.

The camera unit is used to take pictures of these labels L1~L6 to obtain a tally image M1. The image analysis unit 120 is used to: analyze the tally image M1 to determine whether any of these labels L1~L6 is blocked; and, if any of these labels L1~L6 is blocked, determine the label instruction represented by the blocked label. The processing unit 130 is used to: execute the label instruction represented by the blocked label.

As shown in FIG. 2, these labels L1~L6 include at least one of a scanning label L1, a cancellation label L2, a temporary label L3, a box tracking label L4, a box sealing label L5 and a completion label L6. Depending on the actual application, the number of labels can be less than or more than 6. In addition, any of these labels L1~L6 has a pattern, which is not limited to FIG. 2. Labels L1~L6 are, for example, physical labels, such as stickers, decorative panels, signboards, etc., which can be fixed or placed on the carrier 10. In another embodiment, labels L1~L6 can also be formed on the carrier 10 by spraying, drawing, etc.

As shown in FIG. 2, the carrier 10 is, for example, a table. The carrier 10 includes a first surface 10s1 and a second surface 10s2, wherein the first surface 10s1 is substantially perpendicular to the second surface 10s2. In one embodiment, the first surface 10s1 extends in a horizontal direction, and the second surface 10s2 extends in a vertical direction. Any of these labels L1~L6 can be placed on one of the first surface 10s1 and the second surface 10s2. The embodiment of the present invention does not limit the position of these labels L1~L6 relative to the first surface 10s1 or the second surface 10s2. For example, any of the labels L1~L6 can be arranged at the middle, left, right, upper, lower, or a corner of the upper surface of the first surface 10s1 or the middle, left, right, upper, lower, or a corner of the side surface of the second surface 10s2.

As shown in Figure 2, the aforementioned label instructions are instructions represented by the masked labels, such as scanning instructions (such as order scanning instructions T11 and product scanning instructions T12), order cancellation instructions T2, order storage instructions T3, package tracking instructions T4, package sealing instructions T5, and order completion instructions T6. In detail, when a label is masked, it means that the operator wants to input an instruction corresponding to the label. For example, when the scanning label L1 is masked, it means that the operator wants to input a scanning instruction, such as an order scanning instruction (referred to as order scanning instruction T11 herein) or a product scanning instruction (referred to as product scanning instruction T12 herein). When the cancellation label L2 is masked, it means that the operator wants to input the order cancellation instruction T2. When the temporary storage label L3 is blocked, it means that the operator wants to input the temporary storage instruction T3 for the order. When the follow-up box label L4 is blocked, it means that the operator wants to input the follow-up box instruction T4 for adding packaging boxes. When the sealing box label L5 is blocked, it means that the operator wants to input the instruction for printing the label (hereinafter referred to as "sealing box instruction T5"). When the completion label L6 is blocked, it means that the operator wants to input the completion instruction T6 for completing the packaging.

As shown in FIG. 2 , the carrier 10 further includes a plurality of first marking lines S1 and a plurality of second marking lines S2, which can be arranged on the first surface 10s1 and/or the second surface 10s2 of the carrier 10. The plurality of first marking lines S1 and the plurality of second marking lines S2 can be arranged or formed on a carrier, which is arranged on the carrier 10, and the aforementioned carrier is, for example, a pad, paper, etc. The first marking lines S1 and the second marking lines S2 are, for example, perpendicular to each other. These first marking lines S1 and these second marking lines S2 can be interwoven to form a plurality of grids N1, and the grids N1 are, for example, rectangular or square. The side length of each grid N1 is known, for example, between 5 cm and 10 cm. When a packaging box (not shown) is placed on the carrier 10, the image analysis unit 120 can analyze the relationship between the packaging box and the grid N1 in the tally image M1 to determine the length, width, height and other dimensions of the packaging box. For example, the image analysis unit 120 obtains the number of grids N1 occupied by the packaging box in the tally image M1 and calculates the size of the packaging box accordingly.

As shown in FIG. 2, the first camera unit 110A can be arranged above the carrier 10, and the second camera unit 110B can be arranged on one side of the carrier 10. However, the embodiment of the present invention does not limit the position and/or number of the camera units, as long as the label and the marking line can be captured, the number of the camera units can be one or more than two, any of which can be arranged above, on the left side, on the right side, in front of the carrier 10, or between any two of the aforementioned positions, etc.

Although not shown in FIG. 2, the display 140 and the printer 150 can be arranged adjacent to the carrier 10. The display 140 can display various status messages during the sorting process, such as patterns, colors, texts or combinations thereof. The printer 150 can print a single sheet for the operator to paste on the packaging box. In addition, the processing unit 130 is electrically connected to the display 140 and the printer 150 to control the display 140 and the printer 150 to perform their functions.

The following further illustrates an example of the cargo image recognition method using the cargo image recognition system 100 of the embodiment of the present invention.

Please refer to Figures 3A to 3F, which show the flow chart of the cargo tallying image recognition method of the cargo tallying image recognition system 100 in Figure 1.

In step S101, the tally image recognition system 100 is started.

In step S103, the processing unit 130 determines whether there are orders being processed. Before the tally image recognition system 100 is shut down, if there are orders that have not been completed, the processing unit 130 determines that there are orders being processed. If there are orders being processed, the process enters step S105, the processing unit 130 generates a signal indicating "there are still orders being processed", and the display 140 displays the message "there are still orders being processed" accordingly; if there are no orders being processed, the process enters step S107.

In step S107, the processing unit 130 opens an order scanning command T11. In this embodiment, only when the user inputs an open command can the processing unit 130 respond. The processing unit 130 will ignore the unopened command.

In step S108, the camera unit takes images of these labels L1~L6 to obtain the tally image M1. During the tally packaging process, the camera unit can continue to take images of the scene in front (image stream), and the image analysis unit 120 continues to analyze the tally image M1 captured by the camera unit.

In step S109, the image analysis unit 120 analyzes the tally image M1 to determine whether the scan label L1 is obscured by an order, such as a physical order. The order has an order barcode. For example, the operator can move an order between the scan label L1 and the camera unit so that the tally image M1 captured by the camera unit shows the order image OD and its order barcode image OD1. When the order obscures a preset ratio of the scan label L1 and exceeds a preset time, it is determined that the scan label L1 is obscured by the order, the preset ratio is, for example, 1/3, and the preset time is, for example, 2 seconds. If the scan label L1 is obscured by the order, the process enters step S111; if the scan label L1 is not obscured by the order, the process returns to step S109.

In step S111, the image analysis unit 120 analyzes the order barcode image OD1 of the tally image M1.

In step S113, the processing unit 130 determines whether the analysis of the order barcode image OD1 is successful. If the analysis of the order barcode image OD1 fails (for example, the scanning fails or the order barcode image OD1 does not appear in the tally image M1), the process enters step S115, the processing unit 130 generates a reminder scanning signal, and the display 140 can display a message indicating "reminding the operator that the current order scanning fails", and then the process returns to step S103 or S108. If the analysis of the order barcode image OD1 is successful, the process enters step S117.

In step S117, the processing unit 130 determines whether the order exists according to the order barcode image OD1. If the order exists, the process enters step S121; if not, the process enters step S119, the processing unit 130 generates a signal indicating "no such order", and the display 140 displays the message indicating "no such order", and then the process can return to step S103 or S108.

In step S121, the processing unit 130 closes the order scanning command T11 but opens the product scanning command T12.

In step S123, the processing unit 130 determines whether the order is in a temporary state. If so, the process proceeds to step S127; if not, the process proceeds to step S125, and the display 140 displays all items listed in the item details of the order. The embodiment of the present invention does not limit the type of items, which can be goods that have been or are currently sold on the shopping website.

In step S127, the display 140 displays the individual packaging status of several items in the item details in the order, wherein the packaging status is, for example, one of "packaged" and "unpackaged". For example, the packaging status of items that have not yet been placed in the packaging box is "unpackaged", while the packaging status of items that have been placed in the packaging box is set to "packaged".

In step S129, the processing unit 130 opens the cancel instruction T2, the temporary storage instruction T3 and the container tracking instruction T4.

In step S131, the image analysis unit 120 analyzes the tally image M1 to determine whether the barcode tag L1 is blocked by a product, such as a physical product. The product has a product barcode. For example, the operator can move a product between the barcode tag L1 and the camera unit so that the tally image M1 captured by the camera unit shows the product image CO and its product barcode image CO1. When the product blocks a preset ratio of the barcode tag L1 and exceeds a preset time, it is determined that the barcode tag L1 is blocked by the order. The preset ratio is, for example, 1/3, and the preset time is, for example, 2 seconds. If the barcode tag L1 is not blocked by the product, the process enters step S201 (Figure 3E); if the barcode tag L1 is blocked by the product, the process enters step S133.

In step S133, the image analysis unit 120 analyzes the product barcode image CO1 of the inventory image M1.

In step S135, the processing unit 130 determines whether the analysis of the product barcode image CO1 is successful. If the analysis of the product barcode image CO1 fails, the process enters step S137, the processing unit 130 generates a reminder scan signal, and the display 140 displays a reminder message indicating "reminding the operator that the current product scan failed", and then the process returns to step S131. If the analysis of the product barcode image CO1 is successful, the process enters step S139.

In step S139, the processing unit 130 determines the product barcode image CO1 to determine whether the product meets the item details. If the product does not meet the item details, the process enters step S141, the processing unit 130 generates a signal indicating "non-packaged product", and the display 140 displays a message indicating "non-packaged product" accordingly, and then the process can return to step S131. If the product meets the item details, it means that the picked product (to be placed in the packaging box) is the correct product, and the process enters step S143 (Figure 3C).

In step S143, the processing unit 130 updates the packaging status of the items just packaged in the item details of the order. For example, the packaging status of the goods just picked up and put into the packaging box is changed from "unpackaged" to "packaged".

In step S145, the processing unit 130 determines whether all items in the order item details have been packaged. If all items in the order item details have been packaged, the process proceeds to step S147; if all items in the order item details have not been fully packaged, the process returns to step S131 and continues with the next product that has not been placed in the packaging box (not yet inspected).

In step S147, the processing unit 130 opens a box closing instruction T5.

In step S149, the image analysis unit 120 analyzes the tally image M1 to determine whether the sealing label L5 is blocked, for example, blocked by any object, such as the operator's palm or a packaging box. When the blocked portion of the sealing label L5 exceeds a preset ratio and exceeds a preset time, it is determined that the sealing label L5 is blocked. The preset ratio is, for example, 1/3, and the preset time is, for example, 2 seconds. If the sealing label L5 is not blocked, the process enters step S151, the processing unit 130 generates a signal indicating "waiting for sealing instructions", and the display 140 displays a message indicating "waiting for sealing instructions", and then the process returns to step S149. If the sealing label L5 is blocked, the process enters step S153.

In step S153, the image analysis unit 120 analyzes the tally image M1 to determine whether other labels are blocked, for example, blocked by any object, such as the operator's palm. When the blocked portion of other labels exceeds a preset ratio and exceeds a preset time, it is determined that other labels are blocked. The preset ratio is, for example, 1/3, and the preset time is, for example, 2 seconds. If other labels are blocked, the process enters step S151. If other labels are not blocked, the process enters step S155. In other words, only when the sealing label L5 is blocked alone can a valid sealing instruction T5 be generated.

In step S155, the processing unit 130 controls the printer 150 to print a single FS for the operator to stick on the packaging box.

In step S157, the processing unit 130 opens a completion instruction T6.

In step S159 (Figure 3D), the image analysis unit 120 analyzes the tally image M1 to determine whether the completion label L6 is blocked, for example, blocked by any object, such as a packaging box. When the blocked portion of the completion label L6 exceeds a preset ratio and exceeds a preset time, it is determined that the completion label L6 is blocked. The preset ratio is, for example, 1/3, and the preset time is, for example, 2 seconds. If the completion label L6 is not blocked, the process enters step S161, the processing unit 130 generates a signal indicating "waiting for the sealing instruction", and the display 140 displays a message indicating "waiting for the sealing instruction", and then the process returns to step S159. If the completion label L6 is blocked, the process enters step S163.

In step S163, the image analysis unit 120 analyzes the tally image M1 to determine whether other labels are blocked, for example, blocked by any object, such as the operator's palm. When the blocked portion of other labels exceeds a preset ratio and exceeds a preset time, it is determined that other labels are blocked. The preset ratio is, for example, 1/3, and the preset time is, for example, 2 seconds. If other labels are blocked, the process enters step S161. If other labels are not blocked, the process enters step S163. In other words, only when the completion label L6 is blocked alone can a valid completion instruction T6 be generated.

In step S165, the camera unit stops capturing the tally image M1.

In step S167, the processing unit 130 embeds a digital watermark to mark the order number in the captured tally image M1, so as to facilitate the subsequent quick retrieval of the tally image corresponding to this order.

In step S169, the processing unit 130 stores information related to the order and its packaging, such as invoices, picking lists, orders, packaging material dimensions, packaging images, etc. At this point, the packaging process of an order is completed.

In step S171, the processing unit 130 closes the cancel instruction T2, the temporary storage instruction T3, the box tracking instruction T4, the box sealing instruction T5 and the completion instruction T6.

In step S173, the processing unit 130 opens the order scanning instruction T11, but closes the product scanning instruction T12, and then the process returns to step S103 to continue the packaging process of the next order.

After the "No" result of step S131 in FIG. 3B, the process enters step S201. As shown in FIG. 3E, in step S201, the image analysis unit 120 analyzes the tally image M1 to determine whether two or more labels are blocked, for example, blocked by any object, such as the operator's palm. When the blocked portion of the label exceeds a preset ratio and exceeds a preset time, it is determined that the label is blocked. The preset ratio is, for example, 1/3, and the preset time is, for example, 2 seconds. If more than two labels are blocked, the process enters step S203, the processing unit 130 generates a signal indicating "waiting for the sealing instruction", and the display 140 displays a message indicating "waiting for the sealing instruction", and then the process returns to step S201. If no more than two labels are blocked, the process proceeds to step S205.

In step S205, the image analysis unit 120 analyzes the tally image M1 to determine whether the tracking label L4 is blocked, for example, by any object, such as the operator's palm. When the blocked portion of the tracking label L4 exceeds a preset ratio and exceeds a preset time, it is determined that the tracking label L4 is blocked. The preset ratio is, for example, 1/3, and the preset time is, for example, 2 seconds. If the tracking label L4 is not blocked, the process enters step S207 (Figure 3F). If the tracking label L4 is blocked, the process enters step S217.

In step S217, in response to the container tracking instruction T4, the processing unit 130 adds a new shipping order number, and the display 140 displays the newly added shipping order number.

In step S219, the image analysis unit 120 analyzes the tally image M1 to determine whether the "cargo tracking label" is blocked again, for example, blocked by any object, such as the operator's palm. If the "cargo tracking label" is not blocked again, the process returns to step S201. If the "cargo tracking label" is blocked again, the process returns to step S217.

In step S207 of FIG. 3F, the image analysis unit 120 analyzes the tally image M1 to determine whether the temporary label L3 is blocked, for example, blocked by any object, such as the operator's palm. If the temporary label L3 is blocked, the process enters step S213, the processing unit 130 temporarily stores the order, that is, suspends the operation process of the current order, and then the process enters step S215, the processing unit 130 stores the packaging information of the order, for example, stores the status of each item in the item details of the order (such as packaged or unpackaged). Then, the process enters step S211.

In step S209, the image analysis unit 120 analyzes the tally image M1 to determine whether the cancellation label L2 is blocked, for example, blocked by any object, such as the operator's palm. If the cancellation label L2 is not blocked, the process returns to step S201. If the cancellation label L2 is blocked, the process enters step S211, and the processing unit 130 clears the packaging information of the order, that is, the order is equivalent to being scrapped.

In step S223, since the order has been canceled or temporarily saved, the display 140 does not display the order information.

In step S225, the processing unit 130 opens the order scanning command, and then the process returns to step S103.

In summary, the cargo image recognition system and the cargo image recognition method using the same in one embodiment of the present invention can be used by operators to cover the label as a command input, replacing the complicated operation of learning to pick up a variety of different objects, thereby improving the efficiency of cargo packaging. In one embodiment, the label can be a pattern, which can be formed on a physical carrier, such as paper, board, etc., and the physical carrier can be configured (for example, fixed or simply placed) on a carrier (for example, a table), or the pattern can be directly formed (for example, by spraying or drawing) on the carrier. In addition, "being shielded" in this article means that the part of the tag that is shielded by an object (e.g., the operator's palm, a packaging box, or other physical object with shielding function (e.g., opaque)) exceeds a preset ratio of the entire tag range (or area) for a preset time, where the preset ratio is, for example, 1/3, and the preset time is, for example, 2 seconds, but it can also be larger or smaller. In addition, only when a single tag is shielded can a valid instruction be generated.

In summary, although the present invention has been disclosed as above by the embodiments, it is not intended to limit the present invention. Those with common knowledge in the technical field to which the present invention belongs can make various changes and modifications without departing from the spirit and scope of the present invention. Therefore, the scope of protection of the present invention shall be subject to the scope defined in the attached patent application.

100: Cargo image recognition system

110A: First camera unit

110B: Second camera unit

120: Image analysis unit

130: Processing unit

140: Display

150: Printer

CO1: Product barcode image

CO: Product image

OD: Order Image

OD1: Order barcode image

FS: delivery note

L1: Scanning label

L2: Unlabel

L3: Temporary tag

L4: Carton tracking label

L5: Sealing label

L6: Completed label

T11: Order scanning instructions

T12: Product scanning instructions

T2: Cancel the command

T3: Temporary instruction

T4: Chasing box instruction

T5: Sealing instructions

T6: Complete the instruction

Claims (17)

A tally image recognition system includes: a plurality of tags, located on a carrier; at least one camera unit, disposed on the carrier, for photographing the tags to obtain a tally image; an image analysis unit, for: analyzing the tally image to determine whether any of the tags is blocked; and if any of the tags is blocked, determining a tag instruction represented by the blocked tag; and a processing unit, for: executing a tag instruction represented by the blocked tag, wherein the blocking means that the portion of the tag blocked by an object exceeds a preset proportion of the entire range or area of the tag for a preset time. The cargo image recognition system as described in claim 1, wherein the labels include at least one of a scanning label, a cancellation label, a temporary label, a tracing label, a completion label and a sealing label. The tally image recognition system as described in claim 1, wherein the label includes a scanning label, and the processing unit is further used to: open an order scanning instruction; the image analysis unit is further used to: determine from the tally image whether the scanning label is covered by an order, and the order has an order barcode; if the scanning label is covered, analyze an order barcode image of the order barcode of the tally image; and wherein the processing unit is further used to: Used to: determine whether the order exists based on the order barcode image; if the order exists, close the order scanning command but open a product scanning command; determine whether the order is in a temporary state; if the order is in the temporary state, display the packaging status of multiple items in an item detail of the order; and if the order is not in the temporary state, display all the items in the item detail of the order. The tally image recognition system as described in claim 1, wherein the image analysis unit is further used to: determine from the tally image whether a scan label is blocked by a product, the product having a product barcode; if the scan label is blocked by the product, analyze a product barcode image of the product in the tally image; wherein the processing unit is further used to: determine whether the product meets an item detail based on the product barcode image; if the product meets the item detail, determine whether all multiple items in the item detail have been packaged; and if all the items in the item detail have been packaged, issue a box sealing instruction. A cargo image recognition system as described in claim 1, wherein the label includes a sealing label; the image analysis unit is further used to: determine from the cargo image whether the sealing label of the labels is obscured; and wherein the processing unit is further used to: print a delivery note of an order. The tally image recognition system as described in claim 1, wherein the label includes a completion label; the tally image recognition method further includes: judging from the tally image whether the completion label of the labels is blocked; if the completion label is blocked, stopping the capture of the tally image; and embedding a digital watermark to mark the order number in the tally image. As described in claim 1, the tally image recognition system, wherein the label includes a container tracking label; the image analysis unit is further used to: determine whether the container tracking label is blocked from the tally image; wherein the processing unit is further used to: if the container tracking label is blocked, add a face number; and display the face number. The tally image recognition system as described in claim 1, wherein the label includes a cancellation label; the image analysis unit is further used to: determine whether the cancellation label is blocked from the tally image; wherein the processing unit is further used to: if the cancellation label is blocked, clear a packaging status of an order being processed; and issue an order scanning instruction. A tally image recognition system as described in claim 1, wherein the label includes a temporary label; the image analysis unit is further used to: determine whether the temporary label is blocked from the tally image; wherein the processing unit is further used to: if the temporary label is blocked, temporarily block an order being processed; and store a packaging status of multiple items of the order. A method for recognizing tally images includes: photographing a plurality of labels on a carrier to obtain a tally image; analyzing the tally image to determine whether the labels are shielded; if the labels are shielded, determining a label instruction represented by the shielded label; and executing a label instruction represented by the shielded label, wherein the shielding means that the portion of the label shielded by an object exceeds a preset proportion of the entire range or area of the label for a preset time. The method for identifying tally images as described in claim 10, wherein the label comprises a scanning label, and the method for identifying tally images further comprises: issuing an order scanning instruction; analyzing the tally image to determine whether the scanning label is obscured by an order, the order having an order barcode; if the scanning label is obscured, analyzing an order barcode image of the order barcode of the tally image; and determining the order barcode image according to the order barcode. , determine whether the order exists; if the order exists, close the order scanning command but open a product scanning command; determine whether the order is in a temporary state; If the order is in the temporary state, display the packaging status of multiple items in the item details of the order; and if the order is not in the temporary state, display all the items in the item details of the order. The method for identifying tally images as described in claim 10 further includes: analyzing the tally image to determine whether a scan label is obscured by a product, the product having a product barcode; if the scan label is obscured by the product, analyzing a product barcode image of the product in the tally image; determining whether the product meets an item detail based on the product barcode image; if the product meets the item detail, determining whether all multiple items in the item detail have been packaged; and if all the items in the item detail have been packaged, issuing a box sealing instruction. The cargo image recognition method as described in claim 10, wherein the label includes a sealing label; the cargo image recognition method further includes: judging from the cargo image whether the sealing label of the labels is blocked; and printing a delivery note of an order. The tally image recognition method as described in claim 10, wherein the label includes a completion label; the tally image recognition method further includes: judging from the tally image whether the completion label of the labels is blocked; if the completion label is blocked, stopping the capture of the tally image; and embedding a digital watermark to mark the order number in the tally image. The cargo image recognition method as described in claim 10, wherein the label includes a container tracking label; the cargo image recognition method further includes: Determining whether the container tracking label is blocked from the cargo image; if the container tracking label is blocked, adding a face number; and displaying the face number. The method for identifying a tally image as described in claim 10, wherein the label includes a cancellation label; the method for identifying a tally image further includes: judging from the tally image whether the cancellation label is blocked; if the cancellation label is blocked, clearing a packaging status of an order being processed; and issuing an order scanning instruction. A method for identifying tally images as described in claim 10, wherein the label includes a temporary label; the method for identifying tally images further includes: judging from the tally image whether the temporary label is blocked; if the temporary label is blocked, temporarily blocking an order being processed; and storing a packaging status of a plurality of items of the order.

Images